2023-11-17T06:10:05.810 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-17T06:10:05.810 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --name vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} --archive /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341 -- /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341/orig.config.yaml 2023-11-17T06:10:05.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T06:10:05.949 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341 branch: wip-57087-3 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} email: vshankar@redhat.com first_in_suite: false job_id: '7461341' kernel: flavor: default kdb: true sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-57087-3 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - inconsistent rstat on inode - Error recovering journal sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-57087-3 sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 owner: scheduled_vshankar@teuthology priority: 20 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1441 sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 sleep_before_teardown: 0 suite: fs suite_branch: wip-57087-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6899cd26fceddb2fec83dc1a1349394b28c8998e timestamp: 2023-11-17_05:53:21 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1224587 2023-11-17T06:10:05.949 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa; will attempt to use it 2023-11-17T06:10:05.950 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks 2023-11-17T06:10:05.950 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-17T06:10:05.952 INFO:teuthology.task.internal:Checking packages... 2023-11-17T06:10:05.978 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '895e5adad9a763a0f13587c485b17f1ad3f04528' 2023-11-17T06:10:05.978 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-17T06:10:05.978 INFO:teuthology.packaging:ref: None 2023-11-17T06:10:05.978 INFO:teuthology.packaging:tag: None 2023-11-17T06:10:05.978 INFO:teuthology.packaging:branch: wip-57087-3 2023-11-17T06:10:05.978 INFO:teuthology.packaging:sha1: 895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-17T06:10:05.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-57087-3 2023-11-17T06:10:06.198 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6612-g895e5ada-1focal 2023-11-17T06:10:06.198 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-17T06:10:06.205 INFO:teuthology.task.internal:no buildpackages task found 2023-11-17T06:10:06.205 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-17T06:10:06.249 INFO:teuthology.task.internal:Saving configuration 2023-11-17T06:10:06.270 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-17T06:10:06.361 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-17T06:10:06.387 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 06:03:38.476958', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-17T06:10:06.410 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 06:03:38.475383', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-11-17T06:10:06.410 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-17T06:10:06.462 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-17T06:10:06.462 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-17T06:10:06.462 INFO:teuthology.run_tasks:Running task console_log... 2023-11-17T06:10:06.622 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe05aa39e50>, signals=[15]) 2023-11-17T06:10:06.622 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-17T06:10:06.628 INFO:teuthology.task.internal:Opening connections... 2023-11-17T06:10:06.629 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:10:06.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:10:06.680 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:10:06.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:10:06.742 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-17T06:10:06.748 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-11-17T06:10:06.761 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-11-17T06:10:06.761 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-11-17T06:10:06.810 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Ubuntu" 2023-11-17T06:10:06.811 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T06:10:06.811 INFO:teuthology.orchestra.run.smithi069.stdout:ID=ubuntu 2023-11-17T06:10:06.811 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE=debian 2023-11-17T06:10:06.811 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T06:10:06.811 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="20.04" 2023-11-17T06:10:06.811 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T06:10:06.811 INFO:teuthology.orchestra.run.smithi069.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T06:10:06.811 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T06:10:06.811 INFO:teuthology.orchestra.run.smithi069.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T06:10:06.812 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_CODENAME=focal 2023-11-17T06:10:06.812 INFO:teuthology.orchestra.run.smithi069.stdout:UBUNTU_CODENAME=focal 2023-11-17T06:10:06.812 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-11-17T06:10:06.845 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-11-17T06:10:06.857 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-11-17T06:10:06.857 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-11-17T06:10:06.906 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Ubuntu" 2023-11-17T06:10:06.906 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-11-17T06:10:06.907 INFO:teuthology.orchestra.run.smithi093.stdout:ID=ubuntu 2023-11-17T06:10:06.907 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE=debian 2023-11-17T06:10:06.907 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-11-17T06:10:06.907 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="20.04" 2023-11-17T06:10:06.907 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-17T06:10:06.907 INFO:teuthology.orchestra.run.smithi093.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-17T06:10:06.907 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-17T06:10:06.907 INFO:teuthology.orchestra.run.smithi093.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-17T06:10:06.907 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_CODENAME=focal 2023-11-17T06:10:06.907 INFO:teuthology.orchestra.run.smithi093.stdout:UBUNTU_CODENAME=focal 2023-11-17T06:10:06.908 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-11-17T06:10:06.936 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-17T06:10:06.950 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-17T06:10:07.067 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-17T06:10:07.068 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2023-11-17T06:10:07.074 DEBUG:teuthology.orchestra.run.smithi093:> test '!' -e /home/ubuntu/cephtest 2023-11-17T06:10:07.083 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-17T06:10:07.195 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-17T06:10:07.195 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2023-11-17T06:10:07.198 DEBUG:teuthology.orchestra.run.smithi093:> test -z $(ls -A /var/lib/ceph) 2023-11-17T06:10:07.217 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-17T06:10:07.332 INFO:teuthology.run_tasks:Running task kernel... 2023-11-17T06:10:07.354 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'} 2023-11-17T06:10:07.354 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}}, timeout 300 2023-11-17T06:10:07.354 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-17T06:10:07.355 DEBUG:teuthology.orchestra.run.smithi093:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-17T06:10:07.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:10:07.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:10:07.370 DEBUG:teuthology.task.kernel:sha1 for mon.b is 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:10:07.370 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5b73517e0e2fa132ea79290e5fc06ea5349b2288"... 2023-11-17T06:10:07.371 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2023-11-17T06:10:07.371 DEBUG:teuthology.task.kernel:sha1 for mon.a is 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:10:07.371 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5b73517e0e2fa132ea79290e5fc06ea5349b2288"... 2023-11-17T06:10:07.384 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2023-11-17T06:10:07.418 INFO:teuthology.orchestra.run.smithi093.stdout:5.4.0-124-generic 2023-11-17T06:10:07.418 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:10:07.419 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-17T06:10:07.419 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:10:07.423 INFO:teuthology.orchestra.run.smithi069.stdout:5.4.0-124-generic 2023-11-17T06:10:07.423 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:10:07.423 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-17T06:10:07.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:10:07.648 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-11-17T06:10:07.648 DEBUG:teuthology.orchestra.run.smithi093:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-17T06:10:07.668 INFO:teuthology.orchestra.run.smithi093.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-11-17T06:10:07.669 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-11-17T06:10:07.670 DEBUG:teuthology.orchestra.run.smithi069:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-17T06:10:07.689 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-11-17T06:10:07.781 INFO:teuthology.orchestra.run.smithi093.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-17T06:10:07.783 DEBUG:teuthology.orchestra.run.smithi093:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-17T06:10:07.803 INFO:teuthology.orchestra.run.smithi069.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-17T06:10:07.806 DEBUG:teuthology.orchestra.run.smithi069:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-17T06:10:07.819 DEBUG:teuthology.orchestra.run.smithi093:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-17T06:10:07.833 DEBUG:teuthology.orchestra.run.smithi093:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-17T06:10:07.883 DEBUG:teuthology.orchestra.run.smithi069:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-17T06:10:07.896 DEBUG:teuthology.orchestra.run.smithi069:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-17T06:10:59.300 INFO:teuthology.orchestra.run.smithi093.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-17T06:10:59.301 INFO:teuthology.orchestra.run.smithi093.stderr: * [new branch] main -> origin/main 2023-11-17T06:10:59.358 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190312 -> 20190312 2023-11-17T06:10:59.358 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190416 -> 20190416 2023-11-17T06:10:59.359 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190514 -> 20190514 2023-11-17T06:10:59.359 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190618 -> 20190618 2023-11-17T06:10:59.359 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190717 -> 20190717 2023-11-17T06:10:59.359 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190815 -> 20190815 2023-11-17T06:10:59.359 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20190923 -> 20190923 2023-11-17T06:10:59.359 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20191022 -> 20191022 2023-11-17T06:10:59.359 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20191215 -> 20191215 2023-11-17T06:10:59.359 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200122 -> 20200122 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200316 -> 20200316 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200421 -> 20200421 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200519 -> 20200519 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200619 -> 20200619 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200721 -> 20200721 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200817 -> 20200817 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20200918 -> 20200918 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20201022 -> 20201022 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20201118 -> 20201118 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20201218 -> 20201218 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210208 -> 20210208 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210315 -> 20210315 2023-11-17T06:10:59.361 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210511 -> 20210511 2023-11-17T06:10:59.362 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210716 -> 20210716 2023-11-17T06:10:59.362 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210818 -> 20210818 2023-11-17T06:10:59.364 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20210919 -> 20210919 2023-11-17T06:10:59.364 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20211027 -> 20211027 2023-11-17T06:10:59.364 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20211216 -> 20211216 2023-11-17T06:10:59.364 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220209 -> 20220209 2023-11-17T06:10:59.364 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220310 -> 20220310 2023-11-17T06:10:59.364 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220411 -> 20220411 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220509 -> 20220509 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220610 -> 20220610 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220708 -> 20220708 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220815 -> 20220815 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20220913 -> 20220913 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20221012 -> 20221012 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20221109 -> 20221109 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20221214 -> 20221214 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230117 -> 20230117 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230210 -> 20230210 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230310 -> 20230310 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230404 -> 20230404 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230515 -> 20230515 2023-11-17T06:10:59.365 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230625 -> 20230625 2023-11-17T06:10:59.366 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230804 -> 20230804 2023-11-17T06:10:59.366 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20230919 -> 20230919 2023-11-17T06:10:59.366 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20231030 -> 20231030 2023-11-17T06:10:59.366 INFO:teuthology.orchestra.run.smithi093.stderr: * [new tag] 20231111 -> 20231111 2023-11-17T06:10:59.787 INFO:teuthology.orchestra.run.smithi069.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-17T06:11:02.418 INFO:teuthology.orchestra.run.smithi069.stderr: * [new branch] main -> origin/main 2023-11-17T06:11:02.427 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20190312 -> 20190312 2023-11-17T06:11:02.427 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20190416 -> 20190416 2023-11-17T06:11:02.427 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20190514 -> 20190514 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20190618 -> 20190618 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20190717 -> 20190717 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20190815 -> 20190815 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20190923 -> 20190923 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20191022 -> 20191022 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20191215 -> 20191215 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20200122 -> 20200122 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20200316 -> 20200316 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20200421 -> 20200421 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20200519 -> 20200519 2023-11-17T06:11:02.428 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20200619 -> 20200619 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20200721 -> 20200721 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20200817 -> 20200817 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20200918 -> 20200918 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20201022 -> 20201022 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20201118 -> 20201118 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20201218 -> 20201218 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20210208 -> 20210208 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20210315 -> 20210315 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20210511 -> 20210511 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20210716 -> 20210716 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20210818 -> 20210818 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20210919 -> 20210919 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20211027 -> 20211027 2023-11-17T06:11:02.429 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20211216 -> 20211216 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20220209 -> 20220209 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20220310 -> 20220310 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20220411 -> 20220411 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20220509 -> 20220509 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20220610 -> 20220610 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20220708 -> 20220708 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20220815 -> 20220815 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20220913 -> 20220913 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20221012 -> 20221012 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20221109 -> 20221109 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20221214 -> 20221214 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20230117 -> 20230117 2023-11-17T06:11:02.430 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20230210 -> 20230210 2023-11-17T06:11:02.431 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20230310 -> 20230310 2023-11-17T06:11:02.431 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20230404 -> 20230404 2023-11-17T06:11:02.431 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20230515 -> 20230515 2023-11-17T06:11:02.431 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20230625 -> 20230625 2023-11-17T06:11:02.431 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20230804 -> 20230804 2023-11-17T06:11:02.431 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20230919 -> 20230919 2023-11-17T06:11:02.431 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20231030 -> 20231030 2023-11-17T06:11:02.431 INFO:teuthology.orchestra.run.smithi069.stderr: * [new tag] 20231111 -> 20231111 2023-11-17T06:11:03.274 INFO:teuthology.orchestra.run.smithi093.stderr:Updating files: 52% (1698/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 66% (2172/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2654/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-17T06:11:03.278 INFO:teuthology.orchestra.run.smithi093.stdout:HEAD is now at 6723a8d9 Merge branch 'robot/pr-5-1700153542' into 'main' 2023-11-17T06:11:03.295 INFO:teuthology.task.kernel:Downloading kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.b... 2023-11-17T06:11:03.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:11:03.518 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:11:03.518 DEBUG:teuthology.orchestra.run.smithi093:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ --input-file=- 2023-11-17T06:11:03.521 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi093.front.sepia.ceph.com to complete... 2023-11-17T06:11:03.767 INFO:teuthology.orchestra.run.smithi069.stderr:Updating files: 51% (1687/3248) Updating files: 52% (1689/3248) Updating files: 53% (1722/3248) Updating files: 54% (1754/3248) Updating files: 55% (1787/3248) Updating files: 56% (1819/3248) Updating files: 57% (1852/3248) Updating files: 58% (1884/3248) Updating files: 59% (1917/3248) Updating files: 60% (1949/3248) Updating files: 61% (1982/3248) Updating files: 62% (2014/3248) Updating files: 63% (2047/3248) Updating files: 64% (2079/3248) Updating files: 65% (2112/3248) Updating files: 66% (2144/3248) Updating files: 66% (2170/3248) Updating files: 67% (2177/3248) Updating files: 68% (2209/3248) Updating files: 69% (2242/3248) Updating files: 70% (2274/3248) Updating files: 71% (2307/3248) Updating files: 72% (2339/3248) Updating files: 73% (2372/3248) Updating files: 74% (2404/3248) Updating files: 75% (2436/3248) Updating files: 76% (2469/3248) Updating files: 77% (2501/3248) Updating files: 78% (2534/3248) Updating files: 79% (2566/3248) Updating files: 80% (2599/3248) Updating files: 81% (2631/3248) Updating files: 81% (2654/3248) Updating files: 82% (2664/3248) Updating files: 83% (2696/3248) Updating files: 84% (2729/3248) Updating files: 85% (2761/3248) Updating files: 86% (2794/3248) Updating files: 87% (2826/3248) Updating files: 88% (2859/3248) Updating files: 89% (2891/3248) Updating files: 90% (2924/3248) Updating files: 91% (2956/3248) Updating files: 92% (2989/3248) Updating files: 93% (3021/3248) Updating files: 94% (3054/3248) Updating files: 95% (3086/3248) Updating files: 96% (3119/3248) Updating files: 97% (3151/3248) Updating files: 98% (3184/3248) Updating files: 99% (3216/3248) Updating files: 100% (3248/3248) Updating files: 100% (3248/3248), done. 2023-11-17T06:11:03.771 INFO:teuthology.orchestra.run.smithi069.stdout:HEAD is now at 6723a8d9 Merge branch 'robot/pr-5-1700153542' into 'main' 2023-11-17T06:11:03.788 INFO:teuthology.task.kernel:Downloading kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.a... 2023-11-17T06:11:03.788 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=5b73517e0e2fa132ea79290e5fc06ea5349b2288 2023-11-17T06:11:04.069 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:11:04.069 DEBUG:teuthology.orchestra.run.smithi069:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/ --input-file=- 2023-11-17T06:11:04.072 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi069.front.sepia.ceph.com to complete... 2023-11-17T06:11:05.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17 06:11:05 URL:https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb [38918764/38918764] -> "/tmp/linux-image.deb" [1] 2023-11-17T06:11:05.059 INFO:teuthology.orchestra.run.smithi093.stderr:FINISHED --2023-11-17 06:11:05-- 2023-11-17T06:11:05.059 INFO:teuthology.orchestra.run.smithi093.stderr:Total wall clock time: 1.5s 2023-11-17T06:11:05.059 INFO:teuthology.orchestra.run.smithi093.stderr:Downloaded: 1 files, 37M in 1.4s (26.6 MB/s) 2023-11-17T06:11:05.060 INFO:teuthology.task.kernel:Installing kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.b... 2023-11-17T06:11:05.061 DEBUG:teuthology.orchestra.run.smithi093:> sudo dpkg -i /tmp/linux-image.deb 2023-11-17T06:11:05.386 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g5b73517e0e2f. 2023-11-17T06:11:06.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17 06:11:06 URL:https://1.chacra.ceph.com/r/kernel/testing/5b73517e0e2fa132ea79290e5fc06ea5349b2288/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-rc5-g5b73517e0e2f/linux-image-6.6.0-rc5-g5b73517e0e2f_6.6.0-rc5-g5b73517e0e2f-1_amd64.deb [38918764/38918764] -> "/tmp/linux-image.deb" [1] 2023-11-17T06:11:06.749 INFO:teuthology.orchestra.run.smithi069.stderr:FINISHED --2023-11-17 06:11:06-- 2023-11-17T06:11:06.749 INFO:teuthology.orchestra.run.smithi069.stderr:Total wall clock time: 2.7s 2023-11-17T06:11:06.749 INFO:teuthology.orchestra.run.smithi069.stderr:Downloaded: 1 files, 37M in 2.5s (15.1 MB/s) 2023-11-17T06:11:06.755 INFO:teuthology.task.kernel:Installing kernel 5b73517e0e2fa132ea79290e5fc06ea5349b2288 on mon.a... 2023-11-17T06:11:06.756 DEBUG:teuthology.orchestra.run.smithi069:> sudo dpkg -i /tmp/linux-image.deb 2023-11-17T06:11:07.024 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package linux-image-6.6.0-rc5-g5b73517e0e2f. 2023-11-17T06:11:07.087 INFO:teuthology.orchestra.run.smithi093.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-11-17T06:11:07.092 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-17T06:11:07.238 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-17T06:11:08.781 INFO:teuthology.orchestra.run.smithi069.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-11-17T06:11:08.786 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-17T06:11:08.995 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-17T06:11:10.303 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-17T06:11:10.419 INFO:teuthology.orchestra.run.smithi093.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:11:11.775 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up linux-image-6.6.0-rc5-g5b73517e0e2f (6.6.0-rc5-g5b73517e0e2f-1) ... 2023-11-17T06:11:11.901 INFO:teuthology.orchestra.run.smithi069.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:11:36.446 INFO:teuthology.orchestra.run.smithi093.stderr:Sourcing file `/etc/default/grub' 2023-11-17T06:12:13.552 INFO:teuthology.orchestra.run.smithi093.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-17T06:12:13.552 INFO:teuthology.orchestra.run.smithi093.stderr:Generating grub configuration file ... 2023-11-17T06:12:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-17T06:12:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-17T06:12:13.681 INFO:teuthology.orchestra.run.smithi093.stderr:done 2023-11-17T06:12:13.682 INFO:teuthology.orchestra.run.smithi069.stderr:Sourcing file `/etc/default/grub' 2023-11-17T06:12:13.682 INFO:teuthology.orchestra.run.smithi069.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-17T06:12:13.682 INFO:teuthology.orchestra.run.smithi069.stderr:Generating grub configuration file ... 2023-11-17T06:12:13.682 INFO:teuthology.orchestra.run.smithi069.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:13.682 INFO:teuthology.orchestra.run.smithi069.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:13.682 INFO:teuthology.orchestra.run.smithi069.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-17T06:12:13.682 INFO:teuthology.orchestra.run.smithi069.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-17T06:12:13.682 INFO:teuthology.orchestra.run.smithi069.stderr:done 2023-11-17T06:12:13.683 DEBUG:teuthology.orchestra.run.smithi093:> dpkg-deb -c /tmp/linux-image.deb 2023-11-17T06:12:13.683 DEBUG:teuthology.orchestra.run.smithi069:> dpkg-deb -c /tmp/linux-image.deb 2023-11-17T06:12:13.693 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./ 2023-11-17T06:12:13.693 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./boot/ 2023-11-17T06:12:13.693 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 4415097 2023-10-25 03:19 ./boot/System.map-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:13.694 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./ 2023-11-17T06:12:13.694 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./boot/ 2023-11-17T06:12:13.694 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 4415097 2023-10-25 03:19 ./boot/System.map-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:13.710 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 169298 2023-10-25 03:19 ./boot/config-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:13.710 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11352928 2023-10-25 03:19 ./boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:13.710 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 169298 2023-10-25 03:19 ./boot/config-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:13.711 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11352928 2023-10-25 03:19 ./boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:13.728 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/ 2023-11-17T06:12:13.728 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postinst.d/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postrm.d/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/preinst.d/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/prerm.d/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ 2023-11-17T06:12:13.729 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 490233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 93113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 106729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 152241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 83889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-17T06:12:13.730 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/ 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/ 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/ 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpuid.ko 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/msr.ko 2023-11-17T06:12:13.731 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/ 2023-11-17T06:12:13.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 353761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-17T06:12:13.732 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 881713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-17T06:12:13.733 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 2276817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm.ko 2023-11-17T06:12:13.735 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/ 2023-11-17T06:12:13.735 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/ 2023-11-17T06:12:13.735 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postinst.d/ 2023-11-17T06:12:13.735 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/postrm.d/ 2023-11-17T06:12:13.735 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/preinst.d/ 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./etc/kernel/prerm.d/ 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/ 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/ 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/ 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/ 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/ 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 490233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-17T06:12:13.736 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 93113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 106729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 152241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 83889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 58585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-17T06:12:13.737 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/ 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/ 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/ 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/cpuid.ko 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kernel/msr.ko 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/ 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 353761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-17T06:12:13.738 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 881713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-17T06:12:13.739 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 2276817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/arch/x86/kvm/kvm.ko 2023-11-17T06:12:14.100 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/af_alg.ko 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_hash.ko 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_skcipher.ko 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ansi_cprng.ko 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/anubis.ko 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/arc4.ko 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/ 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/ 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_memcpy.ko 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_pq.ko 2023-11-17T06:12:14.101 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_tx.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_xor.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/raid6test.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authenc.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authencesn.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blake2b_generic.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_common.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_generic.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/camellia_generic.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast5_generic.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast6_generic.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast_common.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ccm.ko 2023-11-17T06:12:14.102 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cmac.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crc32_generic.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cryptd.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_engine.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_simd.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_user.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cts.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/des_generic.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/dh_generic.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/echainiv.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/essiv.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/fcrypt.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/khazad.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lrw.ko 2023-11-17T06:12:14.103 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4hc.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/md4.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/michael_mic.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcbc.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcrypt.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/rmd160.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/seed.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/serpent_generic.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 149193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tcrypt.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tea.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_common.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_generic.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/vmac.ko 2023-11-17T06:12:14.104 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/wp512.ko 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xcbc.ko 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xor.ko 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xts.ko 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xxhash_generic.ko 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_extlog.ko 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_pad.ko 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/ 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/einj.ko 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ec_sys.ko 2023-11-17T06:12:14.105 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/platform_profile.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbs.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbshc.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 103025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/video.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/acard-ahci.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 88865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci_platform.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 88289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci_platform.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_acpi.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ali.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_amd.ko 2023-11-17T06:12:14.106 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_artop.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atiixp.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atp867x.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd640.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd64x.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cypress.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_efar.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt366.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt37x.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it8213.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it821x.ko 2023-11-17T06:12:14.107 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_jmicron.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_legacy.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_marvell.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_mpiix.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_netcell.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ninja32.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87410.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87415.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_oldpiix.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_opti.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_optidma.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pcmcia.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-17T06:12:14.108 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_piccolo.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_radisys.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rdc.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rz1000.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sch.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_serverworks.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sil680.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sl82c105.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_triflex.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_via.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pdc_adma.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_inic162x.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 83345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_mv.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_nv.ko 2023-11-17T06:12:14.109 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_promise.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_qstor.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil24.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sis.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_svw.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sx4.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_uli.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_via.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_vsc.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ks0108.ko 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/ 2023-11-17T06:12:14.110 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 124473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/bcma.ko 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/ 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/ 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 113665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/aoe.ko 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/ 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 965585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/drbd.ko 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 173225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/floppy.ko 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/ 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 94297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 115793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/nbd.ko 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/ 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 110449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/null_blk.ko 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 98193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/pktcdvd.ko 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 263769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/rbd.ko 2023-11-17T06:12:14.111 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/ 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 98145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/ 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/zram.ko 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/applicom.ko 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hangcheck-timer.ko 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/ 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/via-rng.ko 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ 2023-11-17T06:12:14.112 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 148601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 139313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/lp.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/ 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 84097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/mwave.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/nvram.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ppdev.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tlclk.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/ 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-17T06:12:14.113 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/ 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/ 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-palmas.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-si5351.ko 2023-11-17T06:12:14.114 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-twl6040.ko 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-wm831x.ko 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/ 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 243025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp.ko 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/ 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/ 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-17T06:12:14.115 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 438761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-17T06:12:14.116 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-17T06:12:14.116 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-17T06:12:14.116 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-aes.ko 2023-11-17T06:12:14.116 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-sha.ko 2023-11-17T06:12:14.116 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/ 2023-11-17T06:12:14.116 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 68857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-17T06:12:14.144 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/ 2023-11-17T06:12:14.144 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/dca.ko 2023-11-17T06:12:14.144 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ 2023-11-17T06:12:14.144 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/ 2023-11-17T06:12:14.144 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-17T06:12:14.144 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 122569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 79953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/amd64_edac.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/e752x_edac.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 63617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/edac_mce_amd.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3000_edac.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3200_edac.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5100_edac.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5400_edac.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7300_edac.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7core_edac.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i82975x_edac.ko 2023-11-17T06:12:14.145 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ie31200_edac.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 56825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/sb_edac.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/x38_edac.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/ 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-gpio.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max14577.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max77693.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max8997.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-palmas.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/ 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-17T06:12:14.146 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/ 2023-11-17T06:12:14.147 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-17T06:12:14.147 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-17T06:12:14.147 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/ 2023-11-17T06:12:14.147 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-17T06:12:14.147 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-17T06:12:14.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-arizona.ko 2023-11-17T06:12:14.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9052.ko 2023-11-17T06:12:14.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9055.ko 2023-11-17T06:12:14.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-dln2.ko 2023-11-17T06:12:14.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 77849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-17T06:12:14.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-generic.ko 2023-11-17T06:12:14.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ich.ko 2023-11-17T06:12:14.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-17T06:12:14.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-kempld.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max7300.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max730x.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max732x.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-17T06:12:14.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-vx855.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/ 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-a4tech.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-apple.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-appleir.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-aureal.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-axff.ko 2023-11-17T06:12:14.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-belkin.ko 2023-11-17T06:12:14.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cherry.ko 2023-11-17T06:12:14.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-chicony.ko 2023-11-17T06:12:14.212 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cp2112.ko 2023-11-17T06:12:14.212 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cypress.ko 2023-11-17T06:12:14.212 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-dr.ko 2023-11-17T06:12:14.212 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elecom.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elo.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-emsff.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ezkey.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gaff.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-generic.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gt683r.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gyration.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtekff.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-hyperv.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-icade.ko 2023-11-17T06:12:14.213 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kensington.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-keytouch.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kye.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lcpower.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-led.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lenovo.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lg-g15.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 80993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-magicmouse.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-microsoft.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-monterey.ko 2023-11-17T06:12:14.214 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-multitouch.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ntrig.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ortek.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-penmount.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-petalynx.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-picolcd.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-pl.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-plantronics.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-primax.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-rmi.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-common.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-17T06:12:14.215 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-17T06:12:14.245 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-17T06:12:14.245 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-17T06:12:14.245 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-17T06:12:14.245 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-17T06:12:14.245 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-17T06:12:14.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-17T06:12:14.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-saitek.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-samsung.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sjoy.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sony.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-speedlink.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-steelseries.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sunplus.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-17T06:12:14.396 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tivo.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tmff.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-topseed.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-twinhan.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 71073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-uclogic.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-waltop.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 143473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-wiimote.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-xinmo.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zpff.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zydacron.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 267825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/uhid.ko 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/ 2023-11-17T06:12:14.397 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 217873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/wacom.ko 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/ 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 64201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_balloon.ko 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_utils.ko 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 305465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_vmbus.ko 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru.ko 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru3.ko 2023-11-17T06:12:14.398 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-17T06:12:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7414.ko 2023-11-17T06:12:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7418.ko 2023-11-17T06:12:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adc128d818.ko 2023-11-17T06:12:14.430 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1025.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 97977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1026.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1029.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1031.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm9240.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ads7828.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7410.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7411.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 74433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7462.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7470.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7475.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7x10.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/amc6821.ko 2023-11-17T06:12:14.431 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/applesmc.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asb100.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asc7621.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/atxp1.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/coretemp.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 99601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dme1737.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds1621.ko 2023-11-17T06:12:14.432 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds620.ko 2023-11-17T06:12:14.586 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc1403.ko 2023-11-17T06:12:14.586 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc2103.ko 2023-11-17T06:12:14.586 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc6w201.ko 2023-11-17T06:12:14.586 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71805f.ko 2023-11-17T06:12:14.586 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 94457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71882fg.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f75375s.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fam15h_power.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fschmd.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g760a.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g762.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl518sm.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl520sm.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hih6130.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5500_temp.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5k_amb.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmaem.ko 2023-11-17T06:12:14.587 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmpex.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina209.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina2xx.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 130449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/it87.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/jc42.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k10temp.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k8temp.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lineage-pem.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm63.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm73.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm75.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm77.ko 2023-11-17T06:12:14.588 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm78.ko 2023-11-17T06:12:14.589 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm80.ko 2023-11-17T06:12:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm83.ko 2023-11-17T06:12:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm85.ko 2023-11-17T06:12:14.668 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm87.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm90.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm92.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 108841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm93.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95234.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95241.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95245.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc2945.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4151.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4215.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4222.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4245.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4260.ko 2023-11-17T06:12:14.669 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4261.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max16065.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1619.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1668.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max197.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6639.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6650.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6697.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mcp3021.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6683.ko 2023-11-17T06:12:14.670 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 119817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775-core.ko 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775.ko 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct7802.ko 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 82337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87360.ko 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87427.ko 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pcf8591.ko 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-17T06:12:14.671 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 82577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/powr1220.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5627.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5636.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-17T06:12:14.785 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht15.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht21.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/shtc1.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sis5595.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47b397.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m1.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m192.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/thmc50.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp102.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp103.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp401.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp421.ko 2023-11-17T06:12:14.786 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via-cputemp.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via686a.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt1211.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt8231.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627ehf.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627hf.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 71345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83781d.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 63289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83791d.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 71321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83792d.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83793.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 119505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83795.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l785ts.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l786ng.ko 2023-11-17T06:12:14.787 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-17T06:12:14.788 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-17T06:12:14.788 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/ 2023-11-17T06:12:14.788 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/ 2023-11-17T06:12:14.788 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-17T06:12:14.788 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-17T06:12:14.788 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/ 2023-11-17T06:12:14.813 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-17T06:12:14.813 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-17T06:12:14.813 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-17T06:12:14.813 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-17T06:12:14.813 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-17T06:12:14.813 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-17T06:12:14.813 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-17T06:12:14.813 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-17T06:12:14.813 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-17T06:12:14.813 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-17T06:12:14.814 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-17T06:12:14.815 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-17T06:12:14.855 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-17T06:12:14.855 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-mux.ko 2023-11-17T06:12:14.855 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-smbus.ko 2023-11-17T06:12:14.855 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-stub.ko 2023-11-17T06:12:14.855 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/ 2023-11-17T06:12:14.855 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-17T06:12:14.855 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 273609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 879969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_core.ko 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 69337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 324217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 97985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 282273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-17T06:12:14.856 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 493073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/ 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 419737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/ 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 739025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 296625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 153697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/ 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 168969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-17T06:12:14.857 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 263081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-17T06:12:14.858 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ 2023-11-17T06:12:14.880 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 100241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-17T06:12:14.880 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ 2023-11-17T06:12:14.880 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 111425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-17T06:12:14.880 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ 2023-11-17T06:12:14.880 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 128753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-17T06:12:14.880 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ 2023-11-17T06:12:14.880 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 129529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-17T06:12:14.880 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ 2023-11-17T06:12:14.880 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/evbug.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ff-memless.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/ 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/gameport.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/joydev.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/ 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-17T06:12:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-17T06:12:14.882 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-17T06:12:14.882 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8323.ko 2023-11-17T06:12:14.882 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8333.ko 2023-11-17T06:12:14.882 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-17T06:12:14.882 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-17T06:12:14.882 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-17T06:12:14.882 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-17T06:12:14.882 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt1070.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt2160.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/stowaway.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-17T06:12:14.883 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/matrix-keymap.ko 2023-11-17T06:12:14.905 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/ 2023-11-17T06:12:14.905 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/appletouch.ko 2023-11-17T06:12:14.905 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/bcm5974.ko 2023-11-17T06:12:14.905 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 123681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/cyapatp.ko 2023-11-17T06:12:14.905 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-17T06:12:14.905 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-17T06:12:14.905 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 335977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/psmouse.ko 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/sermouse.ko 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/ 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 109873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/altera_ps2.ko 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/arc_ps2.ko 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ct82c710.ko 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-17T06:12:14.906 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/parkbd.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/pcips2.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ps2mult.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serio_raw.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serport.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/sparse-keymap.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/ 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/ 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/ 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-88pm860x.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-adp5520.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-bd2802.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-blinkm.ko 2023-11-17T06:12:14.907 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da903x.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da9052.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-gpio.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3530.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3533.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm355x.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3642.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp3944.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp8788.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-max8997.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-mc13783.ko 2023-11-17T06:12:14.908 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-17T06:12:14.935 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca9532.ko 2023-11-17T06:12:14.935 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca955x.ko 2023-11-17T06:12:14.936 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca963x.ko 2023-11-17T06:12:14.936 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-ss4200.ko 2023-11-17T06:12:14.936 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-tca6507.ko 2023-11-17T06:12:15.015 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-17T06:12:15.015 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm8350.ko 2023-11-17T06:12:15.028 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ 2023-11-17T06:12:15.028 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-17T06:12:15.028 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-17T06:12:15.028 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-17T06:12:15.028 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/ 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/ 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 654969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/bcache.ko 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bio-prison.ko 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bufio.ko 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache-smq.ko 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 156009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache.ko 2023-11-17T06:12:15.029 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 106897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-crypt.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-delay.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-era.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-flakey.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log-userspace.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-mirror.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-multipath.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-queue-length.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-raid.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-region-hash.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-round-robin.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-service-time.ko 2023-11-17T06:12:15.030 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-snapshot.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-switch.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 181865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-thin-pool.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-verity.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-zero.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/faulty.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/linear.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/multipath.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/ 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 199937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid0.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 113073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid1.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 158681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid10.ko 2023-11-17T06:12:15.031 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 395721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid456.ko 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/ 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/ 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 178137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptbase.ko 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 63385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptctl.ko 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptfc.ko 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptlan.ko 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 123321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptsas.ko 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 79041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptscsih.ko 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptspi.ko 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm800.ko 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm805.ko 2023-11-17T06:12:15.032 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm80x.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona-i2c.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 123721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/bcm590xx.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/dln2.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/janz-cmodio.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/kempld-core.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-core.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lp3943.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_ich.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_sch.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/max8907.ko 2023-11-17T06:12:15.033 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-17T06:12:15.034 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-17T06:12:15.034 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/menf21bmc.ko 2023-11-17T06:12:15.034 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-17T06:12:15.034 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-17T06:12:15.034 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633.ko 2023-11-17T06:12:15.038 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-17T06:12:15.046 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/retu-mfd.ko 2023-11-17T06:12:15.046 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 80425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/si476x-core.ko 2023-11-17T06:12:15.046 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/sm501.ko 2023-11-17T06:12:15.046 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-17T06:12:15.046 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps65010.ko 2023-11-17T06:12:15.046 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps6507x.ko 2023-11-17T06:12:15.047 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/viperboard.ko 2023-11-17T06:12:15.047 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/vx855.ko 2023-11-17T06:12:15.047 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wl1273-core.ko 2023-11-17T06:12:15.047 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wm8994.ko 2023-11-17T06:12:15.047 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ 2023-11-17T06:12:15.047 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-17T06:12:15.047 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot.ko 2023-11-17T06:12:15.047 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/ 2023-11-17T06:12:15.048 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-17T06:12:15.048 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds9802als.ko 2023-11-17T06:12:15.048 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds990x.ko 2023-11-17T06:12:15.048 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/bh1770glc.ko 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/ 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/core.ko 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/ 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/cb710.ko 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ds1682.ko 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/dummy-irq.ko 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/ 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/echo.ko 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/ 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/at24.ko 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-17T06:12:15.049 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/max6875.ko 2023-11-17T06:12:15.050 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/enclosure.ko 2023-11-17T06:12:15.050 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/ 2023-11-17T06:12:15.050 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 152201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-17T06:12:15.050 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hmc6352.ko 2023-11-17T06:12:15.050 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hpilo.ko 2023-11-17T06:12:15.050 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ 2023-11-17T06:12:15.050 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-17T06:12:15.050 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ics932s401.ko 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29003.ko 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29020.ko 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/ 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/ 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-me.ko 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 56521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-txe.ko 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 310113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei.ko 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/phantom.ko 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/ 2023-11-17T06:12:15.051 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 74265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-17T06:12:15.080 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_7xx1.ko 2023-11-17T06:12:15.080 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_core.ko 2023-11-17T06:12:15.080 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tsl2550.ko 2023-11-17T06:12:15.080 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_balloon.ko 2023-11-17T06:12:15.080 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/ 2023-11-17T06:12:15.080 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 183609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-17T06:12:15.080 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/ 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 490129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/bonding.ko 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/ 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/ 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 106033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 453737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dummy.ko 2023-11-17T06:12:15.081 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/eql.ko 2023-11-17T06:12:15.083 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ 2023-11-17T06:12:15.083 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/ 2023-11-17T06:12:15.083 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-17T06:12:15.083 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-17T06:12:15.083 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 130553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-17T06:12:15.083 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 68849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-17T06:12:15.084 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ 2023-11-17T06:12:15.084 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-17T06:12:15.084 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-17T06:12:15.084 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-17T06:12:15.084 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 99113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-17T06:12:15.084 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/ 2023-11-17T06:12:15.085 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-17T06:12:15.085 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/ 2023-11-17T06:12:15.085 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 69201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-17T06:12:15.085 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/ 2023-11-17T06:12:15.088 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-17T06:12:15.088 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/ 2023-11-17T06:12:15.088 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-17T06:12:15.089 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/ 2023-11-17T06:12:15.089 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-17T06:12:15.090 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-17T06:12:15.090 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 87297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-17T06:12:15.090 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/ 2023-11-17T06:12:15.090 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-17T06:12:15.090 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 97337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-17T06:12:15.090 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 104673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 90257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 81569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 69729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/ 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 176761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1421497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 128569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-17T06:12:15.091 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 132089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 312081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/ 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 323513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/ 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 193497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 347417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1044433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-17T06:12:15.092 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 166193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-17T06:12:15.093 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-17T06:12:15.093 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-17T06:12:15.093 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/ 2023-11-17T06:12:15.093 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-17T06:12:15.093 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 204345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-17T06:12:15.093 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/ 2023-11-17T06:12:15.093 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-17T06:12:15.093 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 69449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-17T06:12:15.093 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-17T06:12:15.093 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 141225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/ 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dnet.ko 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/ 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-17T06:12:15.094 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 281137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-17T06:12:15.095 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ethoc.ko 2023-11-17T06:12:15.154 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fealnx.ko 2023-11-17T06:12:15.154 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/ 2023-11-17T06:12:15.154 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-17T06:12:15.154 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 90465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 295577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 584497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 246209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 925697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 302849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/ 2023-11-17T06:12:15.155 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 514681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 93593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 734305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 151769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 86921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/jme.ko 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/ 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 102289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 122649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/ 2023-11-17T06:12:15.156 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 727601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 278937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1113993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 95665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/ 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-17T06:12:15.157 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 108649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-17T06:12:15.158 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ 2023-11-17T06:12:15.158 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-17T06:12:15.158 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-17T06:12:15.158 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/ 2023-11-17T06:12:15.158 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 150905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-17T06:12:15.158 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/ 2023-11-17T06:12:15.158 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 136721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-17T06:12:15.158 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/ 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/ 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 227897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 87081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 672049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/ 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/ 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-17T06:12:15.159 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 83985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-17T06:12:15.160 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-17T06:12:15.160 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 189801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-17T06:12:15.160 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/ 2023-11-17T06:12:15.161 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-17T06:12:15.161 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 104241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-17T06:12:15.161 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/ 2023-11-17T06:12:15.161 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1053921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-17T06:12:15.161 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/ 2023-11-17T06:12:15.161 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-17T06:12:15.162 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/ 2023-11-17T06:12:15.162 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-17T06:12:15.162 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 63337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-17T06:12:15.162 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/ 2023-11-17T06:12:15.162 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-17T06:12:15.162 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-17T06:12:15.162 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-17T06:12:15.162 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 68177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-17T06:12:15.162 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/ 2023-11-17T06:12:15.163 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-17T06:12:15.163 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-17T06:12:15.163 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-17T06:12:15.163 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-17T06:12:15.163 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 486961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-17T06:12:15.163 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/ 2023-11-17T06:12:15.163 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 103337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 166161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/ 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/ 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 86529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/ 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 80273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 83633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/ 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-17T06:12:15.164 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/ 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/ 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/defxx.ko 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/ 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 216985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 77345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/geneve.ko 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/ 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 235521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/ 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ifb.ko 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ 2023-11-17T06:12:15.165 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 83769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-17T06:12:15.166 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvlan.ko 2023-11-17T06:12:15.166 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvtap.ko 2023-11-17T06:12:15.166 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/ 2023-11-17T06:12:15.166 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-17T06:12:15.166 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-17T06:12:15.166 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-17T06:12:15.166 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-17T06:12:15.166 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio.ko 2023-11-17T06:12:15.166 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mii.ko 2023-11-17T06:12:15.167 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/netconsole.ko 2023-11-17T06:12:15.167 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/nlmon.ko 2023-11-17T06:12:15.167 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/ 2023-11-17T06:12:15.167 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-17T06:12:15.167 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-17T06:12:15.167 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ 2023-11-17T06:12:15.167 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/amd.ko 2023-11-17T06:12:15.167 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-17T06:12:15.168 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-17T06:12:15.168 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm87xx.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/broadcom.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/cicada.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/davicom.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/et1011c.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/icplus.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/lxt.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 82049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/marvell.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 76177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/micrel.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/national.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 97857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/phylink.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/qsemi.ko 2023-11-17T06:12:15.169 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/realtek.ko 2023-11-17T06:12:15.170 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/smsc.ko 2023-11-17T06:12:15.170 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ste10Xp.ko 2023-11-17T06:12:15.170 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/vitesse.ko 2023-11-17T06:12:15.170 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/ 2023-11-17T06:12:15.170 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/plip.ko 2023-11-17T06:12:15.170 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ 2023-11-17T06:12:15.171 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-17T06:12:15.171 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_async.ko 2023-11-17T06:12:15.171 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-17T06:12:15.171 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-17T06:12:15.171 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppoe.ko 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppox.ko 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pptp.ko 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sb1000.ko 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/ 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/slip.ko 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sungem_phy.ko 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 64385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/tap.ko 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/ 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 106169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team.ko 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-17T06:12:15.172 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-17T06:12:15.173 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-17T06:12:15.173 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_random.ko 2023-11-17T06:12:15.173 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-17T06:12:15.173 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 87017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/veth.ko 2023-11-17T06:12:15.173 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/ 2023-11-17T06:12:15.173 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 144297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-17T06:12:15.173 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/ 2023-11-17T06:12:15.174 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 297329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/vxlan.ko 2023-11-17T06:12:15.174 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/ 2023-11-17T06:12:15.174 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 144649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-17T06:12:15.174 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ 2023-11-17T06:12:15.174 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ntb.ko 2023-11-17T06:12:15.174 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/ 2023-11-17T06:12:15.179 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/ 2023-11-17T06:12:15.180 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 264937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme-core.ko 2023-11-17T06:12:15.180 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 102209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme.ko 2023-11-17T06:12:15.180 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/ 2023-11-17T06:12:15.180 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 133841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport.ko 2023-11-17T06:12:15.180 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_cs.ko 2023-11-17T06:12:15.180 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 84465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_pc.ko 2023-11-17T06:12:15.180 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_serial.ko 2023-11-17T06:12:15.180 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/ 2023-11-17T06:12:15.180 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/ 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/pci-stub.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/xen-pcifront.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/ 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/i82092.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 145809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pd6729.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 112889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-17T06:12:15.181 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/ 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/ 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/ 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/ 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/ 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/ 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/ 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-17T06:12:15.182 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acerhdf.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 127569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-17T06:12:15.183 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/hdaps.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/ 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel_ips.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-17T06:12:15.184 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/ 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-17T06:12:15.185 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9030_battery.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9052-battery.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/gpio-charger.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max14577_charger.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17040_battery.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17042_battery.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8903_charger.ko 2023-11-17T06:12:15.186 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8925_power.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/sbs-battery.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/test_power.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_power.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm8350_power.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/ 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/ 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/ 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-17T06:12:15.187 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps_parport.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/pps_core.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp_kvm.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/ 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9052.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9055.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9063.ko 2023-11-17T06:12:15.188 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-17T06:12:15.189 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 68577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-17T06:12:15.189 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-17T06:12:15.189 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-17T06:12:15.189 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-17T06:12:15.190 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-17T06:12:15.190 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-17T06:12:15.190 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-17T06:12:15.190 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-17T06:12:15.190 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-em3027.ko 2023-11-17T06:12:15.190 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max6900.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8907.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8925.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8997.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8998.ko 2023-11-17T06:12:15.191 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-palmas.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-17T06:12:15.192 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-17T06:12:15.193 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-17T06:12:15.193 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-17T06:12:15.193 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-17T06:12:15.193 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-17T06:12:15.193 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-17T06:12:15.193 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-17T06:12:15.193 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-17T06:12:15.193 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-17T06:12:15.193 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-x1205.ko 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 77617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-9xxx.ko 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-sas.ko 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-xxxx.ko 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 135185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/BusLogic.ko 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/a100u2w.ko 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/ 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 272305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 100617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/advansys.ko 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/ 2023-11-17T06:12:15.194 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 356265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 295801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/ 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 189185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/am53c974.ko 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/ 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 106881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/atp870u.ko 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/ 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 246985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/ 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1171945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/bfa.ko 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/ 2023-11-17T06:12:15.195 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 237273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/ 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 115369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ch.ko 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/ 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 308921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/ 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 76145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-17T06:12:15.196 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 146689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 75553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dc395x.ko 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dmx3191d.ko 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/ 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 212425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esp_scsi.ko 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/ 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 158505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fdomain.ko 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/ 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 263489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/fnic.ko 2023-11-17T06:12:15.197 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 201817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hpsa.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hptiop.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hv_storvsc.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/imm.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/initio.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 266537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ipr.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ips.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/ 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 317153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/isci.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/ 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 314865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/libfc.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 145585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi.ko 2023-11-17T06:12:15.198 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/ 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 216665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/libsas.ko 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/ 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 2197249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/ 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 310617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 84721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid.ko 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/ 2023-11-17T06:12:15.199 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 659777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-17T06:12:15.200 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/ 2023-11-17T06:12:15.200 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 119561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-17T06:12:15.200 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvumi.ko 2023-11-17T06:12:15.200 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/ 2023-11-17T06:12:15.200 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 81625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-17T06:12:15.200 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-17T06:12:15.200 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-17T06:12:15.200 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-17T06:12:15.200 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/ 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 364105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 123617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pmcraid.ko 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ppa.ko 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla1280.ko 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/ 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1876625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 85289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/ 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 559033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qlogicfas408.ko 2023-11-17T06:12:15.201 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/raid_class.ko 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 238825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_debug.ko 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 173937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 279313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 97729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ses.ko 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 115889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/st.ko 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/stex.ko 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-17T06:12:15.202 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 162121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/virtio_scsi.ko 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/wd719x.ko 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/xen-scsifront.ko 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 129441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ssb.ko 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/ 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/ 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 736601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/ 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_file.ko 2023-11-17T06:12:15.203 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_iblock.ko 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 930321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_mod.ko 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_pscsi.ko 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 122521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_user.ko 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/ 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 75593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/ 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/ 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-17T06:12:15.204 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-17T06:12:15.205 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/moxa.ko 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 50953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/mxser.ko 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 108601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_gsm.ko 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_hdlc.ko 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/nozomi.ko 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/ 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/ 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-17T06:12:15.206 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_uart.ko 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/arc_uart.ko 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/ 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 103073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/rp2.ko 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/ 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 531265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ 2023-11-17T06:12:15.207 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/ 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio.ko 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_aec.ko 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_cif.ko 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_mf624.ko 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_netx.ko 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pci_generic.ko 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-17T06:12:15.208 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_sercos3.ko 2023-11-17T06:12:15.209 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/ 2023-11-17T06:12:15.264 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/ 2023-11-17T06:12:15.264 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-17T06:12:15.264 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ 2023-11-17T06:12:15.264 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 144377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-17T06:12:15.264 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-17T06:12:15.264 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-17T06:12:15.264 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/ 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 87089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-acm.ko 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usblp.ko 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usbtmc.ko 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ulpi.ko 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/ 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/ 2023-11-17T06:12:15.265 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-17T06:12:15.271 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-17T06:12:15.271 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 444553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-17T06:12:15.271 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/ 2023-11-17T06:12:15.275 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/ 2023-11-17T06:12:15.275 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-17T06:12:15.275 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-17T06:12:15.275 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-17T06:12:15.275 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-17T06:12:15.275 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-17T06:12:15.275 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-17T06:12:15.275 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 92489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 122081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 85609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/ 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-17T06:12:15.276 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-17T06:12:15.277 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-17T06:12:15.277 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-17T06:12:15.277 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-17T06:12:15.277 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-17T06:12:15.277 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-17T06:12:15.277 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-17T06:12:15.277 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-17T06:12:15.277 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-17T06:12:15.277 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-17T06:12:15.277 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 62185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 161225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/ 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 157681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 69705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 56033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-17T06:12:15.282 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 76057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-17T06:12:15.283 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 75073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-17T06:12:15.283 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 73169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-17T06:12:15.283 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 65809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-17T06:12:15.283 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-17T06:12:15.283 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 81505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-17T06:12:15.283 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 156073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-17T06:12:15.283 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ 2023-11-17T06:12:15.283 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-17T06:12:15.283 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 80113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-17T06:12:15.283 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 87353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811_cs.ko 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/ 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/mdc800.ko 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/microtek.ko 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/adutux.ko 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/appledisplay.ko 2023-11-17T06:12:15.284 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cytherm.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ehset.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi26.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi62.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ezusb.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/idmouse.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/iowarrior.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ldusb.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/legousbtower.ko 2023-11-17T06:12:15.285 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/lvstest.ko 2023-11-17T06:12:15.286 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/ 2023-11-17T06:12:15.286 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 64841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-17T06:12:15.286 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-17T06:12:15.286 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usb3503.ko 2023-11-17T06:12:15.286 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usblcd.ko 2023-11-17T06:12:15.286 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-17T06:12:15.286 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbtest.ko 2023-11-17T06:12:15.286 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/uss720.ko 2023-11-17T06:12:15.286 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/yurex.ko 2023-11-17T06:12:15.290 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/ 2023-11-17T06:12:15.290 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/usbmon.ko 2023-11-17T06:12:15.290 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/ 2023-11-17T06:12:15.290 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 301545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-17T06:12:15.290 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/ 2023-11-17T06:12:15.290 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-generic.ko 2023-11-17T06:12:15.290 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-17T06:12:15.290 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-17T06:12:15.290 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/aircable.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ark3116.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ch341.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cp210x.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cyberjack.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/empeg.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/f81232.ko 2023-11-17T06:12:15.291 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 175137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 137081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 124833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_ti.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipaq.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipw.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ir-usb.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 107521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-17T06:12:15.292 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mct_u232.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/metro-usb.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7720.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 78217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7840.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 56337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mxuport.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/navman.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/omninet.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/opticon.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 190633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/option.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/oti6858.ko 2023-11-17T06:12:15.293 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/pl2303.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcaux.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcserial.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/quatech2.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/safe_serial.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 51625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/sierra.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ssu100.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/symbolserial.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_debug.ko 2023-11-17T06:12:15.294 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usbserial.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/visor.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/whiteheat.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 52913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/uas.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-17T06:12:15.295 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-karma.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 179969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/usb-storage.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/ 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-17T06:12:15.296 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 107001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/ 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/ 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 154297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 108737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio.ko 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 77609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/ 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 113873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost.ko 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 58089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_net.ko 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_scsi.ko 2023-11-17T06:12:15.297 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/ 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/ 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/apple_bl.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/bd6107.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-17T06:12:15.298 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lcd.ko 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/ 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ 2023-11-17T06:12:15.299 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2482.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2490.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/ 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-17T06:12:15.300 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 56425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 102673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/wire.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/acquirewdt.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/advantechwdt.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/dw_wdt.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-17T06:12:15.301 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/hpwdt.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/i6300esb.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ib700wdt.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ibmasr.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it87_wdt.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/machzwd.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-17T06:12:15.302 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/nv_tco.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/retu_wdt.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-17T06:12:15.303 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/softdog.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/via_wdt.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wdt_pci.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/xen_wdt.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/ 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-evtchn.ko 2023-11-17T06:12:15.304 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntalloc.ko 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntdev.ko 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/ 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 176441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-privcmd.ko 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 71249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-scsiback.ko 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/ 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/ 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 166425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/9p.ko 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/ 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/adfs.ko 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/ 2023-11-17T06:12:15.305 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 163593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/affs.ko 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/ 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 932817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/kafs.ko 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/ 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/autofs4.ko 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/ 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 64545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/befs.ko 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/ 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/bfs.ko 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/binfmt_misc.ko 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/ 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 3402585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/btrfs.ko 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/ 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 306073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/cachefiles.ko 2023-11-17T06:12:15.306 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1323873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ceph.ko 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/ 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 100801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/coda.ko 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/ 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 108393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/configfs.ko 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/ 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 29625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/cramfs.ko 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/ 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 642577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/dlm.ko 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/ 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/efs.ko 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/ 2023-11-17T06:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1505025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/f2fs.ko 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/ 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/msdos.ko 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/ 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/freevxfs.ko 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/ 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 226481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/fscache.ko 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/ 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/cuse.ko 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/ 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1231529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/gfs2.ko 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/ 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 141209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/hfs.ko 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/ 2023-11-17T06:12:15.308 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 222817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/hfsplus.ko 2023-11-17T06:12:15.309 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/ 2023-11-17T06:12:15.309 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 192329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/hpfs.ko 2023-11-17T06:12:15.309 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/ 2023-11-17T06:12:15.309 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 74065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/isofs.ko 2023-11-17T06:12:15.309 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/ 2023-11-17T06:12:15.309 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 419497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/jfs.ko 2023-11-17T06:12:15.309 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/ 2023-11-17T06:12:15.309 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 280313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/lockd.ko 2023-11-17T06:12:15.309 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/ 2023-11-17T06:12:15.310 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/minix.ko 2023-11-17T06:12:15.310 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/ 2023-11-17T06:12:15.310 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 124649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/netfs.ko 2023-11-17T06:12:15.310 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/ 2023-11-17T06:12:15.310 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/ 2023-11-17T06:12:15.310 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 81449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-17T06:12:15.310 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/ 2023-11-17T06:12:15.310 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 59449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-17T06:12:15.310 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/ 2023-11-17T06:12:15.310 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 117513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1055649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfs.ko 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv2.ko 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 120177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv3.ko 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 2041689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv4.ko 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/ 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/grace.ko 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/nfs_acl.ko 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/ 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1516809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/nfsd.ko 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/ 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 592833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/nilfs2.ko 2023-11-17T06:12:15.311 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/ 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-celtic.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-centeuro.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-croatian.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-cyrillic.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-gaelic.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-greek.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-iceland.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-inuit.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-roman.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-romanian.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-turkish.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ascii.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1250.ko 2023-11-17T06:12:15.312 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1251.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1255.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp737.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp775.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp850.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp852.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp855.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp857.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp860.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp861.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp862.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp863.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp864.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp865.ko 2023-11-17T06:12:15.313 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp866.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp869.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp874.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 94137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp932.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 142673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp936.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 165745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp949.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 118121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp950.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_euc-jp.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-1.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-13.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-14.ko 2023-11-17T06:12:15.314 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-15.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-2.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-3.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-4.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-5.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-6.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-7.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-9.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-r.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-ru.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-u.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_utf8.ko 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ 2023-11-17T06:12:15.315 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 219417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ntfs.ko 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 244409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 440737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 2592433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2.ko 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/ 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/omfs.ko 2023-11-17T06:12:15.316 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/ 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 352153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/overlay.ko 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ramoops.ko 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/ 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/qnx4.ko 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/ 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 46689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/qnx6.ko 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/ 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_tree.ko 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v1.ko 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v2.ko 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/ 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 532673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/reiserfs.ko 2023-11-17T06:12:15.317 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/ 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/romfs.ko 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/ 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/ 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 2668121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/cifs.ko 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/ 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_arc4.ko 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_md4.ko 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/ 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 134641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/squashfs.ko 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/ 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 90721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/sysv.ko 2023-11-17T06:12:15.318 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/ 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 247737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/udf.ko 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 162497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ufs.ko 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/ 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 4010729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/xfs.ko 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/ 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/ 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 75489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/locktorture.ko 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/ 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/test_udelay.ko 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/torture.ko 2023-11-17T06:12:15.319 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc-itu-t.ko 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc7.ko 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc8.ko 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/ 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libarc4.ko 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libdes.ko 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/interval_tree_test.ko 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/libcrc32c.ko 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lru_cache.ko 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/ 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4_compress.ko 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4hc_compress.ko 2023-11-17T06:12:15.320 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/ 2023-11-17T06:12:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/cordic.ko 2023-11-17T06:12:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/memory-notifier-error-inject.ko 2023-11-17T06:12:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/notifier-error-inject.ko 2023-11-17T06:12:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/percpu_test.ko 2023-11-17T06:12:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/pm-notifier-error-inject.ko 2023-11-17T06:12:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/ 2023-11-17T06:12:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 143433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/raid6_pq.ko 2023-11-17T06:12:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/rbtree_test.ko 2023-11-17T06:12:15.321 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/ 2023-11-17T06:12:15.322 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-17T06:12:15.322 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-kstrtox.ko 2023-11-17T06:12:15.322 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-string_helpers.ko 2023-11-17T06:12:15.322 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 4760425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_bpf.ko 2023-11-17T06:12:15.322 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_firmware.ko 2023-11-17T06:12:15.322 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_module.ko 2023-11-17T06:12:15.322 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_user_copy.ko 2023-11-17T06:12:15.323 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_bm.ko 2023-11-17T06:12:15.323 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_fsm.ko 2023-11-17T06:12:15.323 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_kmp.ko 2023-11-17T06:12:15.323 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/ 2023-11-17T06:12:15.323 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/xz_dec_test.ko 2023-11-17T06:12:15.323 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/ 2023-11-17T06:12:15.323 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/hwpoison-inject.ko 2023-11-17T06:12:15.323 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ 2023-11-17T06:12:15.323 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/ 2023-11-17T06:12:15.323 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/6lowpan.ko 2023-11-17T06:12:15.324 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_dest.ko 2023-11-17T06:12:15.324 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_fragment.ko 2023-11-17T06:12:15.324 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_hop.ko 2023-11-17T06:12:15.324 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 6985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-17T06:12:15.324 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_mobility.ko 2023-11-17T06:12:15.324 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_routing.ko 2023-11-17T06:12:15.324 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_udp.ko 2023-11-17T06:12:15.324 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/ 2023-11-17T06:12:15.324 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/garp.ko 2023-11-17T06:12:15.325 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/mrp.ko 2023-11-17T06:12:15.325 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/p8022.ko 2023-11-17T06:12:15.325 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/psnap.ko 2023-11-17T06:12:15.325 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/stp.ko 2023-11-17T06:12:15.325 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/ 2023-11-17T06:12:15.325 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 81737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/8021q.ko 2023-11-17T06:12:15.325 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/ 2023-11-17T06:12:15.325 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 198337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet.ko 2023-11-17T06:12:15.325 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_fd.ko 2023-11-17T06:12:15.326 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_rdma.ko 2023-11-17T06:12:15.326 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_virtio.ko 2023-11-17T06:12:15.326 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/ 2023-11-17T06:12:15.326 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 649297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/batman-adv.ko 2023-11-17T06:12:15.326 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/ 2023-11-17T06:12:15.326 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 63809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/br_netfilter.ko 2023-11-17T06:12:15.326 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 777689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/bridge.ko 2023-11-17T06:12:15.326 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ 2023-11-17T06:12:15.326 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-17T06:12:15.327 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-17T06:12:15.327 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-17T06:12:15.327 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-17T06:12:15.327 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-17T06:12:15.327 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-17T06:12:15.327 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-17T06:12:15.327 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-17T06:12:15.327 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-17T06:12:15.327 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-17T06:12:15.327 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 55929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtables.ko 2023-11-17T06:12:15.328 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/ 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1047497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/libceph.ko 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/ 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/pktgen.ko 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/ 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 194209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp.ko 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_diag.ko 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 57881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv4.ko 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv6.ko 2023-11-17T06:12:15.329 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/ 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 390473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/dsa_core.ko 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_brcm.ko 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_dsa.ko 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_none.ko 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_trailer.ko 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/ 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 99729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/hsr.ko 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 45233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 254625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154.ko 2023-11-17T06:12:15.330 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ah4.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/esp4.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/fou.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/gre.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/inet_diag.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_gre.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_tunnel.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_vti.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipcomp.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipip.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-17T06:12:15.331 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-17T06:12:15.332 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_bic.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_dctcp.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_diag.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_highspeed.ko 2023-11-17T06:12:15.333 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_htcp.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_hybla.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_illinois.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_lp.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_scalable.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_vegas.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_veno.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_westwood.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_yeah.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tunnel4.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_diag.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 41665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_tunnel.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-17T06:12:15.334 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ah6.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/esp6.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/fou6.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 80897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_gre.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 93577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_tunnel.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_vti.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ipcomp6.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/mip6.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-17T06:12:15.335 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-17T06:12:15.336 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 74073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/sit.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/tunnel6.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-17T06:12:15.337 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/ 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 82833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/af_key.ko 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/ 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_core.ko 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 25953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_eth.ko 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip.ko 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip6.ko 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_netlink.ko 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 53241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ppp.ko 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/ 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 47977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/lapb.ko 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/ 2023-11-17T06:12:15.338 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc.ko 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 267777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc2.ko 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/ 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 290417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/mac802154.ko 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/ 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/mpls_gso.ko 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 119585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set.ko 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 100297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 101441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-17T06:12:15.339 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 102817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 103481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 112849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 60329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 113129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 112585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 111585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 114465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 411729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-17T06:12:15.340 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-17T06:12:15.341 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conncount.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 408257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 118145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 107297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-17T06:12:15.342 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 37129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_log_syslog.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 95417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_irc.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_sip.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 44065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-17T06:12:15.343 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 615313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_tables.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 42561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 39785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_log.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_chain_nat.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_compat.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 40721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_ct.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fib.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_hash.ko 2023-11-17T06:12:15.344 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_limit.ko 2023-11-17T06:12:15.345 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_log.ko 2023-11-17T06:12:15.345 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_masq.ko 2023-11-17T06:12:15.345 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_nat.ko 2023-11-17T06:12:15.345 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_numgen.ko 2023-11-17T06:12:15.345 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_osf.ko 2023-11-17T06:12:15.345 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_queue.ko 2023-11-17T06:12:15.345 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_redir.ko 2023-11-17T06:12:15.345 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject.ko 2023-11-17T06:12:15.351 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject_inet.ko 2023-11-17T06:12:15.351 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_socket.ko 2023-11-17T06:12:15.352 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_synproxy.ko 2023-11-17T06:12:15.352 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_tproxy.ko 2023-11-17T06:12:15.352 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 89313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/x_tables.ko 2023-11-17T06:12:15.352 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_AUDIT.ko 2023-11-17T06:12:15.352 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-17T06:12:15.352 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-17T06:12:15.353 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-17T06:12:15.353 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 18169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CT.ko 2023-11-17T06:12:15.353 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_DSCP.ko 2023-11-17T06:12:15.353 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HL.ko 2023-11-17T06:12:15.353 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HMARK.ko 2023-11-17T06:12:15.353 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-17T06:12:15.353 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LED.ko 2023-11-17T06:12:15.354 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LOG.ko 2023-11-17T06:12:15.354 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-17T06:12:15.354 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NETMAP.ko 2023-11-17T06:12:15.354 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFLOG.ko 2023-11-17T06:12:15.354 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-17T06:12:15.354 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_RATEEST.ko 2023-11-17T06:12:15.355 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-17T06:12:15.355 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_SECMARK.ko 2023-11-17T06:12:15.355 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-17T06:12:15.355 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-17T06:12:15.355 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TEE.ko 2023-11-17T06:12:15.355 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TPROXY.ko 2023-11-17T06:12:15.356 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TRACE.ko 2023-11-17T06:12:15.356 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_addrtype.ko 2023-11-17T06:12:15.356 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_bpf.ko 2023-11-17T06:12:15.356 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cgroup.ko 2023-11-17T06:12:15.356 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cluster.ko 2023-11-17T06:12:15.356 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_comment.ko 2023-11-17T06:12:15.357 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connbytes.ko 2023-11-17T06:12:15.357 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlabel.ko 2023-11-17T06:12:15.357 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlimit.ko 2023-11-17T06:12:15.357 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connmark.ko 2023-11-17T06:12:15.357 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_conntrack.ko 2023-11-17T06:12:15.357 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cpu.ko 2023-11-17T06:12:15.357 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dccp.ko 2023-11-17T06:12:15.357 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_devgroup.ko 2023-11-17T06:12:15.357 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dscp.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ecn.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_esp.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hashlimit.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_helper.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hl.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipcomp.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_iprange.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipvs.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_l2tp.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_length.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_limit.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mac.ko 2023-11-17T06:12:15.358 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mark.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_multiport.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nat.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nfacct.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_osf.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_owner.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_physdev.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_pkttype.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_policy.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_quota.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_rateest.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_realm.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_recent.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_sctp.ko 2023-11-17T06:12:15.359 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_set.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 16089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_socket.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_state.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_statistic.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_string.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 8553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpmss.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpudp.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_time.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_u32.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/ 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/netlink_diag.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/ 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 12425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/nsh.ko 2023-11-17T06:12:15.360 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/ 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 380033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/openvswitch.ko 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-geneve.ko 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-gre.ko 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 11793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-vxlan.ko 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/ 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/af_packet_diag.ko 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/ 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 110201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/phonet.ko 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/pn_pep.ko 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/ 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 251481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds.ko 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 164937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_rdma.ko 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 67377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_tcp.ko 2023-11-17T06:12:15.361 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/ 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 819657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/rxrpc.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/ 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_csum.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_gact.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_ipt.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_mirred.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_nat.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 43449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_pedit.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_police.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_simple.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_skbedit.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_vlan.ko 2023-11-17T06:12:15.362 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_basic.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_bpf.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_cgroup.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_flow.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_fw.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 38489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_route.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 61409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_u32.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_cmp.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 13409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_ipset.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_meta.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_nbyte.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_text.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_u32.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 21649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_choke.ko 2023-11-17T06:12:15.363 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_codel.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 34633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_drr.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 33609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq_codel.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 35433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_gred.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 49601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hfsc.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hhf.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 66393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_htb.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_ingress.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 30273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio_lib.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_multiq.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 36137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_netem.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 27497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_pie.ko 2023-11-17T06:12:15.364 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_plug.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_prio.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 48793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_qfq.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 32905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_red.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 26881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfb.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 31353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfq.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_tbf.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 28105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_teql.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/ 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 929745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 19033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp_diag.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/ 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/ 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 336529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-17T06:12:15.365 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 54737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 1520161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/sunrpc.ko 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/ 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 707721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/ 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/diag.ko 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 862641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/tipc.ko 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/ 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/unix_diag.ko 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/ 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 85337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 68049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 96193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock.ko 2023-11-17T06:12:15.366 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 10705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 17521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/ 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 125177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/x25.ko 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/ 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 22657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_algo.ko 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 20649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 102257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_user.ko 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/ 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/ 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 15537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/irqbypass.ko 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 639863 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 623919 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias.bin 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 7663 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin 2023-11-17T06:12:15.367 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 23428 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.alias.bin 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 9821 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.bin 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 70004 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.modinfo 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 146313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 232548 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep.bin 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 210 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.devname 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 72606 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.order 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 879 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.softdep 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 254438 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 309363 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols.bin 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/ 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/ 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/ 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:12:15.368 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 175 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/changelog.Debian.gz 2023-11-17T06:12:15.369 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-r--r-- root/root 691 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/copyright 2023-11-17T06:12:15.369 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:15.370 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:15.370 DEBUG:teuthology.orchestra.run.smithi093:> egrep '(submenu|menuentry.*6.6.0-rc5-g5b73517e0e2f).*{' /boot/grub/grub.cfg 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/af_alg.ko 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_hash.ko 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/algif_skcipher.ko 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ansi_cprng.ko 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/anubis.ko 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/arc4.ko 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/ 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/ 2023-11-17T06:12:15.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_memcpy.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_pq.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_tx.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/async_xor.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/async_tx/raid6test.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authenc.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/authencesn.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blake2b_generic.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_common.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/blowfish_generic.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/camellia_generic.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast5_generic.ko 2023-11-17T06:12:15.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast6_generic.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cast_common.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/ccm.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cmac.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crc32_generic.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cryptd.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_engine.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_simd.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/crypto_user.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/cts.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/des_generic.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/dh_generic.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/echainiv.ko 2023-11-17T06:12:15.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/essiv.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/fcrypt.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/khazad.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lrw.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/lz4hc.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/md4.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/michael_mic.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcbc.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/pcrypt.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/rmd160.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/seed.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/serpent_generic.ko 2023-11-17T06:12:15.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 149193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tcrypt.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/tea.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_common.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/twofish_generic.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/vmac.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/wp512.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xcbc.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xor.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xts.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/crypto/xxhash_generic.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_extlog.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-17T06:12:15.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/acpi_pad.ko 2023-11-17T06:12:15.388 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/ 2023-11-17T06:12:15.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/apei/einj.ko 2023-11-17T06:12:15.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/ec_sys.ko 2023-11-17T06:12:15.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/platform_profile.ko 2023-11-17T06:12:15.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbs.ko 2023-11-17T06:12:15.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/sbshc.ko 2023-11-17T06:12:15.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 103025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/acpi/video.ko 2023-11-17T06:12:15.396 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ 2023-11-17T06:12:15.442 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/acard-ahci.ko 2023-11-17T06:12:15.442 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 88865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci.ko 2023-11-17T06:12:15.442 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/ahci_platform.ko 2023-11-17T06:12:15.442 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 88289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci.ko 2023-11-17T06:12:15.442 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/libahci_platform.ko 2023-11-17T06:12:15.442 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_acpi.ko 2023-11-17T06:12:15.443 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ali.ko 2023-11-17T06:12:15.443 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_amd.ko 2023-11-17T06:12:15.443 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_artop.ko 2023-11-17T06:12:15.443 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atiixp.ko 2023-11-17T06:12:15.443 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_atp867x.ko 2023-11-17T06:12:15.443 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd640.ko 2023-11-17T06:12:15.443 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cmd64x.ko 2023-11-17T06:12:15.443 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_cypress.ko 2023-11-17T06:12:15.548 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_efar.ko 2023-11-17T06:12:15.548 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt366.ko 2023-11-17T06:12:15.548 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt37x.ko 2023-11-17T06:12:15.548 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-17T06:12:15.548 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-17T06:12:15.548 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it8213.ko 2023-11-17T06:12:15.548 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_it821x.ko 2023-11-17T06:12:15.548 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_jmicron.ko 2023-11-17T06:12:15.549 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_legacy.ko 2023-11-17T06:12:15.549 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_marvell.ko 2023-11-17T06:12:15.549 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_mpiix.ko 2023-11-17T06:12:15.549 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_netcell.ko 2023-11-17T06:12:15.549 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ninja32.ko 2023-11-17T06:12:15.549 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87410.ko 2023-11-17T06:12:15.549 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_ns87415.ko 2023-11-17T06:12:15.549 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_oldpiix.ko 2023-11-17T06:12:15.549 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_opti.ko 2023-11-17T06:12:15.549 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_optidma.ko 2023-11-17T06:12:15.551 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pcmcia.ko 2023-11-17T06:12:15.551 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-17T06:12:15.551 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-17T06:12:15.551 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_piccolo.ko 2023-11-17T06:12:15.551 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_radisys.ko 2023-11-17T06:12:15.551 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rdc.ko 2023-11-17T06:12:15.551 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_rz1000.ko 2023-11-17T06:12:15.551 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sch.ko 2023-11-17T06:12:15.551 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_serverworks.ko 2023-11-17T06:12:15.551 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sil680.ko 2023-11-17T06:12:15.581 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_sl82c105.ko 2023-11-17T06:12:15.581 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_triflex.ko 2023-11-17T06:12:15.581 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pata_via.ko 2023-11-17T06:12:15.581 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/pdc_adma.ko 2023-11-17T06:12:15.581 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_inic162x.ko 2023-11-17T06:12:15.581 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 83345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_mv.ko 2023-11-17T06:12:15.581 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 70393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_nv.ko 2023-11-17T06:12:15.581 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_promise.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_qstor.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sil24.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sis.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_svw.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_sx4.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_uli.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_via.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ata/sata_vsc.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/auxdisplay/ks0108.ko 2023-11-17T06:12:15.582 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/ 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 124473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/bcma/bcma.ko 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/ 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/ 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 113665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/aoe/aoe.ko 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/ 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 965585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/drbd/drbd.ko 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 173225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/floppy.ko 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/ 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 94297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 115793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/nbd.ko 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/ 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 110449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/null_blk/null_blk.ko 2023-11-17T06:12:15.583 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 98193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/pktcdvd.ko 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 263769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/rbd.ko 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/ 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 98145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/ 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/block/zram/zram.ko 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/applicom.ko 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hangcheck-timer.ko 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/ 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-17T06:12:15.584 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/via-rng.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 148601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 139313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 70921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/lp.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/ 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 84097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/mwave/mwave.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/nvram.ko 2023-11-17T06:12:15.585 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/ppdev.ko 2023-11-17T06:12:15.586 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tlclk.ko 2023-11-17T06:12:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/ 2023-11-17T06:12:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-17T06:12:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-17T06:12:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-17T06:12:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-17T06:12:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-17T06:12:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-17T06:12:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-17T06:12:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/ 2023-11-17T06:12:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-17T06:12:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-17T06:12:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-17T06:12:15.829 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/ 2023-11-17T06:12:15.830 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-palmas.ko 2023-11-17T06:12:15.830 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-si5351.ko 2023-11-17T06:12:15.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-twl6040.ko 2023-11-17T06:12:15.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/clk/clk-wm831x.ko 2023-11-17T06:12:15.832 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/ 2023-11-17T06:12:15.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-17T06:12:15.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-17T06:12:15.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-17T06:12:15.834 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ 2023-11-17T06:12:15.834 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ 2023-11-17T06:12:15.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 70801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-17T06:12:15.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 243025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/ccp/ccp.ko 2023-11-17T06:12:15.838 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/ 2023-11-17T06:12:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/ 2023-11-17T06:12:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-17T06:12:15.841 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 438761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-17T06:12:15.842 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-17T06:12:15.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-17T06:12:15.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-aes.ko 2023-11-17T06:12:15.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/padlock-sha.ko 2023-11-17T06:12:15.844 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/ 2023-11-17T06:12:15.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 68857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-17T06:12:15.846 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/ 2023-11-17T06:12:15.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dca/dca.ko 2023-11-17T06:12:15.848 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ 2023-11-17T06:12:15.849 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/ 2023-11-17T06:12:15.850 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-17T06:12:15.851 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ 2023-11-17T06:12:15.852 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 122569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-17T06:12:15.853 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ 2023-11-17T06:12:15.854 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 79953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/amd64_edac.ko 2023-11-17T06:12:15.855 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/e752x_edac.ko 2023-11-17T06:12:15.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 63617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/edac_mce_amd.ko 2023-11-17T06:12:15.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3000_edac.ko 2023-11-17T06:12:15.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i3200_edac.ko 2023-11-17T06:12:15.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5100_edac.ko 2023-11-17T06:12:15.860 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i5400_edac.ko 2023-11-17T06:12:15.861 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7300_edac.ko 2023-11-17T06:12:15.862 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 52041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i7core_edac.ko 2023-11-17T06:12:15.862 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/i82975x_edac.ko 2023-11-17T06:12:15.863 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/ie31200_edac.ko 2023-11-17T06:12:15.870 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 56825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/sb_edac.ko 2023-11-17T06:12:15.870 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/edac/x38_edac.ko 2023-11-17T06:12:15.870 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/ 2023-11-17T06:12:15.871 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-gpio.ko 2023-11-17T06:12:15.871 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max14577.ko 2023-11-17T06:12:15.872 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max77693.ko 2023-11-17T06:12:15.872 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-max8997.ko 2023-11-17T06:12:15.872 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-palmas.ko 2023-11-17T06:12:15.873 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-17T06:12:15.873 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-17T06:12:15.874 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/ 2023-11-17T06:12:15.874 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-17T06:12:15.874 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/ 2023-11-17T06:12:15.875 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-17T06:12:15.875 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-17T06:12:15.875 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/ 2023-11-17T06:12:15.876 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-17T06:12:15.876 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-17T06:12:15.877 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-arizona.ko 2023-11-17T06:12:15.877 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9052.ko 2023-11-17T06:12:15.877 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-da9055.ko 2023-11-17T06:12:15.878 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-dln2.ko 2023-11-17T06:12:15.878 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 77849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-17T06:12:15.879 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-generic.ko 2023-11-17T06:12:15.879 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ich.ko 2023-11-17T06:12:15.879 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-17T06:12:15.883 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-kempld.ko 2023-11-17T06:12:15.884 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-17T06:12:15.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max7300.ko 2023-11-17T06:12:15.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max730x.ko 2023-11-17T06:12:15.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-max732x.ko 2023-11-17T06:12:15.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-17T06:12:15.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-17T06:12:15.888 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-17T06:12:15.888 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-17T06:12:15.888 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch.ko 2023-11-17T06:12:15.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-17T06:12:15.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-17T06:12:15.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-17T06:12:15.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-17T06:12:15.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-17T06:12:15.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-vx855.ko 2023-11-17T06:12:15.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-17T06:12:15.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-17T06:12:15.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-17T06:12:15.893 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/ 2023-11-17T06:12:15.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-a4tech.ko 2023-11-17T06:12:15.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-apple.ko 2023-11-17T06:12:15.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-appleir.ko 2023-11-17T06:12:15.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-aureal.ko 2023-11-17T06:12:15.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-axff.ko 2023-11-17T06:12:15.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-belkin.ko 2023-11-17T06:12:15.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cherry.ko 2023-11-17T06:12:15.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-chicony.ko 2023-11-17T06:12:15.898 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cp2112.ko 2023-11-17T06:12:15.898 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-cypress.ko 2023-11-17T06:12:15.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-dr.ko 2023-11-17T06:12:15.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elecom.ko 2023-11-17T06:12:15.900 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-elo.ko 2023-11-17T06:12:15.900 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-emsff.ko 2023-11-17T06:12:15.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ezkey.ko 2023-11-17T06:12:15.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gaff.ko 2023-11-17T06:12:15.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-generic.ko 2023-11-17T06:12:15.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gt683r.ko 2023-11-17T06:12:15.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-gyration.ko 2023-11-17T06:12:15.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-17T06:12:15.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-17T06:12:15.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-holtekff.ko 2023-11-17T06:12:15.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-hyperv.ko 2023-11-17T06:12:15.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-icade.ko 2023-11-17T06:12:15.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kensington.ko 2023-11-17T06:12:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-keytouch.ko 2023-11-17T06:12:15.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-kye.ko 2023-11-17T06:12:15.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lcpower.ko 2023-11-17T06:12:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-led.ko 2023-11-17T06:12:15.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lenovo.ko 2023-11-17T06:12:15.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-lg-g15.ko 2023-11-17T06:12:15.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 58185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-17T06:12:15.909 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 101369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-17T06:12:15.909 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 80993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-logitech.ko 2023-11-17T06:12:15.909 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-magicmouse.ko 2023-11-17T06:12:15.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-microsoft.ko 2023-11-17T06:12:15.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-monterey.ko 2023-11-17T06:12:15.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-multitouch.ko 2023-11-17T06:12:15.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ntrig.ko 2023-11-17T06:12:15.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-ortek.ko 2023-11-17T06:12:15.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-penmount.ko 2023-11-17T06:12:15.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-petalynx.ko 2023-11-17T06:12:15.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 72937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-picolcd.ko 2023-11-17T06:12:15.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-pl.ko 2023-11-17T06:12:15.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-plantronics.ko 2023-11-17T06:12:15.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-primax.ko 2023-11-17T06:12:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-rmi.ko 2023-11-17T06:12:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-17T06:12:15.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-common.ko 2023-11-17T06:12:15.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-17T06:12:15.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-17T06:12:15.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-17T06:12:15.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-17T06:12:15.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-17T06:12:15.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-17T06:12:15.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-17T06:12:15.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-17T06:12:15.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-17T06:12:15.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-roccat.ko 2023-11-17T06:12:15.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-saitek.ko 2023-11-17T06:12:15.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-samsung.ko 2023-11-17T06:12:15.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-17T06:12:15.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sjoy.ko 2023-11-17T06:12:15.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sony.ko 2023-11-17T06:12:15.921 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-speedlink.ko 2023-11-17T06:12:15.921 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-steelseries.ko 2023-11-17T06:12:15.921 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-sunplus.ko 2023-11-17T06:12:15.921 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-17T06:12:15.922 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tivo.ko 2023-11-17T06:12:15.922 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-tmff.ko 2023-11-17T06:12:15.923 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-topseed.ko 2023-11-17T06:12:15.923 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-twinhan.ko 2023-11-17T06:12:15.924 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 71073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-uclogic.ko 2023-11-17T06:12:15.924 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-waltop.ko 2023-11-17T06:12:15.924 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 143473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-wiimote.ko 2023-11-17T06:12:15.925 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-xinmo.ko 2023-11-17T06:12:15.925 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zpff.ko 2023-11-17T06:12:15.926 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid-zydacron.ko 2023-11-17T06:12:15.926 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 267825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/hid.ko 2023-11-17T06:12:15.926 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/uhid.ko 2023-11-17T06:12:15.927 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/ 2023-11-17T06:12:15.927 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 125721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-17T06:12:15.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-17T06:12:15.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-17T06:12:15.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 217873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hid/wacom.ko 2023-11-17T06:12:15.929 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/ 2023-11-17T06:12:15.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 64201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_balloon.ko 2023-11-17T06:12:15.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 89625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_utils.ko 2023-11-17T06:12:15.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 305465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hv/hv_vmbus.ko 2023-11-17T06:12:15.930 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ 2023-11-17T06:12:15.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 66521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru.ko 2023-11-17T06:12:15.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 61393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/abituguru3.ko 2023-11-17T06:12:15.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-17T06:12:15.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7414.ko 2023-11-17T06:12:15.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ad7418.ko 2023-11-17T06:12:15.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adc128d818.ko 2023-11-17T06:12:15.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1025.ko 2023-11-17T06:12:15.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 97977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1026.ko 2023-11-17T06:12:15.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1029.ko 2023-11-17T06:12:15.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 45553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm1031.ko 2023-11-17T06:12:15.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adm9240.ko 2023-11-17T06:12:15.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ads7828.ko 2023-11-17T06:12:15.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7410.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7411.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 74433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7462.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7470.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7475.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/adt7x10.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/amc6821.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 55265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/applesmc.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asb100.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 58617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asc7621.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/atxp1.ko 2023-11-17T06:12:15.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/coretemp.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 99601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/dme1737.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds1621.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ds620.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc1403.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc2103.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/emc6w201.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 66985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71805f.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 94457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f71882fg.ko 2023-11-17T06:12:15.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/f75375s.ko 2023-11-17T06:12:15.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fam15h_power.ko 2023-11-17T06:12:15.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 55449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/fschmd.ko 2023-11-17T06:12:15.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g760a.ko 2023-11-17T06:12:15.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/g762.ko 2023-11-17T06:12:15.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 46801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl518sm.ko 2023-11-17T06:12:15.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 45529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/gl520sm.ko 2023-11-17T06:12:15.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hih6130.ko 2023-11-17T06:12:15.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5500_temp.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/i5k_amb.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmaem.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ibmpex.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina209.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ina2xx.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 130449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/it87.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/jc42.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k10temp.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/k8temp.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lineage-pem.ko 2023-11-17T06:12:15.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 48601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm63.ko 2023-11-17T06:12:15.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm73.ko 2023-11-17T06:12:15.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm75.ko 2023-11-17T06:12:15.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm77.ko 2023-11-17T06:12:15.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm78.ko 2023-11-17T06:12:15.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm80.ko 2023-11-17T06:12:15.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm83.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 72833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm85.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 46153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm87.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm90.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm92.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 108841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm93.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95234.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95241.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/lm95245.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc2945.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4151.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4215.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4222.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4245.ko 2023-11-17T06:12:15.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4260.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/ltc4261.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max16065.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1619.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max1668.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max197.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6639.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6650.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/max6697.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/mcp3021.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6683.ko 2023-11-17T06:12:15.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 119817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775-core.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct6775.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 59737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/nct7802.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 82337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87360.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pc87427.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pcf8591.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-17T06:12:15.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 82577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/powr1220.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5627.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch5636.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht15.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sht21.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/shtc1.ko 2023-11-17T06:12:15.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/sis5595.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47b397.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m1.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/smsc47m192.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/thmc50.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp102.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp103.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp401.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/tmp421.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via-cputemp.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/via686a.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 52457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt1211.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/vt8231.ko 2023-11-17T06:12:15.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 57513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627ehf.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83627hf.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 71345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83781d.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 63289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83791d.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 71321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83792d.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 101473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83793.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 119505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83795.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l785ts.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/w83l786ng.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/ 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/ 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-17T06:12:15.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/ 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 6929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-17T06:12:15.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-17T06:12:15.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-mux.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-smbus.ko 2023-11-17T06:12:15.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/i2c-stub.ko 2023-11-17T06:12:15.949 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/ 2023-11-17T06:12:15.949 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-17T06:12:15.949 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-17T06:12:15.949 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 273609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 879969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_core.ko 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 69337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 324217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 97985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 282273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 66201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 493073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-17T06:12:15.950 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/ 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 419737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/ 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 739025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 296625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 153697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/ 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 168969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 263081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-17T06:12:15.951 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 100241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 111425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 128753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 129529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/evbug.ko 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/ff-memless.ko 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/ 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-17T06:12:15.952 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/gameport/gameport.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/joydev.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/ 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8323.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/lm8333.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-17T06:12:15.953 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt1070.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/qt2160.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/stowaway.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-17T06:12:15.954 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/matrix-keymap.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/ 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/appletouch.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/bcm5974.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 123681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/cyapatp.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 89449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 335977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/psmouse.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/sermouse.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/ 2023-11-17T06:12:15.955 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 109873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/altera_ps2.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/arc_ps2.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ct82c710.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/parkbd.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/pcips2.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/ps2mult.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serio_raw.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/serio/serport.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/input/sparse-keymap.ko 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/ 2023-11-17T06:12:15.956 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/ 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/ 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-88pm860x.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-adp5520.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 59753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-bd2802.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-blinkm.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da903x.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-da9052.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-gpio.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3530.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3533.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm355x.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lm3642.ko 2023-11-17T06:12:15.957 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp3944.ko 2023-11-17T06:12:15.958 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-lp8788.ko 2023-11-17T06:12:15.958 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-max8997.ko 2023-11-17T06:12:15.958 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-mc13783.ko 2023-11-17T06:12:15.958 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-17T06:12:15.958 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca9532.ko 2023-11-17T06:12:15.958 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca955x.ko 2023-11-17T06:12:15.958 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-pca963x.ko 2023-11-17T06:12:15.958 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-ss4200.ko 2023-11-17T06:12:15.958 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-tca6507.ko 2023-11-17T06:12:15.958 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-17T06:12:15.974 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/leds-wm8350.ko 2023-11-17T06:12:15.974 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ 2023-11-17T06:12:15.974 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-17T06:12:15.974 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-17T06:12:15.974 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-17T06:12:15.974 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-17T06:12:15.974 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-17T06:12:15.974 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-17T06:12:15.974 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-17T06:12:15.974 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-17T06:12:16.020 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/ 2023-11-17T06:12:16.020 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/ 2023-11-17T06:12:16.020 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 654969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/bcache/bcache.ko 2023-11-17T06:12:16.020 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bio-prison.ko 2023-11-17T06:12:16.020 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 89601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-bufio.ko 2023-11-17T06:12:16.058 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache-smq.ko 2023-11-17T06:12:16.058 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 156009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-cache.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 106897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-crypt.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-delay.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-era.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-flakey.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log-userspace.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-log.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-mirror.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 78033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-multipath.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-queue-length.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 70825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-raid.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-region-hash.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-round-robin.ko 2023-11-17T06:12:16.059 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-service-time.ko 2023-11-17T06:12:16.060 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-snapshot.ko 2023-11-17T06:12:16.060 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-switch.ko 2023-11-17T06:12:16.060 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 181865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-thin-pool.ko 2023-11-17T06:12:16.060 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-verity.ko 2023-11-17T06:12:16.060 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/dm-zero.ko 2023-11-17T06:12:16.060 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/faulty.ko 2023-11-17T06:12:16.060 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/linear.ko 2023-11-17T06:12:16.060 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/multipath.ko 2023-11-17T06:12:16.067 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/ 2023-11-17T06:12:16.067 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 199937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-17T06:12:16.067 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid0.ko 2023-11-17T06:12:16.067 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 113073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid1.ko 2023-11-17T06:12:16.067 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 158681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid10.ko 2023-11-17T06:12:16.276 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 395721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/md/raid456.ko 2023-11-17T06:12:16.276 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/ 2023-11-17T06:12:16.276 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/ 2023-11-17T06:12:16.276 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 178137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptbase.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 63385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptctl.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptfc.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptlan.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 123321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptsas.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 79041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptscsih.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/message/fusion/mptspi.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm800.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm805.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/88pm80x.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona-i2c.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 123721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/arizona.ko 2023-11-17T06:12:16.277 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/bcm590xx.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/dln2.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/janz-cmodio.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/kempld-core.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-core.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lp3943.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_ich.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/lpc_sch.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/max8907.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/menf21bmc.ko 2023-11-17T06:12:16.278 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/pcf50633.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/retu-mfd.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 80425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/si476x-core.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 48457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/sm501.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps65010.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/tps6507x.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/viperboard.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/vx855.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wl1273-core.ko 2023-11-17T06:12:16.279 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/mfd/wm8994.ko 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 48489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ad525x_dpot.ko 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/ 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 46585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds9802als.ko 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/apds990x.ko 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 45593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/bh1770glc.ko 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/ 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/c2port/core.ko 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/ 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/cb710/cb710.ko 2023-11-17T06:12:16.280 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ds1682.ko 2023-11-17T06:12:16.281 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/dummy-irq.ko 2023-11-17T06:12:16.281 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/ 2023-11-17T06:12:16.298 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/echo/echo.ko 2023-11-17T06:12:16.298 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/ 2023-11-17T06:12:16.298 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/at24.ko 2023-11-17T06:12:16.298 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-17T06:12:16.298 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-17T06:12:16.298 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/eeprom/max6875.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/enclosure.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/ 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 152201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hmc6352.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/hpilo.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 72129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ics932s401.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29003.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/isl29020.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/ 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-17T06:12:16.299 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/ 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 125209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-me.ko 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 56521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei-txe.ko 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 310113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/mei/mei.ko 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/phantom.ko 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/ 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 74265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_7xx1.ko 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tifm_core.ko 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/tsl2550.ko 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 48697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_balloon.ko 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/ 2023-11-17T06:12:16.301 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 183609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/ 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 490129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/bonding/bonding.ko 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/ 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/ 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 106033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 453737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/dummy.ko 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/eql.ko 2023-11-17T06:12:16.302 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ 2023-11-17T06:12:16.303 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/ 2023-11-17T06:12:16.303 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 45785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-17T06:12:16.303 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-17T06:12:16.303 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 130553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-17T06:12:16.303 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 68849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-17T06:12:16.303 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ 2023-11-17T06:12:16.303 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-17T06:12:16.303 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 59689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 99113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/ 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/ 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 69201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/ 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 59585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/ 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/ 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-17T06:12:16.304 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 87297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/ 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 97337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 104673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 90257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 81569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 69729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/ 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 78401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-17T06:12:16.305 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 176761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1421497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 128569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 132089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 312081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/ 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 323513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/ 2023-11-17T06:12:16.306 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-17T06:12:16.378 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 193497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-17T06:12:16.378 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-17T06:12:16.378 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 347417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-17T06:12:16.378 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-17T06:12:16.378 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1044433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-17T06:12:16.378 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 166193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/ 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 204345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/ 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 69449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 141225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-17T06:12:16.379 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-17T06:12:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 62817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-17T06:12:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-17T06:12:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/ 2023-11-17T06:12:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-17T06:12:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 62833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-17T06:12:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 45721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/dnet.ko 2023-11-17T06:12:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-17T06:12:16.380 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/ 2023-11-17T06:12:16.384 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-17T06:12:16.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 281137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-17T06:12:16.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ethoc.ko 2023-11-17T06:12:16.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fealnx.ko 2023-11-17T06:12:16.484 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/ 2023-11-17T06:12:16.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 45345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-17T06:12:16.484 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 90465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 295577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 584497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 246209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 925697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-17T06:12:16.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 302849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/ 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 514681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 93593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 734305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 151769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 86921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/jme.ko 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/ 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-17T06:12:16.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 102289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 122649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/ 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 727601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 278937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1113993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-17T06:12:16.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 95665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/ 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 108649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 73441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/ 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 150905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/ 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 136721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-17T06:12:16.488 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/ 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 43145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/ 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 227897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 87081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 672049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/ 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 43017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-17T06:12:16.489 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/ 2023-11-17T06:12:16.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 67385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-17T06:12:16.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 83985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-17T06:12:16.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-17T06:12:16.570 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 189801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-17T06:12:16.570 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/ 2023-11-17T06:12:16.570 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-17T06:12:16.570 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 104241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-17T06:12:16.570 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/ 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1053921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/ 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/ 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 63337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/ 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 61601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 67193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 73409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 68177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/ 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-17T06:12:16.571 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 486961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/ 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 103337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 166161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 66329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 78801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/ 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/ 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 86529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/ 2023-11-17T06:12:16.572 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 80273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 83633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/ 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 46241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/ 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/ 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/defxx.ko 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/ 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 216985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 77345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/geneve.ko 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/ 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 235521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-17T06:12:16.573 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/ 2023-11-17T06:12:16.717 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-17T06:12:16.717 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ifb.ko 2023-11-17T06:12:16.717 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 83769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 62209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvlan.ko 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/macvtap.ko 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/ 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mdio.ko 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/mii.ko 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 43953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/netconsole.ko 2023-11-17T06:12:16.718 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/nlmon.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/ 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/amd.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/bcm87xx.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/broadcom.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/cicada.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/davicom.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/et1011c.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/icplus.ko 2023-11-17T06:12:16.719 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/lxt.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 82049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/marvell.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 76177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/micrel.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/national.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 97857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/phylink.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/qsemi.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/realtek.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/smsc.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/ste10Xp.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/phy/vitesse.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/ 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 43569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/plip/plip.ko 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ 2023-11-17T06:12:16.720 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_async.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppoe.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pppox.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/ppp/pptp.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sb1000.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/ 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/slip/slip.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/sungem_phy.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 64385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/tap.ko 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/ 2023-11-17T06:12:16.721 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 106169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team.ko 2023-11-17T06:12:16.722 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-17T06:12:16.722 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-17T06:12:16.722 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-17T06:12:16.722 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_random.ko 2023-11-17T06:12:16.722 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-17T06:12:16.722 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 87017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/veth.ko 2023-11-17T06:12:16.722 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/ 2023-11-17T06:12:16.738 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 144297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-17T06:12:16.738 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/ 2023-11-17T06:12:16.738 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 297329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/vxlan/vxlan.ko 2023-11-17T06:12:16.738 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/ 2023-11-17T06:12:16.738 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 144649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-17T06:12:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ 2023-11-17T06:12:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ntb/ntb.ko 2023-11-17T06:12:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/ 2023-11-17T06:12:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/ 2023-11-17T06:12:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 264937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme-core.ko 2023-11-17T06:12:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 102209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/nvme/host/nvme.ko 2023-11-17T06:12:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/ 2023-11-17T06:12:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 133841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport.ko 2023-11-17T06:12:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_cs.ko 2023-11-17T06:12:16.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 84465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_pc.ko 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/parport/parport_serial.ko 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/ 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/ 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/pci-stub.ko 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 46529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pci/xen-pcifront.ko 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/ 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/i82092.ko 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 145809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia.ko 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 62137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-17T06:12:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/pd6729.ko 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 112889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/ 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/ 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/ 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/ 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/ 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 70153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/ 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/ 2023-11-17T06:12:16.789 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 67097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/acerhdf.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 59665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-17T06:12:16.790 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 127569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/hdaps.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/ 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 43497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/intel_ips.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-17T06:12:16.791 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 57569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/platform/x86/wmi.ko 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/ 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-17T06:12:16.792 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 55057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9030_battery.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/da9052-battery.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/gpio-charger.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-17T06:12:16.793 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max14577_charger.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17040_battery.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max17042_battery.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8903_charger.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/max8925_power.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/sbs-battery.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/test_power.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm831x_power.ko 2023-11-17T06:12:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/power/supply/wm8350_power.ko 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/ 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/ 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/ 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/clients/pps_parport.ko 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/pps/pps_core.ko 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 66385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp.ko 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ptp/ptp_kvm.ko 2023-11-17T06:12:16.795 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/ 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9052.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9055.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-da9063.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 68577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-17T06:12:16.796 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-em3027.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max6900.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8907.ko 2023-11-17T06:12:16.797 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8925.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8997.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-max8998.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-palmas.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 46633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-17T06:12:16.798 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/rtc/rtc-x1205.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 77617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-9xxx.ko 2023-11-17T06:12:16.799 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 57665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-sas.ko 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 55169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/3w-xxxx.ko 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 135185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/BusLogic.ko 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/a100u2w.ko 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/ 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 272305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 100617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/advansys.ko 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/ 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 356265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 295801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/ 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 189185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/am53c974.ko 2023-11-17T06:12:16.800 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/ 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 106881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/atp870u.ko 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/ 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 246985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/ 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1171945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bfa/bfa.ko 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/ 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 237273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/ 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 115369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-17T06:12:16.801 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ch.ko 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/ 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 308921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/ 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 76145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 101449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 146689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 75553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dc395x.ko 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/dmx3191d.ko 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/ 2023-11-17T06:12:16.802 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 212425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/esp_scsi.ko 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/ 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 78209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 158505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fdomain.ko 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/ 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 263489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/fnic/fnic.ko 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 201817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hpsa.ko 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hptiop.ko 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/hv_storvsc.ko 2023-11-17T06:12:16.803 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/imm.ko 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/initio.ko 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 266537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ipr.ko 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 101881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ips.ko 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/ 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 317153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/isci/isci.ko 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 52961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/ 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 314865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libfc/libfc.ko 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 145585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi.ko 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/ 2023-11-17T06:12:16.804 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 216665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/libsas/libsas.ko 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/ 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 2197249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/ 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 73569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 310617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 84721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/megaraid.ko 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/ 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 659777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/ 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 119561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 78129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/mvumi.ko 2023-11-17T06:12:16.805 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/ 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 81625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/ 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 364105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 123617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/pmcraid.ko 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ppa.ko 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 55361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla1280.ko 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/ 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1876625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 85289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-17T06:12:16.806 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/ 2023-11-17T06:12:16.807 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 559033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-17T06:12:16.807 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/qlogicfas408.ko 2023-11-17T06:12:16.807 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/raid_class.ko 2023-11-17T06:12:16.807 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 238825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_debug.ko 2023-11-17T06:12:16.807 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 173937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-17T06:12:16.807 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 279313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-17T06:12:16.807 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 97729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-17T06:12:16.807 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 73881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-17T06:12:16.807 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-17T06:12:16.807 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/ses.ko 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 115889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/st.ko 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 46825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/stex.ko 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 162121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/virtio_scsi.ko 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/wd719x.ko 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/scsi/xen-scsifront.ko 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 129441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ssb/ssb.ko 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/ 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/ 2023-11-17T06:12:16.808 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 736601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-17T06:12:16.809 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/ 2023-11-17T06:12:16.809 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-17T06:12:16.809 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_file.ko 2023-11-17T06:12:16.809 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 43025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_iblock.ko 2023-11-17T06:12:16.809 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 930321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_mod.ko 2023-11-17T06:12:16.809 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_pscsi.ko 2023-11-17T06:12:16.809 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 122521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/target_core_user.ko 2023-11-17T06:12:16.809 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/ 2023-11-17T06:12:16.809 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 75593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-17T06:12:16.809 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/ 2023-11-17T06:12:16.810 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/ 2023-11-17T06:12:16.810 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-17T06:12:16.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-17T06:12:16.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-17T06:12:16.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-17T06:12:16.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-17T06:12:16.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-17T06:12:16.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-17T06:12:16.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-17T06:12:16.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-17T06:12:16.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-17T06:12:16.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-17T06:12:16.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-17T06:12:16.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-17T06:12:16.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-17T06:12:16.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-17T06:12:16.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-17T06:12:16.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-17T06:12:16.811 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 78425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 57865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/moxa.ko 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 50953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/mxser.ko 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 108601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_gsm.ko 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/n_hdlc.ko 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 67929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/nozomi.ko 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/ 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/ 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-17T06:12:16.812 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 59497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/altera_uart.ko 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/arc_uart.ko 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 72425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/ 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 103073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/rp2.ko 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 52817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/ 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ 2023-11-17T06:12:16.813 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 531265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-17T06:12:16.814 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ 2023-11-17T06:12:16.814 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-17T06:12:16.814 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-17T06:12:16.814 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/ 2023-11-17T06:12:16.814 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio.ko 2023-11-17T06:12:16.814 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_aec.ko 2023-11-17T06:12:16.814 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_cif.ko 2023-11-17T06:12:16.814 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-17T06:12:16.814 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_mf624.ko 2023-11-17T06:12:16.814 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_netx.ko 2023-11-17T06:12:16.815 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pci_generic.ko 2023-11-17T06:12:16.815 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-17T06:12:16.815 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/uio/uio_sercos3.ko 2023-11-17T06:12:16.815 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/ 2023-11-17T06:12:16.815 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/ 2023-11-17T06:12:16.815 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 73297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-17T06:12:16.815 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ 2023-11-17T06:12:16.815 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 144377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-17T06:12:16.815 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-17T06:12:16.815 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-17T06:12:16.816 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-17T06:12:16.816 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/ 2023-11-17T06:12:16.816 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 87089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-acm.ko 2023-11-17T06:12:16.816 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-17T06:12:16.816 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usblp.ko 2023-11-17T06:12:16.816 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 89857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/class/usbtmc.ko 2023-11-17T06:12:16.816 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ 2023-11-17T06:12:16.816 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/common/ulpi.ko 2023-11-17T06:12:16.816 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/ 2023-11-17T06:12:16.817 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-17T06:12:16.817 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/ 2023-11-17T06:12:16.817 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-17T06:12:16.817 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-17T06:12:16.817 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 444553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-17T06:12:16.817 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/ 2023-11-17T06:12:16.817 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/ 2023-11-17T06:12:16.817 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-17T06:12:16.817 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-17T06:12:16.817 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-17T06:12:16.818 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-17T06:12:16.818 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-17T06:12:16.818 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-17T06:12:16.818 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 92489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-17T06:12:16.818 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-17T06:12:16.818 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 122081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-17T06:12:16.818 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 57617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-17T06:12:16.818 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-17T06:12:16.818 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-17T06:12:16.819 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 57729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-17T06:12:16.819 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 85609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-17T06:12:16.819 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-17T06:12:16.819 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 58113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-17T06:12:16.819 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 67337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/ 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-17T06:12:16.820 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-17T06:12:16.830 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-17T06:12:16.830 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 62185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-17T06:12:16.830 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-17T06:12:16.830 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 161225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-17T06:12:16.830 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/ 2023-11-17T06:12:16.830 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-17T06:12:16.830 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-17T06:12:16.830 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 157681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-17T06:12:16.830 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-17T06:12:16.830 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 52721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 69705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 56033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 76057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 75073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 73169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 65809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 66097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 81505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 156073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-17T06:12:16.831 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 80113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 87353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 78873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/sl811_cs.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/ 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/mdc800.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/image/microtek.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/adutux.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/appledisplay.ko 2023-11-17T06:12:16.832 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/cytherm.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ehset.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi26.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/emi62.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ezusb.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/idmouse.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/iowarrior.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/ldusb.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/legousbtower.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/lvstest.ko 2023-11-17T06:12:16.833 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/ 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 64841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usb3503.ko 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usblcd.ko 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 70873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/usbtest.ko 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/uss720.ko 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/misc/yurex.ko 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/ 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 72953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/mon/usbmon.ko 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/ 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 301545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-17T06:12:16.834 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/ 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-generic.ko 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/aircable.ko 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ark3116.ko 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ch341.ko 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 70257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cp210x.ko 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cyberjack.ko 2023-11-17T06:12:16.835 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 58217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/empeg.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/f81232.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 175137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 137081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 124833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/io_ti.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 67769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipaq.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ipw.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ir-usb.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 58233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-17T06:12:16.836 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 107521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mct_u232.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/metro-usb.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 66449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7720.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 78217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mos7840.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 56337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/mxuport.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/navman.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/omninet.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/opticon.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 190633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/option.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/oti6858.ko 2023-11-17T06:12:16.837 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/pl2303.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcaux.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/qcserial.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/quatech2.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/safe_serial.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 51625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/sierra.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ssu100.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/symbolserial.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 61489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_debug.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-17T06:12:16.838 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 125609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/usbserial.ko 2023-11-17T06:12:16.839 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/visor.ko 2023-11-17T06:12:16.839 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/whiteheat.ko 2023-11-17T06:12:16.839 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-17T06:12:16.839 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-17T06:12:16.839 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ 2023-11-17T06:12:16.839 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 52913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/uas.ko 2023-11-17T06:12:16.839 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-17T06:12:16.839 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-17T06:12:16.839 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-karma.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 179969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/storage/usb-storage.ko 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/ 2023-11-17T06:12:16.840 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 67481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 72177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 107001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/ 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/ 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 154297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 108737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio.ko 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 77609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/ 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 113873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost.ko 2023-11-17T06:12:16.841 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 58089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_net.ko 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 89249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/vhost/vhost_scsi.ko 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/ 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/ 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/apple_bl.ko 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-17T06:12:16.842 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/bd6107.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lcd.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-17T06:12:16.843 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/ 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2482.ko 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/ds2490.ko 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/ 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-17T06:12:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 56425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 102673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/w1/wire.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/acquirewdt.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/advantechwdt.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-17T06:12:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/dw_wdt.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/hpwdt.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/i6300esb.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ib700wdt.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ibmasr.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-17T06:12:16.846 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/it87_wdt.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/machzwd.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/nv_tco.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22265 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/retu_wdt.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-17T06:12:16.847 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/softdog.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/via_wdt.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wdt_pci.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-17T06:12:16.848 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/watchdog/xen_wdt.ko 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/ 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-evtchn.ko 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntalloc.ko 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-gntdev.ko 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/ 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 176441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-privcmd.ko 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 71249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xen-scsiback.ko 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/ 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/ 2023-11-17T06:12:16.849 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 166425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/9p/9p.ko 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/ 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 61073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/adfs/adfs.ko 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/ 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 163593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/affs/affs.ko 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/ 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 932817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/afs/kafs.ko 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/ 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 101057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/autofs/autofs4.ko 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/ 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 64545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/befs/befs.ko 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/ 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/bfs/bfs.ko 2023-11-17T06:12:16.850 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/binfmt_misc.ko 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/ 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 3402585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/btrfs/btrfs.ko 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/ 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 306073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cachefiles/cachefiles.ko 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1323873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ceph/ceph.ko 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/ 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 100801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/coda/coda.ko 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/ 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 108393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/configfs/configfs.ko 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/ 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 29625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/cramfs/cramfs.ko 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/ 2023-11-17T06:12:16.851 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 642577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/dlm/dlm.ko 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/ 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/efs/efs.ko 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/ 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1505025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/f2fs/f2fs.ko 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/ 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fat/msdos.ko 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/ 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/freevxfs/freevxfs.ko 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/ 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 226481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fscache/fscache.ko 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/ 2023-11-17T06:12:16.852 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/fuse/cuse.ko 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/ 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1231529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/gfs2/gfs2.ko 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/ 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 141209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfs/hfs.ko 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/ 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 222817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hfsplus/hfsplus.ko 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/ 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 192329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/hpfs/hpfs.ko 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/ 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 74065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/isofs/isofs.ko 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/ 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 419497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/jfs/jfs.ko 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/ 2023-11-17T06:12:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 280313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/lockd/lockd.ko 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/ 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 89193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/minix/minix.ko 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/ 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 124649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/netfs/netfs.ko 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/ 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/ 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 81449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/ 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 59449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/ 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 117513 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1055649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfs.ko 2023-11-17T06:12:16.854 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 66441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv2.ko 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 120177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv3.ko 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 2041689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs/nfsv4.ko 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/ 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/grace.ko 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfs_common/nfs_acl.ko 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/ 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1516809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nfsd/nfsd.ko 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/ 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 592833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nilfs2/nilfs2.ko 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/ 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-celtic.ko 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-centeuro.ko 2023-11-17T06:12:16.855 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-croatian.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-cyrillic.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-gaelic.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-greek.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-iceland.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-inuit.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-roman.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-romanian.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/mac-turkish.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ascii.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1250.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1251.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp1255.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp737.ko 2023-11-17T06:12:16.856 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp775.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp850.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp852.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp855.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp857.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp860.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp861.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp862.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp863.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp864.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp865.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp866.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp869.ko 2023-11-17T06:12:16.857 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp874.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 94137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp932.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 142673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp936.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 165745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp949.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 118121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_cp950.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_euc-jp.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-1.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-13.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-14.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-15.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-2.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-3.ko 2023-11-17T06:12:16.858 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-4.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-5.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-6.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-7.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_iso8859-9.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-r.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-ru.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_koi8-u.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/nls/nls_utf8.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 219417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ntfs/ntfs.ko 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ 2023-11-17T06:12:16.859 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 244409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 440737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 2592433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2.ko 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/ 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/omfs/omfs.ko 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/ 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 352153 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/overlayfs/overlay.ko 2023-11-17T06:12:16.860 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/pstore/ramoops.ko 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/ 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx4/qnx4.ko 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/ 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 46689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/qnx6/qnx6.ko 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/ 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_tree.ko 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v1.ko 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/quota/quota_v2.ko 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/ 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 532673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/reiserfs/reiserfs.ko 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/ 2023-11-17T06:12:16.861 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/romfs/romfs.ko 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/ 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/ 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 2668121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/client/cifs.ko 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/ 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_arc4.ko 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/smb/common/cifs_md4.ko 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/ 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 134641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/squashfs/squashfs.ko 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/ 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 90721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/sysv/sysv.ko 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/ 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 247737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/udf/udf.ko 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ 2023-11-17T06:12:16.862 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 162497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/ufs/ufs.ko 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/ 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 4010729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/fs/xfs/xfs.ko 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/ 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/ 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 75489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/locking/locktorture.ko 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/ 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/time/test_udelay.ko 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/kernel/torture.ko 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 6833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc-itu-t.ko 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 6529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc7.ko 2023-11-17T06:12:16.863 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crc8.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/ 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libarc4.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/crypto/libdes.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/interval_tree_test.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/libcrc32c.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lru_cache.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/ 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4_compress.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/lz4/lz4hc_compress.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/ 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 6617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/math/cordic.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/memory-notifier-error-inject.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/notifier-error-inject.ko 2023-11-17T06:12:16.864 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/percpu_test.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/pm-notifier-error-inject.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/ 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 143433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/raid6/raid6_pq.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/rbtree_test.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/ 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-kstrtox.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test-string_helpers.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 4760425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_bpf.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_firmware.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 6369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_module.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/test_user_copy.ko 2023-11-17T06:12:16.865 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_bm.ko 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_fsm.ko 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/ts_kmp.ko 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/ 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/lib/xz/xz_dec_test.ko 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/ 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/mm/hwpoison-inject.ko 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/ 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 55737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/6lowpan.ko 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_dest.ko 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_fragment.ko 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_hop.ko 2023-11-17T06:12:16.866 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 6985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-17T06:12:16.867 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_mobility.ko 2023-11-17T06:12:16.867 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_routing.ko 2023-11-17T06:12:16.867 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/6lowpan/nhc_udp.ko 2023-11-17T06:12:16.867 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/ 2023-11-17T06:12:16.867 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/garp.ko 2023-11-17T06:12:16.882 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/mrp.ko 2023-11-17T06:12:16.883 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/p8022.ko 2023-11-17T06:12:16.883 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/psnap.ko 2023-11-17T06:12:16.883 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/802/stp.ko 2023-11-17T06:12:16.883 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/ 2023-11-17T06:12:16.883 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 81737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/8021q/8021q.ko 2023-11-17T06:12:16.883 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/ 2023-11-17T06:12:16.883 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 198337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet.ko 2023-11-17T06:12:16.883 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_fd.ko 2023-11-17T06:12:16.883 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26345 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_rdma.ko 2023-11-17T06:12:16.883 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/9p/9pnet_virtio.ko 2023-11-17T06:12:16.884 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/ 2023-11-17T06:12:16.884 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 649297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/batman-adv/batman-adv.ko 2023-11-17T06:12:16.884 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/ 2023-11-17T06:12:16.884 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 63809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/br_netfilter.ko 2023-11-17T06:12:16.884 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 777689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/bridge.ko 2023-11-17T06:12:16.884 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13217 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-17T06:12:16.885 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8385 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 55929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/ebtables.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/ 2023-11-17T06:12:16.886 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1047497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ceph/libceph.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/ 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 125697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/core/pktgen.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/ 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 194209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_diag.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 57881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv4.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dccp/dccp_ipv6.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/ 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 390473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/dsa_core.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_brcm.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_dsa.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_none.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/dsa/tag_trailer.ko 2023-11-17T06:12:16.887 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/ 2023-11-17T06:12:16.888 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 99729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/hsr/hsr.ko 2023-11-17T06:12:16.888 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ 2023-11-17T06:12:16.888 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ 2023-11-17T06:12:16.888 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 45233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-17T06:12:16.888 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 254625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154.ko 2023-11-17T06:12:16.888 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-17T06:12:16.888 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ah4.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/esp4.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 48401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/fou.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/gre.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 48657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/inet_diag.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_gre.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 61225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_tunnel.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ip_vti.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipcomp.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/ipip.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-17T06:12:16.889 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11305 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-17T06:12:16.890 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18225 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_bic.ko 2023-11-17T06:12:16.891 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_dctcp.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_diag.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_highspeed.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_htcp.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_hybla.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_illinois.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_lp.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_scalable.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_vegas.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_veno.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_westwood.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tcp_yeah.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/tunnel4.ko 2023-11-17T06:12:16.892 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_diag.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 41665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/udp_tunnel.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ah6.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/esp6.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/fou6.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 80897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_gre.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 93577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_tunnel.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ip6_vti.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/ipcomp6.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19017 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/mip6.ko 2023-11-17T06:12:16.893 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-17T06:12:16.894 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11121 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25945 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9009 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 74073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/sit.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/tunnel6.ko 2023-11-17T06:12:16.895 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/ 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 82833 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/key/af_key.ko 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/ 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 125281 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_core.ko 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 25953 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_eth.ko 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip.ko 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36713 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ip6.ko 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_netlink.ko 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 53241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/l2tp/l2tp_ppp.ko 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/ 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 47977 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/lapb/lapb.ko 2023-11-17T06:12:16.896 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/ 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc.ko 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 267777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/llc/llc2.ko 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/ 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 290417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mac802154/mac802154.ko 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/ 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/mpls/mpls_gso.ko 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 119585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set.ko 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26913 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 100297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-17T06:12:16.897 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 101441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-17T06:12:16.898 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 102817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-17T06:12:16.898 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 103481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-17T06:12:16.898 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 112849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-17T06:12:16.898 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 60329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-17T06:12:16.898 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 109593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-17T06:12:16.898 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 113129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-17T06:12:16.898 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 112585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-17T06:12:16.898 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 111585 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-17T06:12:16.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 114465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-17T06:12:16.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-17T06:12:16.899 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ 2023-11-17T06:12:16.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 411729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-17T06:12:16.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-17T06:12:16.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-17T06:12:16.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-17T06:12:16.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-17T06:12:16.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-17T06:12:16.899 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-17T06:12:16.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7689 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-17T06:12:16.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10681 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-17T06:12:16.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-17T06:12:16.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-17T06:12:16.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-17T06:12:16.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-17T06:12:16.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10993 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-17T06:12:16.901 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conncount.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 408257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33761 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 118145 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 107297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 66641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-17T06:12:16.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10113 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 89473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9593 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 37129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_log_syslog.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 95417 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11857 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_irc.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28929 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_sip.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 44065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 615313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nf_tables.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 42561 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink.ko 2023-11-17T06:12:16.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30569 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 39785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_log.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10457 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_chain_nat.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_compat.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 40721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_ct.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fib.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14185 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_hash.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_limit.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_log.ko 2023-11-17T06:12:16.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_masq.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14329 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_nat.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13673 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_numgen.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11841 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_osf.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_queue.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_redir.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_reject_inet.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_socket.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20369 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_synproxy.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/nft_tproxy.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 89313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/x_tables.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_AUDIT.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-17T06:12:16.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 18169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_CT.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_DSCP.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HL.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_HMARK.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13889 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LED.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_LOG.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11753 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NETMAP.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFLOG.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-17T06:12:16.906 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_RATEEST.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 14337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_SECMARK.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17361 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TEE.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TPROXY.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_TRACE.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_addrtype.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_bpf.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cgroup.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11209 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cluster.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_comment.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10465 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connbytes.ko 2023-11-17T06:12:16.907 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11081 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlabel.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connlimit.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_connmark.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_conntrack.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_cpu.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dccp.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_devgroup.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8801 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_dscp.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ecn.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_esp.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 43289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hashlimit.ko 2023-11-17T06:12:16.908 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_helper.ko 2023-11-17T06:12:16.909 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7865 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_hl.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11921 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipcomp.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_iprange.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11785 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_ipvs.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16041 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_l2tp.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8001 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_length.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_limit.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7545 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mac.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_mark.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11825 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_multiport.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13817 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nat.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_nfacct.ko 2023-11-17T06:12:16.910 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_osf.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_owner.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_physdev.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_pkttype.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11985 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_policy.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_quota.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_rateest.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_realm.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_recent.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_sctp.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_set.ko 2023-11-17T06:12:16.911 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 16089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_socket.ko 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9505 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_state.ko 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9473 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_statistic.ko 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8809 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_string.ko 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 8553 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpmss.ko 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15777 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_tcpudp.ko 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11129 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_time.ko 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netfilter/xt_u32.ko 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/ 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13969 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/netlink/netlink_diag.ko 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/ 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 12425 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/nsh/nsh.ko 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/ 2023-11-17T06:12:16.912 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 380033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/openvswitch.ko 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10321 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-geneve.ko 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-gre.ko 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 11793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/openvswitch/vport-vxlan.ko 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/ 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13057 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/packet/af_packet_diag.ko 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/ 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 110201 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/phonet.ko 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54697 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/phonet/pn_pep.ko 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/ 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 251481 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds.ko 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 164937 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_rdma.ko 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 67377 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rds/rds_tcp.ko 2023-11-17T06:12:16.913 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/ 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 819657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/rxrpc/rxrpc.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/ 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32241 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_csum.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23577 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_gact.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26873 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_ipt.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34097 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_mirred.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_nat.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 43449 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_pedit.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_police.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_simple.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35297 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_skbedit.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36665 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/act_vlan.ko 2023-11-17T06:12:16.914 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26169 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_basic.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33961 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_bpf.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19233 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_cgroup.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31401 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_flow.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31769 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_fw.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 38489 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_route.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 61409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/cls_u32.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7441 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_cmp.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 13409 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_ipset.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33289 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_meta.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_nbyte.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_text.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7249 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/em_u32.ko 2023-11-17T06:12:16.915 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 21649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_choke.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20849 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_codel.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 34633 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_drr.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 33609 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31617 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_fq_codel.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 35433 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_gred.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 49601 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hfsc.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22089 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_hhf.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 66393 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_htb.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26073 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_ingress.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 30273 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_mqprio_lib.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26065 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_multiq.ko 2023-11-17T06:12:16.916 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 36137 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_netem.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 27497 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_pie.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10625 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_plug.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 24729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_prio.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 48793 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_qfq.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 32905 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_red.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 26881 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfb.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 31353 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_sfq.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28897 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_tbf.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 28105 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sched/sch_teql.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/ 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 929745 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 19033 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sctp/sctp_diag.ko 2023-11-17T06:12:16.917 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/ 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/ 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 336529 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 54737 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 1520161 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/sunrpc.ko 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/ 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 707721 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/ 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10025 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/diag.ko 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 862641 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/tipc/tipc.ko 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/ 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15729 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/unix/unix_diag.ko 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/ 2023-11-17T06:12:16.918 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 85337 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 68049 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 96193 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock.ko 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 10705 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 17521 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/ 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 125177 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/x25/x25.ko 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/ 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 22657 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_algo.ko 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 20649 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 102257 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/net/xfrm/xfrm_user.ko 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/ 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/ 2023-11-17T06:12:16.919 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 15537 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/kernel/virt/lib/irqbypass.ko 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 639863 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 623919 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.alias.bin 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 7663 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 23428 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.alias.bin 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 9821 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.bin 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 70004 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.builtin.modinfo 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 146313 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 232548 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.dep.bin 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 210 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.devname 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 72606 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.order 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 879 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.softdep 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 254438 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 309363 2023-10-25 03:19 ./lib/modules/6.6.0-rc5-g5b73517e0e2f/modules.symbols.bin 2023-11-17T06:12:16.920 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/ 2023-11-17T06:12:16.921 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/ 2023-11-17T06:12:16.921 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/ 2023-11-17T06:12:16.921 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x root/root 0 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/ 2023-11-17T06:12:16.921 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 175 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/changelog.Debian.gz 2023-11-17T06:12:16.921 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r-- root/root 691 2023-10-25 03:19 ./usr/share/doc/linux-image-6.6.0-rc5-g5b73517e0e2f/copyright 2023-11-17T06:12:16.921 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:16.922 INFO:teuthology.task.kernel:searching for kernel 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:16.922 DEBUG:teuthology.orchestra.run.smithi069:> egrep '(submenu|menuentry.*6.6.0-rc5-g5b73517e0e2f).*{' /boot/grub/grub.cfg 2023-11-17T06:12:16.923 INFO:teuthology.orchestra.run.smithi093.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:12:16.923 INFO:teuthology.orchestra.run.smithi093.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:12:16.923 INFO:teuthology.orchestra.run.smithi093.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:12:16.924 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-17T06:12:16.924 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:16.924 DEBUG:teuthology.orchestra.run.smithi093:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-17T06:12:16.951 INFO:teuthology.orchestra.run.smithi069.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:12:16.951 INFO:teuthology.orchestra.run.smithi069.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:12:16.951 INFO:teuthology.orchestra.run.smithi069.stdout: menuentry 'Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-rc5-g5b73517e0e2f-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-11-17T06:12:16.952 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-17T06:12:16.952 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:16.952 DEBUG:teuthology.orchestra.run.smithi069:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-17T06:12:16.966 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi093.front.sepia.ceph.com to complete... 2023-11-17T06:12:16.998 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi069.front.sepia.ceph.com to complete... 2023-11-17T06:12:17.542 INFO:teuthology.orchestra.run.smithi093.stderr:Sourcing file `/etc/default/grub' 2023-11-17T06:12:17.546 INFO:teuthology.orchestra.run.smithi093.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-17T06:12:17.559 INFO:teuthology.orchestra.run.smithi093.stderr:Generating grub configuration file ... 2023-11-17T06:12:17.588 INFO:teuthology.orchestra.run.smithi069.stderr:Sourcing file `/etc/default/grub' 2023-11-17T06:12:17.596 INFO:teuthology.orchestra.run.smithi069.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-17T06:12:17.607 INFO:teuthology.orchestra.run.smithi069.stderr:Generating grub configuration file ... 2023-11-17T06:12:17.800 INFO:teuthology.orchestra.run.smithi093.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:17.812 INFO:teuthology.orchestra.run.smithi093.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:17.816 INFO:teuthology.orchestra.run.smithi069.stderr:Found linux image: /boot/vmlinuz-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:17.829 INFO:teuthology.orchestra.run.smithi069.stderr:Found initrd image: /boot/initrd.img-6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:12:18.164 INFO:teuthology.orchestra.run.smithi069.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-17T06:12:18.175 INFO:teuthology.orchestra.run.smithi069.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-17T06:12:18.193 INFO:teuthology.orchestra.run.smithi093.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-11-17T06:12:18.205 INFO:teuthology.orchestra.run.smithi093.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-11-17T06:12:18.926 INFO:teuthology.orchestra.run.smithi069.stderr:done 2023-11-17T06:12:18.993 INFO:teuthology.orchestra.run.smithi093.stderr:done 2023-11-17T06:12:50.084 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-17T06:12:50.084 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-11-17T06:12:50.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:12:50.097 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-17T06:12:50.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-17T06:12:50.102 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:13:08.602 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-11-17T06:13:08.603 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-11-17T06:13:17.612 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-17T06:13:17.613 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:13:17.614 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-11-17T06:13:17.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:13:20.666 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-11-17T06:13:20.667 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-11-17T06:13:32.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-17T06:13:32.682 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:13:32.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-11-17T06:13:32.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:13:51.098 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-11-17T06:13:51.099 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-11-17T06:14:06.110 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-17T06:14:06.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:14:06.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-11-17T06:14:06.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:14:06.358 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-11-17T06:14:06.522 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-11-17T06:14:07.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-17T06:14:07.130 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-rc5-g5b73517e0e2f"... 2023-11-17T06:14:07.130 DEBUG:teuthology.orchestra.run.smithi093:> uname -r 2023-11-17T06:14:07.192 INFO:teuthology.orchestra.run.smithi093.stdout:6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:14:07.192 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g5b73517e0e2f vs 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:14:07.192 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-17T06:14:07.192 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-17T06:14:07.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-11-17T06:14:07.492 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-rc5-g5b73517e0e2f"... 2023-11-17T06:14:07.493 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2023-11-17T06:14:07.549 INFO:teuthology.orchestra.run.smithi069.stdout:6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:14:07.550 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g5b73517e0e2f vs 6.6.0-rc5-g5b73517e0e2f 2023-11-17T06:14:07.550 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-17T06:14:07.550 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-17T06:14:08.193 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-17T06:14:08.194 DEBUG:teuthology.orchestra.run.smithi093:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-17T06:14:08.300 INFO:teuthology.orchestra.run.smithi093.stdout:ttyS1 2023-11-17T06:14:08.371 DEBUG:teuthology.parallel:result is None 2023-11-17T06:14:08.551 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-17T06:14:08.551 DEBUG:teuthology.orchestra.run.smithi069:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-17T06:14:08.662 INFO:teuthology.orchestra.run.smithi069.stdout:ttyS1 2023-11-17T06:14:08.719 DEBUG:teuthology.parallel:result is None 2023-11-17T06:14:08.719 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-17T06:14:08.729 INFO:teuthology.task.internal:Creating test directory... 2023-11-17T06:14:08.730 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-17T06:14:08.737 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-17T06:14:08.757 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-17T06:14:08.764 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-17T06:14:08.773 INFO:teuthology.task.internal:Creating archive directory... 2023-11-17T06:14:08.773 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-17T06:14:08.800 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-17T06:14:08.833 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-17T06:14:08.854 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-17T06:14:08.862 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-17T06:14:08.869 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-17T06:14:08.912 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-17T06:14:08.917 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-17T06:14:08.937 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-17T06:14:08.943 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-17T06:14:08.947 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-17T06:14:08.954 INFO:teuthology.task.internal:Configuring sudo... 2023-11-17T06:14:08.955 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-17T06:14:08.988 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-17T06:14:09.028 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-17T06:14:09.041 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-17T06:14:09.041 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-17T06:14:09.065 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-17T06:14:09.092 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-17T06:14:09.138 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-17T06:14:09.200 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:14:09.200 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-17T06:14:09.282 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-17T06:14:09.304 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-17T06:14:09.365 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:14:09.365 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-17T06:14:09.448 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2023-11-17T06:14:09.455 DEBUG:teuthology.orchestra.run.smithi093:> sudo service rsyslog restart 2023-11-17T06:14:09.624 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-17T06:14:09.632 INFO:teuthology.task.internal:Starting timer... 2023-11-17T06:14:09.632 INFO:teuthology.run_tasks:Running task pcp... 2023-11-17T06:14:09.676 INFO:teuthology.run_tasks:Running task selinux... 2023-11-17T06:14:09.686 DEBUG:teuthology.task.selinux:Excluding smithi069: OS 'ubuntu' does not support SELinux 2023-11-17T06:14:09.686 DEBUG:teuthology.task.selinux:Excluding smithi093: OS 'ubuntu' does not support SELinux 2023-11-17T06:14:09.686 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-17T06:14:09.686 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-17T06:14:09.686 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-17T06:14:09.686 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-17T06:14:09.704 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-17T06:14:09.704 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-17T06:14:09.726 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-17T06:14:09.728 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi069.front.sepia.ceph.com,smithi093.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-17T06:23:26.307 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi069.front.sepia.ceph.com'), Remote(name='ubuntu@smithi093.front.sepia.ceph.com')] 2023-11-17T06:23:26.308 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-11-17T06:23:26.309 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:23:26.417 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-11-17T06:23:26.653 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-11-17T06:23:26.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-17T06:23:26.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-17T06:23:26.753 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-11-17T06:23:26.970 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-11-17T06:23:26.970 INFO:teuthology.run_tasks:Running task clock... 2023-11-17T06:23:26.981 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-17T06:23:26.981 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-17T06:23:26.982 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-17T06:23:26.991 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-17T06:23:26.992 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-17T06:23:27.056 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-17T06:23:27.056 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: Command line: ntpd -gq 2023-11-17T06:23:27.057 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: proto: precision = 0.060 usec (-24) 2023-11-17T06:23:27.057 INFO:teuthology.orchestra.run.smithi069.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-17T06:23:27.058 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-17T06:23:27.058 INFO:teuthology.orchestra.run.smithi069.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-17T06:23:27.059 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: restrict ::: KOD does nothing without LIMITED. 2023-11-17T06:23:27.059 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: Listen and drop on 0 v6wildcard [::]:123 2023-11-17T06:23:27.059 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-17T06:23:27.059 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: Listen normally on 2 lo 127.0.0.1:123 2023-11-17T06:23:27.059 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: Listen normally on 3 enp3s0f1 172.21.15.69:123 2023-11-17T06:23:27.059 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: Listen normally on 4 lo [::1]:123 2023-11-17T06:23:27.059 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d737%5]:123 2023-11-17T06:23:27.059 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:27 ntpd[23443]: Listening on routing socket on fd #22 for interface updates 2023-11-17T06:23:27.090 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-11-17T06:23:27.090 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: Command line: ntpd -gq 2023-11-17T06:23:27.091 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: proto: precision = 0.041 usec (-24) 2023-11-17T06:23:27.091 INFO:teuthology.orchestra.run.smithi093.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-17T06:23:27.092 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-17T06:23:27.092 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: restrict ::: KOD does nothing without LIMITED. 2023-11-17T06:23:27.092 INFO:teuthology.orchestra.run.smithi093.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-17T06:23:27.093 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: Listen and drop on 0 v6wildcard [::]:123 2023-11-17T06:23:27.093 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-17T06:23:27.093 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: Listen normally on 2 lo 127.0.0.1:123 2023-11-17T06:23:27.093 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: Listen normally on 3 enp3s0f1 172.21.15.93:123 2023-11-17T06:23:27.093 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: Listen normally on 4 lo [::1]:123 2023-11-17T06:23:27.093 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d635%5]:123 2023-11-17T06:23:27.093 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:27 ntpd[23458]: Listening on routing socket on fd #22 for interface updates 2023-11-17T06:23:28.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:28.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:28 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:28.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:28.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:28 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:28.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:28.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:28 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:28.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:28.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:28 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:28.091 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:28 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:28.091 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:28 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:28.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:28 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:28.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:28 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:28.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:28 ntpd[23458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:28.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:28 ntpd[23458]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:30.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:30.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:30.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:30 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:30.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:30.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:30.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:30.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:30.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:30.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:30.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:30.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:30.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:30.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:30.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:30.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:30.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:30.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:30 ntpd[23458]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:31.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:31 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:31.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:31 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:31.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:31 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:31.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:31 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:31.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:31 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:31.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:31 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:32 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:32.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:32.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:32.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:32.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:32.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:32.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:32.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:32.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:32.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:32.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:32.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:32.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:32.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:32.095 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:32.095 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:32.095 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:32.095 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:32.095 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:32 ntpd[23458]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:33.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:33 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:33.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:33 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:33.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:33 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:33.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:33 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:33.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:33 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:33.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:33 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:34.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:34.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:34 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:34.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:34.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:34 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:34.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:34.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:34 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:34.057 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:34.058 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:34 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:34.058 INFO:teuthology.orchestra.run.smithi069.stdout:17 Nov 06:23:34 ntpd[23443]: ntpd: time slew +0.001424 s 2023-11-17T06:23:34.058 INFO:teuthology.orchestra.run.smithi069.stdout:ntpd: time slew +0.001424s 2023-11-17T06:23:34.059 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-17T06:23:34.059 INFO:teuthology.orchestra.run.smithi069.stderr:17 Nov 06:23:34 ntpd[23443]: can't open /var/log/ntpstats/loopstats.20231117: Permission denied 2023-11-17T06:23:34.092 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:34.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:34.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:34.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:34.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-17T06:23:34.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: can't open /var/log/ntpstats/rawstats.20231117: Permission denied 2023-11-17T06:23:34.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-17T06:23:34.094 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: can't open /var/log/ntpstats/peerstats.20231117: Permission denied 2023-11-17T06:23:34.095 INFO:teuthology.orchestra.run.smithi093.stdout:17 Nov 06:23:34 ntpd[23458]: ntpd: time slew +0.000045 s 2023-11-17T06:23:34.095 INFO:teuthology.orchestra.run.smithi093.stdout:ntpd: time slew +0.000045s 2023-11-17T06:23:34.096 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-17T06:23:34.096 INFO:teuthology.orchestra.run.smithi093.stderr:17 Nov 06:23:34 ntpd[23458]: can't open /var/log/ntpstats/loopstats.20231117: Permission denied 2023-11-17T06:23:34.216 INFO:teuthology.orchestra.run.smithi069.stdout: remote refid st t when poll reach delay offset jitter 2023-11-17T06:23:34.216 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================== 2023-11-17T06:23:34.216 INFO:teuthology.orchestra.run.smithi069.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:23:34.216 INFO:teuthology.orchestra.run.smithi069.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:23:34.216 INFO:teuthology.orchestra.run.smithi069.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:23:34.216 INFO:teuthology.orchestra.run.smithi069.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:23:34.229 INFO:teuthology.orchestra.run.smithi093.stdout: remote refid st t when poll reach delay offset jitter 2023-11-17T06:23:34.230 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================== 2023-11-17T06:23:34.230 INFO:teuthology.orchestra.run.smithi093.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:23:34.230 INFO:teuthology.orchestra.run.smithi093.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:23:34.230 INFO:teuthology.orchestra.run.smithi093.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:23:34.230 INFO:teuthology.orchestra.run.smithi093.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-11-17T06:23:34.232 INFO:teuthology.run_tasks:Running task install... 2023-11-17T06:23:34.332 DEBUG:teuthology.task.install:project ceph 2023-11-17T06:23:34.332 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}} 2023-11-17T06:23:34.333 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'} 2023-11-17T06:23:34.333 INFO:teuthology.task.install:Using flavor: default 2023-11-17T06:23:34.339 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-17T06:23:34.339 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-17T06:23:34.340 DEBUG:teuthology.orchestra.run.smithi069:> sudo apt-key list | grep Ceph 2023-11-17T06:23:34.340 DEBUG:teuthology.orchestra.run.smithi093:> sudo apt-key list | grep Ceph 2023-11-17T06:23:34.575 INFO:teuthology.orchestra.run.smithi069.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-17T06:23:34.587 INFO:teuthology.orchestra.run.smithi093.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-11-17T06:23:34.722 INFO:teuthology.orchestra.run.smithi069.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-17T06:23:34.722 INFO:teuthology.orchestra.run.smithi069.stdout:uid [ unknown] Ceph.com (release key) 2023-11-17T06:23:34.724 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-17T06:23:34.724 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-17T06:23:34.724 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-17T06:23:34.731 INFO:teuthology.orchestra.run.smithi093.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-17T06:23:34.731 INFO:teuthology.orchestra.run.smithi093.stdout:uid [ unknown] Ceph.com (release key) 2023-11-17T06:23:34.733 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-17T06:23:34.733 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-17T06:23:34.733 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-17T06:23:34.877 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default/ 2023-11-17T06:23:34.877 INFO:teuthology.task.install.deb:Package version is 18.0.0-6612-g895e5ada-1focal 2023-11-17T06:23:34.955 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default/ 2023-11-17T06:23:34.955 INFO:teuthology.task.install.deb:Package version is 18.0.0-6612-g895e5ada-1focal 2023-11-17T06:23:35.072 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:23:35.073 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-17T06:23:35.110 DEBUG:teuthology.orchestra.run.smithi093:> sudo apt-get update 2023-11-17T06:23:35.125 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:23:35.125 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-17T06:23:35.161 DEBUG:teuthology.orchestra.run.smithi069:> sudo apt-get update 2023-11-17T06:23:35.385 INFO:teuthology.orchestra.run.smithi093.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-17T06:23:35.386 INFO:teuthology.orchestra.run.smithi093.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-11-17T06:23:35.386 INFO:teuthology.orchestra.run.smithi093.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-17T06:23:35.433 INFO:teuthology.orchestra.run.smithi093.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal InRelease 2023-11-17T06:23:35.441 INFO:teuthology.orchestra.run.smithi069.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-11-17T06:23:35.441 INFO:teuthology.orchestra.run.smithi069.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-11-17T06:23:35.441 INFO:teuthology.orchestra.run.smithi069.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-11-17T06:23:35.454 INFO:teuthology.orchestra.run.smithi093.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-17T06:23:35.455 INFO:teuthology.orchestra.run.smithi093.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-17T06:23:35.456 INFO:teuthology.orchestra.run.smithi069.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-11-17T06:23:35.479 INFO:teuthology.orchestra.run.smithi093.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal Release.gpg 2023-11-17T06:23:35.501 INFO:teuthology.orchestra.run.smithi093.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-11-17T06:23:35.546 INFO:teuthology.orchestra.run.smithi069.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal InRelease 2023-11-17T06:23:35.546 INFO:teuthology.orchestra.run.smithi093.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main i386 Packages [3,402 B] 2023-11-17T06:23:35.585 INFO:teuthology.orchestra.run.smithi069.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-11-17T06:23:35.622 INFO:teuthology.orchestra.run.smithi069.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal Release.gpg 2023-11-17T06:23:35.659 INFO:teuthology.orchestra.run.smithi069.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-11-17T06:23:35.718 INFO:teuthology.orchestra.run.smithi069.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main i386 Packages [3,402 B] 2023-11-17T06:23:36.822 INFO:teuthology.orchestra.run.smithi093.stdout:Fetched 142 kB in 1s (105 kB/s) 2023-11-17T06:23:36.854 INFO:teuthology.orchestra.run.smithi069.stdout:Fetched 28.5 kB in 1s (20.9 kB/s) 2023-11-17T06:23:38.045 INFO:teuthology.orchestra.run.smithi093.stdout:Reading package lists... 2023-11-17T06:23:38.065 INFO:teuthology.orchestra.run.smithi069.stdout:Reading package lists... 2023-11-17T06:23:38.091 DEBUG:teuthology.orchestra.run.smithi093:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6612-g895e5ada-1focal cephadm=18.0.0-6612-g895e5ada-1focal ceph-mds=18.0.0-6612-g895e5ada-1focal ceph-mgr=18.0.0-6612-g895e5ada-1focal ceph-common=18.0.0-6612-g895e5ada-1focal ceph-fuse=18.0.0-6612-g895e5ada-1focal ceph-test=18.0.0-6612-g895e5ada-1focal ceph-volume=18.0.0-6612-g895e5ada-1focal radosgw=18.0.0-6612-g895e5ada-1focal python3-rados=18.0.0-6612-g895e5ada-1focal python3-rgw=18.0.0-6612-g895e5ada-1focal python3-cephfs=18.0.0-6612-g895e5ada-1focal python3-rbd=18.0.0-6612-g895e5ada-1focal libcephfs2=18.0.0-6612-g895e5ada-1focal libcephfs-dev=18.0.0-6612-g895e5ada-1focal librados2=18.0.0-6612-g895e5ada-1focal librbd1=18.0.0-6612-g895e5ada-1focal rbd-fuse=18.0.0-6612-g895e5ada-1focal python3-cephfs=18.0.0-6612-g895e5ada-1focal cephfs-shell=18.0.0-6612-g895e5ada-1focal cephfs-top=18.0.0-6612-g895e5ada-1focal cephfs-mirror=18.0.0-6612-g895e5ada-1focal 2023-11-17T06:23:38.113 DEBUG:teuthology.orchestra.run.smithi069:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-6612-g895e5ada-1focal cephadm=18.0.0-6612-g895e5ada-1focal ceph-mds=18.0.0-6612-g895e5ada-1focal ceph-mgr=18.0.0-6612-g895e5ada-1focal ceph-common=18.0.0-6612-g895e5ada-1focal ceph-fuse=18.0.0-6612-g895e5ada-1focal ceph-test=18.0.0-6612-g895e5ada-1focal ceph-volume=18.0.0-6612-g895e5ada-1focal radosgw=18.0.0-6612-g895e5ada-1focal python3-rados=18.0.0-6612-g895e5ada-1focal python3-rgw=18.0.0-6612-g895e5ada-1focal python3-cephfs=18.0.0-6612-g895e5ada-1focal python3-rbd=18.0.0-6612-g895e5ada-1focal libcephfs2=18.0.0-6612-g895e5ada-1focal libcephfs-dev=18.0.0-6612-g895e5ada-1focal librados2=18.0.0-6612-g895e5ada-1focal librbd1=18.0.0-6612-g895e5ada-1focal rbd-fuse=18.0.0-6612-g895e5ada-1focal python3-cephfs=18.0.0-6612-g895e5ada-1focal cephfs-shell=18.0.0-6612-g895e5ada-1focal cephfs-top=18.0.0-6612-g895e5ada-1focal cephfs-mirror=18.0.0-6612-g895e5ada-1focal 2023-11-17T06:23:38.214 INFO:teuthology.orchestra.run.smithi093.stdout:Reading package lists... 2023-11-17T06:23:38.232 INFO:teuthology.orchestra.run.smithi069.stdout:Reading package lists... 2023-11-17T06:23:38.415 INFO:teuthology.orchestra.run.smithi093.stdout:Building dependency tree... 2023-11-17T06:23:38.415 INFO:teuthology.orchestra.run.smithi093.stdout:Reading state information... 2023-11-17T06:23:38.430 INFO:teuthology.orchestra.run.smithi069.stdout:Building dependency tree... 2023-11-17T06:23:38.431 INFO:teuthology.orchestra.run.smithi069.stdout:Reading state information... 2023-11-17T06:23:38.600 INFO:teuthology.orchestra.run.smithi093.stdout:The following packages were automatically installed and are no longer required: 2023-11-17T06:23:38.601 INFO:teuthology.orchestra.run.smithi093.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-17T06:23:38.601 INFO:teuthology.orchestra.run.smithi093.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-17T06:23:38.601 INFO:teuthology.orchestra.run.smithi093.stdout:The following additional packages will be installed: 2023-11-17T06:23:38.602 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-17T06:23:38.602 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-17T06:23:38.602 INFO:teuthology.orchestra.run.smithi093.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-17T06:23:38.602 INFO:teuthology.orchestra.run.smithi093.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-17T06:23:38.602 INFO:teuthology.orchestra.run.smithi093.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-17T06:23:38.603 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-17T06:23:38.604 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-17T06:23:38.604 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-17T06:23:38.604 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-17T06:23:38.604 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-17T06:23:38.604 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-17T06:23:38.604 INFO:teuthology.orchestra.run.smithi093.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-17T06:23:38.604 INFO:teuthology.orchestra.run.smithi093.stdout:Suggested packages: 2023-11-17T06:23:38.604 INFO:teuthology.orchestra.run.smithi093.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-17T06:23:38.604 INFO:teuthology.orchestra.run.smithi093.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-17T06:23:38.604 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-17T06:23:38.605 INFO:teuthology.orchestra.run.smithi093.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-17T06:23:38.605 INFO:teuthology.orchestra.run.smithi093.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-17T06:23:38.605 INFO:teuthology.orchestra.run.smithi093.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-17T06:23:38.605 INFO:teuthology.orchestra.run.smithi093.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-17T06:23:38.605 INFO:teuthology.orchestra.run.smithi093.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-17T06:23:38.605 INFO:teuthology.orchestra.run.smithi093.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-17T06:23:38.605 INFO:teuthology.orchestra.run.smithi093.stdout:Recommended packages: 2023-11-17T06:23:38.605 INFO:teuthology.orchestra.run.smithi093.stdout: btrfs-tools 2023-11-17T06:23:38.617 INFO:teuthology.orchestra.run.smithi069.stdout:The following packages were automatically installed and are no longer required: 2023-11-17T06:23:38.618 INFO:teuthology.orchestra.run.smithi069.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-17T06:23:38.619 INFO:teuthology.orchestra.run.smithi069.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-17T06:23:38.619 INFO:teuthology.orchestra.run.smithi069.stdout:The following additional packages will be installed: 2023-11-17T06:23:38.619 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-17T06:23:38.619 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-11-17T06:23:38.619 INFO:teuthology.orchestra.run.smithi069.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-11-17T06:23:38.619 INFO:teuthology.orchestra.run.smithi069.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-11-17T06:23:38.619 INFO:teuthology.orchestra.run.smithi069.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-11-17T06:23:38.620 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-11-17T06:23:38.620 INFO:teuthology.orchestra.run.smithi069.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-17T06:23:38.620 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-17T06:23:38.620 INFO:teuthology.orchestra.run.smithi069.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-17T06:23:38.620 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-11-17T06:23:38.620 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-11-17T06:23:38.620 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-17T06:23:38.621 INFO:teuthology.orchestra.run.smithi069.stdout: qttranslations5-l10n socat xmlstarlet 2023-11-17T06:23:38.622 INFO:teuthology.orchestra.run.smithi069.stdout:Suggested packages: 2023-11-17T06:23:38.622 INFO:teuthology.orchestra.run.smithi069.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-11-17T06:23:38.622 INFO:teuthology.orchestra.run.smithi069.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-11-17T06:23:38.622 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-11-17T06:23:38.622 INFO:teuthology.orchestra.run.smithi069.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-11-17T06:23:38.622 INFO:teuthology.orchestra.run.smithi069.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-11-17T06:23:38.623 INFO:teuthology.orchestra.run.smithi069.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-11-17T06:23:38.623 INFO:teuthology.orchestra.run.smithi069.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-11-17T06:23:38.623 INFO:teuthology.orchestra.run.smithi069.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-17T06:23:38.623 INFO:teuthology.orchestra.run.smithi069.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-11-17T06:23:38.623 INFO:teuthology.orchestra.run.smithi069.stdout:Recommended packages: 2023-11-17T06:23:38.623 INFO:teuthology.orchestra.run.smithi069.stdout: btrfs-tools 2023-11-17T06:23:38.814 INFO:teuthology.orchestra.run.smithi093.stdout:The following NEW packages will be installed: 2023-11-17T06:23:38.815 INFO:teuthology.orchestra.run.smithi093.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-17T06:23:38.815 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-17T06:23:38.815 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-17T06:23:38.816 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-17T06:23:38.816 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-17T06:23:38.816 INFO:teuthology.orchestra.run.smithi093.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-17T06:23:38.816 INFO:teuthology.orchestra.run.smithi093.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-17T06:23:38.816 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-17T06:23:38.817 INFO:teuthology.orchestra.run.smithi093.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-17T06:23:38.817 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-17T06:23:38.817 INFO:teuthology.orchestra.run.smithi093.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-17T06:23:38.817 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-17T06:23:38.817 INFO:teuthology.orchestra.run.smithi093.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-17T06:23:38.818 INFO:teuthology.orchestra.run.smithi093.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-17T06:23:38.818 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-17T06:23:38.818 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-17T06:23:38.818 INFO:teuthology.orchestra.run.smithi093.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-17T06:23:38.819 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-17T06:23:38.819 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-17T06:23:38.819 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-17T06:23:38.820 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-17T06:23:38.820 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-17T06:23:38.820 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-17T06:23:38.820 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-17T06:23:38.820 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-17T06:23:38.821 INFO:teuthology.orchestra.run.smithi093.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-17T06:23:38.821 INFO:teuthology.orchestra.run.smithi093.stdout:The following packages will be upgraded: 2023-11-17T06:23:38.821 INFO:teuthology.orchestra.run.smithi093.stdout: librados2 librbd1 2023-11-17T06:23:38.832 INFO:teuthology.orchestra.run.smithi069.stdout:The following NEW packages will be installed: 2023-11-17T06:23:38.832 INFO:teuthology.orchestra.run.smithi069.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-17T06:23:38.832 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-17T06:23:38.832 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-17T06:23:38.832 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-11-17T06:23:38.832 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-11-17T06:23:38.832 INFO:teuthology.orchestra.run.smithi069.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-11-17T06:23:38.832 INFO:teuthology.orchestra.run.smithi069.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-11-17T06:23:38.833 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-11-17T06:23:38.833 INFO:teuthology.orchestra.run.smithi069.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-11-17T06:23:38.833 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-11-17T06:23:38.833 INFO:teuthology.orchestra.run.smithi069.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-11-17T06:23:38.833 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-11-17T06:23:38.833 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-11-17T06:23:38.833 INFO:teuthology.orchestra.run.smithi069.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-11-17T06:23:38.833 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-11-17T06:23:38.833 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-11-17T06:23:38.834 INFO:teuthology.orchestra.run.smithi069.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-11-17T06:23:38.834 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-11-17T06:23:38.834 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-11-17T06:23:38.834 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-11-17T06:23:38.834 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-17T06:23:38.834 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-11-17T06:23:38.835 INFO:teuthology.orchestra.run.smithi069.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-11-17T06:23:38.835 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-11-17T06:23:38.835 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-11-17T06:23:38.835 INFO:teuthology.orchestra.run.smithi069.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-11-17T06:23:38.835 INFO:teuthology.orchestra.run.smithi069.stdout:The following packages will be upgraded: 2023-11-17T06:23:38.835 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 librbd1 2023-11-17T06:23:38.903 INFO:teuthology.orchestra.run.smithi093.stdout:2 upgraded, 116 newly installed, 0 to remove and 260 not upgraded. 2023-11-17T06:23:38.904 INFO:teuthology.orchestra.run.smithi093.stdout:Need to get 211 MB of archives. 2023-11-17T06:23:38.904 INFO:teuthology.orchestra.run.smithi093.stdout:After this operation, 1,044 MB of additional disk space will be used. 2023-11-17T06:23:38.904 INFO:teuthology.orchestra.run.smithi093.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-17T06:23:38.917 INFO:teuthology.orchestra.run.smithi069.stdout:2 upgraded, 116 newly installed, 0 to remove and 260 not upgraded. 2023-11-17T06:23:38.917 INFO:teuthology.orchestra.run.smithi069.stdout:Need to get 211 MB of archives. 2023-11-17T06:23:38.917 INFO:teuthology.orchestra.run.smithi069.stdout:After this operation, 1,044 MB of additional disk space will be used. 2023-11-17T06:23:38.917 INFO:teuthology.orchestra.run.smithi069.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-11-17T06:23:38.923 INFO:teuthology.orchestra.run.smithi093.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-17T06:23:38.931 INFO:teuthology.orchestra.run.smithi093.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-17T06:23:38.936 INFO:teuthology.orchestra.run.smithi069.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-11-17T06:23:38.945 INFO:teuthology.orchestra.run.smithi069.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-11-17T06:23:38.958 INFO:teuthology.orchestra.run.smithi093.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-17T06:23:38.971 INFO:teuthology.orchestra.run.smithi069.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-11-17T06:23:38.986 INFO:teuthology.orchestra.run.smithi093.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-17T06:23:38.989 INFO:teuthology.orchestra.run.smithi093.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-17T06:23:39.000 INFO:teuthology.orchestra.run.smithi069.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-11-17T06:23:39.002 INFO:teuthology.orchestra.run.smithi093.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-17T06:23:39.003 INFO:teuthology.orchestra.run.smithi069.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-11-17T06:23:39.016 INFO:teuthology.orchestra.run.smithi069.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-11-17T06:23:39.045 INFO:teuthology.orchestra.run.smithi093.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-17T06:23:39.048 INFO:teuthology.orchestra.run.smithi093.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-17T06:23:39.056 INFO:teuthology.orchestra.run.smithi093.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-17T06:23:39.058 INFO:teuthology.orchestra.run.smithi069.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-11-17T06:23:39.059 INFO:teuthology.orchestra.run.smithi093.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-17T06:23:39.059 INFO:teuthology.orchestra.run.smithi093.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-17T06:23:39.061 INFO:teuthology.orchestra.run.smithi069.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-11-17T06:23:39.062 INFO:teuthology.orchestra.run.smithi093.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-17T06:23:39.062 INFO:teuthology.orchestra.run.smithi093.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-17T06:23:39.065 INFO:teuthology.orchestra.run.smithi093.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-17T06:23:39.067 INFO:teuthology.orchestra.run.smithi093.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-17T06:23:39.068 INFO:teuthology.orchestra.run.smithi069.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-11-17T06:23:39.068 INFO:teuthology.orchestra.run.smithi093.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-17T06:23:39.070 INFO:teuthology.orchestra.run.smithi069.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-11-17T06:23:39.071 INFO:teuthology.orchestra.run.smithi069.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-11-17T06:23:39.072 INFO:teuthology.orchestra.run.smithi069.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-11-17T06:23:39.072 INFO:teuthology.orchestra.run.smithi069.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-11-17T06:23:39.077 INFO:teuthology.orchestra.run.smithi069.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-11-17T06:23:39.077 INFO:teuthology.orchestra.run.smithi069.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-11-17T06:23:39.078 INFO:teuthology.orchestra.run.smithi069.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-11-17T06:23:39.079 INFO:teuthology.orchestra.run.smithi093.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-17T06:23:39.080 INFO:teuthology.orchestra.run.smithi093.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-17T06:23:39.081 INFO:teuthology.orchestra.run.smithi093.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-17T06:23:39.087 INFO:teuthology.orchestra.run.smithi093.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-17T06:23:39.087 INFO:teuthology.orchestra.run.smithi093.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-17T06:23:39.088 INFO:teuthology.orchestra.run.smithi093.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-17T06:23:39.092 INFO:teuthology.orchestra.run.smithi069.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-11-17T06:23:39.093 INFO:teuthology.orchestra.run.smithi069.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-11-17T06:23:39.094 INFO:teuthology.orchestra.run.smithi069.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-11-17T06:23:39.096 INFO:teuthology.orchestra.run.smithi093.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-17T06:23:39.096 INFO:teuthology.orchestra.run.smithi069.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-17T06:23:39.097 INFO:teuthology.orchestra.run.smithi093.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-17T06:23:39.098 INFO:teuthology.orchestra.run.smithi069.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-11-17T06:23:39.099 INFO:teuthology.orchestra.run.smithi093.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-17T06:23:39.099 INFO:teuthology.orchestra.run.smithi069.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-11-17T06:23:39.101 INFO:teuthology.orchestra.run.smithi093.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-17T06:23:39.109 INFO:teuthology.orchestra.run.smithi069.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-11-17T06:23:39.110 INFO:teuthology.orchestra.run.smithi069.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-11-17T06:23:39.111 INFO:teuthology.orchestra.run.smithi069.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-11-17T06:23:39.112 INFO:teuthology.orchestra.run.smithi069.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-11-17T06:23:39.113 INFO:teuthology.orchestra.run.smithi093.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-17T06:23:39.123 INFO:teuthology.orchestra.run.smithi093.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-17T06:23:39.124 INFO:teuthology.orchestra.run.smithi093.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-17T06:23:39.125 INFO:teuthology.orchestra.run.smithi093.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-17T06:23:39.126 INFO:teuthology.orchestra.run.smithi093.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-17T06:23:39.126 INFO:teuthology.orchestra.run.smithi069.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-11-17T06:23:39.128 INFO:teuthology.orchestra.run.smithi093.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-17T06:23:39.131 INFO:teuthology.orchestra.run.smithi093.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-17T06:23:39.135 INFO:teuthology.orchestra.run.smithi093.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-17T06:23:39.135 INFO:teuthology.orchestra.run.smithi093.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-17T06:23:39.135 INFO:teuthology.orchestra.run.smithi069.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-11-17T06:23:39.136 INFO:teuthology.orchestra.run.smithi069.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-11-17T06:23:39.136 INFO:teuthology.orchestra.run.smithi069.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-11-17T06:23:39.136 INFO:teuthology.orchestra.run.smithi093.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-17T06:23:39.136 INFO:teuthology.orchestra.run.smithi069.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-11-17T06:23:39.138 INFO:teuthology.orchestra.run.smithi069.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-11-17T06:23:39.142 INFO:teuthology.orchestra.run.smithi069.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-11-17T06:23:39.145 INFO:teuthology.orchestra.run.smithi069.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-11-17T06:23:39.145 INFO:teuthology.orchestra.run.smithi069.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-11-17T06:23:39.146 INFO:teuthology.orchestra.run.smithi093.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-17T06:23:39.147 INFO:teuthology.orchestra.run.smithi093.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-17T06:23:39.148 INFO:teuthology.orchestra.run.smithi069.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-11-17T06:23:39.148 INFO:teuthology.orchestra.run.smithi093.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-17T06:23:39.149 INFO:teuthology.orchestra.run.smithi093.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-17T06:23:39.159 INFO:teuthology.orchestra.run.smithi069.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-11-17T06:23:39.160 INFO:teuthology.orchestra.run.smithi069.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-11-17T06:23:39.160 INFO:teuthology.orchestra.run.smithi069.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-17T06:23:39.161 INFO:teuthology.orchestra.run.smithi069.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-11-17T06:23:39.162 INFO:teuthology.orchestra.run.smithi093.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-17T06:23:39.163 INFO:teuthology.orchestra.run.smithi069.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-11-17T06:23:39.164 INFO:teuthology.orchestra.run.smithi069.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-17T06:23:39.164 INFO:teuthology.orchestra.run.smithi093.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-11-17T06:23:39.166 INFO:teuthology.orchestra.run.smithi093.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-17T06:23:39.166 INFO:teuthology.orchestra.run.smithi093.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-17T06:23:39.167 INFO:teuthology.orchestra.run.smithi093.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-17T06:23:39.176 INFO:teuthology.orchestra.run.smithi069.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-11-17T06:23:39.176 INFO:teuthology.orchestra.run.smithi069.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-11-17T06:23:39.177 INFO:teuthology.orchestra.run.smithi069.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-11-17T06:23:39.264 INFO:teuthology.orchestra.run.smithi069.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-17T06:23:39.267 INFO:teuthology.orchestra.run.smithi093.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-11-17T06:23:39.281 INFO:teuthology.orchestra.run.smithi069.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-17T06:23:39.283 INFO:teuthology.orchestra.run.smithi069.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-17T06:23:39.287 INFO:teuthology.orchestra.run.smithi093.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-11-17T06:23:39.288 INFO:teuthology.orchestra.run.smithi093.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-11-17T06:23:39.294 INFO:teuthology.orchestra.run.smithi069.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-6612-g895e5ada-1focal [3,602 kB] 2023-11-17T06:23:39.296 INFO:teuthology.orchestra.run.smithi069.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-17T06:23:39.296 INFO:teuthology.orchestra.run.smithi069.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-17T06:23:39.297 INFO:teuthology.orchestra.run.smithi069.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-17T06:23:39.298 INFO:teuthology.orchestra.run.smithi069.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-17T06:23:39.299 INFO:teuthology.orchestra.run.smithi069.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-17T06:23:39.299 INFO:teuthology.orchestra.run.smithi069.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-17T06:23:39.299 INFO:teuthology.orchestra.run.smithi069.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-17T06:23:39.300 INFO:teuthology.orchestra.run.smithi069.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-17T06:23:39.303 INFO:teuthology.orchestra.run.smithi093.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-11-17T06:23:39.303 INFO:teuthology.orchestra.run.smithi093.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-11-17T06:23:39.303 INFO:teuthology.orchestra.run.smithi093.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-11-17T06:23:39.304 INFO:teuthology.orchestra.run.smithi093.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-11-17T06:23:39.305 INFO:teuthology.orchestra.run.smithi093.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-11-17T06:23:39.305 INFO:teuthology.orchestra.run.smithi093.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-11-17T06:23:39.306 INFO:teuthology.orchestra.run.smithi093.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-11-17T06:23:39.307 INFO:teuthology.orchestra.run.smithi093.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-11-17T06:23:39.315 INFO:teuthology.orchestra.run.smithi069.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-17T06:23:39.316 INFO:teuthology.orchestra.run.smithi069.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-17T06:23:39.320 INFO:teuthology.orchestra.run.smithi093.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-11-17T06:23:39.323 INFO:teuthology.orchestra.run.smithi093.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-11-17T06:23:39.323 INFO:teuthology.orchestra.run.smithi069.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-17T06:23:39.325 INFO:teuthology.orchestra.run.smithi069.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-17T06:23:39.326 INFO:teuthology.orchestra.run.smithi069.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-17T06:23:39.328 INFO:teuthology.orchestra.run.smithi093.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-11-17T06:23:39.332 INFO:teuthology.orchestra.run.smithi069.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-17T06:23:39.335 INFO:teuthology.orchestra.run.smithi069.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-17T06:23:39.337 INFO:teuthology.orchestra.run.smithi093.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-11-17T06:23:39.338 INFO:teuthology.orchestra.run.smithi069.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-17T06:23:39.339 INFO:teuthology.orchestra.run.smithi069.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-17T06:23:39.340 INFO:teuthology.orchestra.run.smithi093.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-11-17T06:23:39.342 INFO:teuthology.orchestra.run.smithi093.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-11-17T06:23:39.349 INFO:teuthology.orchestra.run.smithi093.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-11-17T06:23:39.349 INFO:teuthology.orchestra.run.smithi093.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-6612-g895e5ada-1focal [3,602 kB] 2023-11-17T06:23:39.351 INFO:teuthology.orchestra.run.smithi093.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-11-17T06:23:39.352 INFO:teuthology.orchestra.run.smithi093.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-11-17T06:23:39.357 INFO:teuthology.orchestra.run.smithi069.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-17T06:23:39.371 INFO:teuthology.orchestra.run.smithi093.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-11-17T06:23:39.374 INFO:teuthology.orchestra.run.smithi093.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-17T06:23:39.377 INFO:teuthology.orchestra.run.smithi093.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-17T06:23:39.425 INFO:teuthology.orchestra.run.smithi093.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-17T06:23:39.426 INFO:teuthology.orchestra.run.smithi093.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-17T06:23:39.426 INFO:teuthology.orchestra.run.smithi093.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-17T06:23:39.427 INFO:teuthology.orchestra.run.smithi093.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-17T06:23:39.427 INFO:teuthology.orchestra.run.smithi093.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-17T06:23:39.428 INFO:teuthology.orchestra.run.smithi093.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-17T06:23:39.442 INFO:teuthology.orchestra.run.smithi093.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-17T06:23:39.442 INFO:teuthology.orchestra.run.smithi093.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-17T06:23:39.443 INFO:teuthology.orchestra.run.smithi093.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-17T06:23:39.443 INFO:teuthology.orchestra.run.smithi093.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-17T06:23:39.460 INFO:teuthology.orchestra.run.smithi093.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-17T06:23:39.461 INFO:teuthology.orchestra.run.smithi093.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-17T06:23:39.462 INFO:teuthology.orchestra.run.smithi093.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-17T06:23:39.467 INFO:teuthology.orchestra.run.smithi093.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-17T06:23:39.469 INFO:teuthology.orchestra.run.smithi093.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-17T06:23:39.570 INFO:teuthology.orchestra.run.smithi069.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-11-17T06:23:39.577 INFO:teuthology.orchestra.run.smithi069.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-11-17T06:23:39.627 INFO:teuthology.orchestra.run.smithi069.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-11-17T06:23:39.627 INFO:teuthology.orchestra.run.smithi069.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-11-17T06:23:39.628 INFO:teuthology.orchestra.run.smithi069.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-11-17T06:23:39.628 INFO:teuthology.orchestra.run.smithi069.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-11-17T06:23:39.629 INFO:teuthology.orchestra.run.smithi069.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-11-17T06:23:39.630 INFO:teuthology.orchestra.run.smithi069.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-11-17T06:23:39.643 INFO:teuthology.orchestra.run.smithi069.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-11-17T06:23:39.643 INFO:teuthology.orchestra.run.smithi069.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-17T06:23:39.644 INFO:teuthology.orchestra.run.smithi069.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-11-17T06:23:39.644 INFO:teuthology.orchestra.run.smithi069.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-11-17T06:23:39.661 INFO:teuthology.orchestra.run.smithi069.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-11-17T06:23:39.663 INFO:teuthology.orchestra.run.smithi069.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-11-17T06:23:39.665 INFO:teuthology.orchestra.run.smithi069.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-11-17T06:23:39.668 INFO:teuthology.orchestra.run.smithi069.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-11-17T06:23:39.668 INFO:teuthology.orchestra.run.smithi069.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-11-17T06:23:41.514 INFO:teuthology.orchestra.run.smithi069.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-6612-g895e5ada-1focal [4,063 kB] 2023-11-17T06:23:41.935 INFO:teuthology.orchestra.run.smithi093.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-6612-g895e5ada-1focal [4,063 kB] 2023-11-17T06:23:43.510 INFO:teuthology.orchestra.run.smithi069.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-6612-g895e5ada-1focal [753 kB] 2023-11-17T06:23:43.638 INFO:teuthology.orchestra.run.smithi069.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-6612-g895e5ada-1focal [387 kB] 2023-11-17T06:23:43.691 INFO:teuthology.orchestra.run.smithi069.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-6612-g895e5ada-1focal [31.9 kB] 2023-11-17T06:23:43.702 INFO:teuthology.orchestra.run.smithi069.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-6612-g895e5ada-1focal [200 kB] 2023-11-17T06:23:43.730 INFO:teuthology.orchestra.run.smithi069.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-6612-g895e5ada-1focal [61.1 kB] 2023-11-17T06:23:43.738 INFO:teuthology.orchestra.run.smithi069.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-6612-g895e5ada-1focal [364 kB] 2023-11-17T06:23:43.800 INFO:teuthology.orchestra.run.smithi069.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-6612-g895e5ada-1focal [6,940 kB] 2023-11-17T06:23:43.858 INFO:teuthology.orchestra.run.smithi093.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-6612-g895e5ada-1focal [753 kB] 2023-11-17T06:23:44.054 INFO:teuthology.orchestra.run.smithi093.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-6612-g895e5ada-1focal [387 kB] 2023-11-17T06:23:44.155 INFO:teuthology.orchestra.run.smithi093.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-6612-g895e5ada-1focal [31.9 kB] 2023-11-17T06:23:44.163 INFO:teuthology.orchestra.run.smithi093.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-6612-g895e5ada-1focal [200 kB] 2023-11-17T06:23:44.217 INFO:teuthology.orchestra.run.smithi093.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-6612-g895e5ada-1focal [61.1 kB] 2023-11-17T06:23:44.232 INFO:teuthology.orchestra.run.smithi093.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-6612-g895e5ada-1focal [364 kB] 2023-11-17T06:23:44.330 INFO:teuthology.orchestra.run.smithi093.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-6612-g895e5ada-1focal [6,940 kB] 2023-11-17T06:23:44.836 INFO:teuthology.orchestra.run.smithi069.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-6612-g895e5ada-1focal [113 kB] 2023-11-17T06:23:44.853 INFO:teuthology.orchestra.run.smithi069.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-6612-g895e5ada-1focal [474 kB] 2023-11-17T06:23:44.915 INFO:teuthology.orchestra.run.smithi069.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-6612-g895e5ada-1focal [25.8 MB] 2023-11-17T06:23:46.053 INFO:teuthology.orchestra.run.smithi093.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-6612-g895e5ada-1focal [113 kB] 2023-11-17T06:23:46.078 INFO:teuthology.orchestra.run.smithi093.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-6612-g895e5ada-1focal [474 kB] 2023-11-17T06:23:46.186 INFO:teuthology.orchestra.run.smithi093.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-6612-g895e5ada-1focal [25.8 MB] 2023-11-17T06:23:48.303 INFO:teuthology.orchestra.run.smithi069.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-6612-g895e5ada-1focal [11.0 MB] 2023-11-17T06:23:49.715 INFO:teuthology.orchestra.run.smithi069.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-6612-g895e5ada-1focal [234 kB] 2023-11-17T06:23:49.745 INFO:teuthology.orchestra.run.smithi069.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6612-g895e5ada-1focal [145 kB] 2023-11-17T06:23:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-6612-g895e5ada-1focal [1,584 kB] 2023-11-17T06:23:49.980 INFO:teuthology.orchestra.run.smithi069.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-6612-g895e5ada-1focal [9,402 kB] 2023-11-17T06:23:50.849 INFO:teuthology.orchestra.run.smithi069.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-6612-g895e5ada-1focal [31.6 MB] 2023-11-17T06:23:51.230 INFO:teuthology.orchestra.run.smithi093.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-6612-g895e5ada-1focal [11.0 MB] 2023-11-17T06:23:52.269 INFO:teuthology.orchestra.run.smithi093.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-6612-g895e5ada-1focal [234 kB] 2023-11-17T06:23:52.281 INFO:teuthology.orchestra.run.smithi093.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-6612-g895e5ada-1focal [145 kB] 2023-11-17T06:23:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-6612-g895e5ada-1focal [1,584 kB] 2023-11-17T06:23:52.445 INFO:teuthology.orchestra.run.smithi093.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-6612-g895e5ada-1focal [9,402 kB] 2023-11-17T06:23:52.598 INFO:teuthology.orchestra.run.smithi069.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-6612-g895e5ada-1focal [13.6 kB] 2023-11-17T06:24:01.115 INFO:teuthology.orchestra.run.smithi069.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-6612-g895e5ada-1focal [864 kB] 2023-11-17T06:24:01.124 INFO:teuthology.orchestra.run.smithi093.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-6612-g895e5ada-1focal [31.6 MB] 2023-11-17T06:24:01.124 INFO:teuthology.orchestra.run.smithi093.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-6612-g895e5ada-1focal [13.6 kB] 2023-11-17T06:24:01.125 INFO:teuthology.orchestra.run.smithi093.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-6612-g895e5ada-1focal [864 kB] 2023-11-17T06:24:01.125 INFO:teuthology.orchestra.run.smithi093.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-6612-g895e5ada-1focal [2,285 kB] 2023-11-17T06:24:01.168 INFO:teuthology.orchestra.run.smithi093.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-6612-g895e5ada-1focal [282 kB] 2023-11-17T06:24:01.168 INFO:teuthology.orchestra.run.smithi093.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-6612-g895e5ada-1focal [136 kB] 2023-11-17T06:24:01.168 INFO:teuthology.orchestra.run.smithi093.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-6612-g895e5ada-1focal [1,840 kB] 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi093.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6612-g895e5ada-1focal [7,903 kB] 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi093.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-6612-g895e5ada-1focal [13.8 kB] 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi093.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-6612-g895e5ada-1focal [51.1 MB] 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi093.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-6612-g895e5ada-1focal [118 kB] 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi093.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-6612-g895e5ada-1focal [267 kB] 2023-11-17T06:24:01.169 INFO:teuthology.orchestra.run.smithi093.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-6612-g895e5ada-1focal [32.9 kB] 2023-11-17T06:24:01.170 INFO:teuthology.orchestra.run.smithi093.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-6612-g895e5ada-1focal [22.7 kB] 2023-11-17T06:24:01.170 INFO:teuthology.orchestra.run.smithi093.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-6612-g895e5ada-1focal [37.3 kB] 2023-11-17T06:24:01.170 INFO:teuthology.orchestra.run.smithi093.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-6612-g895e5ada-1focal [14.1 MB] 2023-11-17T06:24:01.176 INFO:teuthology.orchestra.run.smithi069.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-6612-g895e5ada-1focal [2,285 kB] 2023-11-17T06:24:01.177 INFO:teuthology.orchestra.run.smithi069.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-6612-g895e5ada-1focal [282 kB] 2023-11-17T06:24:01.177 INFO:teuthology.orchestra.run.smithi069.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-6612-g895e5ada-1focal [136 kB] 2023-11-17T06:24:01.177 INFO:teuthology.orchestra.run.smithi069.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-6612-g895e5ada-1focal [1,840 kB] 2023-11-17T06:24:01.177 INFO:teuthology.orchestra.run.smithi069.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-6612-g895e5ada-1focal [7,903 kB] 2023-11-17T06:24:01.177 INFO:teuthology.orchestra.run.smithi069.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-6612-g895e5ada-1focal [13.8 kB] 2023-11-17T06:24:01.177 INFO:teuthology.orchestra.run.smithi069.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-6612-g895e5ada-1focal [51.1 MB] 2023-11-17T06:24:01.178 INFO:teuthology.orchestra.run.smithi069.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-6612-g895e5ada-1focal [118 kB] 2023-11-17T06:24:01.178 INFO:teuthology.orchestra.run.smithi069.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-6612-g895e5ada-1focal [267 kB] 2023-11-17T06:24:01.178 INFO:teuthology.orchestra.run.smithi069.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-6612-g895e5ada-1focal [32.9 kB] 2023-11-17T06:24:01.178 INFO:teuthology.orchestra.run.smithi069.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-6612-g895e5ada-1focal [22.7 kB] 2023-11-17T06:24:01.178 INFO:teuthology.orchestra.run.smithi069.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-6612-g895e5ada-1focal [37.3 kB] 2023-11-17T06:24:01.178 INFO:teuthology.orchestra.run.smithi069.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-6612-g895e5ada-1focal [14.1 MB] 2023-11-17T06:24:01.179 INFO:teuthology.orchestra.run.smithi069.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-6612-g895e5ada-1focal [106 kB] 2023-11-17T06:24:01.179 INFO:teuthology.orchestra.run.smithi069.stdout:Fetched 211 MB in 17s (12.2 MB/s) 2023-11-17T06:24:01.179 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-17T06:24:01.179 INFO:teuthology.orchestra.run.smithi069.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-11-17T06:24:01.179 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-17T06:24:01.179 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-17T06:24:01.180 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-17T06:24:01.180 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-17T06:24:01.180 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-17T06:24:01.180 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-cmd2. 2023-11-17T06:24:01.180 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-17T06:24:01.180 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-17T06:24:01.181 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-17T06:24:01.181 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-17T06:24:01.181 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-17T06:24:01.181 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-17T06:24:01.181 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-17T06:24:01.181 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-17T06:24:01.182 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-17T06:24:01.182 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-17T06:24:01.182 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-17T06:24:01.182 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-17T06:24:01.182 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:24:01.182 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:01.183 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-17T06:24:01.183 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:24:01.183 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:01.326 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-17T06:24:01.349 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:24:01.350 INFO:teuthology.orchestra.run.smithi093.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-57087-3/895e5adad9a763a0f13587c485b17f1ad3f04528/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-6612-g895e5ada-1focal [106 kB] 2023-11-17T06:24:01.393 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:01.838 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-17T06:24:01.858 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-17T06:24:01.895 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-17T06:24:02.282 INFO:teuthology.orchestra.run.smithi093.stdout:Fetched 211 MB in 23s (9,384 kB/s) 2023-11-17T06:24:02.302 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../010-librbd1_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:02.432 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking librbd1 (18.0.0-6612-g895e5ada-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-17T06:24:02.442 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-17T06:24:02.516 INFO:teuthology.orchestra.run.smithi093.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-11-17T06:24:02.519 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-11-17T06:24:02.563 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-11-17T06:24:02.891 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-17T06:24:02.911 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-11-17T06:24:02.949 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-17T06:24:03.198 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../011-librados2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:03.285 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-cmd2. 2023-11-17T06:24:03.304 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-11-17T06:24:03.319 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking librados2 (18.0.0-6612-g895e5ada-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-17T06:24:03.368 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-11-17T06:24:03.729 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-11-17T06:24:03.750 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-11-17T06:24:03.838 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-17T06:24:04.098 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libcephfs2. 2023-11-17T06:24:04.119 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:04.156 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libcephfs2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:04.233 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-17T06:24:04.256 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-11-17T06:24:04.300 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-17T06:24:04.534 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-rados. 2023-11-17T06:24:04.546 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../013-python3-rados_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:04.584 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-rados (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:04.703 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-17T06:24:04.724 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-11-17T06:24:04.770 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-17T06:24:04.978 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-17T06:24:04.997 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:05.036 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-ceph-argparse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:05.281 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-17T06:24:05.304 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:24:05.365 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-cephfs. 2023-11-17T06:24:05.369 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:05.382 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:05.422 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-cephfs (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:05.742 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-17T06:24:05.760 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:05.825 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:05.902 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-17T06:24:05.919 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:24:05.959 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:06.194 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-prettytable. 2023-11-17T06:24:06.215 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-17T06:24:06.269 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-17T06:24:06.363 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-17T06:24:06.380 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-11-17T06:24:06.420 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:24:06.555 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-rbd. 2023-11-17T06:24:06.573 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:06.613 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-rbd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:06.866 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-11-17T06:24:06.888 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-11-17T06:24:06.924 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-17T06:24:07.033 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-17T06:24:07.053 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-17T06:24:07.091 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-17T06:24:07.322 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../010-librbd1_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:07.452 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking librbd1 (18.0.0-6612-g895e5ada-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-17T06:24:07.460 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-17T06:24:07.478 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-17T06:24:07.518 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-17T06:24:07.921 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-17T06:24:07.941 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-17T06:24:07.979 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-17T06:24:08.297 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../011-librados2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:08.341 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package librgw2. 2023-11-17T06:24:08.359 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../022-librgw2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:08.399 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking librgw2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:08.423 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking librados2 (18.0.0-6612-g895e5ada-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-11-17T06:24:09.185 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libcephfs2. 2023-11-17T06:24:09.208 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:09.243 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libcephfs2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:09.597 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-rados. 2023-11-17T06:24:09.616 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../013-python3-rados_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:09.654 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-rados (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:10.026 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-rgw. 2023-11-17T06:24:10.039 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:10.065 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-17T06:24:10.076 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-rgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:10.088 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:10.132 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-ceph-argparse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:10.450 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-cephfs. 2023-11-17T06:24:10.470 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:10.496 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package liboath0. 2023-11-17T06:24:10.517 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-cephfs (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:10.519 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-17T06:24:10.562 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-17T06:24:10.846 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-17T06:24:10.868 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:10.904 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:10.932 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libradosstriper1. 2023-11-17T06:24:10.955 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:10.998 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libradosstriper1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:11.240 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-prettytable. 2023-11-17T06:24:11.260 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-11-17T06:24:11.298 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-11-17T06:24:11.518 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-common. 2023-11-17T06:24:11.537 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../026-ceph-common_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:11.576 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:11.592 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-rbd. 2023-11-17T06:24:11.615 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:11.659 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-rbd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:12.020 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-11-17T06:24:12.038 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-11-17T06:24:12.103 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-17T06:24:12.473 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-11-17T06:24:12.490 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-11-17T06:24:12.531 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-11-17T06:24:12.918 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-17T06:24:12.936 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-11-17T06:24:12.976 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-17T06:24:13.912 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package librgw2. 2023-11-17T06:24:13.925 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../022-librgw2_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:13.962 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking librgw2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:14.273 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-base. 2023-11-17T06:24:14.293 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../027-ceph-base_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:14.353 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-base (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:14.881 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-rgw. 2023-11-17T06:24:14.901 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:14.939 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-rgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:15.350 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package liboath0. 2023-11-17T06:24:15.370 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-11-17T06:24:15.408 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-11-17T06:24:15.778 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libradosstriper1. 2023-11-17T06:24:15.798 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:15.836 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libradosstriper1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:15.861 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-17T06:24:15.878 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-17T06:24:15.919 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-17T06:24:16.330 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-natsort. 2023-11-17T06:24:16.349 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-17T06:24:16.373 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-common. 2023-11-17T06:24:16.388 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-17T06:24:16.394 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../026-ceph-common_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:16.439 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:16.775 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-logutils. 2023-11-17T06:24:16.794 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-17T06:24:16.825 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-17T06:24:17.194 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-17T06:24:17.215 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-17T06:24:17.261 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-17T06:24:17.622 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-mako. 2023-11-17T06:24:17.643 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-17T06:24:17.689 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-17T06:24:18.083 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-17T06:24:18.101 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-17T06:24:18.141 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-17T06:24:18.486 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-17T06:24:18.503 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-17T06:24:18.544 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-17T06:24:18.918 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-webob. 2023-11-17T06:24:18.934 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-17T06:24:18.971 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-17T06:24:19.087 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-base. 2023-11-17T06:24:19.108 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../027-ceph-base_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:19.175 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-base (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:19.366 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-17T06:24:19.386 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-17T06:24:19.424 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-17T06:24:20.056 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-bs4. 2023-11-17T06:24:20.074 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-17T06:24:20.118 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-17T06:24:20.530 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-waitress. 2023-11-17T06:24:20.551 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-17T06:24:20.603 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-17T06:24:20.624 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-17T06:24:20.644 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-11-17T06:24:20.723 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-11-17T06:24:21.025 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-tempita. 2023-11-17T06:24:21.044 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-17T06:24:21.082 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-17T06:24:21.110 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-natsort. 2023-11-17T06:24:21.131 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-11-17T06:24:21.168 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-11-17T06:24:21.435 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-paste. 2023-11-17T06:24:21.448 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-17T06:24:21.493 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-17T06:24:21.530 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-logutils. 2023-11-17T06:24:21.552 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-11-17T06:24:21.596 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-11-17T06:24:21.906 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-17T06:24:21.925 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-17T06:24:21.963 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-17T06:24:21.983 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-17T06:24:22.003 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-11-17T06:24:22.041 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-11-17T06:24:22.341 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-17T06:24:22.361 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-17T06:24:22.369 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-mako. 2023-11-17T06:24:22.389 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-11-17T06:24:22.399 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-17T06:24:22.418 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-17T06:24:22.710 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-webtest. 2023-11-17T06:24:22.733 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-17T06:24:22.764 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-17T06:24:22.777 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-17T06:24:22.782 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-17T06:24:22.821 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-17T06:24:23.080 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-pecan. 2023-11-17T06:24:23.102 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-17T06:24:23.146 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-17T06:24:23.175 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-17T06:24:23.195 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-11-17T06:24:23.232 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-11-17T06:24:23.559 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-17T06:24:23.580 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-17T06:24:23.594 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-webob. 2023-11-17T06:24:23.614 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-11-17T06:24:23.652 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-11-17T06:24:23.660 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-17T06:24:23.970 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-17T06:24:23.991 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:24.036 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:24.389 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-soupsieve. 2023-11-17T06:24:24.406 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-11-17T06:24:24.447 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-17T06:24:24.544 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-17T06:24:24.563 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:24.601 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:24.808 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-bs4. 2023-11-17T06:24:24.829 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-11-17T06:24:24.874 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-11-17T06:24:24.946 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-cryptography. 2023-11-17T06:24:24.966 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-17T06:24:25.021 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-17T06:24:25.269 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-waitress. 2023-11-17T06:24:25.289 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-11-17T06:24:25.334 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-17T06:24:25.466 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-openssl. 2023-11-17T06:24:25.486 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-17T06:24:25.524 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-17T06:24:25.731 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-tempita. 2023-11-17T06:24:25.749 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-11-17T06:24:25.788 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-11-17T06:24:25.944 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-mgr. 2023-11-17T06:24:25.964 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:26.011 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-mgr (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:26.143 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-paste. 2023-11-17T06:24:26.160 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-11-17T06:24:26.200 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-11-17T06:24:26.539 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-mon. 2023-11-17T06:24:26.547 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-17T06:24:26.558 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:26.560 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-11-17T06:24:26.597 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-11-17T06:24:26.597 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-mon (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:26.941 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-17T06:24:26.954 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-11-17T06:24:26.991 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-11-17T06:24:27.361 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-webtest. 2023-11-17T06:24:27.377 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-11-17T06:24:27.418 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-11-17T06:24:27.771 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pecan. 2023-11-17T06:24:27.793 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-11-17T06:24:27.846 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-11-17T06:24:27.884 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-osd. 2023-11-17T06:24:27.904 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:27.950 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-osd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:28.234 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-17T06:24:28.252 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-11-17T06:24:28.292 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-17T06:24:28.661 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-17T06:24:28.680 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:28.719 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:29.191 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-17T06:24:29.209 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:29.249 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:29.609 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-cryptography. 2023-11-17T06:24:29.622 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-11-17T06:24:29.659 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-17T06:24:30.079 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-openssl. 2023-11-17T06:24:30.092 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-11-17T06:24:30.130 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-11-17T06:24:30.492 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr. 2023-11-17T06:24:30.504 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:30.549 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:30.737 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph. 2023-11-17T06:24:30.757 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../053-ceph_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:30.794 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:31.161 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mon. 2023-11-17T06:24:31.172 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-fuse. 2023-11-17T06:24:31.178 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:31.193 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:31.218 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mon (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:31.230 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:31.759 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-mds. 2023-11-17T06:24:31.777 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:31.817 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-mds (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:32.395 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package cephadm. 2023-11-17T06:24:32.418 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../056-cephadm_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:32.462 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:32.472 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-osd. 2023-11-17T06:24:32.491 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:32.538 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-osd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-17T06:24:32.853 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-17T06:24:32.897 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-17T06:24:33.318 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-jinja2. 2023-11-17T06:24:33.338 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-17T06:24:33.395 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-17T06:24:33.753 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-17T06:24:33.771 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:33.811 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:34.206 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-17T06:24:34.226 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-17T06:24:34.264 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-17T06:24:34.634 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-jwt. 2023-11-17T06:24:34.654 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-17T06:24:34.708 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-17T06:24:35.076 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-17T06:24:35.096 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-11-17T06:24:35.134 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-17T06:24:35.249 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph. 2023-11-17T06:24:35.270 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../053-ceph_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:35.307 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:35.395 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libjs-underscore. 2023-11-17T06:24:35.417 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-17T06:24:35.478 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-17T06:24:35.707 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-fuse. 2023-11-17T06:24:35.725 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:35.776 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:35.789 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-17T06:24:35.806 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-17T06:24:35.846 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-17T06:24:36.233 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-routes. 2023-11-17T06:24:36.252 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-11-17T06:24:36.254 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mds. 2023-11-17T06:24:36.273 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:36.290 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-17T06:24:36.312 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mds (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:36.686 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-17T06:24:36.706 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:36.744 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:36.865 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package cephadm. 2023-11-17T06:24:36.877 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../056-cephadm_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:36.914 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:37.209 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-17T06:24:37.222 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-11-17T06:24:37.258 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-11-17T06:24:37.323 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-decorator. 2023-11-17T06:24:37.343 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-17T06:24:37.380 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-17T06:24:37.670 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-jinja2. 2023-11-17T06:24:37.691 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-11-17T06:24:37.725 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-17T06:24:37.736 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-11-17T06:24:37.746 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-17T06:24:37.783 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-17T06:24:38.131 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-17T06:24:38.152 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:38.161 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-scipy. 2023-11-17T06:24:38.182 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-17T06:24:38.189 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:38.228 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-17T06:24:38.575 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-17T06:24:38.594 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-11-17T06:24:38.633 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-17T06:24:38.978 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-jwt. 2023-11-17T06:24:38.997 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-11-17T06:24:39.035 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-17T06:24:39.364 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-17T06:24:39.385 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-11-17T06:24:39.430 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-17T06:24:39.615 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-17T06:24:39.635 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-17T06:24:39.673 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-17T06:24:39.744 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libjs-underscore. 2023-11-17T06:24:39.766 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-11-17T06:24:39.810 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-17T06:24:40.138 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-11-17T06:24:40.150 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-11-17T06:24:40.187 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-17T06:24:40.267 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-joblib. 2023-11-17T06:24:40.288 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-11-17T06:24:40.333 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-17T06:24:40.507 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-routes. 2023-11-17T06:24:40.527 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-11-17T06:24:40.556 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-11-17T06:24:40.754 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-sklearn. 2023-11-17T06:24:40.774 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-17T06:24:40.812 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-17T06:24:40.910 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-17T06:24:40.928 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:40.968 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:41.513 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-decorator. 2023-11-17T06:24:41.532 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-11-17T06:24:41.570 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-11-17T06:24:41.596 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-17T06:24:41.617 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:41.662 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:41.949 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-11-17T06:24:41.969 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-11-17T06:24:41.998 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-17T06:24:42.360 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-scipy. 2023-11-17T06:24:42.377 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-11-17T06:24:42.417 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-11-17T06:24:42.890 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-cachetools. 2023-11-17T06:24:42.910 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-11-17T06:24:42.948 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-17T06:24:43.309 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-17T06:24:43.330 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-17T06:24:43.375 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-17T06:24:43.779 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-17T06:24:43.802 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-17T06:24:43.829 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-11-17T06:24:43.845 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-17T06:24:43.849 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-11-17T06:24:43.912 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-17T06:24:44.223 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-rsa. 2023-11-17T06:24:44.241 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-11-17T06:24:44.281 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-17T06:24:44.508 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-joblib. 2023-11-17T06:24:44.528 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-11-17T06:24:44.573 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-11-17T06:24:44.659 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-google-auth. 2023-11-17T06:24:44.679 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-11-17T06:24:44.717 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-17T06:24:45.009 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-sklearn. 2023-11-17T06:24:45.030 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-11-17T06:24:45.067 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-17T06:24:45.104 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-blinker. 2023-11-17T06:24:45.125 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-17T06:24:45.170 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-17T06:24:45.532 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-17T06:24:45.552 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-17T06:24:45.589 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-17T06:24:45.858 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-17T06:24:45.879 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:45.924 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:46.104 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-17T06:24:46.122 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-17T06:24:46.161 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-17T06:24:46.557 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-websocket. 2023-11-17T06:24:46.577 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-17T06:24:46.614 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-17T06:24:47.019 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-17T06:24:47.033 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-17T06:24:47.077 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-17T06:24:47.161 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-cachetools. 2023-11-17T06:24:47.178 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-11-17T06:24:47.218 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-11-17T06:24:47.555 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-17T06:24:47.575 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-11-17T06:24:47.621 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-11-17T06:24:47.750 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-17T06:24:47.767 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:47.807 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:47.999 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-17T06:24:48.018 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-11-17T06:24:48.057 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-17T06:24:48.144 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-17T06:24:48.164 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-11-17T06:24:48.212 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-17T06:24:48.427 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-rsa. 2023-11-17T06:24:48.445 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-11-17T06:24:48.484 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-rsa (4.0-3) ... 2023-11-17T06:24:48.606 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-17T06:24:48.623 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:24:48.663 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:24:48.873 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-google-auth. 2023-11-17T06:24:48.891 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-11-17T06:24:48.929 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-11-17T06:24:48.966 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package jq. 2023-11-17T06:24:48.986 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:24:49.024 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:24:49.257 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-blinker. 2023-11-17T06:24:52.293 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package socat. 2023-11-17T06:24:52.294 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-11-17T06:24:52.294 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-17T06:24:52.294 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package xmlstarlet. 2023-11-17T06:24:52.294 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-17T06:24:52.294 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-17T06:24:52.294 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-test. 2023-11-17T06:24:52.294 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../090-ceph-test_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:52.294 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-test (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-11-17T06:24:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-17T06:24:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-oauthlib. 2023-11-17T06:24:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-11-17T06:24:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-17T06:24:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-17T06:24:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-11-17T06:24:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-17T06:24:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-websocket. 2023-11-17T06:24:52.296 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-11-17T06:24:52.297 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-11-17T06:24:52.297 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-17T06:24:52.297 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-11-17T06:24:52.297 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-11-17T06:24:52.297 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-17T06:24:52.297 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:52.297 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:52.297 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-17T06:24:52.297 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-11-17T06:24:52.336 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-11-17T06:24:52.706 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-17T06:24:52.724 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:24:52.765 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:24:53.067 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package jq. 2023-11-17T06:24:53.086 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:24:53.150 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:24:53.444 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package socat. 2023-11-17T06:24:53.465 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-11-17T06:24:53.510 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking socat (1.7.3.3-2) ... 2023-11-17T06:24:53.872 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package xmlstarlet. 2023-11-17T06:24:53.890 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-11-17T06:24:53.930 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-11-17T06:24:54.360 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-test. 2023-11-17T06:24:54.380 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../090-ceph-test_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:54.425 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-test (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:54.655 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ceph-volume. 2023-11-17T06:24:54.675 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:54.712 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ceph-volume (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:55.175 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-17T06:24:55.198 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:55.241 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking cephfs-mirror (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:55.611 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-colorama. 2023-11-17T06:24:55.637 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-17T06:24:55.677 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-17T06:24:56.005 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package cephfs-shell. 2023-11-17T06:24:56.023 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:56.063 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking cephfs-shell (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:56.374 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package cephfs-top. 2023-11-17T06:24:56.395 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:56.432 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking cephfs-top (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:56.778 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-17T06:24:56.801 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-17T06:24:56.844 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:24:57.398 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-17T06:24:57.419 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:57.464 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libcephfs-dev (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:57.926 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package nvme-cli. 2023-11-17T06:24:57.943 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-17T06:24:58.014 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-17T06:24:58.348 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-17T06:24:58.368 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-17T06:24:58.414 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-17T06:24:58.779 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ceph-volume. 2023-11-17T06:24:58.792 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:24:58.833 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-17T06:24:58.837 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ceph-volume (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:58.854 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-17T06:24:58.891 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:24:59.266 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-17T06:24:59.319 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:24:59.325 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking cephfs-mirror (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:24:59.702 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-colorama. 2023-11-17T06:24:59.722 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-11-17T06:24:59.761 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-11-17T06:25:00.204 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package cephfs-shell. 2023-11-17T06:25:00.220 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:25:00.278 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking cephfs-shell (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:00.565 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package cephfs-top. 2023-11-17T06:25:00.587 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-6612-g895e5ada-1focal_all.deb ... 2023-11-17T06:25:00.631 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking cephfs-top (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:00.934 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package fonts-mathjax. 2023-11-17T06:25:00.957 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-17T06:25:00.960 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-17T06:25:00.981 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-17T06:25:01.000 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:25:01.025 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-17T06:25:01.491 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-17T06:25:01.515 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-17T06:25:01.566 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-17T06:25:01.646 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-17T06:25:01.665 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:25:01.704 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libcephfs-dev (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:02.054 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-attr. 2023-11-17T06:25:02.076 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-11-17T06:25:02.161 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-17T06:25:02.242 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package nvme-cli. 2023-11-17T06:25:02.260 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-11-17T06:25:02.351 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-11-17T06:25:02.577 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-webencodings. 2023-11-17T06:25:02.600 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-17T06:25:02.643 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-17T06:25:02.758 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-17T06:25:02.773 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-11-17T06:25:02.815 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-11-17T06:25:03.030 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-html5lib. 2023-11-17T06:25:03.047 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-11-17T06:25:03.087 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-17T06:25:03.218 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libjs-mathjax. 2023-11-17T06:25:03.237 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-11-17T06:25:03.276 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:25:03.491 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-17T06:25:03.513 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-17T06:25:03.557 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-17T06:25:04.061 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-packaging. 2023-11-17T06:25:04.079 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-11-17T06:25:04.118 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-17T06:25:04.463 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-pastescript. 2023-11-17T06:25:04.484 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-11-17T06:25:04.529 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-17T06:25:04.909 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-pluggy. 2023-11-17T06:25:04.924 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-11-17T06:25:04.966 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-17T06:25:05.336 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-psutil. 2023-11-17T06:25:05.355 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-17T06:25:05.378 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python-natsort-doc. 2023-11-17T06:25:05.394 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-17T06:25:05.399 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-11-17T06:25:05.444 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-11-17T06:25:05.807 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-py. 2023-11-17T06:25:05.809 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-atomicwrites. 2023-11-17T06:25:05.822 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-17T06:25:05.825 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-11-17T06:25:05.863 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-17T06:25:05.866 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-11-17T06:25:06.211 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-attr. 2023-11-17T06:25:06.230 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-11-17T06:25:06.234 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-17T06:25:06.251 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-17T06:25:06.285 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-11-17T06:25:06.291 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-17T06:25:06.662 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-pytest. 2023-11-17T06:25:06.664 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-webencodings. 2023-11-17T06:25:06.680 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-11-17T06:25:06.683 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-11-17T06:25:06.719 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-17T06:25:06.729 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-17T06:25:07.093 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-html5lib. 2023-11-17T06:25:07.112 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-11-17T06:25:07.115 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package python3-simplejson. 2023-11-17T06:25:07.130 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-17T06:25:07.150 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-11-17T06:25:07.172 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-17T06:25:07.526 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-17T06:25:07.547 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-17T06:25:07.562 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-11-17T06:25:07.583 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-17T06:25:07.584 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-11-17T06:25:07.628 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-17T06:25:08.139 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-packaging. 2023-11-17T06:25:08.151 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-11-17T06:25:08.189 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-packaging (20.3-1) ... 2023-11-17T06:25:08.296 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package radosgw. 2023-11-17T06:25:08.313 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../116-radosgw_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:25:08.353 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking radosgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:12.322 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package rbd-fuse. 2023-11-17T06:25:12.323 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:25:12.323 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking rbd-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:12.323 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-17T06:25:12.323 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-17T06:25:12.323 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-17T06:25:12.323 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-17T06:25:12.324 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:12.324 INFO:teuthology.orchestra.run.smithi069.stdout:Adding system user cephadm....done 2023-11-17T06:25:12.324 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:25:12.324 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-17T06:25:12.326 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pastescript. 2023-11-17T06:25:12.327 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-11-17T06:25:12.327 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-17T06:25:12.327 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pluggy. 2023-11-17T06:25:12.327 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-11-17T06:25:12.327 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-psutil. 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-py. 2023-11-17T06:25:12.328 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-11-17T06:25:12.329 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-11-17T06:25:12.329 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-17T06:25:12.329 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-11-17T06:25:12.329 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-17T06:25:12.329 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-pytest. 2023-11-17T06:25:12.329 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-11-17T06:25:12.330 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-11-17T06:25:12.330 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package python3-simplejson. 2023-11-17T06:25:12.330 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-11-17T06:25:12.330 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-17T06:25:12.330 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-17T06:25:12.331 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-11-17T06:25:12.331 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-17T06:25:12.389 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package radosgw. 2023-11-17T06:25:12.406 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../116-radosgw_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:25:12.446 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking radosgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:12.532 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-17T06:25:12.900 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:25:13.026 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-17T06:25:13.152 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-17T06:25:13.554 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-17T06:25:20.605 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-17T06:25:20.605 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-17T06:25:20.606 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-17T06:25:20.606 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-17T06:25:20.606 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-17T06:25:20.606 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-ceph-argparse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.606 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-17T06:25:20.607 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-17T06:25:20.607 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-17T06:25:20.607 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-17T06:25:20.607 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-17T06:25:20.607 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-17T06:25:20.607 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-17T06:25:20.608 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-17T06:25:20.608 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-17T06:25:20.608 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-17T06:25:20.608 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-17T06:25:20.608 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-17T06:25:20.609 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package rbd-fuse. 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-6612-g895e5ada-1focal_amd64.deb ... 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking rbd-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-attr (19.3.0-2) ... 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-11-17T06:25:20.610 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Adding system user cephadm....done 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-11-17T06:25:20.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-11-17T06:25:20.612 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-ceph-argparse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:20.612 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-11-17T06:25:20.612 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-11-17T06:25:20.821 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-17T06:25:20.879 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-11-17T06:25:20.989 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-17T06:25:21.115 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-17T06:25:21.247 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-11-17T06:25:21.460 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-17T06:25:21.614 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-11-17T06:25:21.741 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-11-17T06:25:21.945 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-17T06:25:22.200 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-11-17T06:25:22.330 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-17T06:25:22.587 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-11-17T06:25:22.781 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-17T06:25:22.938 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-11-17T06:25:23.249 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-17T06:25:23.364 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-11-17T06:25:23.375 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:23.723 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-11-17T06:25:23.785 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:25:23.927 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-17T06:25:24.132 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-11-17T06:25:24.354 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-17T06:25:24.490 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-17T06:25:24.525 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-packaging (20.3-1) ... 2023-11-17T06:25:24.632 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-17T06:25:24.894 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-11-17T06:25:25.008 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-17T06:25:25.027 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-11-17T06:25:25.153 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-11-17T06:25:25.393 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:25:25.504 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-11-17T06:25:25.552 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-17T06:25:25.678 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-17T06:25:25.989 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-11-17T06:25:26.071 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-17T06:25:26.407 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-11-17T06:25:26.822 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-17T06:25:26.850 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-11-17T06:25:27.215 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-17T06:25:27.328 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up socat (1.7.3.3-2) ... 2023-11-17T06:25:27.333 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-17T06:25:27.479 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:25:27.709 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-17T06:25:27.872 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:25:28.040 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-11-17T06:25:28.076 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-17T06:25:28.444 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-17T06:25:28.474 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-11-17T06:25:28.610 INFO:teuthology.orchestra.run.smithi069.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-17T06:25:28.625 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-11-17T06:25:28.751 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-11-17T06:25:28.921 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-17T06:25:29.047 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-17T06:25:29.135 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-11-17T06:25:29.448 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-17T06:25:29.512 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:25:29.664 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-11-17T06:25:29.789 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-11-17T06:25:29.875 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-17T06:25:30.001 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-17T06:25:30.160 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-17T06:25:30.216 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-11-17T06:25:30.561 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-17T06:25:30.826 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-11-17T06:25:30.920 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-17T06:25:31.334 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-11-17T06:25:31.588 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-17T06:25:31.836 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-11-17T06:25:32.229 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-11-17T06:25:32.605 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-11-17T06:25:32.776 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-11-17T06:25:32.801 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:25:32.927 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-17T06:25:33.098 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-11-17T06:25:33.224 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-11-17T06:25:33.395 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-17T06:25:33.625 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-11-17T06:25:33.771 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-17T06:25:34.060 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-11-17T06:25:34.156 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:25:34.211 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-11-17T06:25:34.282 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-17T06:25:34.337 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-11-17T06:25:34.708 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-17T06:25:34.746 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-11-17T06:25:35.097 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-11-17T06:25:35.109 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-17T06:25:35.578 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-17T06:26:30.295 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-17T06:26:30.295 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-17T06:26:30.295 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-17T06:26:30.349 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:26:30.349 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-17T06:26:30.349 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-17T06:26:30.349 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-17T06:26:30.349 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up librados2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up librgw2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libcephfs2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libradosstriper1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-17T06:26:30.350 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up librbd1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libcephfs-dev (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-rados (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up cephfs-top (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-rbd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.351 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up rbd-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-rgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up python3-cephfs (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up cephfs-shell (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi069.stdout:Adding group ceph....done 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi069.stdout:Adding system user ceph....done 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi069.stdout:Setting system user ceph properties....done 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi069.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-17T06:26:30.352 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up cephfs-mirror (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-test (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up radosgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-base (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-mds (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.353 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-mgr (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-osd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-mon (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.354 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ceph-volume (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-17T06:26:30.355 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-17T06:26:30.357 INFO:teuthology.orchestra.run.smithi069.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-17T06:26:30.357 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:26:30.357 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-11-17T06:26:30.358 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-11-17T06:26:30.358 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-11-17T06:26:30.358 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-11-17T06:26:30.358 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-11-17T06:26:30.358 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-11-17T06:26:30.358 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-11-17T06:26:30.358 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-11-17T06:26:30.358 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-11-17T06:26:30.358 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-11-17T06:26:30.358 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-rsa (4.0-3) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up librados2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up librgw2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.359 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libsqlite3-mod-ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libcephfs2 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-routes (2.4.1-2) ... 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libradosstriper1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up librbd1 (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr-modules-core (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libcephfs-dev (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.360 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-rados (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up cephfs-top (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-rbd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up rbd-fuse (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-rgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up python3-cephfs (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up cephfs-shell (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-common (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Adding group ceph....done 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Adding system user ceph....done 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:Setting system user ceph properties....done 2023-11-17T06:26:30.361 INFO:teuthology.orchestra.run.smithi093.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-17T06:26:30.362 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-17T06:26:30.362 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-17T06:26:30.362 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up cephfs-mirror (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.362 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-17T06:26:30.362 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-17T06:26:30.362 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-test (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.362 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up radosgw (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.362 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-17T06:26:30.362 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-17T06:26:30.362 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-base (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mds (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-osd (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr-k8sevents (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.363 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mon (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.364 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-17T06:26:30.364 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-17T06:26:30.364 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr-cephadm (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.364 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.364 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-mgr-dashboard (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.364 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ceph-volume (18.0.0-6612-g895e5ada-1focal) ... 2023-11-17T06:26:30.364 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-17T06:26:30.364 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-17T06:26:30.364 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-17T06:26:30.364 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-11-17T06:26:30.365 DEBUG:teuthology.orchestra.run.smithi069:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-17T06:26:30.366 INFO:teuthology.orchestra.run.smithi093.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-17T06:26:30.367 DEBUG:teuthology.orchestra.run.smithi093:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-17T06:26:30.496 INFO:teuthology.orchestra.run.smithi069.stdout:Reading package lists... 2023-11-17T06:26:30.498 INFO:teuthology.orchestra.run.smithi093.stdout:Reading package lists... 2023-11-17T06:26:30.707 INFO:teuthology.orchestra.run.smithi093.stdout:Building dependency tree... 2023-11-17T06:26:30.708 INFO:teuthology.orchestra.run.smithi093.stdout:Reading state information... 2023-11-17T06:26:30.710 INFO:teuthology.orchestra.run.smithi069.stdout:Building dependency tree... 2023-11-17T06:26:30.710 INFO:teuthology.orchestra.run.smithi069.stdout:Reading state information... 2023-11-17T06:26:30.905 INFO:teuthology.orchestra.run.smithi093.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-17T06:26:30.905 INFO:teuthology.orchestra.run.smithi093.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-17T06:26:30.905 INFO:teuthology.orchestra.run.smithi093.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-17T06:26:30.905 INFO:teuthology.orchestra.run.smithi093.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-17T06:26:30.905 INFO:teuthology.orchestra.run.smithi093.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-17T06:26:30.905 INFO:teuthology.orchestra.run.smithi093.stdout:The following packages were automatically installed and are no longer required: 2023-11-17T06:26:30.906 INFO:teuthology.orchestra.run.smithi093.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-17T06:26:30.906 INFO:teuthology.orchestra.run.smithi093.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-17T06:26:30.906 INFO:teuthology.orchestra.run.smithi093.stdout:The following additional packages will be installed: 2023-11-17T06:26:30.906 INFO:teuthology.orchestra.run.smithi093.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-17T06:26:30.907 INFO:teuthology.orchestra.run.smithi069.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-11-17T06:26:30.907 INFO:teuthology.orchestra.run.smithi069.stdout:flex is already the newest version (2.6.4-6.2). 2023-11-17T06:26:30.907 INFO:teuthology.orchestra.run.smithi069.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-11-17T06:26:30.907 INFO:teuthology.orchestra.run.smithi069.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-11-17T06:26:30.908 INFO:teuthology.orchestra.run.smithi069.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-11-17T06:26:30.908 INFO:teuthology.orchestra.run.smithi069.stdout:The following packages were automatically installed and are no longer required: 2023-11-17T06:26:30.908 INFO:teuthology.orchestra.run.smithi093.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-17T06:26:30.909 INFO:teuthology.orchestra.run.smithi093.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-17T06:26:30.909 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-17T06:26:30.909 INFO:teuthology.orchestra.run.smithi093.stdout: usb-modeswitch-data wpasupplicant 2023-11-17T06:26:30.909 INFO:teuthology.orchestra.run.smithi093.stdout:Suggested packages: 2023-11-17T06:26:30.909 INFO:teuthology.orchestra.run.smithi093.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-17T06:26:30.909 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-17T06:26:30.909 INFO:teuthology.orchestra.run.smithi093.stdout: libengine-pkcs11-openssl 2023-11-17T06:26:30.911 INFO:teuthology.orchestra.run.smithi069.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-11-17T06:26:30.911 INFO:teuthology.orchestra.run.smithi069.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-17T06:26:30.911 INFO:teuthology.orchestra.run.smithi069.stdout:The following additional packages will be installed: 2023-11-17T06:26:30.911 INFO:teuthology.orchestra.run.smithi069.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-11-17T06:26:30.911 INFO:teuthology.orchestra.run.smithi069.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-11-17T06:26:30.911 INFO:teuthology.orchestra.run.smithi069.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-11-17T06:26:30.911 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-11-17T06:26:30.912 INFO:teuthology.orchestra.run.smithi069.stdout: usb-modeswitch-data wpasupplicant 2023-11-17T06:26:30.912 INFO:teuthology.orchestra.run.smithi069.stdout:Suggested packages: 2023-11-17T06:26:30.912 INFO:teuthology.orchestra.run.smithi069.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-11-17T06:26:30.912 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-11-17T06:26:30.912 INFO:teuthology.orchestra.run.smithi069.stdout: libengine-pkcs11-openssl 2023-11-17T06:26:31.012 INFO:teuthology.orchestra.run.smithi069.stdout:The following NEW packages will be installed: 2023-11-17T06:26:31.013 INFO:teuthology.orchestra.run.smithi069.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-17T06:26:31.013 INFO:teuthology.orchestra.run.smithi069.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-17T06:26:31.013 INFO:teuthology.orchestra.run.smithi093.stdout:The following NEW packages will be installed: 2023-11-17T06:26:31.014 INFO:teuthology.orchestra.run.smithi069.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-17T06:26:31.014 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-17T06:26:31.014 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-17T06:26:31.014 INFO:teuthology.orchestra.run.smithi069.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-17T06:26:31.016 INFO:teuthology.orchestra.run.smithi069.stdout:The following packages will be upgraded: 2023-11-17T06:26:31.018 INFO:teuthology.orchestra.run.smithi093.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-11-17T06:26:31.018 INFO:teuthology.orchestra.run.smithi093.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-11-17T06:26:31.018 INFO:teuthology.orchestra.run.smithi093.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-11-17T06:26:31.018 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-11-17T06:26:31.018 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-11-17T06:26:31.018 INFO:teuthology.orchestra.run.smithi093.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-17T06:26:31.018 INFO:teuthology.orchestra.run.smithi093.stdout:The following packages will be upgraded: 2023-11-17T06:26:31.018 INFO:teuthology.orchestra.run.smithi093.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-17T06:26:31.019 INFO:teuthology.orchestra.run.smithi069.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-11-17T06:26:31.081 INFO:teuthology.orchestra.run.smithi093.stdout:6 upgraded, 31 newly installed, 0 to remove and 254 not upgraded. 2023-11-17T06:26:31.081 INFO:teuthology.orchestra.run.smithi093.stdout:Need to get 25.3 MB of archives. 2023-11-17T06:26:31.081 INFO:teuthology.orchestra.run.smithi093.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-17T06:26:31.082 INFO:teuthology.orchestra.run.smithi093.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-17T06:26:31.214 INFO:teuthology.orchestra.run.smithi069.stdout:6 upgraded, 31 newly installed, 0 to remove and 254 not upgraded. 2023-11-17T06:26:31.215 INFO:teuthology.orchestra.run.smithi069.stdout:Need to get 25.3 MB of archives. 2023-11-17T06:26:31.215 INFO:teuthology.orchestra.run.smithi069.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-11-17T06:26:31.215 INFO:teuthology.orchestra.run.smithi069.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-11-17T06:26:31.216 INFO:teuthology.orchestra.run.smithi093.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-17T06:26:31.218 INFO:teuthology.orchestra.run.smithi093.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-17T06:26:31.219 INFO:teuthology.orchestra.run.smithi093.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-17T06:26:31.224 INFO:teuthology.orchestra.run.smithi093.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-17T06:26:31.225 INFO:teuthology.orchestra.run.smithi093.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-17T06:26:31.241 INFO:teuthology.orchestra.run.smithi093.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-17T06:26:31.242 INFO:teuthology.orchestra.run.smithi093.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-17T06:26:31.244 INFO:teuthology.orchestra.run.smithi093.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-17T06:26:31.245 INFO:teuthology.orchestra.run.smithi093.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-17T06:26:31.245 INFO:teuthology.orchestra.run.smithi093.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-17T06:26:31.250 INFO:teuthology.orchestra.run.smithi093.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-17T06:26:31.251 INFO:teuthology.orchestra.run.smithi093.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-17T06:26:31.252 INFO:teuthology.orchestra.run.smithi093.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-17T06:26:31.253 INFO:teuthology.orchestra.run.smithi093.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-17T06:26:31.267 INFO:teuthology.orchestra.run.smithi093.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-17T06:26:31.267 INFO:teuthology.orchestra.run.smithi093.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-17T06:26:31.273 INFO:teuthology.orchestra.run.smithi093.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-17T06:26:31.275 INFO:teuthology.orchestra.run.smithi093.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-17T06:26:31.284 INFO:teuthology.orchestra.run.smithi093.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-17T06:26:31.285 INFO:teuthology.orchestra.run.smithi093.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-17T06:26:31.301 INFO:teuthology.orchestra.run.smithi093.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-17T06:26:31.301 INFO:teuthology.orchestra.run.smithi093.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-17T06:26:31.310 INFO:teuthology.orchestra.run.smithi093.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-17T06:26:31.322 INFO:teuthology.orchestra.run.smithi093.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-17T06:26:31.341 INFO:teuthology.orchestra.run.smithi093.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-17T06:26:31.344 INFO:teuthology.orchestra.run.smithi093.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-17T06:26:31.345 INFO:teuthology.orchestra.run.smithi093.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-17T06:26:31.345 INFO:teuthology.orchestra.run.smithi093.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-17T06:26:31.346 INFO:teuthology.orchestra.run.smithi093.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-17T06:26:31.357 INFO:teuthology.orchestra.run.smithi093.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-17T06:26:31.358 INFO:teuthology.orchestra.run.smithi093.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-17T06:26:31.489 INFO:teuthology.orchestra.run.smithi093.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-17T06:26:31.489 INFO:teuthology.orchestra.run.smithi093.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-17T06:26:31.489 INFO:teuthology.orchestra.run.smithi093.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-17T06:26:31.489 INFO:teuthology.orchestra.run.smithi093.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-17T06:26:31.490 INFO:teuthology.orchestra.run.smithi093.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-17T06:26:31.853 INFO:teuthology.orchestra.run.smithi069.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-11-17T06:26:31.856 INFO:teuthology.orchestra.run.smithi069.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-11-17T06:26:31.857 INFO:teuthology.orchestra.run.smithi069.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-11-17T06:26:31.869 INFO:teuthology.orchestra.run.smithi069.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-11-17T06:26:31.872 INFO:teuthology.orchestra.run.smithi069.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-11-17T06:26:31.970 INFO:teuthology.orchestra.run.smithi069.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-11-17T06:26:31.971 INFO:teuthology.orchestra.run.smithi069.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-11-17T06:26:31.979 INFO:teuthology.orchestra.run.smithi069.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-11-17T06:26:31.984 INFO:teuthology.orchestra.run.smithi069.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-11-17T06:26:31.984 INFO:teuthology.orchestra.run.smithi069.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-11-17T06:26:32.044 INFO:teuthology.orchestra.run.smithi093.stdout:Preconfiguring packages ... 2023-11-17T06:26:32.151 INFO:teuthology.orchestra.run.smithi069.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-11-17T06:26:32.263 INFO:teuthology.orchestra.run.smithi093.stdout:Fetched 25.3 MB in 0s (54.4 MB/s) 2023-11-17T06:26:32.424 INFO:teuthology.orchestra.run.smithi069.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-11-17T06:26:32.565 INFO:teuthology.orchestra.run.smithi069.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-11-17T06:26:32.572 INFO:teuthology.orchestra.run.smithi069.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-11-17T06:26:32.674 INFO:teuthology.orchestra.run.smithi069.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-11-17T06:26:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-11-17T06:26:32.740 INFO:teuthology.orchestra.run.smithi093.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:26:32.743 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:26:32.758 INFO:teuthology.orchestra.run.smithi069.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.16-0ubuntu0.20.04.1 [115 kB] 2023-11-17T06:26:32.775 INFO:teuthology.orchestra.run.smithi069.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-11-17T06:26:32.842 INFO:teuthology.orchestra.run.smithi069.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-11-17T06:26:32.842 INFO:teuthology.orchestra.run.smithi069.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-11-17T06:26:32.927 INFO:teuthology.orchestra.run.smithi069.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-11-17T06:26:32.958 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:26:33.091 INFO:teuthology.orchestra.run.smithi069.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-11-17T06:26:33.722 INFO:teuthology.orchestra.run.smithi069.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-11-17T06:26:33.822 INFO:teuthology.orchestra.run.smithi069.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-11-17T06:26:33.911 INFO:teuthology.orchestra.run.smithi069.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-11-17T06:26:33.920 INFO:teuthology.orchestra.run.smithi069.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-11-17T06:26:33.920 INFO:teuthology.orchestra.run.smithi069.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-11-17T06:26:33.921 INFO:teuthology.orchestra.run.smithi069.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-11-17T06:26:33.922 INFO:teuthology.orchestra.run.smithi069.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.16-0ubuntu0.20.04.1 [1,053 kB] 2023-11-17T06:26:33.955 INFO:teuthology.orchestra.run.smithi069.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-11-17T06:26:33.960 INFO:teuthology.orchestra.run.smithi069.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.16-0ubuntu0.20.04.1 [13.5 MB] 2023-11-17T06:26:34.331 INFO:teuthology.orchestra.run.smithi069.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-11-17T06:26:34.496 INFO:teuthology.orchestra.run.smithi069.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-11-17T06:26:34.573 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-17T06:26:34.579 INFO:teuthology.orchestra.run.smithi069.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-11-17T06:26:34.580 INFO:teuthology.orchestra.run.smithi069.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-11-17T06:26:34.695 INFO:teuthology.orchestra.run.smithi069.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-11-17T06:26:35.371 INFO:teuthology.orchestra.run.smithi069.stdout:Preconfiguring packages ... 2023-11-17T06:26:35.624 INFO:teuthology.orchestra.run.smithi069.stdout:Fetched 25.3 MB in 4s (6,720 kB/s) 2023-11-17T06:26:35.964 INFO:teuthology.orchestra.run.smithi069.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:26:35.968 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:26:36.150 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:26:36.566 INFO:teuthology.orchestra.run.smithi093.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:26:36.570 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:26:36.725 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:26:37.169 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:26:37.407 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:26:37.694 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-11-17T06:26:37.771 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-17T06:26:38.280 INFO:teuthology.orchestra.run.smithi093.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:26:38.283 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:26:38.439 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-17T06:26:38.958 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:26:39.094 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-17T06:26:39.637 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-17T06:26:44.210 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-17T06:26:44.210 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-17T06:26:44.210 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-17T06:26:44.210 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-17T06:26:44.210 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package dump. 2023-11-17T06:26:44.210 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-17T06:26:44.210 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking dump (0.4b46-6) ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package indent. 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:26:44.211 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:44.212 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi069.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-11-17T06:26:44.213 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118812 files and directories currently installed.) 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-11-17T06:26:44.214 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-11-17T06:26:44.246 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package dump. 2023-11-17T06:26:44.266 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-11-17T06:26:44.304 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking dump (0.4b46-6) ... 2023-11-17T06:26:44.596 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-17T06:26:44.615 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-17T06:26:44.654 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-17T06:26:44.666 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package indent. 2023-11-17T06:26:44.688 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:44.733 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-17T06:26:45.040 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-17T06:26:45.060 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-17T06:26:45.098 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-17T06:26:45.119 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-17T06:26:45.141 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-11-17T06:26:45.186 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-11-17T06:26:45.510 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-17T06:26:45.532 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:45.572 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-17T06:26:45.594 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-11-17T06:26:45.601 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:45.639 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-17T06:26:45.950 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-17T06:26:45.962 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-17T06:26:45.972 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-11-17T06:26:45.983 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:46.016 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:26:46.020 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:26:46.398 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-17T06:26:46.411 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-17T06:26:46.422 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:46.431 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:46.465 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:26:46.469 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:26:46.756 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-17T06:26:46.775 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:46.801 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-17T06:26:46.822 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-17T06:26:46.838 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:26:46.867 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:26:47.191 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-17T06:26:47.210 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:47.283 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:26:47.429 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-17T06:26:47.448 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-17T06:26:47.487 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-17T06:26:47.715 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-17T06:26:47.736 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-11-17T06:26:47.786 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-17T06:26:47.915 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package modemmanager. 2023-11-17T06:26:47.935 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:47.992 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:26:48.180 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-17T06:26:48.203 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-17T06:26:48.246 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-17T06:26:48.646 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package wpasupplicant. 2023-11-17T06:26:48.660 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-17T06:26:48.666 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-17T06:26:48.684 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../14-libpq5_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:48.704 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-17T06:26:48.724 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:49.144 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-17T06:26:49.166 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:49.210 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:26:49.302 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package network-manager. 2023-11-17T06:26:49.322 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-17T06:26:49.446 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-17T06:26:49.580 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-17T06:26:49.603 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:49.646 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:26:49.907 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-17T06:26:54.270 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-11-17T06:26:54.271 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:26:54.271 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-17T06:26:54.271 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-11-17T06:26:54.271 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-11-17T06:26:54.271 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package modemmanager. 2023-11-17T06:26:54.271 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-11-17T06:26:54.272 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:26:54.272 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package wpasupplicant. 2023-11-17T06:26:54.272 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-11-17T06:26:54.272 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-17T06:26:54.272 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package network-manager. 2023-11-17T06:26:54.273 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-11-17T06:26:54.273 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-11-17T06:26:54.273 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package ppp. 2023-11-17T06:26:54.273 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-17T06:26:54.273 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-17T06:26:54.274 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package ppp. 2023-11-17T06:26:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-11-17T06:26:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-17T06:26:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package pptp-linux. 2023-11-17T06:26:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-17T06:26:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-17T06:26:54.275 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-17T06:26:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-17T06:26:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-17T06:26:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-17T06:26:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-17T06:26:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-17T06:26:54.276 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-17T06:26:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-common. 2023-11-17T06:26:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-17T06:26:54.277 INFO:teuthology.orchestra.run.smithi093.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-17T06:26:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-17T06:26:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-12. 2023-11-17T06:26:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:54.278 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:54.353 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package pptp-linux. 2023-11-17T06:26:54.375 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-11-17T06:26:54.419 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-11-17T06:26:54.822 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-17T06:26:54.843 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-11-17T06:26:54.957 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-11-17T06:26:55.275 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-17T06:26:55.294 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-11-17T06:26:55.366 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-11-17T06:26:55.679 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql. 2023-11-17T06:26:55.702 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:55.712 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package postgresql-client-12. 2023-11-17T06:26:55.727 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../26-postgresql-client-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:55.745 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-17T06:26:55.815 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:56.047 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-client. 2023-11-17T06:26:56.069 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:56.114 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-17T06:26:56.383 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-17T06:26:56.404 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:56.491 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-17T06:26:56.492 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package postgresql-common. 2023-11-17T06:26:56.514 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-11-17T06:26:56.591 INFO:teuthology.orchestra.run.smithi069.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-17T06:26:56.620 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-11-17T06:26:56.777 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-17T06:26:56.799 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-17T06:26:56.843 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-17T06:26:57.137 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package postgresql-12. 2023-11-17T06:26:57.158 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../28-postgresql-12_12.16-0ubuntu0.20.04.1_amd64.deb ... 2023-11-17T06:26:57.206 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:57.246 INFO:teuthology.orchestra.run.smithi093.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-17T06:26:57.266 INFO:teuthology.orchestra.run.smithi093.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-17T06:26:57.327 INFO:teuthology.orchestra.run.smithi093.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-17T06:26:57.698 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-17T06:26:57.910 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:26:58.253 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:26:58.379 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-17T06:26:58.505 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-17T06:26:58.656 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-17T06:26:58.876 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package postgresql. 2023-11-17T06:26:58.898 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:58.967 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-11-17T06:26:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-17T06:26:59.088 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-17T06:26:59.253 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package postgresql-client. 2023-11-17T06:26:59.275 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:59.320 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-11-17T06:26:59.622 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-17T06:26:59.644 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-11-17T06:26:59.688 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-11-17T06:26:59.991 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-17T06:27:00.014 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-11-17T06:27:00.026 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:27:00.057 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-11-17T06:27:00.494 INFO:teuthology.orchestra.run.smithi069.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-17T06:27:00.516 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-11-17T06:27:00.584 INFO:teuthology.orchestra.run.smithi069.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-17T06:27:00.950 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-11-17T06:27:01.158 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:27:01.534 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libpq5:amd64 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:27:01.685 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-11-17T06:27:01.828 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-11-17T06:27:01.954 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-11-17T06:27:02.134 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-17T06:27:02.239 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-17T06:27:02.365 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-17T06:27:02.431 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-17T06:27:02.432 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-17T06:27:02.525 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-17T06:27:03.341 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up postgresql-client-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:27:04.154 INFO:teuthology.orchestra.run.smithi093.stdout:Adding user postgres to group ssl-cert 2023-11-17T06:27:04.512 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:04.513 INFO:teuthology.orchestra.run.smithi093.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-17T06:27:05.005 INFO:teuthology.orchestra.run.smithi093.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-17T06:27:05.005 INFO:teuthology.orchestra.run.smithi093.stdout:Removing obsolete dictionary files: 2023-11-17T06:27:05.459 INFO:teuthology.orchestra.run.smithi069.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-17T06:27:05.550 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-17T06:27:05.570 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-11-17T06:27:05.721 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-11-17T06:27:05.847 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-11-17T06:27:06.994 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:27:07.119 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-17T06:27:07.136 INFO:teuthology.orchestra.run.smithi069.stdout:Adding user postgres to group ssl-cert 2023-11-17T06:27:07.246 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-17T06:27:07.404 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-17T06:27:07.526 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:07.527 INFO:teuthology.orchestra.run.smithi069.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-17T06:27:08.005 INFO:teuthology.orchestra.run.smithi069.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-17T06:27:08.005 INFO:teuthology.orchestra.run.smithi069.stdout:Removing obsolete dictionary files: 2023-11-17T06:27:08.559 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-17T06:27:08.612 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-17T06:27:09.035 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up dump (0.4b46-6) ... 2023-11-17T06:27:09.144 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-17T06:27:09.212 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:27:09.338 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-17T06:27:09.464 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-17T06:27:09.623 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-17T06:27:09.810 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-17T06:27:09.936 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:27:09.981 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-11-17T06:27:10.107 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-11-17T06:27:10.266 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-11-17T06:27:10.393 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-11-17T06:27:10.421 INFO:teuthology.orchestra.run.smithi093.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-17T06:27:10.448 INFO:teuthology.orchestra.run.smithi093.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-17T06:27:10.515 INFO:teuthology.orchestra.run.smithi093.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-17T06:27:10.515 INFO:teuthology.orchestra.run.smithi093.stdout:This user must also own the server process. 2023-11-17T06:27:10.515 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:10.516 INFO:teuthology.orchestra.run.smithi093.stdout:The database cluster will be initialized with locale "en_US". 2023-11-17T06:27:10.516 INFO:teuthology.orchestra.run.smithi093.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-17T06:27:10.516 INFO:teuthology.orchestra.run.smithi093.stdout:The default text search configuration will be set to "english". 2023-11-17T06:27:10.516 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:10.516 INFO:teuthology.orchestra.run.smithi093.stdout:Data page checksums are disabled. 2023-11-17T06:27:10.516 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:10.517 INFO:teuthology.orchestra.run.smithi093.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-17T06:27:10.518 INFO:teuthology.orchestra.run.smithi093.stdout:creating subdirectories ... ok 2023-11-17T06:27:10.518 INFO:teuthology.orchestra.run.smithi093.stdout:selecting dynamic shared memory implementation ... posix 2023-11-17T06:27:10.554 INFO:teuthology.orchestra.run.smithi093.stdout:selecting default max_connections ... 100 2023-11-17T06:27:10.600 INFO:teuthology.orchestra.run.smithi093.stdout:selecting default shared_buffers ... 128MB 2023-11-17T06:27:10.625 INFO:teuthology.orchestra.run.smithi093.stdout:selecting default time zone ... Etc/UTC 2023-11-17T06:27:10.626 INFO:teuthology.orchestra.run.smithi093.stdout:creating configuration files ... ok 2023-11-17T06:27:10.808 INFO:teuthology.orchestra.run.smithi093.stdout:running bootstrap script ... ok 2023-11-17T06:27:11.459 INFO:teuthology.orchestra.run.smithi093.stdout:performing post-bootstrap initialization ... ok 2023-11-17T06:27:11.645 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-11-17T06:27:11.984 INFO:teuthology.orchestra.run.smithi093.stdout:syncing data to disk ... ok 2023-11-17T06:27:11.984 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:11.984 INFO:teuthology.orchestra.run.smithi093.stdout:Success. You can now start the database server using: 2023-11-17T06:27:11.984 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:11.984 INFO:teuthology.orchestra.run.smithi093.stdout: pg_ctlcluster 12 main start 2023-11-17T06:27:11.984 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:12.064 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up dump (0.4b46-6) ... 2023-11-17T06:27:12.172 INFO:teuthology.orchestra.run.smithi069.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-17T06:27:12.241 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:27:12.369 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-11-17T06:27:12.520 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-11-17T06:27:12.577 INFO:teuthology.orchestra.run.smithi093.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-17T06:27:12.577 INFO:teuthology.orchestra.run.smithi093.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-17T06:27:12.646 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-11-17T06:27:12.787 INFO:teuthology.orchestra.run.smithi093.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-17T06:27:12.857 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-11-17T06:27:12.990 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up postgresql-12 (12.16-0ubuntu0.20.04.1) ... 2023-11-17T06:27:13.503 INFO:teuthology.orchestra.run.smithi069.stdout:Creating new PostgreSQL cluster 12/main ... 2023-11-17T06:27:13.535 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-11-17T06:27:13.607 INFO:teuthology.orchestra.run.smithi069.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-17T06:27:13.607 INFO:teuthology.orchestra.run.smithi069.stdout:This user must also own the server process. 2023-11-17T06:27:13.607 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:13.607 INFO:teuthology.orchestra.run.smithi069.stdout:The database cluster will be initialized with locale "en_US". 2023-11-17T06:27:13.608 INFO:teuthology.orchestra.run.smithi069.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-17T06:27:13.608 INFO:teuthology.orchestra.run.smithi069.stdout:The default text search configuration will be set to "english". 2023-11-17T06:27:13.608 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:13.608 INFO:teuthology.orchestra.run.smithi069.stdout:Data page checksums are disabled. 2023-11-17T06:27:13.608 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:13.608 INFO:teuthology.orchestra.run.smithi069.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-11-17T06:27:13.610 INFO:teuthology.orchestra.run.smithi069.stdout:creating subdirectories ... ok 2023-11-17T06:27:13.611 INFO:teuthology.orchestra.run.smithi069.stdout:selecting dynamic shared memory implementation ... posix 2023-11-17T06:27:13.647 INFO:teuthology.orchestra.run.smithi069.stdout:selecting default max_connections ... 100 2023-11-17T06:27:13.696 INFO:teuthology.orchestra.run.smithi069.stdout:selecting default shared_buffers ... 128MB 2023-11-17T06:27:13.719 INFO:teuthology.orchestra.run.smithi069.stdout:selecting default time zone ... Etc/UTC 2023-11-17T06:27:13.720 INFO:teuthology.orchestra.run.smithi069.stdout:creating configuration files ... ok 2023-11-17T06:27:13.908 INFO:teuthology.orchestra.run.smithi069.stdout:running bootstrap script ... ok 2023-11-17T06:27:14.548 INFO:teuthology.orchestra.run.smithi069.stdout:performing post-bootstrap initialization ... ok 2023-11-17T06:27:15.062 INFO:teuthology.orchestra.run.smithi069.stdout:syncing data to disk ... ok 2023-11-17T06:27:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:15.062 INFO:teuthology.orchestra.run.smithi069.stdout:Success. You can now start the database server using: 2023-11-17T06:27:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: pg_ctlcluster 12 main start 2023-11-17T06:27:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:15.655 INFO:teuthology.orchestra.run.smithi069.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-11-17T06:27:15.656 INFO:teuthology.orchestra.run.smithi069.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-11-17T06:27:15.872 INFO:teuthology.orchestra.run.smithi069.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-17T06:27:16.485 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:27:16.611 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:27:16.770 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-17T06:27:16.938 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:27:17.064 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-17T06:27:17.190 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-17T06:27:18.419 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:18.419 INFO:teuthology.orchestra.run.smithi093.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-17T06:27:18.420 INFO:teuthology.orchestra.run.smithi093.stdout:which means they are currently configured by ifupdown: 2023-11-17T06:27:18.420 INFO:teuthology.orchestra.run.smithi093.stdout:- enp3s0f1 2023-11-17T06:27:18.420 INFO:teuthology.orchestra.run.smithi093.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-17T06:27:18.420 INFO:teuthology.orchestra.run.smithi093.stdout:remove their configuration from /etc/network/interfaces. 2023-11-17T06:27:18.420 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:18.657 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-17T06:27:19.213 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-17T06:27:19.523 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:27:19.680 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:27:19.816 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-11-17T06:27:19.984 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:27:20.143 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-11-17T06:27:20.190 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-17T06:27:20.270 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-11-17T06:27:21.176 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:27:21.310 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-17T06:27:21.470 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:27:21.470 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:21.471 INFO:teuthology.orchestra.run.smithi069.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-17T06:27:21.471 INFO:teuthology.orchestra.run.smithi069.stdout:which means they are currently configured by ifupdown: 2023-11-17T06:27:21.471 INFO:teuthology.orchestra.run.smithi069.stdout:- enp3s0f1 2023-11-17T06:27:21.471 INFO:teuthology.orchestra.run.smithi069.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-17T06:27:21.471 INFO:teuthology.orchestra.run.smithi069.stdout:remove their configuration from /etc/network/interfaces. 2023-11-17T06:27:21.471 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:21.621 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-17T06:27:21.704 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-17T06:27:21.746 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-17T06:27:21.873 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:27:21.998 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:27:22.151 INFO:teuthology.orchestra.run.smithi093.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:27:22.265 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-17T06:27:22.487 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-17T06:27:22.487 INFO:teuthology.orchestra.run.smithi093.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-17T06:27:23.246 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-17T06:27:23.502 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-17T06:27:23.614 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-17T06:27:23.796 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-17T06:27:23.955 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-17T06:27:24.172 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-11-17T06:27:24.324 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-11-17T06:27:24.465 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-17T06:27:24.483 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-11-17T06:27:24.633 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-11-17T06:27:24.776 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-11-17T06:27:24.911 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:27:25.062 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-11-17T06:27:25.187 INFO:teuthology.orchestra.run.smithi069.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-11-17T06:27:25.492 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-17T06:27:25.492 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-17T06:27:26.482 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-11-17T06:27:26.591 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-17T06:27:26.725 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-11-17T06:27:26.927 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-11-17T06:27:27.420 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-11-17T06:27:38.252 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-17T06:27:38.369 INFO:teuthology.orchestra.run.smithi093.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-17T06:27:39.612 INFO:teuthology.orchestra.run.smithi093.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-17T06:27:39.619 DEBUG:teuthology.parallel:result is None 2023-11-17T06:27:40.826 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-11-17T06:27:40.940 INFO:teuthology.orchestra.run.smithi069.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-11-17T06:27:42.224 INFO:teuthology.orchestra.run.smithi069.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-17T06:27:42.230 DEBUG:teuthology.parallel:result is None 2023-11-17T06:27:42.230 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-17T06:27:42.646 DEBUG:teuthology.orchestra.run.smithi069:> dpkg-query -W -f '${Version}' ceph 2023-11-17T06:27:42.683 INFO:teuthology.orchestra.run.smithi069.stdout:18.0.0-6612-g895e5ada-1focal 2023-11-17T06:27:42.684 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6612-g895e5ada-1focal 2023-11-17T06:27:42.684 INFO:teuthology.task.install:The correct ceph version 18.0.0-6612-g895e5ada-1focal is installed. 2023-11-17T06:27:42.684 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=895e5adad9a763a0f13587c485b17f1ad3f04528 2023-11-17T06:27:43.050 DEBUG:teuthology.orchestra.run.smithi093:> dpkg-query -W -f '${Version}' ceph 2023-11-17T06:27:43.092 INFO:teuthology.orchestra.run.smithi093.stdout:18.0.0-6612-g895e5ada-1focal 2023-11-17T06:27:43.092 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6612-g895e5ada-1focal 2023-11-17T06:27:43.092 INFO:teuthology.task.install:The correct ceph version 18.0.0-6612-g895e5ada-1focal is installed. 2023-11-17T06:27:43.092 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-17T06:27:43.093 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:43.093 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-17T06:27:43.127 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:27:43.127 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-17T06:27:43.180 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-17T06:27:43.180 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:43.180 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2023-11-17T06:27:43.214 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-17T06:27:43.291 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:27:43.292 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/daemon-helper 2023-11-17T06:27:43.325 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-17T06:27:43.403 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-17T06:27:43.404 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:43.404 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-17T06:27:43.444 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-17T06:27:43.528 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:27:43.528 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-17T06:27:43.565 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-17T06:27:43.642 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-17T06:27:43.643 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:43.643 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2023-11-17T06:27:43.678 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-17T06:27:43.753 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:27:43.753 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/stdin-killer 2023-11-17T06:27:43.790 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-17T06:27:43.866 INFO:teuthology.run_tasks:Running task ceph... 2023-11-17T06:27:43.936 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-17T06:27:43.936 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /var/log/ceph 2023-11-17T06:27:43.944 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 777 /var/log/ceph 2023-11-17T06:27:43.976 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-17T06:27:43.977 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-17T06:27:44.021 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-17T06:27:44.053 INFO:tasks.ceph:Creating extra log directories... 2023-11-17T06:27:44.053 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-17T06:27:44.101 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-17T06:27:44.143 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-17T06:27:44.143 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-17T06:27:44.143 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-17T06:27:44.144 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:44.144 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-17T06:27:44.202 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-17T06:27:44.327 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:27:44.327 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-17T06:27:44.348 DEBUG:teuthology.orchestra.run.smithi093:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-17T06:27:44.474 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-17T06:27:44.475 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-17T06:27:44.475 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341', 'branch': 'wip-57087-3', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7461341', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-57087-3'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-57087-3', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 20, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1441, 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-57087-3', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi069.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi093.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '5b73517e0e2fa132ea79290e5fc06ea5349b2288'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': '895e5adad9a763a0f13587c485b17f1ad3f04528', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6899cd26fceddb2fec83dc1a1349394b28c8998e', 'timestamp': '2023-11-17_05:53:21', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1224587'} 2023-11-17T06:27:44.475 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-17T06:27:44.483 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-17T06:27:44.501 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/run/ceph 2023-11-17T06:27:44.545 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/run/ceph 2023-11-17T06:27:44.582 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:44.582 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2023-11-17T06:27:44.635 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-17T06:27:44.635 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2023-11-17T06:27:44.700 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-17T06:27:44.700 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:44.700 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 496 Links: 1 2023-11-17T06:27:44.700 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:44.700 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-11-17 06:21:15.972975289 +0000 2023-11-17T06:27:44.700 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-11-17 06:21:15.488990807 +0000 2023-11-17T06:27:44.701 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-11-17 06:21:15.488990807 +0000 2023-11-17T06:27:44.701 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-11-17T06:27:44.701 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-11-17T06:27:44.773 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000635709 s, 805 kB/s 2023-11-17T06:27:44.775 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-17T06:27:44.841 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2023-11-17T06:27:44.904 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-17T06:27:44.904 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:44.904 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 499 Links: 1 2023-11-17T06:27:44.904 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:44.904 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-11-17 06:21:16.772949640 +0000 2023-11-17T06:27:44.904 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-11-17 06:21:16.272965671 +0000 2023-11-17T06:27:44.904 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-11-17 06:21:16.272965671 +0000 2023-11-17T06:27:44.904 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-11-17T06:27:44.905 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-17T06:27:44.979 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-11-17T06:27:44.980 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-11-17T06:27:44.980 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.00062293 s, 822 kB/s 2023-11-17T06:27:44.981 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-17T06:27:45.051 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2023-11-17T06:27:45.116 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-17T06:27:45.116 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:45.116 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 507 Links: 1 2023-11-17T06:27:45.116 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:45.116 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-11-17 06:21:17.520926178 +0000 2023-11-17T06:27:45.116 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-11-17 06:21:17.052940714 +0000 2023-11-17T06:27:45.116 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-11-17 06:21:17.052940714 +0000 2023-11-17T06:27:45.117 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-11-17T06:27:45.117 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-17T06:27:45.195 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-11-17T06:27:45.195 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-11-17T06:27:45.195 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000532715 s, 961 kB/s 2023-11-17T06:27:45.197 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-17T06:27:45.265 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2023-11-17T06:27:45.329 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-17T06:27:45.330 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:45.330 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 514 Links: 1 2023-11-17T06:27:45.330 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:45.330 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-11-17 06:21:18.324900881 +0000 2023-11-17T06:27:45.330 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-11-17 06:21:17.848915989 +0000 2023-11-17T06:27:45.330 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-11-17 06:21:17.848915989 +0000 2023-11-17T06:27:45.330 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-11-17T06:27:45.330 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-17T06:27:45.407 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-11-17T06:27:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-11-17T06:27:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000678221 s, 755 kB/s 2023-11-17T06:27:45.410 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-17T06:27:45.475 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:45.475 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:27:45.475 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/scratch_devs of=/dev/stdout 2023-11-17T06:27:45.495 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-17T06:27:45.496 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_1 2023-11-17T06:27:45.559 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-17T06:27:45.560 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:45.560 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 495 Links: 1 2023-11-17T06:27:45.560 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:45.560 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-11-17 06:21:06.617562459 +0000 2023-11-17T06:27:45.560 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-11-17 06:21:06.129580544 +0000 2023-11-17T06:27:45.560 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-11-17 06:21:06.129580544 +0000 2023-11-17T06:27:45.560 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-11-17T06:27:45.560 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-17T06:27:45.636 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-11-17T06:27:45.636 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-11-17T06:27:45.636 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000487394 s, 1.1 MB/s 2023-11-17T06:27:45.638 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-17T06:27:45.705 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_2 2023-11-17T06:27:45.768 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-17T06:27:45.769 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:45.769 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 502 Links: 1 2023-11-17T06:27:45.769 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:45.769 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-11-17 06:21:07.437532504 +0000 2023-11-17T06:27:45.769 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-11-17 06:21:06.941550451 +0000 2023-11-17T06:27:45.769 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-11-17 06:21:06.941550451 +0000 2023-11-17T06:27:45.769 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-11-17T06:27:45.769 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-17T06:27:45.842 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-11-17T06:27:45.843 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-11-17T06:27:45.843 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000589235 s, 869 kB/s 2023-11-17T06:27:45.845 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-17T06:27:45.916 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_3 2023-11-17T06:27:45.980 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-17T06:27:45.981 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:45.981 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 506 Links: 1 2023-11-17T06:27:45.981 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:45.981 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-11-17 06:21:08.217504376 +0000 2023-11-17T06:27:45.981 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-11-17 06:21:07.737521685 +0000 2023-11-17T06:27:45.981 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-11-17 06:21:07.737521685 +0000 2023-11-17T06:27:45.981 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-11-17T06:27:45.981 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-17T06:27:46.059 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-11-17T06:27:46.060 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-11-17T06:27:46.060 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000641383 s, 798 kB/s 2023-11-17T06:27:46.062 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-17T06:27:46.126 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_4 2023-11-17T06:27:46.185 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-17T06:27:46.185 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-17T06:27:46.185 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 5h/5d Inode: 514 Links: 1 2023-11-17T06:27:46.185 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-17T06:27:46.185 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-11-17 06:21:08.985476680 +0000 2023-11-17T06:27:46.185 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-11-17 06:21:08.509493846 +0000 2023-11-17T06:27:46.186 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-11-17 06:21:08.509493846 +0000 2023-11-17T06:27:46.186 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-11-17T06:27:46.186 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-17T06:27:46.263 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-11-17T06:27:46.263 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-11-17T06:27:46.263 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000630367 s, 812 kB/s 2023-11-17T06:27:46.265 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-17T06:27:46.330 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:46.330 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-17T06:27:46.330 INFO:tasks.ceph:Generating config... 2023-11-17T06:27:46.332 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-17T06:27:46.332 INFO:tasks.ceph:[client] debug client = 20 2023-11-17T06:27:46.332 INFO:tasks.ceph:[client] debug ms = 1 2023-11-17T06:27:46.332 INFO:tasks.ceph:[client] pid file = 2023-11-17T06:27:46.332 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-17T06:27:46.332 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-17T06:27:46.332 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-17T06:27:46.332 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-17T06:27:46.333 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-17T06:27:46.334 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-17T06:27:46.334 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-17T06:27:46.334 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-17T06:27:46.334 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-17T06:27:46.334 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-17T06:27:46.334 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-17T06:27:46.334 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-17T06:27:46.334 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-17T06:27:46.335 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-17T06:27:46.335 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-17T06:27:46.335 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-17T06:27:46.335 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-17T06:27:46.335 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-17T06:27:46.335 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-17T06:27:46.335 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-17T06:27:46.335 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-17T06:27:46.336 INFO:tasks.ceph:Setting up mon.a... 2023-11-17T06:27:46.336 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-17T06:27:46.409 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.keyring 2023-11-17T06:27:46.432 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-17T06:27:46.515 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-17T06:27:46.548 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.69'), ('mon.b', '172.21.15.93'), ('mon.c', '[v2:172.21.15.93:3301,v1:172.21.15.93:6790]')] 2023-11-17T06:27:46.549 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.69,172.21.15.93,[v2:172.21.15.93:3301,v1:172.21.15.93:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-17T06:27:46.550 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:46.550 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-17T06:27:46.615 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.69 --add b 172.21.15.93 --addv c '[v2:172.21.15.93:3301,v1:172.21.15.93:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:46.732 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:46.732 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: generated fsid 473113af-218f-4c66-9eb3-2c30c3150d71 2023-11-17T06:27:46.732 INFO:teuthology.orchestra.run.smithi069.stdout:setting min_mon_release = pacific 2023-11-17T06:27:46.732 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 0 2023-11-17T06:27:46.732 INFO:teuthology.orchestra.run.smithi069.stdout:fsid 473113af-218f-4c66-9eb3-2c30c3150d71 2023-11-17T06:27:46.732 INFO:teuthology.orchestra.run.smithi069.stdout:last_changed 2023-11-17T06:27:46.731126+0000 2023-11-17T06:27:46.733 INFO:teuthology.orchestra.run.smithi069.stdout:created 2023-11-17T06:27:46.731126+0000 2023-11-17T06:27:46.733 INFO:teuthology.orchestra.run.smithi069.stdout:min_mon_release 16 (pacific) 2023-11-17T06:27:46.733 INFO:teuthology.orchestra.run.smithi069.stdout:election_strategy: 1 2023-11-17T06:27:46.733 INFO:teuthology.orchestra.run.smithi069.stdout:0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2023-11-17T06:27:46.733 INFO:teuthology.orchestra.run.smithi069.stdout:1: [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] mon.b 2023-11-17T06:27:46.733 INFO:teuthology.orchestra.run.smithi069.stdout:2: [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] mon.c 2023-11-17T06:27:46.734 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-17T06:27:46.736 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-17T06:27:46.753 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 473113af-218f-4c66-9eb3-2c30c3150d71... 2023-11-17T06:27:46.754 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:27:46.801 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:27:46.869 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2023-11-17T06:27:46.869 INFO:teuthology.orchestra.run.smithi069.stdout: chdir = "" 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: auth supported = cephx 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: filestore xattr use omap = true 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: mon clock drift allowed = 1.000 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: osd crush chooseleaf type = 0 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: auth debug = true 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on old message = true 2023-11-17T06:27:46.870 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on bug = true 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn max object skew = 0 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default size = 2 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow primary affinity = true 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow pg remap = true 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:27:46.871 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on no sortbitwise = false 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on too few osds = false 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: mon_allow_pool_size_one = true 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: osd default data pool replay window = 5 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: mon allow pool delete = true 2023-11-17T06:27:46.872 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: mon cluster log file level = debug 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: debug asserts on shutdown = true 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: mon health detail to clog = false 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: mon host = "172.21.15.69,172.21.15.93,[v2:172.21.15.93:3301,v1:172.21.15.93:6790]" 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = 473113af-218f-4c66-9eb3-2c30c3150d71 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout:[osd] 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: osd journal size = 100 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub load threshold = 5.0 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub max interval = 600 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:27:46.873 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: osd recover clone overlap = true 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: osd recovery max chunk = 1048576 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug shutdown = true 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug op order = true 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug verify stray on activate = true 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: osd open classes on start = true 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug pg log writeout = true 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.874 INFO:teuthology.orchestra.run.smithi069.stdout: osd map max advance = 10 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: journal zero on create = true 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: filestore apply finisher threads = 3 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: bdev debug aio = true 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug misdirected ops = true 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: bdev async discard = True 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: bdev enable discard = True 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore allocator = bitmap 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore block size = 96636764160 2023-11-17T06:27:46.875 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore fsck on mount = True 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluefs = 1/20 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluestore = 1/20 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: debug osd = 20 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: debug rocksdb = 4/10 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd full ratio = 0.9 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: osd objectstore = bluestore 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.876 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr] 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: debug mgr = 20 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: mgr/telemetry/nag = false 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout:[mon] 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: debug paxos = 20 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-11-17T06:27:46.877 INFO:teuthology.orchestra.run.smithi069.stdout: mon data avail warn = 5 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: mon mgr mkfs grace = 240 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd reporter subtree level = osd 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd prime pg temp = true 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:27:46.878 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: # 1m isn't quite enough 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: mon op complaint time = 120 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout:[client] 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: rgw cache enabled = true 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable ops log = true 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable usage log = true 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:27:46.879 INFO:teuthology.orchestra.run.smithi069.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout: client mount timeout = 600 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout: debug client = 20 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = "" 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.a] 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.b] 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.c] 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d] 2023-11-17T06:27:46.880 INFO:teuthology.orchestra.run.smithi069.stdout:[mds] 2023-11-17T06:27:46.881 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds = 20 2023-11-17T06:27:46.881 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds balancer = 20 2023-11-17T06:27:46.881 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:27:46.881 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug frag = True 2023-11-17T06:27:46.881 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug scatterstat = True 2023-11-17T06:27:46.881 INFO:teuthology.orchestra.run.smithi069.stdout: mds op complaint time = 180 2023-11-17T06:27:46.881 INFO:teuthology.orchestra.run.smithi069.stdout: mds verify scatter = True 2023-11-17T06:27:46.881 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-11-17T06:27:46.881 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-11-17T06:27:46.881 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-11-17T06:27:46.890 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2023-11-17T06:27:46.890 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2023-11-17T06:27:46.890 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:27:46.890 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2023-11-17T06:27:46.890 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.890 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2023-11-17T06:27:46.890 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.890 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2023-11-17T06:27:46.890 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2023-11-17T06:27:46.891 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:27:46.892 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = "172.21.15.69,172.21.15.93,[v2:172.21.15.93:3301,v1:172.21.15.93:6790]" 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = 473113af-218f-4c66-9eb3-2c30c3150d71 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.893 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.894 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2023-11-17T06:27:46.895 INFO:teuthology.orchestra.run.smithi093.stdout: bdev async discard = True 2023-11-17T06:27:46.896 INFO:teuthology.orchestra.run.smithi093.stdout: bdev enable discard = True 2023-11-17T06:27:46.896 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore allocator = bitmap 2023-11-17T06:27:46.896 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore block size = 96636764160 2023-11-17T06:27:46.896 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore fsck on mount = True 2023-11-17T06:27:46.896 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluefs = 1/20 2023-11-17T06:27:46.896 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluestore = 1/20 2023-11-17T06:27:46.896 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:27:46.896 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 20 2023-11-17T06:27:46.896 INFO:teuthology.orchestra.run.smithi093.stdout: debug rocksdb = 4/10 2023-11-17T06:27:46.896 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd full ratio = 0.9 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: osd objectstore = bluestore 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:27:46.897 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:27:46.898 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: # 1m isn't quite enough 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:27:46.899 INFO:teuthology.orchestra.run.smithi093.stdout: mon op complaint time = 120 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: client mount timeout = 600 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: debug client = 20 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = "" 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2023-11-17T06:27:46.900 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.b] 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.c] 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout:[mds] 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds = 20 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds balancer = 20 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug frag = True 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug scatterstat = True 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout: mds op complaint time = 180 2023-11-17T06:27:46.901 INFO:teuthology.orchestra.run.smithi093.stdout: mds verify scatter = True 2023-11-17T06:27:46.902 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2023-11-17T06:27:46.902 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2023-11-17T06:27:46.902 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2023-11-17T06:27:46.911 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-17T06:27:46.911 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-17T06:27:47.017 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-17T06:27:47.017 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:47.017 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-17T06:27:47.035 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:47.035 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-17T06:27:47.097 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:27:47.097 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:47.097 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-17T06:27:47.097 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-17T06:27:47.198 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:27:47.198 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:47.261 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:27:47.261 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:27:47.261 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-17T06:27:47.261 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-17T06:27:47.324 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:27:47.324 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:47.383 INFO:tasks.ceph:Setting up mon nodes... 2023-11-17T06:27:47.384 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-17T06:27:47.384 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-17T06:27:47.489 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-17T06:27:47.497 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-17T06:27:47.599 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-17T06:27:47.628 INFO:tasks.ceph:Setting up mds nodes... 2023-11-17T06:27:47.628 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-17T06:27:47.730 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-17T06:27:47.738 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-17T06:27:47.770 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-17T06:27:47.907 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-17T06:27:47.914 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-17T06:27:47.951 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-17T06:27:48.066 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-17T06:27:48.073 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-17T06:27:48.107 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-17T06:27:48.261 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-17T06:27:48.268 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-17T06:27:48.299 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-17T06:27:48.300 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-17T06:27:48.374 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-17T06:27:48.404 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-17T06:27:48.472 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-17T06:27:48.502 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-17T06:27:48.574 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-17T06:27:48.603 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-17T06:27:48.671 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-17T06:27:48.699 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-17T06:27:48.700 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-17T06:27:48.700 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-17T06:27:48.739 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:48.739 INFO:tasks.ceph:role: osd.0 2023-11-17T06:27:48.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:27:48.739 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-17T06:27:49.320 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:27:49.320 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:27:49.320 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:27:49.320 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-11-17T06:27:49.320 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:27:49.320 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:27:49.320 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:27:49.321 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:27:49.321 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:27:49.321 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:27:49.327 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-11-17T06:27:49.327 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-17T06:27:49.437 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-17T06:27:49.459 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:27:49.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:27:49.460 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-17T06:27:49.539 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:49.539 INFO:tasks.ceph:role: osd.1 2023-11-17T06:27:49.539 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:27:49.539 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-17T06:27:50.072 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:27:50.072 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:27:50.072 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:27:50.072 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-11-17T06:27:50.072 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:27:50.072 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:27:50.072 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:27:50.072 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:27:50.072 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:27:50.073 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:27:50.076 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-11-17T06:27:50.076 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-17T06:27:50.146 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-17T06:27:50.171 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:27:50.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:27:50.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-17T06:27:50.254 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:50.254 INFO:tasks.ceph:role: osd.2 2023-11-17T06:27:50.255 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:27:50.255 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-17T06:27:50.813 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:27:50.813 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:27:50.813 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:27:50.813 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-11-17T06:27:50.813 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:27:50.813 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:27:50.813 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:27:50.813 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:27:50.813 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:27:50.813 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:27:50.816 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-11-17T06:27:50.816 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-17T06:27:50.936 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-17T06:27:50.957 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:27:50.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:27:50.958 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-17T06:27:51.041 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-17T06:27:51.042 INFO:tasks.ceph:role: osd.3 2023-11-17T06:27:51.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:27:51.042 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-17T06:27:51.627 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:27:51.628 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:27:51.628 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:27:51.628 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-11-17T06:27:51.628 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:27:51.628 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:27:51.628 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:27:51.628 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:27:51.628 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:27:51.628 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:27:51.632 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-11-17T06:27:51.633 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-17T06:27:51.749 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-17T06:27:51.771 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:27:51.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:27:51.773 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:51.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:51.935+0000 7ff66dd58700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-17T06:27:51.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:51.939+0000 7ff66dd58700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-17T06:27:51.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:51.939+0000 7ff66dd58700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-17T06:27:51.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:51.939+0000 7ff66dd58700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-17T06:27:51.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:51.939+0000 7ff66dd58700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-17T06:27:51.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:51.943+0000 7ff66dd58700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-17T06:27:55.027 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-17T06:27:55.059 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:55.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:55.187+0000 7f38e72da700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-17T06:27:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:55.187+0000 7f38e72da700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-17T06:27:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:55.187+0000 7f38e72da700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-17T06:27:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:55.187+0000 7f38e72da700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-17T06:27:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:55.187+0000 7f38e72da700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-17T06:27:55.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:55.187+0000 7f38e72da700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-17T06:27:58.249 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-17T06:27:58.292 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:27:58.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:58.419+0000 7f94902cf700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-17T06:27:58.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:58.419+0000 7f94902cf700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-17T06:27:58.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:58.419+0000 7f94902cf700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-17T06:27:58.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:58.419+0000 7f94902cf700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-17T06:27:58.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:58.419+0000 7f94902cf700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-17T06:27:58.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:27:58.423+0000 7f94902cf700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-17T06:28:01.493 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-17T06:28:01.531 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:01.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:01.655+0000 7f2b0b569700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-17T06:28:01.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:01.659+0000 7f2b0b569700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-17T06:28:01.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:01.659+0000 7f2b0b569700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-17T06:28:01.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:01.659+0000 7f2b0b569700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-17T06:28:01.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:01.659+0000 7f2b0b569700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-17T06:28:01.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:01.659+0000 7f2b0b569700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-17T06:28:04.743 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-17T06:28:04.777 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-17T06:28:04.812 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-17T06:28:04.812 INFO:tasks.ceph:role: osd.4 2023-11-17T06:28:04.812 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:28:04.812 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-17T06:28:05.431 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:28:05.432 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:28:05.432 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:28:05.432 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2023-11-17T06:28:05.432 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:28:05.432 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:28:05.432 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:28:05.432 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:28:05.432 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:28:05.432 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:28:05.437 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-11-17T06:28:05.437 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-17T06:28:05.574 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-17T06:28:05.596 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:28:05.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:28:05.597 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-17T06:28:05.679 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-17T06:28:05.679 INFO:tasks.ceph:role: osd.5 2023-11-17T06:28:05.679 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:28:05.679 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-17T06:28:06.186 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:28:06.186 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:28:06.186 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:28:06.186 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2023-11-17T06:28:06.186 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:28:06.186 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:28:06.186 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:28:06.187 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:28:06.187 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:28:06.187 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:28:06.191 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-11-17T06:28:06.192 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-17T06:28:06.267 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-17T06:28:06.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:28:06.289 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:28:06.289 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-17T06:28:06.365 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-17T06:28:06.365 INFO:tasks.ceph:role: osd.6 2023-11-17T06:28:06.366 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:28:06.366 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-17T06:28:06.949 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:28:06.950 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:28:06.950 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:28:06.950 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2023-11-17T06:28:06.950 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:28:06.950 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:28:06.950 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:28:06.950 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:28:06.950 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:28:06.950 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:28:06.953 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-11-17T06:28:06.953 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-17T06:28:07.086 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-17T06:28:07.105 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:28:07.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:28:07.107 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-17T06:28:07.191 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-17T06:28:07.191 INFO:tasks.ceph:role: osd.7 2023-11-17T06:28:07.191 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:28:07.192 DEBUG:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-17T06:28:07.752 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-17T06:28:07.752 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-17T06:28:07.752 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-17T06:28:07.752 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2023-11-17T06:28:07.753 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-17T06:28:07.753 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2023-11-17T06:28:07.753 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-17T06:28:07.753 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-17T06:28:07.753 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-17T06:28:07.753 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-17T06:28:07.756 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2023-11-17T06:28:07.756 DEBUG:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-17T06:28:07.870 DEBUG:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-17T06:28:07.888 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: /sbin/restorecon: command not found 2023-11-17T06:28:07.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:28:07.890 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:08.054 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:08.049+0000 7f94bee16700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-17T06:28:08.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:08.049+0000 7f94bee16700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-17T06:28:08.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:08.053+0000 7f94bee16700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-17T06:28:08.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:08.053+0000 7f94bee16700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-17T06:28:08.055 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:08.053+0000 7f94bee16700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-17T06:28:08.058 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:08.053+0000 7f94bee16700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-17T06:28:11.130 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-17T06:28:11.159 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:11.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:11.288+0000 7f59c9f6d700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-17T06:28:11.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:11.288+0000 7f59c9f6d700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-17T06:28:11.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:11.288+0000 7f59c9f6d700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-17T06:28:11.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:11.288+0000 7f59c9f6d700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-17T06:28:11.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:11.288+0000 7f59c9f6d700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-17T06:28:11.297 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:11.292+0000 7f59c9f6d700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-17T06:28:14.362 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-17T06:28:18.331 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:28:18.341 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:28:18.365 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:18.494 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:18.488+0000 7ff03b0ac700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-17T06:28:18.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:18.488+0000 7ff03b0ac700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-17T06:28:18.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:18.488+0000 7ff03b0ac700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-17T06:28:18.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:18.492+0000 7ff03b0ac700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-17T06:28:18.495 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:18.492+0000 7ff03b0ac700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-17T06:28:18.497 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:18.492+0000 7ff03b0ac700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-17T06:28:21.541 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-17T06:28:24.850 DEBUG:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:24.980 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:24.976+0000 7efc7ef17700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-17T06:28:24.981 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:24.976+0000 7efc7ef17700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-17T06:28:24.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:24.976+0000 7efc7ef17700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-17T06:28:24.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:24.976+0000 7efc7ef17700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-17T06:28:24.982 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:24.976+0000 7efc7ef17700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-17T06:28:24.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:24.980+0000 7efc7ef17700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-17T06:28:28.040 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-17T06:28:28.074 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-17T06:28:28.074 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:28.074 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-17T06:28:28.107 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:28.107 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-17T06:28:28.183 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:28.184 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-17T06:28:28.260 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:28.260 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-17T06:28:28.339 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:28.339 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-17T06:28:28.416 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:28.416 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-17T06:28:28.495 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:28.495 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-17T06:28:28.568 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:28.568 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-17T06:28:28.604 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:28.604 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-17T06:28:28.690 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:28.690 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-17T06:28:28.768 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:28.768 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-17T06:28:28.846 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:28.846 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-17T06:28:28.919 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:28.919 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-17T06:28:29.010 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:29.010 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-17T06:28:29.084 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:29.084 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-17T06:28:29.104 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:29.104 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-17T06:28:29.166 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:29.167 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-17T06:28:29.184 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:29.184 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-17T06:28:29.247 INFO:tasks.ceph:Adding keys to all mons... 2023-11-17T06:28:29.247 DEBUG:teuthology.orchestra.run.smithi069:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-17T06:28:29.254 DEBUG:teuthology.orchestra.run.smithi093:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-17T06:28:29.302 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.y] 2023-11-17T06:28:29.302 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDjB1dlg/kbHRAAvegnKqn+7AfT+0typysGIw== 2023-11-17T06:28:29.302 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2023-11-17T06:28:29.302 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDjB1dlgWiBKxAAYEkZfFVMlN9EoWLTr/I8OQ== 2023-11-17T06:28:29.302 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2023-11-17T06:28:29.302 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDjB1dlRm8QNhAAk54RKTB3LbaY6fcgT34xJQ== 2023-11-17T06:28:29.302 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.0] 2023-11-17T06:28:29.302 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDnB1dl68AhOBAA/lvZStKsbNQgMfnAqWLTLg== 2023-11-17T06:28:29.302 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.1] 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDrB1dl4n1cCxAAXVeFxZezoHlQxvVliJvc1w== 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.2] 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDuB1dlL900GRAAxQR349gqXqccX4ZSFpyhMw== 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.3] 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDxB1dlC8FsJxAAPL93rZ17CfD+hoxcPsX+3A== 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.x] 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDjB1dl0CmwIxAAgToYDDT4yXyijdxApbE1MQ== 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDkB1dlry3xAxAAtAioA4mdHKGv0QmRrfncpw== 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d] 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDkB1dlVPaODxAA0KfAVmrO7mi8bx7Z7jiAxQ== 2023-11-17T06:28:29.303 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.4] 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD4B1dluMs4AxAAxA5eddnCF/gGW0q9vp1eDg== 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.5] 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD7B1dlPQpxERAAIfGHoNujgdks2lgdMfg+ZA== 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.6] 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQACCFdlf9pwHRAAqBa1KwXc2pdd7C3RG1Rg2Q== 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.7] 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAICFdlP0BwOhAA9EvXUQ3bT9dF2B1b+P3pMQ== 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDkB1dlV8dIFhAARKHRwgoM6K9tEeqTeD4+ug== 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout:[client.2] 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDkB1dl8fYgHBAA2EObzKig+ezw7cNnl1sUtg== 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout:[client.1] 2023-11-17T06:28:29.304 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDkB1dlC+43IhAAmy4eZy6AEYmjY+Xslw3nNw== 2023-11-17T06:28:29.305 INFO:teuthology.orchestra.run.smithi069.stdout:[client.3] 2023-11-17T06:28:29.305 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDkB1dlgg4DKBAA9ePiQ3wkehyT/jL3YKiNRA== 2023-11-17T06:28:29.325 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.y] 2023-11-17T06:28:29.325 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDjB1dlg/kbHRAAvegnKqn+7AfT+0typysGIw== 2023-11-17T06:28:29.325 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDjB1dlgWiBKxAAYEkZfFVMlN9EoWLTr/I8OQ== 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDjB1dlRm8QNhAAk54RKTB3LbaY6fcgT34xJQ== 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.0] 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDnB1dl68AhOBAA/lvZStKsbNQgMfnAqWLTLg== 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.1] 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDrB1dl4n1cCxAAXVeFxZezoHlQxvVliJvc1w== 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.2] 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDuB1dlL900GRAAxQR349gqXqccX4ZSFpyhMw== 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.3] 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDxB1dlC8FsJxAAPL93rZ17CfD+hoxcPsX+3A== 2023-11-17T06:28:29.326 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.x] 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDjB1dl0CmwIxAAgToYDDT4yXyijdxApbE1MQ== 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDkB1dlry3xAxAAtAioA4mdHKGv0QmRrfncpw== 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDkB1dlVPaODxAA0KfAVmrO7mi8bx7Z7jiAxQ== 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.4] 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQD4B1dluMs4AxAAxA5eddnCF/gGW0q9vp1eDg== 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.5] 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQD7B1dlPQpxERAAIfGHoNujgdks2lgdMfg+ZA== 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.6] 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQACCFdlf9pwHRAAqBa1KwXc2pdd7C3RG1Rg2Q== 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.7] 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQAICFdlP0BwOhAA9EvXUQ3bT9dF2B1b+P3pMQ== 2023-11-17T06:28:29.327 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2023-11-17T06:28:29.328 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDkB1dlV8dIFhAARKHRwgoM6K9tEeqTeD4+ug== 2023-11-17T06:28:29.328 INFO:teuthology.orchestra.run.smithi093.stdout:[client.2] 2023-11-17T06:28:29.328 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDkB1dl8fYgHBAA2EObzKig+ezw7cNnl1sUtg== 2023-11-17T06:28:29.328 INFO:teuthology.orchestra.run.smithi093.stdout:[client.1] 2023-11-17T06:28:29.328 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDkB1dlC+43IhAAmy4eZy6AEYmjY+Xslw3nNw== 2023-11-17T06:28:29.328 INFO:teuthology.orchestra.run.smithi093.stdout:[client.3] 2023-11-17T06:28:29.328 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDkB1dlgg4DKBAA9ePiQ3wkehyT/jL3YKiNRA== 2023-11-17T06:28:29.329 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-17T06:28:29.353 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-17T06:28:29.459 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:29.467 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:29.554 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:29.565 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:29.651 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:29.658 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:29.744 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:29.751 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:29.839 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:29.846 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:29.929 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:29.935 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:30.016 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-17T06:28:30.023 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-17T06:28:30.104 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:30.111 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:30.200 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:30.207 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-17T06:28:30.291 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:30.297 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:30.378 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:30.385 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:30.467 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:30.474 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:30.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:30.568 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-17T06:28:30.654 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:30.661 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:30.745 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:30.752 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:30.838 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:30.845 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:30.937 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:30.944 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-17T06:28:31.034 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-17T06:28:31.034 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-17T06:28:31.070 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-17T06:28:31.224 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-17T06:28:31.256 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-17T06:28:31.293 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-17T06:28:31.448 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-17T06:28:31.480 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-17T06:28:31.563 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-17T06:28:31.721 DEBUG:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-17T06:28:31.756 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:31.764 DEBUG:teuthology.orchestra.run.smithi093:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-17T06:28:31.817 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-17T06:28:31.817 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-17T06:28:31.817 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-17T06:28:31.829 INFO:tasks.ceph.mon.a:Started 2023-11-17T06:28:31.830 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-17T06:28:31.830 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-17T06:28:31.869 INFO:tasks.ceph.mon.b:Started 2023-11-17T06:28:31.869 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-17T06:28:31.870 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-17T06:28:31.874 INFO:tasks.ceph.mon.c:Started 2023-11-17T06:28:31.874 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-17T06:28:31.874 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-17T06:28:31.874 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-17T06:28:31.881 INFO:tasks.ceph.mgr.y:Started 2023-11-17T06:28:31.882 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-17T06:28:31.882 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-17T06:28:31.887 INFO:tasks.ceph.mgr.x:Started 2023-11-17T06:28:31.887 INFO:tasks.ceph:Setting crush tunables to default 2023-11-17T06:28:31.887 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd crush tunables default 2023-11-17T06:28:32.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.046+0000 7fe945214700 1 Processor -- start 2023-11-17T06:28:32.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.046+0000 7fe945214700 1 -- start start 2023-11-17T06:28:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.046+0000 7fe945214700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe9401652b0 0x7fe9400cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.046+0000 7fe945214700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 0x7fe9400cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.046+0000 7fe945214700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94006c200 con 0x7fe9400c21a0 2023-11-17T06:28:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.046+0000 7fe945214700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9401662c0 con 0x7fe9401652b0 2023-11-17T06:28:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.046+0000 7fe945214700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe940165d00 con 0x7fe940165740 2023-11-17T06:28:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe93ffff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe9400c21a0 0x7fe94006c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:39890/0 (socket says 172.21.15.69:39890) 2023-11-17T06:28:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe93ffff700 1 -- 172.21.15.69:0/3692803769 learned_addr learned my addr 172.21.15.69:0/3692803769 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:28:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe944a13700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 0x7fe9400cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe9377fe700 1 --2- 172.21.15.69:0/3692803769 >> v2:172.21.15.69:3300/0 conn(0x7fe9401652b0 0x7fe9400cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe944a13700 1 -- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 msgr2=0x7fe9400cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-17T06:28:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe944a13700 1 -- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 msgr2=0x7fe9400cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-17T06:28:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe944a13700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 0x7fe9400cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-17T06:28:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe944a13700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 0x7fe9400cbd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-17T06:28:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe9377fe700 1 -- 172.21.15.69:0/3692803769 >> v2:172.21.15.69:3300/0 conn(0x7fe9401652b0 msgr2=0x7fe9400cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-17T06:28:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe9377fe700 1 -- 172.21.15.69:0/3692803769 >> v2:172.21.15.69:3300/0 conn(0x7fe9401652b0 msgr2=0x7fe9400cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-17T06:28:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe9377fe700 1 --2- 172.21.15.69:0/3692803769 >> v2:172.21.15.69:3300/0 conn(0x7fe9401652b0 0x7fe9400cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-17T06:28:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.050+0000 7fe9377fe700 1 --2- 172.21.15.69:0/3692803769 >> v2:172.21.15.69:3300/0 conn(0x7fe9401652b0 0x7fe9400cb7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-17T06:28:32.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.218+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415355764 0 0) 0x7fe94006c200 con 0x7fe9400c21a0 2023-11-17T06:28:32.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.218+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe92c0035d0 con 0x7fe9400c21a0 2023-11-17T06:28:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2155107540 0 0) 0x7fe92c0035d0 con 0x7fe9400c21a0 2023-11-17T06:28:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 msgr2=0x7fe9400cbd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 0x7fe9400cbd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 >> v2:172.21.15.69:3300/0 conn(0x7fe9401652b0 msgr2=0x7fe9400cb7e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 --2- 172.21.15.69:0/3692803769 >> v2:172.21.15.69:3300/0 conn(0x7fe9401652b0 0x7fe9400cb7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe940165fe0 con 0x7fe9400c21a0 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7fe930001670 con 0x7fe9400c21a0 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 >> v1:172.21.15.93:6789/0 conn(0x7fe9400c21a0 legacy=0x7fe94006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 0x7fe92c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 0x7fe92c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe92c004db0 0x7fe92c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9401662c0 con 0x7fe92c004db0 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940165d00 con 0x7fe92c0040a0 2023-11-17T06:28:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c00bb90 con 0x7fe940165740 2023-11-17T06:28:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe93ffff700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 0x7fe92c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe9377fe700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 0x7fe92c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe944a13700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe92c004db0 0x7fe92c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe9377fe700 1 -- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 msgr2=0x7fe92c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe9377fe700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940165740 0x7fe92c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe9377fe700 1 -- 172.21.15.69:0/3692803769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe92c004db0 msgr2=0x7fe92c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe9377fe700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe92c004db0 0x7fe92c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe9377fe700 1 -- 172.21.15.69:0/3692803769 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c0035d0 con 0x7fe92c0040a0 2023-11-17T06:28:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe944a13700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe92c004db0 0x7fe92c005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:28:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.222+0000 7fe9377fe700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 0x7fe92c004870 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe928009870 tx=0x7fe92c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dea0c2b89e38010 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.226+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92800c070 con 0x7fe92c0040a0 2023-11-17T06:28:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.226+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe928013610 con 0x7fe92c0040a0 2023-11-17T06:28:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.226+0000 7fe93f7fe700 1 -- 172.21.15.69:0/3692803769 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9280139c0 con 0x7fe92c0040a0 2023-11-17T06:28:32.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.230+0000 7fe945214700 1 -- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 msgr2=0x7fe92c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.230+0000 7fe945214700 1 --2- 172.21.15.69:0/3692803769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 0x7fe92c004870 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe928009870 tx=0x7fe92c0058a0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.230+0000 7fe944a13700 1 -- 172.21.15.69:0/3692803769 reap_dead start 2023-11-17T06:28:32.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.230+0000 7fe945214700 1 -- 172.21.15.69:0/3692803769 shutdown_connections 2023-11-17T06:28:32.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.230+0000 7fe945214700 1 -- 172.21.15.69:0/3692803769 >> 172.21.15.69:0/3692803769 conn(0x7fe9400b0900 msgr2=0x7fe9400b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:32.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.230+0000 7fe945214700 1 -- 172.21.15.69:0/3692803769 shutdown_connections 2023-11-17T06:28:32.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.230+0000 7fe945214700 1 -- 172.21.15.69:0/3692803769 wait complete. 2023-11-17T06:28:32.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe945214700 1 Processor -- start 2023-11-17T06:28:32.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe945214700 1 -- start start 2023-11-17T06:28:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe945214700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 0x7fe9400b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe945214700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9400c5ea0 0x7fe9401627d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe945214700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940071080 0x7fe94014edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe945214700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400c6320 con 0x7fe9400c5ea0 2023-11-17T06:28:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe945214700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe940162d10 con 0x7fe92c0040a0 2023-11-17T06:28:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe945214700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe940162fd0 con 0x7fe940071080 2023-11-17T06:28:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe9377fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9400c5ea0 0x7fe9401627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe93ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 0x7fe9400b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe93ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 0x7fe9400b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:60650/0 (socket says 172.21.15.69:60650) 2023-11-17T06:28:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe93ffff700 1 -- 172.21.15.69:0/2982942408 learned_addr learned my addr 172.21.15.69:0/2982942408 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:28:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe944a13700 1 --2- 172.21.15.69:0/2982942408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940071080 0x7fe94014edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe93ffff700 1 -- 172.21.15.69:0/2982942408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940071080 msgr2=0x7fe94014edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe93ffff700 1 --2- 172.21.15.69:0/2982942408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940071080 0x7fe94014edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe93ffff700 1 -- 172.21.15.69:0/2982942408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9400c5ea0 msgr2=0x7fe9401627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.234+0000 7fe93ffff700 1 --2- 172.21.15.69:0/2982942408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9400c5ea0 0x7fe9401627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe93ffff700 1 -- 172.21.15.69:0/2982942408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9401632b0 con 0x7fe92c0040a0 2023-11-17T06:28:32.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe9377fe700 1 --2- 172.21.15.69:0/2982942408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9400c5ea0 0x7fe9401627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:28:32.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe93ffff700 1 --2- 172.21.15.69:0/2982942408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 0x7fe9400b01c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe930007340 tx=0x7fe930007650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe93d7fa700 1 -- 172.21.15.69:0/2982942408 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93000f600 con 0x7fe92c0040a0 2023-11-17T06:28:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe93d7fa700 1 -- 172.21.15.69:0/2982942408 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93000f760 con 0x7fe92c0040a0 2023-11-17T06:28:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe93d7fa700 1 -- 172.21.15.69:0/2982942408 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93000faf0 con 0x7fe92c0040a0 2023-11-17T06:28:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe945214700 1 -- 172.21.15.69:0/2982942408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe940163590 con 0x7fe92c0040a0 2023-11-17T06:28:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe945214700 1 -- 172.21.15.69:0/2982942408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe940163b50 con 0x7fe92c0040a0 2023-11-17T06:28:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe93d7fa700 1 -- 172.21.15.69:0/2982942408 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe93001d460 con 0x7fe92c0040a0 2023-11-17T06:28:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe93d7fa700 1 -- 172.21.15.69:0/2982942408 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe930013530 con 0x7fe92c0040a0 2023-11-17T06:28:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.238+0000 7fe945214700 1 -- 172.21.15.69:0/2982942408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe940073f00 con 0x7fe92c0040a0 2023-11-17T06:28:32.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.242+0000 7fe93d7fa700 1 -- 172.21.15.69:0/2982942408 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe93001d9a0 con 0x7fe92c0040a0 2023-11-17T06:28:32.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.314+0000 7fe945214700 1 -- 172.21.15.69:0/2982942408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe940163d10 con 0x7fe92c0040a0 2023-11-17T06:28:32.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.326+0000 7fe93d7fa700 1 -- 172.21.15.69:0/2982942408 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe93001db40 con 0x7fe92c0040a0 2023-11-17T06:28:32.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.330+0000 7fe945214700 1 -- 172.21.15.69:0/2982942408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 msgr2=0x7fe9400b01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:32.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.330+0000 7fe945214700 1 --2- 172.21.15.69:0/2982942408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 0x7fe9400b01c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe930007340 tx=0x7fe930007650 comp rx=0 tx=0).stop 2023-11-17T06:28:32.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.330+0000 7fe945214700 1 -- 172.21.15.69:0/2982942408 shutdown_connections 2023-11-17T06:28:32.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.330+0000 7fe945214700 1 --2- 172.21.15.69:0/2982942408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe940071080 0x7fe94014edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.330+0000 7fe945214700 1 --2- 172.21.15.69:0/2982942408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9400c5ea0 0x7fe9401627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.330+0000 7fe945214700 1 --2- 172.21.15.69:0/2982942408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe92c0040a0 0x7fe9400b01c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:32.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.330+0000 7fe945214700 1 -- 172.21.15.69:0/2982942408 >> 172.21.15.69:0/2982942408 conn(0x7fe9400b0900 msgr2=0x7fe9400cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:32.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.330+0000 7fe945214700 1 -- 172.21.15.69:0/2982942408 shutdown_connections 2023-11-17T06:28:32.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:28:32.330+0000 7fe945214700 1 -- 172.21.15.69:0/2982942408 wait complete. 2023-11-17T06:28:32.337 INFO:teuthology.orchestra.run.smithi069.stderr:adjusted tunables profile to default 2023-11-17T06:28:32.358 INFO:tasks.ceph:check_enable_crimson: False 2023-11-17T06:28:32.358 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-17T06:28:32.358 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:32.358 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-17T06:28:32.391 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:32.391 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-17T06:28:32.452 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:32.448+0000 7f4b811a62c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-17T06:28:32.461 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:32.454+0000 7fdaac53e2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-17T06:28:32.467 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:32.467 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-17T06:28:32.543 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:28:32.543 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-17T06:28:32.618 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:32.619 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-17T06:28:32.652 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:32.652 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-17T06:28:32.732 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:32.732 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-17T06:28:32.807 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:28:32.807 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-17T06:28:32.889 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 21887f14-24ae-49fd-8af6-6e396eddb0da 0 2023-11-17T06:28:33.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.092+0000 7f047dada700 1 Processor -- start 2023-11-17T06:28:33.179 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.092+0000 7f047dada700 1 -- start start 2023-11-17T06:28:33.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f047815d5a0 0x7f04780cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04781621b0 con 0x7f047815d980 2023-11-17T06:28:33.183 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0478161630 con 0x7f047815d5a0 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0478161910 con 0x7f04780b2600 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047d2d9700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047cad8700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f047815d5a0 0x7f04780cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f0477fff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f047815d980 0x7f04780b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43196/0 (socket says 172.21.15.93:43196) 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f0477fff700 1 -- 172.21.15.93:0/489021860 learned_addr learned my addr 172.21.15.93:0/489021860 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047d2d9700 1 -- 172.21.15.93:0/489021860 >> v2:172.21.15.93:3300/0 conn(0x7f047815d5a0 msgr2=0x7f04780cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047d2d9700 1 --2- 172.21.15.93:0/489021860 >> v2:172.21.15.93:3300/0 conn(0x7f047815d5a0 0x7f04780cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047d2d9700 1 -- 172.21.15.93:0/489021860 >> v1:172.21.15.93:6789/0 conn(0x7f047815d980 legacy=0x7f04780b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047d2d9700 1 -- 172.21.15.93:0/489021860 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478161bf0 con 0x7f04780b2600 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047cad8700 1 --2- 172.21.15.93:0/489021860 >> v2:172.21.15.93:3300/0 conn(0x7f047815d5a0 0x7f04780cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f04777fe700 1 -- 172.21.15.93:0/489021860 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074040842 0 0) 0x7f04781621b0 con 0x7f047815d980 2023-11-17T06:28:33.184 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047d2d9700 1 --2- 172.21.15.93:0/489021860 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780d0060 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0470009d90 tx=0x7f047000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50dd718db11f94f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f04777fe700 1 -- 172.21.15.93:0/489021860 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047000e070 con 0x7f04780b2600 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f04777fe700 1 -- 172.21.15.93:0/489021860 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047000bb20 con 0x7f04780b2600 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f04777fe700 1 -- 172.21.15.93:0/489021860 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0470012430 con 0x7f04780b2600 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 -- 172.21.15.93:0/489021860 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 msgr2=0x7f04780d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 --2- 172.21.15.93:0/489021860 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780d0060 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0470009d90 tx=0x7f047000b330 comp rx=0 tx=0).stop 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 -- 172.21.15.93:0/489021860 shutdown_connections 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 --2- 172.21.15.93:0/489021860 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780d0060 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 --2- 172.21.15.93:0/489021860 >> v2:172.21.15.93:3300/0 conn(0x7f047815d5a0 0x7f04780cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.096+0000 7f047dada700 1 -- 172.21.15.93:0/489021860 >> 172.21.15.93:0/489021860 conn(0x7f047806aca0 msgr2=0x7f047806b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.100+0000 7f047dada700 1 -- 172.21.15.93:0/489021860 shutdown_connections 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.100+0000 7f047dada700 1 -- 172.21.15.93:0/489021860 wait complete. 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.100+0000 7f047dada700 1 Processor -- start 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.100+0000 7f047dada700 1 -- start start 2023-11-17T06:28:33.185 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047dada700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047dada700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f047815d5a0 0x7f04780c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047dada700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04781f7320 0x7f04781f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047dada700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780c8e00 con 0x7f04781f7320 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047dada700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04780b2ad0 con 0x7f047815d5a0 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047dada700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04780b2db0 con 0x7f04780b2600 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047cad8700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047cad8700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:38948/0 (socket says 172.21.15.93:38948) 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047cad8700 1 -- 172.21.15.93:0/1137438801 learned_addr learned my addr 172.21.15.93:0/1137438801 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f0477fff700 1 --2- 172.21.15.93:0/1137438801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f047815d5a0 0x7f04780c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047d2d9700 1 --2- 172.21.15.93:0/1137438801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04781f7320 0x7f04781f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047cad8700 1 -- 172.21.15.93:0/1137438801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f047815d5a0 msgr2=0x7f04780c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047cad8700 1 --2- 172.21.15.93:0/1137438801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f047815d5a0 0x7f04780c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.186 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047cad8700 1 -- 172.21.15.93:0/1137438801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04781f7320 msgr2=0x7f04781f2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047cad8700 1 --2- 172.21.15.93:0/1137438801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04781f7320 0x7f04781f2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047cad8700 1 -- 172.21.15.93:0/1137438801 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c0094b0 con 0x7f04780b2600 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047d2d9700 1 --2- 172.21.15.93:0/1137438801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04781f7320 0x7f04781f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047cad8700 1 --2- 172.21.15.93:0/1137438801 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780ca1e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f046c00ebe0 tx=0x7f046c00eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f04757fa700 1 -- 172.21.15.93:0/1137438801 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00c890 con 0x7f04780b2600 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f04757fa700 1 -- 172.21.15.93:0/1137438801 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c00c9f0 con 0x7f04780b2600 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f04757fa700 1 -- 172.21.15.93:0/1137438801 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c00cd80 con 0x7f04780b2600 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047dada700 1 -- 172.21.15.93:0/1137438801 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0470009a70 con 0x7f04780b2600 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f047dada700 1 -- 172.21.15.93:0/1137438801 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04780b3370 con 0x7f04780b2600 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f04757fa700 1 -- 172.21.15.93:0/1137438801 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f046c005d40 con 0x7f04780b2600 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.104+0000 7f04757fa700 1 -- 172.21.15.93:0/1137438801 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f046c0137b0 con 0x7f04780b2600 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.108+0000 7f047dada700 1 -- 172.21.15.93:0/1137438801 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04780b3590 con 0x7f04780b2600 2023-11-17T06:28:33.187 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.112+0000 7f04757fa700 1 -- 172.21.15.93:0/1137438801 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f046c021060 con 0x7f04780b2600 2023-11-17T06:28:33.197 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.192+0000 7f047dada700 1 -- 172.21.15.93:0/1137438801 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "21887f14-24ae-49fd-8af6-6e396eddb0da", "id": 0} v 0) v1 -- 0x7f04780686a0 con 0x7f04780b2600 2023-11-17T06:28:33.209 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.204+0000 7f04757fa700 1 -- 172.21.15.93:0/1137438801 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "21887f14-24ae-49fd-8af6-6e396eddb0da", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f046c029020 con 0x7f04780b2600 2023-11-17T06:28:33.210 INFO:teuthology.orchestra.run.smithi093.stdout:0 2023-11-17T06:28:33.211 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.204+0000 7f047dada700 1 -- 172.21.15.93:0/1137438801 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 msgr2=0x7f04780ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.204+0000 7f047dada700 1 --2- 172.21.15.93:0/1137438801 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780ca1e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f046c00ebe0 tx=0x7f046c00eef0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.204+0000 7f047dada700 1 -- 172.21.15.93:0/1137438801 shutdown_connections 2023-11-17T06:28:33.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.204+0000 7f047dada700 1 --2- 172.21.15.93:0/1137438801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04781f7320 0x7f04781f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.204+0000 7f047dada700 1 --2- 172.21.15.93:0/1137438801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f047815d5a0 0x7f04780c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.204+0000 7f047dada700 1 --2- 172.21.15.93:0/1137438801 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f04780b2600 0x7f04780ca1e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.204+0000 7f047dada700 1 -- 172.21.15.93:0/1137438801 >> 172.21.15.93:0/1137438801 conn(0x7f047806aca0 msgr2=0x7f047815bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:33.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.208+0000 7f047dada700 1 -- 172.21.15.93:0/1137438801 shutdown_connections 2023-11-17T06:28:33.212 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.208+0000 7f047dada700 1 -- 172.21.15.93:0/1137438801 wait complete. 2023-11-17T06:28:33.213 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:33.206+0000 7fdaac53e2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-17T06:28:33.213 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:33.208+0000 7f4b811a62c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-17T06:28:33.233 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new d735b46c-a147-4975-94d8-fae9caeaf5ec 1 2023-11-17T06:28:33.293 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:33.288+0000 7f4b811a62c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-17T06:28:33.296 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:33.290+0000 7fdaac53e2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-17T06:28:33.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.388+0000 7f385a1e4700 1 Processor -- start 2023-11-17T06:28:33.395 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f385a1e4700 1 -- start start 2023-11-17T06:28:33.397 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f385a1e4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f385415d980 0x7f38540b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f385a1e4700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f38540b5270 0x7f38540d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f385a1e4700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38540b6750 con 0x7f38540d1ca0 2023-11-17T06:28:33.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f385a1e4700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540d2a30 con 0x7f38540b5270 2023-11-17T06:28:33.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f385a1e4700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38540b6980 con 0x7f385415d980 2023-11-17T06:28:33.398 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f38537fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f385415d980 0x7f38540b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f3852ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f38540b5270 0x7f38540d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f3852ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f38540b5270 0x7f38540d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.93:60054/0 (socket says 172.21.15.93:60054) 2023-11-17T06:28:33.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f3852ffd700 1 -- 172.21.15.93:0/1329946944 learned_addr learned my addr 172.21.15.93:0/1329946944 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:28:33.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f3852ffd700 1 -- 172.21.15.93:0/1329946944 >> v2:172.21.15.93:3300/0 conn(0x7f385415d980 msgr2=0x7f38540b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:33.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f3852ffd700 1 --2- 172.21.15.93:0/1329946944 >> v2:172.21.15.93:3300/0 conn(0x7f385415d980 0x7f38540b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f3852ffd700 1 -- 172.21.15.93:0/1329946944 >> v1:172.21.15.69:6789/0 conn(0x7f38540d1ca0 legacy=0x7f385406ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.399 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f3852ffd700 1 -- 172.21.15.93:0/1329946944 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38540b56d0 con 0x7f38540b5270 2023-11-17T06:28:33.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.392+0000 7f38537fe700 1 --2- 172.21.15.93:0/1329946944 >> v2:172.21.15.93:3300/0 conn(0x7f385415d980 0x7f38540b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:28:33.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f3852ffd700 1 --2- 172.21.15.93:0/1329946944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38540b5270 0x7f38540d1760 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38540d43b0 tx=0x7f3848009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401bd9acc87179b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:33.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f38527fc700 1 -- 172.21.15.93:0/1329946944 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848011830 con 0x7f38540b5270 2023-11-17T06:28:33.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f38527fc700 1 -- 172.21.15.93:0/1329946944 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3848011990 con 0x7f38540b5270 2023-11-17T06:28:33.400 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f38527fc700 1 -- 172.21.15.93:0/1329946944 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848011d00 con 0x7f38540b5270 2023-11-17T06:28:33.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f385a1e4700 1 -- 172.21.15.93:0/1329946944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38540b5270 msgr2=0x7f38540d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f385a1e4700 1 --2- 172.21.15.93:0/1329946944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38540b5270 0x7f38540d1760 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f38540d43b0 tx=0x7f3848009bf0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f385a1e4700 1 -- 172.21.15.93:0/1329946944 shutdown_connections 2023-11-17T06:28:33.401 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f385a1e4700 1 --2- 172.21.15.93:0/1329946944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38540b5270 0x7f38540d1760 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f385a1e4700 1 --2- 172.21.15.93:0/1329946944 >> v2:172.21.15.93:3300/0 conn(0x7f385415d980 0x7f38540b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f385a1e4700 1 -- 172.21.15.93:0/1329946944 >> 172.21.15.93:0/1329946944 conn(0x7f38540cfd30 msgr2=0x7f38540d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:33.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f385a1e4700 1 -- 172.21.15.93:0/1329946944 shutdown_connections 2023-11-17T06:28:33.402 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.396+0000 7f385a1e4700 1 -- 172.21.15.93:0/1329946944 wait complete. 2023-11-17T06:28:33.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f385a1e4700 1 Processor -- start 2023-11-17T06:28:33.404 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f385a1e4700 1 -- start start 2023-11-17T06:28:33.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f385a1e4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38540b5270 0x7f38540c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f385a1e4700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f38540d1ca0 0x7f38540ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f385a1e4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540ce720 0x7f38540af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f385a1e4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540c9df0 con 0x7f38540b5270 2023-11-17T06:28:33.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f385a1e4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38540cebb0 con 0x7f38540ce720 2023-11-17T06:28:33.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f385a1e4700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540b04b0 con 0x7f38540d1ca0 2023-11-17T06:28:33.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f3852ffd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f38540d1ca0 0x7f38540ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f3852ffd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f38540d1ca0 0x7f38540ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:38954/0 (socket says 172.21.15.93:38954) 2023-11-17T06:28:33.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f3852ffd700 1 -- 172.21.15.93:0/857269701 learned_addr learned my addr 172.21.15.93:0/857269701 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:28:33.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f3853fff700 1 --2- 172.21.15.93:0/857269701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540ce720 0x7f38540af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.407 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f38537fe700 1 --2- 172.21.15.93:0/857269701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38540b5270 0x7f38540c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f3852ffd700 1 -- 172.21.15.93:0/857269701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540ce720 msgr2=0x7f38540af760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f3852ffd700 1 --2- 172.21.15.93:0/857269701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540ce720 0x7f38540af760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f3852ffd700 1 -- 172.21.15.93:0/857269701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38540b5270 msgr2=0x7f38540c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f3852ffd700 1 --2- 172.21.15.93:0/857269701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38540b5270 0x7f38540c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.408 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.400+0000 7f3852ffd700 1 -- 172.21.15.93:0/857269701 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440094b0 con 0x7f38540d1ca0 2023-11-17T06:28:33.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.404+0000 7f3852ffd700 1 --2- 172.21.15.93:0/857269701 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f38540d1ca0 0x7f38540ce1e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3848014040 tx=0x7f3848004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:33.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.404+0000 7f383bfff700 1 -- 172.21.15.93:0/857269701 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848004590 con 0x7f38540d1ca0 2023-11-17T06:28:33.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.404+0000 7f383bfff700 1 -- 172.21.15.93:0/857269701 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f384801e070 con 0x7f38540d1ca0 2023-11-17T06:28:33.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.404+0000 7f383bfff700 1 -- 172.21.15.93:0/857269701 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848003900 con 0x7f38540d1ca0 2023-11-17T06:28:33.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.404+0000 7f385a1e4700 1 -- 172.21.15.93:0/857269701 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3848009570 con 0x7f38540d1ca0 2023-11-17T06:28:33.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.404+0000 7f385a1e4700 1 -- 172.21.15.93:0/857269701 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38540b0a70 con 0x7f38540d1ca0 2023-11-17T06:28:33.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.404+0000 7f383bfff700 1 -- 172.21.15.93:0/857269701 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3848025480 con 0x7f38540d1ca0 2023-11-17T06:28:33.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.404+0000 7f383bfff700 1 -- 172.21.15.93:0/857269701 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3848020070 con 0x7f38540d1ca0 2023-11-17T06:28:33.409 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.404+0000 7f385a1e4700 1 -- 172.21.15.93:0/857269701 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38541f2d40 con 0x7f38540d1ca0 2023-11-17T06:28:33.412 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.408+0000 7f383bfff700 1 -- 172.21.15.93:0/857269701 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f384802a020 con 0x7f38540d1ca0 2023-11-17T06:28:33.470 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:33.462+0000 7fdaac53e2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-17T06:28:33.471 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:33.468+0000 7f4b811a62c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-17T06:28:33.491 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.488+0000 7f385a1e4700 1 -- 172.21.15.93:0/857269701 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d735b46c-a147-4975-94d8-fae9caeaf5ec", "id": 1} v 0) v1 -- 0x7f3854073f00 con 0x7f38540d1ca0 2023-11-17T06:28:33.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.496+0000 7f383bfff700 1 -- 172.21.15.93:0/857269701 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d735b46c-a147-4975-94d8-fae9caeaf5ec", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3848015020 con 0x7f38540d1ca0 2023-11-17T06:28:33.502 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-17T06:28:33.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.500+0000 7f385a1e4700 1 -- 172.21.15.93:0/857269701 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f38540d1ca0 msgr2=0x7f38540ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.500+0000 7f385a1e4700 1 --2- 172.21.15.93:0/857269701 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f38540d1ca0 0x7f38540ce1e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3848014040 tx=0x7f3848004770 comp rx=0 tx=0).stop 2023-11-17T06:28:33.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.500+0000 7f385a1e4700 1 -- 172.21.15.93:0/857269701 shutdown_connections 2023-11-17T06:28:33.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.500+0000 7f385a1e4700 1 --2- 172.21.15.93:0/857269701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f38540ce720 0x7f38540af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.500+0000 7f385a1e4700 1 --2- 172.21.15.93:0/857269701 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f38540d1ca0 0x7f38540ce1e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.500+0000 7f385a1e4700 1 --2- 172.21.15.93:0/857269701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38540b5270 0x7f38540c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.500+0000 7f385a1e4700 1 -- 172.21.15.93:0/857269701 >> 172.21.15.93:0/857269701 conn(0x7f38540cfd30 msgr2=0x7f38540b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:33.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.500+0000 7f385a1e4700 1 -- 172.21.15.93:0/857269701 shutdown_connections 2023-11-17T06:28:33.504 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.500+0000 7f385a1e4700 1 -- 172.21.15.93:0/857269701 wait complete. 2023-11-17T06:28:33.521 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 3b03818f-034a-46e6-b430-264cecba8b92 2 2023-11-17T06:28:33.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c9467700 1 Processor -- start 2023-11-17T06:28:33.680 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c9467700 1 -- start start 2023-11-17T06:28:33.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c9467700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe5c415b980 0x7fe5c415f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.682 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c9467700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c40719e0 0x7fe5c40c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c9467700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe5c40c9960 0x7fe5c415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c9467700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c4070430 con 0x7fe5c40c9960 2023-11-17T06:28:33.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c9467700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5c415ed70 con 0x7fe5c415b980 2023-11-17T06:28:33.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c9467700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40c9dd0 con 0x7fe5c40719e0 2023-11-17T06:28:33.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c27fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c40719e0 0x7fe5c40c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c27fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c40719e0 0x7fe5c40c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:38966/0 (socket says 172.21.15.93:38966) 2023-11-17T06:28:33.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c27fc700 1 -- 172.21.15.93:0/1567716505 learned_addr learned my addr 172.21.15.93:0/1567716505 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:28:33.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c2ffd700 1 --2- 172.21.15.93:0/1567716505 >> v2:172.21.15.93:3300/0 conn(0x7fe5c415b980 0x7fe5c415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.683 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c37fe700 1 --2- 172.21.15.93:0/1567716505 >> v2:172.21.15.69:3300/0 conn(0x7fe5c40c9960 0x7fe5c415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c2ffd700 1 -- 172.21.15.93:0/1567716505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c40719e0 msgr2=0x7fe5c40c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:33.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c2ffd700 1 --2- 172.21.15.93:0/1567716505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c40719e0 0x7fe5c40c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c2ffd700 1 -- 172.21.15.93:0/1567716505 >> v2:172.21.15.69:3300/0 conn(0x7fe5c40c9960 msgr2=0x7fe5c415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:33.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c2ffd700 1 --2- 172.21.15.93:0/1567716505 >> v2:172.21.15.69:3300/0 conn(0x7fe5c40c9960 0x7fe5c415bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.684 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c2ffd700 1 -- 172.21.15.93:0/1567716505 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c406fc20 con 0x7fe5c415b980 2023-11-17T06:28:33.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c37fe700 1 --2- 172.21.15.93:0/1567716505 >> v2:172.21.15.69:3300/0 conn(0x7fe5c40c9960 0x7fe5c415bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:28:33.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.676+0000 7fe5c27fc700 1 --2- 172.21.15.93:0/1567716505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c40719e0 0x7fe5c40c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:28:33.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c2ffd700 1 --2- 172.21.15.93:0/1567716505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c415b980 0x7fe5c415f780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40cec90 tx=0x7fe5b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=649725a16bf3f2f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:33.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c1ffb700 1 -- 172.21.15.93:0/1567716505 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4011830 con 0x7fe5c415b980 2023-11-17T06:28:33.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c1ffb700 1 -- 172.21.15.93:0/1567716505 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b4011990 con 0x7fe5c415b980 2023-11-17T06:28:33.685 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c1ffb700 1 -- 172.21.15.93:0/1567716505 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4011d20 con 0x7fe5c415b980 2023-11-17T06:28:33.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c9467700 1 -- 172.21.15.93:0/1567716505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c415b980 msgr2=0x7fe5c415f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c9467700 1 --2- 172.21.15.93:0/1567716505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c415b980 0x7fe5c415f780 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40cec90 tx=0x7fe5b4009b60 comp rx=0 tx=0).stop 2023-11-17T06:28:33.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c9467700 1 -- 172.21.15.93:0/1567716505 shutdown_connections 2023-11-17T06:28:33.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c9467700 1 --2- 172.21.15.93:0/1567716505 >> v2:172.21.15.69:3300/0 conn(0x7fe5c40c9960 0x7fe5c415bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c9467700 1 --2- 172.21.15.93:0/1567716505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c40719e0 0x7fe5c40c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c9467700 1 --2- 172.21.15.93:0/1567716505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c415b980 0x7fe5c415f780 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c9467700 1 -- 172.21.15.93:0/1567716505 >> 172.21.15.93:0/1567716505 conn(0x7fe5c40b0900 msgr2=0x7fe5c40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:33.686 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c9467700 1 -- 172.21.15.93:0/1567716505 shutdown_connections 2023-11-17T06:28:33.687 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.680+0000 7fe5c9467700 1 -- 172.21.15.93:0/1567716505 wait complete. 2023-11-17T06:28:33.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.684+0000 7fe5c9467700 1 Processor -- start 2023-11-17T06:28:33.689 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.684+0000 7fe5c9467700 1 -- start start 2023-11-17T06:28:33.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.684+0000 7fe5c9467700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5c40719e0 0x7fe5c40b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.684+0000 7fe5c9467700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c40c9960 0x7fe5c4159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c9467700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c415b980 0x7fe5c4157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c9467700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c40b3e00 con 0x7fe5c40719e0 2023-11-17T06:28:33.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c9467700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4156160 con 0x7fe5c40c9960 2023-11-17T06:28:33.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c9467700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c4156440 con 0x7fe5c415b980 2023-11-17T06:28:33.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c27fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c40c9960 0x7fe5c4159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c27fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c40c9960 0x7fe5c4159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48722/0 (socket says 172.21.15.93:48722) 2023-11-17T06:28:33.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c27fc700 1 -- 172.21.15.93:0/3899850628 learned_addr learned my addr 172.21.15.93:0/3899850628 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:28:33.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c37fe700 1 --2- 172.21.15.93:0/3899850628 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c415b980 0x7fe5c4157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c2ffd700 1 --2- 172.21.15.93:0/3899850628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5c40719e0 0x7fe5c40b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c27fc700 1 -- 172.21.15.93:0/3899850628 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c415b980 msgr2=0x7fe5c4157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c27fc700 1 --2- 172.21.15.93:0/3899850628 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c415b980 0x7fe5c4157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c27fc700 1 -- 172.21.15.93:0/3899850628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5c40719e0 msgr2=0x7fe5c40b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c27fc700 1 --2- 172.21.15.93:0/3899850628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5c40719e0 0x7fe5c40b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c27fc700 1 -- 172.21.15.93:0/3899850628 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b8009570 con 0x7fe5c40c9960 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c2ffd700 1 --2- 172.21.15.93:0/3899850628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5c40719e0 0x7fe5c40b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c27fc700 1 --2- 172.21.15.93:0/3899850628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c40c9960 0x7fe5c4159580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800ebb0 tx=0x7fe5b800eec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5ab7fe700 1 -- 172.21.15.93:0/3899850628 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8004030 con 0x7fe5c40c9960 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5ab7fe700 1 -- 172.21.15.93:0/3899850628 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b8004190 con 0x7fe5c40c9960 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5ab7fe700 1 -- 172.21.15.93:0/3899850628 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b8004520 con 0x7fe5c40c9960 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c9467700 1 -- 172.21.15.93:0/3899850628 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b40094b0 con 0x7fe5c40c9960 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c9467700 1 -- 172.21.15.93:0/3899850628 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c4156a00 con 0x7fe5c40c9960 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5ab7fe700 1 -- 172.21.15.93:0/3899850628 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe5b8005d40 con 0x7fe5c40c9960 2023-11-17T06:28:33.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5ab7fe700 1 -- 172.21.15.93:0/3899850628 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fe5b800cc70 con 0x7fe5c40c9960 2023-11-17T06:28:33.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.688+0000 7fe5c9467700 1 -- 172.21.15.93:0/3899850628 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c4073f00 con 0x7fe5c40c9960 2023-11-17T06:28:33.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.692+0000 7fe5ab7fe700 1 -- 172.21.15.93:0/3899850628 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fe5b8020060 con 0x7fe5c40c9960 2023-11-17T06:28:33.732 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:33.726+0000 7fdaac53e2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-17T06:28:33.735 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:33.732+0000 7f4b811a62c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-17T06:28:33.782 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.776+0000 7fe5c9467700 1 -- 172.21.15.93:0/3899850628 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3b03818f-034a-46e6-b430-264cecba8b92", "id": 2} v 0) v1 -- 0x7fe5c40cc690 con 0x7fe5c40c9960 2023-11-17T06:28:33.796 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.792+0000 7fe5ab7fe700 1 -- 172.21.15.93:0/3899850628 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b03818f-034a-46e6-b430-264cecba8b92", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe5b8028020 con 0x7fe5c40c9960 2023-11-17T06:28:33.796 INFO:teuthology.orchestra.run.smithi093.stdout:2 2023-11-17T06:28:33.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.792+0000 7fe5c9467700 1 -- 172.21.15.93:0/3899850628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c40c9960 msgr2=0x7fe5c4159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.797 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.792+0000 7fe5c9467700 1 --2- 172.21.15.93:0/3899850628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c40c9960 0x7fe5c4159580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800ebb0 tx=0x7fe5b800eec0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.792+0000 7fe5c9467700 1 -- 172.21.15.93:0/3899850628 shutdown_connections 2023-11-17T06:28:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.792+0000 7fe5c9467700 1 --2- 172.21.15.93:0/3899850628 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5c415b980 0x7fe5c4157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.792+0000 7fe5c9467700 1 --2- 172.21.15.93:0/3899850628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5c40c9960 0x7fe5c4159580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.792+0000 7fe5c9467700 1 --2- 172.21.15.93:0/3899850628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5c40719e0 0x7fe5c40b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.792+0000 7fe5c9467700 1 -- 172.21.15.93:0/3899850628 >> 172.21.15.93:0/3899850628 conn(0x7fe5c40b0900 msgr2=0x7fe5c40b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.792+0000 7fe5c9467700 1 -- 172.21.15.93:0/3899850628 shutdown_connections 2023-11-17T06:28:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.792+0000 7fe5c9467700 1 -- 172.21.15.93:0/3899850628 wait complete. 2023-11-17T06:28:33.805 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:33.800+0000 7f4b811a62c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-17T06:28:33.811 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:33.806+0000 7fdaac53e2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-17T06:28:33.818 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 8f837026-cb9e-4964-b340-d8f4e8fb615c 3 2023-11-17T06:28:33.983 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.980+0000 7f68368f0700 1 Processor -- start 2023-11-17T06:28:33.984 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.980+0000 7f68368f0700 1 -- start start 2023-11-17T06:28:33.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f68301654d0 0x7f68300cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.987 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68300cd760 0x7f68300cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68301659d0 con 0x7f68301619a0 2023-11-17T06:28:33.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68300ce130 con 0x7f68301654d0 2023-11-17T06:28:33.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6830165cb0 con 0x7f68300cd760 2023-11-17T06:28:33.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68358ee700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f68301619a0 0x7f68300d0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:43198/0 (socket says 172.21.15.93:43198) 2023-11-17T06:28:33.988 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68358ee700 1 -- 172.21.15.93:0/3333126360 learned_addr learned my addr 172.21.15.93:0/3333126360 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-17T06:28:33.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68360ef700 1 --2- 172.21.15.93:0/3333126360 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68300cd760 0x7f68300cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68350ed700 1 --2- 172.21.15.93:0/3333126360 >> v2:172.21.15.93:3300/0 conn(0x7f68301654d0 0x7f68300cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:28:33.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68348ec700 1 -- 172.21.15.93:0/3333126360 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 926219158 0 0) 0x7f68301659d0 con 0x7f68301619a0 2023-11-17T06:28:33.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68348ec700 1 -- 172.21.15.93:0/3333126360 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f681c0035d0 con 0x7f68301619a0 2023-11-17T06:28:33.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68360ef700 1 -- 172.21.15.93:0/3333126360 >> v2:172.21.15.93:3300/0 conn(0x7f68301654d0 msgr2=0x7f68300cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:28:33.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68360ef700 1 --2- 172.21.15.93:0/3333126360 >> v2:172.21.15.93:3300/0 conn(0x7f68301654d0 0x7f68300cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68360ef700 1 -- 172.21.15.93:0/3333126360 >> v1:172.21.15.93:6789/0 conn(0x7f68301619a0 legacy=0x7f68300d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.989 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68360ef700 1 -- 172.21.15.93:0/3333126360 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6830165f90 con 0x7f68300cd760 2023-11-17T06:28:33.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68360ef700 1 --2- 172.21.15.93:0/3333126360 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68300cd760 0x7f68300cdbf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6828009d90 tx=0x7f682800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28488ea845f9e12e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:28:33.990 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68348ec700 1 -- 172.21.15.93:0/3333126360 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f682800e070 con 0x7f68300cd760 2023-11-17T06:28:33.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68348ec700 1 -- 172.21.15.93:0/3333126360 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682800bb20 con 0x7f68300cd760 2023-11-17T06:28:33.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68348ec700 1 -- 172.21.15.93:0/3333126360 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6828012430 con 0x7f68300cd760 2023-11-17T06:28:33.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 -- 172.21.15.93:0/3333126360 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68300cd760 msgr2=0x7f68300cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:28:33.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 --2- 172.21.15.93:0/3333126360 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68300cd760 0x7f68300cdbf0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6828009d90 tx=0x7f682800b330 comp rx=0 tx=0).stop 2023-11-17T06:28:33.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 -- 172.21.15.93:0/3333126360 shutdown_connections 2023-11-17T06:28:33.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 --2- 172.21.15.93:0/3333126360 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68300cd760 0x7f68300cdbf0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 --2- 172.21.15.93:0/3333126360 >> v2:172.21.15.93:3300/0 conn(0x7f68301654d0 0x7f68300cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:28:33.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 -- 172.21.15.93:0/3333126360 >> 172.21.15.93:0/3333126360 conn(0x7f683006aca0 msgr2=0x7f683006b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:28:33.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 -- 172.21.15.93:0/3333126360 shutdown_connections 2023-11-17T06:28:33.991 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.984+0000 7f68368f0700 1 -- 172.21.15.93:0/3333126360 wait complete. 2023-11-17T06:28:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68368f0700 1 Processor -- start 2023-11-17T06:28:33.992 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68368f0700 1 -- start start 2023-11-17T06:28:33.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68368f0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68300cd760 0x7f68300cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68368f0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68301619a0 0x7f68301f7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68368f0700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68301654d0 0x7f68301f7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:28:33.994 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68368f0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6830159d90 con 0x7f68300cd760 2023-11-17T06:29:33.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68368f0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68301f7b50 con 0x7f68301619a0 2023-11-17T06:29:33.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68368f0700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68301f7e30 con 0x7f68301654d0 2023-11-17T06:29:33.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68350ed700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68301619a0 0x7f68301f7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:33.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68360ef700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68301654d0 0x7f68301f7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:33.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68350ed700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68301619a0 0x7f68301f7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:48748/0 (socket says 172.21.15.93:48748) 2023-11-17T06:29:33.583 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68350ed700 1 -- 172.21.15.93:0/1879737663 learned_addr learned my addr 172.21.15.93:0/1879737663 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:29:33.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68358ee700 1 --2- 172.21.15.93:0/1879737663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68300cd760 0x7f68300cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:33.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68350ed700 1 -- 172.21.15.93:0/1879737663 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68301654d0 msgr2=0x7f68301f7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:33.584 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68350ed700 1 --2- 172.21.15.93:0/1879737663 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68301654d0 0x7f68301f7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:33.585 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:29:33.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68350ed700 1 -- 172.21.15.93:0/1879737663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68300cd760 msgr2=0x7f68300cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:33.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68350ed700 1 --2- 172.21.15.93:0/1879737663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68300cd760 0x7f68300cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:33.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68350ed700 1 -- 172.21.15.93:0/1879737663 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6828009a70 con 0x7f68301619a0 2023-11-17T06:29:33.588 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68358ee700 1 --2- 172.21.15.93:0/1879737663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68300cd760 0x7f68300cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.988+0000 7f68350ed700 1 --2- 172.21.15.93:0/1879737663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68301619a0 0x7f68301f7020 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6820009fd0 tx=0x7f682000eb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.992+0000 7f68267fc700 1 -- 172.21.15.93:0/1879737663 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68200095a0 con 0x7f68301619a0 2023-11-17T06:29:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.992+0000 7f68267fc700 1 -- 172.21.15.93:0/1879737663 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6820013680 con 0x7f68301619a0 2023-11-17T06:29:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.992+0000 7f68368f0700 1 -- 172.21.15.93:0/1879737663 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6830159fa0 con 0x7f68301619a0 2023-11-17T06:29:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.992+0000 7f68267fc700 1 -- 172.21.15.93:0/1879737663 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6820013a30 con 0x7f68301619a0 2023-11-17T06:29:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.992+0000 7f68368f0700 1 -- 172.21.15.93:0/1879737663 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f683015c7b0 con 0x7f68301619a0 2023-11-17T06:29:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.992+0000 7f68267fc700 1 -- 172.21.15.93:0/1879737663 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6820005a40 con 0x7f68301619a0 2023-11-17T06:29:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.992+0000 7f68267fc700 1 -- 172.21.15.93:0/1879737663 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6820006700 con 0x7f68301619a0 2023-11-17T06:29:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.992+0000 7f68368f0700 1 -- 172.21.15.93:0/1879737663 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68300686a0 con 0x7f68301619a0 2023-11-17T06:29:33.589 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:33.996+0000 7f68267fc700 1 -- 172.21.15.93:0/1879737663 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f6820021060 con 0x7f68301619a0 2023-11-17T06:29:33.590 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:34.032+0000 7f4b811a62c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:34.046+0000 7fdaac53e2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:34.134+0000 7fdaac53e2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:34.226+0000 7fdaac53e2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:34.694+0000 7fdaac53e2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:34.858+0000 7fdaac53e2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:35.270+0000 7fdaac53e2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:35.510+0000 7fdaac53e2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:35.606+0000 7fdaac53e2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:35.698+0000 7fdaac53e2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:36.722+0000 7fdaac53e2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-17T06:29:33.591 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:36.814+0000 7fdaac53e2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-17T06:29:33.659 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:36.978+0000 7fdaac53e2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-17T06:29:33.659 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:37.062+0000 7fdaac53e2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-17T06:29:33.659 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:37.158+0000 7fdaac53e2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-17T06:29:33.659 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:37.366+0000 7fdaac53e2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-17T06:29:33.659 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:37.610+0000 7fdaac53e2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-17T06:29:33.659 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-11-17T06:28:38.418+0000 7fdaac53e2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-17T06:29:33.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.072+0000 7f68368f0700 1 -- 172.21.15.93:0/1879737663 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f837026-cb9e-4964-b340-d8f4e8fb615c", "id": 3} v 0) v1 -- 0x7f68301f7ff0 con 0x7f68301619a0 2023-11-17T06:29:33.660 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.080+0000 7f68267fc700 1 -- 172.21.15.93:0/1879737663 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f837026-cb9e-4964-b340-d8f4e8fb615c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f682002a0b0 con 0x7f68301619a0 2023-11-17T06:29:33.661 INFO:teuthology.orchestra.run.smithi093.stdout:3 2023-11-17T06:29:33.661 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.084+0000 7f68368f0700 1 -- 172.21.15.93:0/1879737663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68301619a0 msgr2=0x7f68301f7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:33.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.084+0000 7f68368f0700 1 --2- 172.21.15.93:0/1879737663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68301619a0 0x7f68301f7020 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6820009fd0 tx=0x7f682000eb20 comp rx=0 tx=0).stop 2023-11-17T06:29:33.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.084+0000 7f68368f0700 1 -- 172.21.15.93:0/1879737663 shutdown_connections 2023-11-17T06:29:33.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.084+0000 7f68368f0700 1 --2- 172.21.15.93:0/1879737663 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f68301654d0 0x7f68301f7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:33.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.084+0000 7f68368f0700 1 --2- 172.21.15.93:0/1879737663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68301619a0 0x7f68301f7020 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:33.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.084+0000 7f68368f0700 1 --2- 172.21.15.93:0/1879737663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f68300cd760 0x7f68300cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:33.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.084+0000 7f68368f0700 1 -- 172.21.15.93:0/1879737663 >> 172.21.15.93:0/1879737663 conn(0x7f683006aca0 msgr2=0x7f683006b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:33.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.084+0000 7f68368f0700 1 -- 172.21.15.93:0/1879737663 shutdown_connections 2023-11-17T06:29:33.662 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:28:34.084+0000 7f68368f0700 1 -- 172.21.15.93:0/1879737663 wait complete. 2023-11-17T06:29:33.663 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 56aceb78-f273-4527-9395-6f208db7185a 4 2023-11-17T06:29:33.664 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:34.124+0000 7f4b811a62c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-17T06:29:33.664 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:34.236+0000 7f4b811a62c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:34.756+0000 7f4b811a62c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:34.936+0000 7f4b811a62c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:35.376+0000 7f4b811a62c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:35.600+0000 7f4b811a62c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:35.692+0000 7f4b811a62c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:35.772+0000 7f4b811a62c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:36.568+0000 7f4b811a62c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:36.656+0000 7f4b811a62c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:36.836+0000 7f4b811a62c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:36.924+0000 7f4b811a62c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:37.020+0000 7f4b811a62c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:37.228+0000 7f4b811a62c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-17T06:29:33.665 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:37.488+0000 7f4b811a62c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-17T06:29:33.666 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:38.320+0000 7f4b811a62c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-17T06:29:33.686 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:39.360+0000 7f4b681b8700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-17T06:29:33.686 INFO:tasks.ceph.mgr.x.smithi093.stderr:2023-11-17T06:28:39.364+0000 7f4b681b8700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-17T06:29:33.687 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:29:33.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb12c4f3700 1 Processor -- start 2023-11-17T06:29:33.868 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb12c4f3700 1 -- start start 2023-11-17T06:29:33.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb12c4f3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb12406d0a0 0x7fb124161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:33.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb12c4f3700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb1240d0b70 0x7fb1240d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:33.870 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb12c4f3700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb124154840 con 0x7fb124154460 2023-11-17T06:29:33.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb12c4f3700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb124161e60 con 0x7fb12406d0a0 2023-11-17T06:29:33.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb12c4f3700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12415dca0 con 0x7fb1240d0b70 2023-11-17T06:29:33.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb12aa90700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb1240d0b70 0x7fb1240d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:33.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb12aa90700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb1240d0b70 0x7fb1240d0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52574/0 (socket says 172.21.15.93:52574) 2023-11-17T06:29:33.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb12aa90700 1 -- 172.21.15.93:0/625172370 learned_addr learned my addr 172.21.15.93:0/625172370 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:29:33.871 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.867+0000 7fb129a8e700 1 --2- 172.21.15.93:0/625172370 >> v2:172.21.15.69:3300/0 conn(0x7fb12406d0a0 0x7fb124161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:33.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb129a8e700 1 -- 172.21.15.93:0/625172370 >> v2:172.21.15.93:3300/0 conn(0x7fb1240d0b70 msgr2=0x7fb1240d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:33.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb129a8e700 1 --2- 172.21.15.93:0/625172370 >> v2:172.21.15.93:3300/0 conn(0x7fb1240d0b70 0x7fb1240d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:33.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb129a8e700 1 -- 172.21.15.93:0/625172370 >> v1:172.21.15.69:6789/0 conn(0x7fb124154460 legacy=0x7fb12406c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:33.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb129a8e700 1 -- 172.21.15.93:0/625172370 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12415df80 con 0x7fb12406d0a0 2023-11-17T06:29:33.872 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb129a8e700 1 --2- 172.21.15.93:0/625172370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12406d0a0 0x7fb124161920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb1240cb5e0 tx=0x7fb114009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e231ad82ce2eca6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:33.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12928d700 1 -- 172.21.15.93:0/625172370 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114011830 con 0x7fb12406d0a0 2023-11-17T06:29:33.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12928d700 1 -- 172.21.15.93:0/625172370 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb114011990 con 0x7fb12406d0a0 2023-11-17T06:29:33.873 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12928d700 1 -- 172.21.15.93:0/625172370 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb114011d20 con 0x7fb12406d0a0 2023-11-17T06:29:33.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12c4f3700 1 -- 172.21.15.93:0/625172370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12406d0a0 msgr2=0x7fb124161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:33.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12c4f3700 1 --2- 172.21.15.93:0/625172370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12406d0a0 0x7fb124161920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb1240cb5e0 tx=0x7fb114009b30 comp rx=0 tx=0).stop 2023-11-17T06:29:33.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12c4f3700 1 -- 172.21.15.93:0/625172370 shutdown_connections 2023-11-17T06:29:33.874 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12c4f3700 1 --2- 172.21.15.93:0/625172370 >> v2:172.21.15.93:3300/0 conn(0x7fb1240d0b70 0x7fb1240d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:33.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12c4f3700 1 --2- 172.21.15.93:0/625172370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12406d0a0 0x7fb124161920 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:33.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12c4f3700 1 -- 172.21.15.93:0/625172370 >> 172.21.15.93:0/625172370 conn(0x7fb124065e90 msgr2=0x7fb1240662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:33.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12c4f3700 1 -- 172.21.15.93:0/625172370 shutdown_connections 2023-11-17T06:29:33.875 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.871+0000 7fb12c4f3700 1 -- 172.21.15.93:0/625172370 wait complete. 2023-11-17T06:29:33.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.875+0000 7fb12c4f3700 1 Processor -- start 2023-11-17T06:29:33.878 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.875+0000 7fb12c4f3700 1 -- start start 2023-11-17T06:29:33.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12c4f3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12406d0a0 0x7fb124156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:33.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12c4f3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1240d0b70 0x7fb1241f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:33.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12c4f3700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb124154460 0x7fb1241f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:33.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12c4f3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1241573f0 con 0x7fb12406d0a0 2023-11-17T06:29:33.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12c4f3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb124155e10 con 0x7fb1240d0b70 2023-11-17T06:29:33.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12c4f3700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1241560f0 con 0x7fb124154460 2023-11-17T06:29:33.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12aa90700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb124154460 0x7fb1241f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:33.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12aa90700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb124154460 0x7fb1241f65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:51164/0 (socket says 172.21.15.93:51164) 2023-11-17T06:29:33.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12aa90700 1 -- 172.21.15.93:0/2659472403 learned_addr learned my addr 172.21.15.93:0/2659472403 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:29:33.881 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb129a8e700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1240d0b70 0x7fb1241f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12a28f700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12406d0a0 0x7fb124156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12aa90700 1 -- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1240d0b70 msgr2=0x7fb1241f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12aa90700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1240d0b70 0x7fb1241f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12aa90700 1 -- 172.21.15.93:0/2659472403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12406d0a0 msgr2=0x7fb124156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12aa90700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12406d0a0 0x7fb124156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12aa90700 1 -- 172.21.15.93:0/2659472403 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1140094b0 con 0x7fb124154460 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb129a8e700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1240d0b70 0x7fb1241f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12a28f700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12406d0a0 0x7fb124156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12aa90700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb124154460 0x7fb1241f65a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00e840 tx=0x7fb11c00ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb11affd700 1 -- 172.21.15.93:0/2659472403 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c00c690 con 0x7fb124154460 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb11affd700 1 -- 172.21.15.93:0/2659472403 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c00c810 con 0x7fb124154460 2023-11-17T06:29:33.883 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12c4f3700 1 -- 172.21.15.93:0/2659472403 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1241563d0 con 0x7fb124154460 2023-11-17T06:29:33.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb11affd700 1 -- 172.21.15.93:0/2659472403 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11c00cbc0 con 0x7fb124154460 2023-11-17T06:29:33.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.879+0000 7fb12c4f3700 1 -- 172.21.15.93:0/2659472403 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb124156990 con 0x7fb124154460 2023-11-17T06:29:33.884 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.883+0000 7fb12c4f3700 1 -- 172.21.15.93:0/2659472403 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12415e240 con 0x7fb124154460 2023-11-17T06:29:33.885 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.883+0000 7fb11affd700 1 -- 172.21.15.93:0/2659472403 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7fb11c00cd20 con 0x7fb124154460 2023-11-17T06:29:33.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.883+0000 7fb11affd700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb108066480 0x7fb108068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:33.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.887+0000 7fb11affd700 1 -- 172.21.15.93:0/2659472403 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb11c082ce0 con 0x7fb124154460 2023-11-17T06:29:33.887 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.887+0000 7fb12a28f700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb108066480 0x7fb108068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:33.889 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.887+0000 7fb12a28f700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb108066480 0x7fb108068940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1200012e0 tx=0x7fb120009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:33.894 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:33.891+0000 7fb11affd700 1 -- 172.21.15.93:0/2659472403 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb12415e240 con 0x7fb124154460 2023-11-17T06:29:34.080 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.079+0000 7fb12c4f3700 1 -- 172.21.15.93:0/2659472403 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "56aceb78-f273-4527-9395-6f208db7185a", "id": 4} v 0) v1 -- 0x7fb12415e240 con 0x7fb124154460 2023-11-17T06:29:34.093 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.091+0000 7fb11affd700 1 -- 172.21.15.93:0/2659472403 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "56aceb78-f273-4527-9395-6f208db7185a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb11c017020 con 0x7fb124154460 2023-11-17T06:29:34.093 INFO:teuthology.orchestra.run.smithi093.stdout:4 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 -- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb108066480 msgr2=0x7fb108068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb108066480 0x7fb108068940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb1200012e0 tx=0x7fb120009040 comp rx=0 tx=0).stop 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 -- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb124154460 msgr2=0x7fb1241f65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb124154460 0x7fb1241f65a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb11c00e840 tx=0x7fb11c00ec00 comp rx=0 tx=0).stop 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 -- 172.21.15.93:0/2659472403 shutdown_connections 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb108066480 0x7fb108068940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb124154460 0x7fb1241f65a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1240d0b70 0x7fb1241f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 --2- 172.21.15.93:0/2659472403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb12406d0a0 0x7fb124156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 -- 172.21.15.93:0/2659472403 >> 172.21.15.93:0/2659472403 conn(0x7fb124065e90 msgr2=0x7fb12415e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:34.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 -- 172.21.15.93:0/2659472403 shutdown_connections 2023-11-17T06:29:34.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.095+0000 7fb12c4f3700 1 -- 172.21.15.93:0/2659472403 wait complete. 2023-11-17T06:29:34.117 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 473dae71-5906-4db7-b80f-3cf3fa280301 5 2023-11-17T06:29:34.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.275+0000 7f060f59e700 1 Processor -- start 2023-11-17T06:29:34.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.275+0000 7f060f59e700 1 -- start start 2023-11-17T06:29:34.283 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.275+0000 7f060f59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015e1c0 0x7f06100ce8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.275+0000 7f060f59e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f06100c9c20 0x7f06100ca040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.275+0000 7f060f59e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06100ca580 con 0x7f061015dde0 2023-11-17T06:29:34.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.275+0000 7f060f59e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06100cf200 con 0x7f06100c9c20 2023-11-17T06:29:34.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.275+0000 7f060f59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06100cd1a0 con 0x7f061015e1c0 2023-11-17T06:29:34.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060dd9b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015e1c0 0x7f06100ce8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060dd9b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015e1c0 0x7f06100ce8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:51180/0 (socket says 172.21.15.93:51180) 2023-11-17T06:29:34.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060dd9b700 1 -- 172.21.15.93:0/2009606485 learned_addr learned my addr 172.21.15.93:0/2009606485 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:29:34.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060ed9d700 1 --2- 172.21.15.93:0/2009606485 >> v2:172.21.15.93:3300/0 conn(0x7f06100c9c20 0x7f06100ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.284 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060dd9b700 1 -- 172.21.15.93:0/2009606485 >> v2:172.21.15.93:3300/0 conn(0x7f06100c9c20 msgr2=0x7f06100ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:34.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060dd9b700 1 --2- 172.21.15.93:0/2009606485 >> v2:172.21.15.93:3300/0 conn(0x7f06100c9c20 0x7f06100ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060dd9b700 1 -- 172.21.15.93:0/2009606485 >> v1:172.21.15.69:6789/0 conn(0x7f061015dde0 legacy=0x7f06100cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060dd9b700 1 -- 172.21.15.93:0/2009606485 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06100cd480 con 0x7f061015e1c0 2023-11-17T06:29:34.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060dd9b700 1 --2- 172.21.15.93:0/2009606485 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015e1c0 0x7f06100ce8d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0604009910 tx=0x7f0604009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42b09223a1d3b3c4 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:34.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060d59a700 1 -- 172.21.15.93:0/2009606485 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060400ba60 con 0x7f061015e1c0 2023-11-17T06:29:34.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060d59a700 1 -- 172.21.15.93:0/2009606485 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060400bbc0 con 0x7f061015e1c0 2023-11-17T06:29:34.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060d59a700 1 -- 172.21.15.93:0/2009606485 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604009e60 con 0x7f061015e1c0 2023-11-17T06:29:34.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060f59e700 1 -- 172.21.15.93:0/2009606485 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015e1c0 msgr2=0x7f06100ce8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060f59e700 1 --2- 172.21.15.93:0/2009606485 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015e1c0 0x7f06100ce8d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0604009910 tx=0x7f0604009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:34.285 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060f59e700 1 -- 172.21.15.93:0/2009606485 shutdown_connections 2023-11-17T06:29:34.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060f59e700 1 --2- 172.21.15.93:0/2009606485 >> v2:172.21.15.93:3300/0 conn(0x7f06100c9c20 0x7f06100ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060f59e700 1 --2- 172.21.15.93:0/2009606485 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015e1c0 0x7f06100ce8d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060f59e700 1 -- 172.21.15.93:0/2009606485 >> 172.21.15.93:0/2009606485 conn(0x7f06100cf5d0 msgr2=0x7f06100cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:34.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060f59e700 1 -- 172.21.15.93:0/2009606485 shutdown_connections 2023-11-17T06:29:34.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.279+0000 7f060f59e700 1 -- 172.21.15.93:0/2009606485 wait complete. 2023-11-17T06:29:34.286 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.283+0000 7f060f59e700 1 Processor -- start 2023-11-17T06:29:34.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.283+0000 7f060f59e700 1 -- start start 2023-11-17T06:29:34.287 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.283+0000 7f060f59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06100c9c20 0x7f06100b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.283+0000 7f060f59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015dde0 0x7f06100b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.283+0000 7f060f59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061015e1c0 0x7f0610154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.283+0000 7f060f59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06100b3ff0 con 0x7f061015e1c0 2023-11-17T06:29:34.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.283+0000 7f060f59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06100b42d0 con 0x7f06100c9c20 2023-11-17T06:29:34.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.283+0000 7f060f59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06100b45b0 con 0x7f061015dde0 2023-11-17T06:29:34.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060e59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06100c9c20 0x7f06100b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060e59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06100c9c20 0x7f06100b35c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52600/0 (socket says 172.21.15.93:52600) 2023-11-17T06:29:34.288 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060e59c700 1 -- 172.21.15.93:0/2254903532 learned_addr learned my addr 172.21.15.93:0/2254903532 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:29:34.289 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060dd9b700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015dde0 0x7f06100b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060ed9d700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061015e1c0 0x7f0610154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060e59c700 1 -- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015dde0 msgr2=0x7f06100b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060e59c700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015dde0 0x7f06100b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060e59c700 1 -- 172.21.15.93:0/2254903532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061015e1c0 msgr2=0x7f0610154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060e59c700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061015e1c0 0x7f0610154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060e59c700 1 -- 172.21.15.93:0/2254903532 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0604009570 con 0x7f06100c9c20 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060ed9d700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061015e1c0 0x7f0610154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060e59c700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06100c9c20 0x7f06100b35c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f060000c500 tx=0x7f060000c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f05feffd700 1 -- 172.21.15.93:0/2254903532 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000052d0 con 0x7f06100c9c20 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f05feffd700 1 -- 172.21.15.93:0/2254903532 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600005430 con 0x7f06100c9c20 2023-11-17T06:29:34.291 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f05feffd700 1 -- 172.21.15.93:0/2254903532 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000055a0 con 0x7f06100c9c20 2023-11-17T06:29:34.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060f59e700 1 -- 172.21.15.93:0/2254903532 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06100b4890 con 0x7f06100c9c20 2023-11-17T06:29:34.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060f59e700 1 -- 172.21.15.93:0/2254903532 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06100b3ba0 con 0x7f06100c9c20 2023-11-17T06:29:34.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.287+0000 7f060f59e700 1 -- 172.21.15.93:0/2254903532 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06100b3d90 con 0x7f06100c9c20 2023-11-17T06:29:34.292 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.291+0000 7f05feffd700 1 -- 172.21.15.93:0/2254903532 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7f06000038e0 con 0x7f06100c9c20 2023-11-17T06:29:34.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.291+0000 7f05feffd700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f05f00664b0 0x7f05f0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.293 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.291+0000 7f05feffd700 1 -- 172.21.15.93:0/2254903532 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f0600082110 con 0x7f06100c9c20 2023-11-17T06:29:34.294 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.291+0000 7f060dd9b700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f05f00664b0 0x7f05f0068970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.295 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.291+0000 7f060dd9b700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f05f00664b0 0x7f05f0068970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0604000c00 tx=0x7f0604008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:34.299 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.299+0000 7f05feffd700 1 -- 172.21.15.93:0/2254903532 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0600050700 con 0x7f06100c9c20 2023-11-17T06:29:34.483 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.479+0000 7f060f59e700 1 -- 172.21.15.93:0/2254903532 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd new", "uuid": "473dae71-5906-4db7-b80f-3cf3fa280301", "id": 5} v 0) v1 -- 0x7f06100b4410 con 0x7f06100c9c20 2023-11-17T06:29:34.496 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.495+0000 7f05feffd700 1 -- 172.21.15.93:0/2254903532 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "473dae71-5906-4db7-b80f-3cf3fa280301", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f06100b4410 con 0x7f06100c9c20 2023-11-17T06:29:34.496 INFO:teuthology.orchestra.run.smithi093.stdout:5 2023-11-17T06:29:34.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 -- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f05f00664b0 msgr2=0x7f05f0068970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f05f00664b0 0x7f05f0068970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0604000c00 tx=0x7f0604008030 comp rx=0 tx=0).stop 2023-11-17T06:29:34.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 -- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06100c9c20 msgr2=0x7f06100b35c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06100c9c20 0x7f06100b35c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f060000c500 tx=0x7f060000c810 comp rx=0 tx=0).stop 2023-11-17T06:29:34.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 -- 172.21.15.93:0/2254903532 shutdown_connections 2023-11-17T06:29:34.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f05f00664b0 0x7f05f0068970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061015e1c0 0x7f0610154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.501 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f061015dde0 0x7f06100b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 --2- 172.21.15.93:0/2254903532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06100c9c20 0x7f06100b35c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 -- 172.21.15.93:0/2254903532 >> 172.21.15.93:0/2254903532 conn(0x7f06100cf5d0 msgr2=0x7f06100cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:34.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 -- 172.21.15.93:0/2254903532 shutdown_connections 2023-11-17T06:29:34.502 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.499+0000 7f060f59e700 1 -- 172.21.15.93:0/2254903532 wait complete. 2023-11-17T06:29:34.521 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new ceda42ec-0314-43a7-83ed-6bb66a09e638 6 2023-11-17T06:29:34.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.691+0000 7fca4b6d4700 1 Processor -- start 2023-11-17T06:29:34.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.691+0000 7fca4b6d4700 1 -- start start 2023-11-17T06:29:34.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca4b6d4700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fca4406b3b0 0x7fca4406b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca4b6d4700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440ca720 con 0x7fca4415a0e0 2023-11-17T06:29:34.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca4b6d4700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440cbb40 con 0x7fca44065f40 2023-11-17T06:29:34.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca4b6d4700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4406dd30 con 0x7fca4406b3b0 2023-11-17T06:29:34.697 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca48c6f700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fca44065f40 0x7fca4406d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:34216/0 (socket says 172.21.15.93:34216) 2023-11-17T06:29:34.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca48c6f700 1 -- 172.21.15.93:0/3833965520 learned_addr learned my addr 172.21.15.93:0/3833965520 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-17T06:29:34.698 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca49c71700 1 --2- 172.21.15.93:0/3833965520 >> v2:172.21.15.69:3300/0 conn(0x7fca4406b3b0 0x7fca4406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955855235 0 0) 0x7fca440cbb40 con 0x7fca44065f40 2023-11-17T06:29:34.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca300035d0 con 0x7fca44065f40 2023-11-17T06:29:34.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234744685 0 0) 0x7fca440ca720 con 0x7fca4415a0e0 2023-11-17T06:29:34.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca440cbb40 con 0x7fca4415a0e0 2023-11-17T06:29:34.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 649636990 0 0) 0x7fca300035d0 con 0x7fca44065f40 2023-11-17T06:29:34.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 >> v2:172.21.15.69:3300/0 conn(0x7fca4406b3b0 msgr2=0x7fca4406b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:34.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 --2- 172.21.15.93:0/3833965520 >> v2:172.21.15.69:3300/0 conn(0x7fca4406b3b0 0x7fca4406b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 >> v1:172.21.15.69:6789/0 conn(0x7fca4415a0e0 legacy=0x7fca440cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.700 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4406d7f0 con 0x7fca44065f40 2023-11-17T06:29:34.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7fca34001670 con 0x7fca44065f40 2023-11-17T06:29:34.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 >> v1:172.21.15.93:6789/0 conn(0x7fca44065f40 legacy=0x7fca4406d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca30003bb0 0x7fca30003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca30004870 0x7fca30004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca30005230 0x7fca3000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4406dd30 con 0x7fca30005230 2023-11-17T06:29:34.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3000e2c0 con 0x7fca30004870 2023-11-17T06:29:34.701 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.695+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3000e480 con 0x7fca30003bb0 2023-11-17T06:29:34.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca49470700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca30003bb0 0x7fca30003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca48c6f700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca30004870 0x7fca30004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca49c71700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca30005230 0x7fca3000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca49470700 1 -- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca30004870 msgr2=0x7fca30004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:34.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca49470700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca30004870 0x7fca30004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca49470700 1 -- 172.21.15.93:0/3833965520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca30005230 msgr2=0x7fca3000dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:34.703 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca49470700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca30005230 0x7fca3000dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca49470700 1 -- 172.21.15.93:0/3833965520 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca300035d0 con 0x7fca30003bb0 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca49c71700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca30005230 0x7fca3000dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca48c6f700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca30004870 0x7fca30004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca49c71700 1 -- 172.21.15.93:0/3833965520 reap_dead start 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca49470700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca30003bb0 0x7fca30003fb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fca40001960 tx=0x7fca300058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3baf7db98e1104a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40001450 con 0x7fca30003bb0 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca40006aa0 con 0x7fca30003bb0 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca3bfff700 1 -- 172.21.15.93:0/3833965520 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca40006e50 con 0x7fca30003bb0 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca4b6d4700 1 -- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca30003bb0 msgr2=0x7fca30003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca4b6d4700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca30003bb0 0x7fca30003fb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fca40001960 tx=0x7fca300058a0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca4b6d4700 1 -- 172.21.15.93:0/3833965520 shutdown_connections 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca4b6d4700 1 --2- 172.21.15.93:0/3833965520 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca30003bb0 0x7fca30003fb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca4b6d4700 1 -- 172.21.15.93:0/3833965520 >> 172.21.15.93:0/3833965520 conn(0x7fca440cc0d0 msgr2=0x7fca440cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:34.704 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca4b6d4700 1 -- 172.21.15.93:0/3833965520 shutdown_connections 2023-11-17T06:29:34.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.699+0000 7fca4b6d4700 1 -- 172.21.15.93:0/3833965520 wait complete. 2023-11-17T06:29:34.705 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.703+0000 7fca4b6d4700 1 Processor -- start 2023-11-17T06:29:34.706 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.703+0000 7fca4b6d4700 1 -- start start 2023-11-17T06:29:34.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca4b6d4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca30003bb0 0x7fca440b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.707 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca4b6d4700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca441523a0 0x7fca44151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca4b6d4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca440c6720 0x7fca440c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca4b6d4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440b38f0 con 0x7fca30003bb0 2023-11-17T06:29:34.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca4b6d4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca440b31a0 con 0x7fca440c6720 2023-11-17T06:29:34.708 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca4b6d4700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440b3b40 con 0x7fca441523a0 2023-11-17T06:29:34.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca48c6f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca441523a0 0x7fca44151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca49c71700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca440c6720 0x7fca440c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca48c6f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca441523a0 0x7fca44151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:51220/0 (socket says 172.21.15.93:51220) 2023-11-17T06:29:34.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca48c6f700 1 -- 172.21.15.93:0/4202591664 learned_addr learned my addr 172.21.15.93:0/4202591664 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:29:34.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca49470700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca30003bb0 0x7fca440b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca48c6f700 1 -- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca440c6720 msgr2=0x7fca440c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca48c6f700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca440c6720 0x7fca440c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.709 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca48c6f700 1 -- 172.21.15.93:0/4202591664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca30003bb0 msgr2=0x7fca440b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca48c6f700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca30003bb0 0x7fca440b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca48c6f700 1 -- 172.21.15.93:0/4202591664 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440b3e20 con 0x7fca441523a0 2023-11-17T06:29:34.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca48c6f700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca441523a0 0x7fca44151b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fca340072c0 tx=0x7fca340075d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:34.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca39ffb700 1 -- 172.21.15.93:0/4202591664 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400f680 con 0x7fca441523a0 2023-11-17T06:29:34.710 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca39ffb700 1 -- 172.21.15.93:0/4202591664 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400f7e0 con 0x7fca441523a0 2023-11-17T06:29:34.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca4b6d4700 1 -- 172.21.15.93:0/4202591664 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca440b4100 con 0x7fca441523a0 2023-11-17T06:29:34.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca39ffb700 1 -- 172.21.15.93:0/4202591664 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400fb90 con 0x7fca441523a0 2023-11-17T06:29:34.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.707+0000 7fca4b6d4700 1 -- 172.21.15.93:0/4202591664 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca44152050 con 0x7fca441523a0 2023-11-17T06:29:34.711 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.711+0000 7fca4b6d4700 1 -- 172.21.15.93:0/4202591664 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca441521e0 con 0x7fca441523a0 2023-11-17T06:29:34.713 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.711+0000 7fca39ffb700 1 -- 172.21.15.93:0/4202591664 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7fca3400fcf0 con 0x7fca441523a0 2023-11-17T06:29:34.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.711+0000 7fca39ffb700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fca28066480 0x7fca28068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:34.715 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.711+0000 7fca39ffb700 1 -- 172.21.15.93:0/4202591664 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fca34082b20 con 0x7fca441523a0 2023-11-17T06:29:34.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.715+0000 7fca49470700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fca28066480 0x7fca28068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:34.716 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.715+0000 7fca49470700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fca28066480 0x7fca28068940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca40005040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:34.720 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.719+0000 7fca39ffb700 1 -- 172.21.15.93:0/4202591664 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca441521e0 con 0x7fca441523a0 2023-11-17T06:29:34.904 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.903+0000 7fca4b6d4700 1 -- 172.21.15.93:0/4202591664 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ceda42ec-0314-43a7-83ed-6bb66a09e638", "id": 6} v 0) v1 -- 0x7fca441521e0 con 0x7fca441523a0 2023-11-17T06:29:34.915 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.915+0000 7fca39ffb700 1 -- 172.21.15.93:0/4202591664 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ceda42ec-0314-43a7-83ed-6bb66a09e638", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fca441521e0 con 0x7fca441523a0 2023-11-17T06:29:34.916 INFO:teuthology.orchestra.run.smithi093.stdout:6 2023-11-17T06:29:34.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 -- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fca28066480 msgr2=0x7fca28068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fca28066480 0x7fca28068940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fca40000c00 tx=0x7fca40005040 comp rx=0 tx=0).stop 2023-11-17T06:29:34.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 -- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca441523a0 msgr2=0x7fca44151b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:34.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca441523a0 0x7fca44151b10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fca340072c0 tx=0x7fca340075d0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 -- 172.21.15.93:0/4202591664 shutdown_connections 2023-11-17T06:29:34.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fca28066480 0x7fca28068940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca440c6720 0x7fca440c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.920 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca441523a0 0x7fca44151b10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 --2- 172.21.15.93:0/4202591664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca30003bb0 0x7fca440b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:34.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 -- 172.21.15.93:0/4202591664 >> 172.21.15.93:0/4202591664 conn(0x7fca440cc0d0 msgr2=0x7fca44070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:34.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 -- 172.21.15.93:0/4202591664 shutdown_connections 2023-11-17T06:29:34.921 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:34.919+0000 7fca4b6d4700 1 -- 172.21.15.93:0/4202591664 wait complete. 2023-11-17T06:29:34.939 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd new 9102eb3c-e110-4cc2-b5b5-e1c53433d972 7 2023-11-17T06:29:35.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a6d01700 1 Processor -- start 2023-11-17T06:29:35.108 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a6d01700 1 -- start start 2023-11-17T06:29:35.109 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a6d01700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe0a015d980 0x7fe0a00d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a6d01700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a01621b0 con 0x7fe0a015d5a0 2023-11-17T06:29:35.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a6d01700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a0161630 con 0x7fe0a00d0230 2023-11-17T06:29:35.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a6d01700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a0161910 con 0x7fe0a015d980 2023-11-17T06:29:35.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a54fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe0a015d980 0x7fe0a00d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a5cff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe0a015d5a0 0x7fe0a00cfb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.93:55612/0 (socket says 172.21.15.93:55612) 2023-11-17T06:29:35.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a54fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe0a015d980 0x7fe0a00d1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52628/0 (socket says 172.21.15.93:52628) 2023-11-17T06:29:35.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a5cff700 1 -- 172.21.15.93:0/365983701 learned_addr learned my addr 172.21.15.93:0/365983701 (peer_addr_for_me v1:172.21.15.93:0/0) 2023-11-17T06:29:35.110 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a6500700 1 --1- 172.21.15.93:0/365983701 >> v1:172.21.15.93:6789/0 conn(0x7fe0a00d0230 0x7fe0a00d1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:34232/0 (socket says 172.21.15.93:34232) 2023-11-17T06:29:35.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a54fe700 1 -- 172.21.15.93:0/365983701 >> v1:172.21.15.93:6789/0 conn(0x7fe0a00d0230 legacy=0x7fe0a00d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a54fe700 1 -- 172.21.15.93:0/365983701 >> v1:172.21.15.69:6789/0 conn(0x7fe0a015d5a0 legacy=0x7fe0a00cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a54fe700 1 -- 172.21.15.93:0/365983701 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0161bf0 con 0x7fe0a015d980 2023-11-17T06:29:35.111 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.107+0000 7fe0a54fe700 1 --2- 172.21.15.93:0/365983701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a015d980 0x7fe0a00d1930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe090009850 tx=0x7fe090009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37d0fac712bd0f13 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.111+0000 7fe0a4cfd700 1 -- 172.21.15.93:0/365983701 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090011830 con 0x7fe0a015d980 2023-11-17T06:29:35.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.111+0000 7fe0a4cfd700 1 -- 172.21.15.93:0/365983701 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090011990 con 0x7fe0a015d980 2023-11-17T06:29:35.112 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.111+0000 7fe0a4cfd700 1 -- 172.21.15.93:0/365983701 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090011d20 con 0x7fe0a015d980 2023-11-17T06:29:35.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.111+0000 7fe0a6d01700 1 -- 172.21.15.93:0/365983701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a015d980 msgr2=0x7fe0a00d1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.111+0000 7fe0a6d01700 1 --2- 172.21.15.93:0/365983701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a015d980 0x7fe0a00d1930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe090009850 tx=0x7fe090009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:35.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.111+0000 7fe0a6d01700 1 -- 172.21.15.93:0/365983701 shutdown_connections 2023-11-17T06:29:35.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.111+0000 7fe0a6d01700 1 --2- 172.21.15.93:0/365983701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a015d980 0x7fe0a00d1930 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.111+0000 7fe0a6d01700 1 -- 172.21.15.93:0/365983701 >> 172.21.15.93:0/365983701 conn(0x7fe0a006aca0 msgr2=0x7fe0a006b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:35.113 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.111+0000 7fe0a6d01700 1 -- 172.21.15.93:0/365983701 shutdown_connections 2023-11-17T06:29:35.114 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.111+0000 7fe0a6d01700 1 -- 172.21.15.93:0/365983701 wait complete. 2023-11-17T06:29:35.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6d01700 1 Processor -- start 2023-11-17T06:29:35.115 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6d01700 1 -- start start 2023-11-17T06:29:35.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6d01700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00d0230 0x7fe0a00b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6d01700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a015d5a0 0x7fe0a014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6d01700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a014f9e0 0x7fe0a00cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6d01700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00c6c40 con 0x7fe0a015d5a0 2023-11-17T06:29:35.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6d01700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a014f640 con 0x7fe0a00d0230 2023-11-17T06:29:35.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6d01700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00b7780 con 0x7fe0a014f9e0 2023-11-17T06:29:35.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6500700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a014f9e0 0x7fe0a00cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a5cff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00d0230 0x7fe0a00b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6500700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a014f9e0 0x7fe0a00cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.93:51228/0 (socket says 172.21.15.93:51228) 2023-11-17T06:29:35.117 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a5cff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00d0230 0x7fe0a00b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:52642/0 (socket says 172.21.15.93:52642) 2023-11-17T06:29:35.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6500700 1 -- 172.21.15.93:0/2100573753 learned_addr learned my addr 172.21.15.93:0/2100573753 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-11-17T06:29:35.118 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a54fe700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a015d5a0 0x7fe0a014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6500700 1 -- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00d0230 msgr2=0x7fe0a00b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6500700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00d0230 0x7fe0a00b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6500700 1 -- 172.21.15.93:0/2100573753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a015d5a0 msgr2=0x7fe0a014f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6500700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a015d5a0 0x7fe0a014f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6500700 1 -- 172.21.15.93:0/2100573753 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900094b0 con 0x7fe0a014f9e0 2023-11-17T06:29:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6500700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a014f9e0 0x7fe0a00cc3b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe09800cbd0 tx=0x7fe09800cee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0967fc700 1 -- 172.21.15.93:0/2100573753 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09800aaa0 con 0x7fe0a014f9e0 2023-11-17T06:29:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0967fc700 1 -- 172.21.15.93:0/2100573753 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09800ac00 con 0x7fe0a014f9e0 2023-11-17T06:29:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6d01700 1 -- 172.21.15.93:0/2100573753 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a00c6e90 con 0x7fe0a014f9e0 2023-11-17T06:29:35.119 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0967fc700 1 -- 172.21.15.93:0/2100573753 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098007070 con 0x7fe0a014f9e0 2023-11-17T06:29:35.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.115+0000 7fe0a6d01700 1 -- 172.21.15.93:0/2100573753 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a00c7450 con 0x7fe0a014f9e0 2023-11-17T06:29:35.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.119+0000 7fe0a6d01700 1 -- 172.21.15.93:0/2100573753 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a00c7640 con 0x7fe0a014f9e0 2023-11-17T06:29:35.120 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.119+0000 7fe0967fc700 1 -- 172.21.15.93:0/2100573753 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7fe0980071d0 con 0x7fe0a014f9e0 2023-11-17T06:29:35.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.119+0000 7fe0967fc700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066480 0x7fe084068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.119+0000 7fe0967fc700 1 -- 172.21.15.93:0/2100573753 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fe0980829c0 con 0x7fe0a014f9e0 2023-11-17T06:29:35.121 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.119+0000 7fe0a5cff700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066480 0x7fe084068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.122 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.119+0000 7fe0a5cff700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066480 0x7fe084068940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe09c005930 tx=0x7fe09c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.125 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.123+0000 7fe0967fc700 1 -- 172.21.15.93:0/2100573753 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe098050f80 con 0x7fe0a014f9e0 2023-11-17T06:29:35.317 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.315+0000 7fe0a6d01700 1 -- 172.21.15.93:0/2100573753 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9102eb3c-e110-4cc2-b5b5-e1c53433d972", "id": 7} v 0) v1 -- 0x7fe0a00686a0 con 0x7fe0a014f9e0 2023-11-17T06:29:35.328 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.327+0000 7fe0967fc700 1 -- 172.21.15.93:0/2100573753 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9102eb3c-e110-4cc2-b5b5-e1c53433d972", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe098017030 con 0x7fe0a014f9e0 2023-11-17T06:29:35.328 INFO:teuthology.orchestra.run.smithi093.stdout:7 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.327+0000 7fe0a6d01700 1 -- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066480 msgr2=0x7fe084068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.327+0000 7fe0a6d01700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066480 0x7fe084068940 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe09c005930 tx=0x7fe09c009040 comp rx=0 tx=0).stop 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.327+0000 7fe0a6d01700 1 -- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a014f9e0 msgr2=0x7fe0a00cc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.327+0000 7fe0a6d01700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a014f9e0 0x7fe0a00cc3b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe09800cbd0 tx=0x7fe09800cee0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.331+0000 7fe0a6d01700 1 -- 172.21.15.93:0/2100573753 shutdown_connections 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.331+0000 7fe0a6d01700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066480 0x7fe084068940 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.331+0000 7fe0a6d01700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a014f9e0 0x7fe0a00cc3b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.331+0000 7fe0a6d01700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a015d5a0 0x7fe0a014f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.331+0000 7fe0a6d01700 1 --2- 172.21.15.93:0/2100573753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00d0230 0x7fe0a00b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.331+0000 7fe0a6d01700 1 -- 172.21.15.93:0/2100573753 >> 172.21.15.93:0/2100573753 conn(0x7fe0a006aca0 msgr2=0x7fe0a015ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.331+0000 7fe0a6d01700 1 -- 172.21.15.93:0/2100573753 shutdown_connections 2023-11-17T06:29:35.332 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:29:35.331+0000 7fe0a6d01700 1 -- 172.21.15.93:0/2100573753 wait complete. 2023-11-17T06:29:35.356 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-17T06:29:35.356 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-17T06:29:35.361 INFO:tasks.ceph.osd.0:Started 2023-11-17T06:29:35.361 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-17T06:29:35.361 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-17T06:29:35.365 INFO:tasks.ceph.osd.1:Started 2023-11-17T06:29:35.365 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-17T06:29:35.365 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-17T06:29:35.369 INFO:tasks.ceph.osd.2:Started 2023-11-17T06:29:35.369 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-17T06:29:35.370 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-17T06:29:35.374 INFO:tasks.ceph.osd.3:Started 2023-11-17T06:29:35.374 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-17T06:29:35.374 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-17T06:29:35.381 INFO:tasks.ceph.osd.4:Started 2023-11-17T06:29:35.381 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-17T06:29:35.381 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-17T06:29:35.385 INFO:tasks.ceph.osd.5:Started 2023-11-17T06:29:35.386 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-17T06:29:35.386 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-17T06:29:35.390 INFO:tasks.ceph.osd.6:Started 2023-11-17T06:29:35.390 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-17T06:29:35.390 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-17T06:29:35.394 INFO:tasks.ceph.osd.7:Started 2023-11-17T06:29:35.395 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:35.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19f4a83700 1 Processor -- start 2023-11-17T06:29:35.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19f4a83700 1 -- start start 2023-11-17T06:29:35.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19f4a83700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f19f015d490 0x7f19f00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19f4a83700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00ce4e0 0x7f19f00b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19f4a83700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f00d1bb0 con 0x7f19f00d13d0 2023-11-17T06:29:35.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19f4a83700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f00d1e90 con 0x7f19f015d490 2023-11-17T06:29:35.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19f4a83700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00d2170 con 0x7f19f00ce4e0 2023-11-17T06:29:35.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19eeffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f19f00d13d0 0x7f19f00cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53556/0 (socket says 172.21.15.69:53556) 2023-11-17T06:29:35.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19eeffd700 1 -- 172.21.15.69:0/645652909 learned_addr learned my addr 172.21.15.69:0/645652909 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:29:35.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19ef7fe700 1 --2- 172.21.15.69:0/645652909 >> v2:172.21.15.93:3300/0 conn(0x7f19f015d490 0x7f19f00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.573+0000 7f19effff700 1 --2- 172.21.15.69:0/645652909 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00ce4e0 0x7f19f00b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19ee7fc700 1 -- 172.21.15.69:0/645652909 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477385199 0 0) 0x7f19f00d1bb0 con 0x7f19f00d13d0 2023-11-17T06:29:35.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19ee7fc700 1 -- 172.21.15.69:0/645652909 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d80035d0 con 0x7f19f00d13d0 2023-11-17T06:29:35.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19ef7fe700 1 -- 172.21.15.69:0/645652909 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00ce4e0 msgr2=0x7f19f00b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:35.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19ef7fe700 1 --2- 172.21.15.69:0/645652909 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00ce4e0 0x7f19f00b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19ef7fe700 1 -- 172.21.15.69:0/645652909 >> v1:172.21.15.69:6789/0 conn(0x7f19f00d13d0 legacy=0x7f19f00cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19ef7fe700 1 -- 172.21.15.69:0/645652909 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f00d2450 con 0x7f19f015d490 2023-11-17T06:29:35.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19ef7fe700 1 --2- 172.21.15.69:0/645652909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f015d490 0x7f19f00b8bc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009850 tx=0x7f19e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1db3297bc404d1f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19ee7fc700 1 -- 172.21.15.69:0/645652909 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0011830 con 0x7f19f015d490 2023-11-17T06:29:35.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19ee7fc700 1 -- 172.21.15.69:0/645652909 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e0011990 con 0x7f19f015d490 2023-11-17T06:29:35.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19ee7fc700 1 -- 172.21.15.69:0/645652909 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0011d40 con 0x7f19f015d490 2023-11-17T06:29:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19f4a83700 1 -- 172.21.15.69:0/645652909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f015d490 msgr2=0x7f19f00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19f4a83700 1 --2- 172.21.15.69:0/645652909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f015d490 0x7f19f00b8bc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009850 tx=0x7f19e0009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19f4a83700 1 -- 172.21.15.69:0/645652909 shutdown_connections 2023-11-17T06:29:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19f4a83700 1 --2- 172.21.15.69:0/645652909 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00ce4e0 0x7f19f00b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19f4a83700 1 --2- 172.21.15.69:0/645652909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f015d490 0x7f19f00b8bc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19f4a83700 1 -- 172.21.15.69:0/645652909 >> 172.21.15.69:0/645652909 conn(0x7f19f006ab40 msgr2=0x7f19f006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19f4a83700 1 -- 172.21.15.69:0/645652909 shutdown_connections 2023-11-17T06:29:35.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.577+0000 7f19f4a83700 1 -- 172.21.15.69:0/645652909 wait complete. 2023-11-17T06:29:35.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19f4a83700 1 Processor -- start 2023-11-17T06:29:35.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19f4a83700 1 -- start start 2023-11-17T06:29:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19f4a83700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f00ce4e0 0x7f19f00c5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19f4a83700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f00d13d0 0x7f19f015f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19f4a83700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f015d490 0x7f19f01523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19f4a83700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f015d870 con 0x7f19f00ce4e0 2023-11-17T06:29:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19f4a83700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f015da80 con 0x7f19f00d13d0 2023-11-17T06:29:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19f4a83700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f015dd60 con 0x7f19f015d490 2023-11-17T06:29:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19ef7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f00ce4e0 0x7f19f00c5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19ef7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f00ce4e0 0x7f19f00c5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46982/0 (socket says 172.21.15.69:46982) 2023-11-17T06:29:35.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19ef7fe700 1 -- 172.21.15.69:0/138060668 learned_addr learned my addr 172.21.15.69:0/138060668 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:35.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19eeffd700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f00d13d0 0x7f19f015f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19effff700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f015d490 0x7f19f01523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19ef7fe700 1 -- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f015d490 msgr2=0x7f19f01523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19ef7fe700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f015d490 0x7f19f01523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19ef7fe700 1 -- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f00d13d0 msgr2=0x7f19f015f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19ef7fe700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f00d13d0 0x7f19f015f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19ef7fe700 1 -- 172.21.15.69:0/138060668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e00094b0 con 0x7f19f00ce4e0 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19effff700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f015d490 0x7f19f01523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.581+0000 7f19ef7fe700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f00ce4e0 0x7f19f00c5be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f19e0014040 tx=0x7f19e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.585+0000 7f19d7fff700 1 -- 172.21.15.69:0/138060668 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00036c0 con 0x7f19f00ce4e0 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.585+0000 7f19d7fff700 1 -- 172.21.15.69:0/138060668 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e001e070 con 0x7f19f00ce4e0 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.585+0000 7f19d7fff700 1 -- 172.21.15.69:0/138060668 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0003a80 con 0x7f19f00ce4e0 2023-11-17T06:29:35.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.585+0000 7f19f4a83700 1 -- 172.21.15.69:0/138060668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f015e040 con 0x7f19f00ce4e0 2023-11-17T06:29:35.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.585+0000 7f19f4a83700 1 -- 172.21.15.69:0/138060668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f015e600 con 0x7f19f00ce4e0 2023-11-17T06:29:35.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.585+0000 7f19f4a83700 1 -- 172.21.15.69:0/138060668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f0073f00 con 0x7f19f00ce4e0 2023-11-17T06:29:35.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.585+0000 7f19d7fff700 1 -- 172.21.15.69:0/138060668 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7f19e0003be0 con 0x7f19f00ce4e0 2023-11-17T06:29:35.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.589+0000 7f19d7fff700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19dc066480 0x7f19dc068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:35.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.589+0000 7f19d7fff700 1 -- 172.21.15.69:0/138060668 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f19e0020070 con 0x7f19f00ce4e0 2023-11-17T06:29:35.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.589+0000 7f19eeffd700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19dc066480 0x7f19dc068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:35.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.589+0000 7f19eeffd700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19dc066480 0x7f19dc068940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f19f0160a00 tx=0x7f19e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:35.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.597+0000 7f19d7fff700 1 -- 172.21.15.69:0/138060668 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f19e00527f0 con 0x7f19f00ce4e0 2023-11-17T06:29:35.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.769+0000 7f19f4a83700 1 -- 172.21.15.69:0/138060668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19f0150b10 con 0x7f19f00ce4e0 2023-11-17T06:29:35.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.769+0000 7f19d7fff700 1 -- 172.21.15.69:0/138060668 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f19e002a090 con 0x7f19f00ce4e0 2023-11-17T06:29:35.774 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:29:35.774 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":10,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:35.317698+0000","last_up_change":"0.000000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:35.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 -- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19dc066480 msgr2=0x7f19dc068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19dc066480 0x7f19dc068940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f19f0160a00 tx=0x7f19e4009040 comp rx=0 tx=0).stop 2023-11-17T06:29:35.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 -- 172.21.15.69:0/138060668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f00ce4e0 msgr2=0x7f19f00c5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:35.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f00ce4e0 0x7f19f00c5be0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f19e0014040 tx=0x7f19e0004770 comp rx=0 tx=0).stop 2023-11-17T06:29:35.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 -- 172.21.15.69:0/138060668 shutdown_connections 2023-11-17T06:29:35.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19dc066480 0x7f19dc068940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f015d490 0x7f19f01523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f00d13d0 0x7f19f015f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 --2- 172.21.15.69:0/138060668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f00ce4e0 0x7f19f00c5be0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:35.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 -- 172.21.15.69:0/138060668 >> 172.21.15.69:0/138060668 conn(0x7f19f006ab40 msgr2=0x7f19f015c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:35.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 -- 172.21.15.69:0/138060668 shutdown_connections 2023-11-17T06:29:35.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:35.773+0000 7f19f4a83700 1 -- 172.21.15.69:0/138060668 wait complete. 2023-11-17T06:29:35.801 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-17T06:29:35.802 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-17T06:29:36.038 INFO:tasks.ceph.osd.5.smithi093.stderr:2023-11-17T06:29:36.035+0000 7f81fbf34700 -1 Falling back to public interface 2023-11-17T06:29:36.042 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-11-17T06:29:36.037+0000 7fbd58618700 -1 Falling back to public interface 2023-11-17T06:29:36.045 INFO:tasks.ceph.osd.7.smithi093.stderr:2023-11-17T06:29:36.043+0000 7f60de51e700 -1 Falling back to public interface 2023-11-17T06:29:36.045 INFO:tasks.ceph.osd.4.smithi093.stderr:2023-11-17T06:29:36.043+0000 7f23e993c700 -1 Falling back to public interface 2023-11-17T06:29:36.054 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-11-17T06:29:36.049+0000 7f0fb7707700 -1 Falling back to public interface 2023-11-17T06:29:36.054 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-11-17T06:29:36.049+0000 7f3f40a39700 -1 Falling back to public interface 2023-11-17T06:29:36.057 INFO:tasks.ceph.osd.6.smithi093.stderr:2023-11-17T06:29:36.055+0000 7f5bc54ba700 -1 Falling back to public interface 2023-11-17T06:29:36.068 INFO:tasks.ceph.osd.3.smithi069.stderr:2023-11-17T06:29:36.065+0000 7f67670e0700 -1 Falling back to public interface 2023-11-17T06:29:36.608 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:36.789 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.785+0000 7f6feeea8700 1 Processor -- start 2023-11-17T06:29:36.789 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.785+0000 7f6feeea8700 1 -- start start 2023-11-17T06:29:36.790 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.785+0000 7f6feeea8700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6fe80cb020 0x7f6fe815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.791 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.785+0000 7f6feeea8700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe80b09e0 con 0x7f6fe80cba80 2023-11-17T06:29:36.791 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.785+0000 7f6feeea8700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fe80b0cc0 con 0x7f6fe80cb400 2023-11-17T06:29:36.791 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.785+0000 7f6feeea8700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe815fd90 con 0x7f6fe80cb020 2023-11-17T06:29:36.791 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fed445700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6fe80cba80 0x7f6fe81519a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53564/0 (socket says 172.21.15.69:53564) 2023-11-17T06:29:36.792 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fed445700 1 -- 172.21.15.69:0/1059780526 learned_addr learned my addr 172.21.15.69:0/1059780526 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:29:36.792 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fecc44700 1 --2- 172.21.15.69:0/1059780526 >> v2:172.21.15.93:3300/0 conn(0x7f6fe80cb020 0x7f6fe815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.792 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fe77fe700 1 -- 172.21.15.69:0/1059780526 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581666304 0 0) 0x7f6fe80b09e0 con 0x7f6fe80cba80 2023-11-17T06:29:36.793 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fe77fe700 1 -- 172.21.15.69:0/1059780526 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd80035d0 con 0x7f6fe80cba80 2023-11-17T06:29:36.793 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fe77fe700 1 -- 172.21.15.69:0/1059780526 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911468793 0 0) 0x7f6fe80b0cc0 con 0x7f6fe80cb400 2023-11-17T06:29:36.793 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fe77fe700 1 -- 172.21.15.69:0/1059780526 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fe80b09e0 con 0x7f6fe80cb400 2023-11-17T06:29:36.793 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fecc44700 1 -- 172.21.15.69:0/1059780526 >> v1:172.21.15.93:6789/0 conn(0x7f6fe80cb400 legacy=0x7f6fe806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.793 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fecc44700 1 -- 172.21.15.69:0/1059780526 >> v1:172.21.15.69:6789/0 conn(0x7f6fe80cba80 legacy=0x7f6fe81519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.793 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fecc44700 1 -- 172.21.15.69:0/1059780526 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe80b0fa0 con 0x7f6fe80cb020 2023-11-17T06:29:36.794 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fecc44700 1 --2- 172.21.15.69:0/1059780526 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 0x7f6fe815ed80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009850 tx=0x7f6fdc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94e1dd601d948202 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:36.794 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fe77fe700 1 -- 172.21.15.69:0/1059780526 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc011830 con 0x7f6fe80cb020 2023-11-17T06:29:36.794 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fe77fe700 1 -- 172.21.15.69:0/1059780526 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc011990 con 0x7f6fe80cb020 2023-11-17T06:29:36.794 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.789+0000 7f6fe77fe700 1 -- 172.21.15.69:0/1059780526 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc011d40 con 0x7f6fe80cb020 2023-11-17T06:29:36.795 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.793+0000 7f6feeea8700 1 -- 172.21.15.69:0/1059780526 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 msgr2=0x7f6fe815ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.795 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.793+0000 7f6feeea8700 1 --2- 172.21.15.69:0/1059780526 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 0x7f6fe815ed80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009850 tx=0x7f6fdc009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:36.795 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.793+0000 7f6feeea8700 1 -- 172.21.15.69:0/1059780526 shutdown_connections 2023-11-17T06:29:36.795 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.793+0000 7f6feeea8700 1 --2- 172.21.15.69:0/1059780526 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 0x7f6fe815ed80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.796 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.793+0000 7f6feeea8700 1 -- 172.21.15.69:0/1059780526 >> 172.21.15.69:0/1059780526 conn(0x7f6fe806a480 msgr2=0x7f6fe806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:36.796 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.793+0000 7f6feeea8700 1 -- 172.21.15.69:0/1059780526 shutdown_connections 2023-11-17T06:29:36.796 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.793+0000 7f6feeea8700 1 -- 172.21.15.69:0/1059780526 wait complete. 2023-11-17T06:29:36.799 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6feeea8700 1 Processor -- start 2023-11-17T06:29:36.799 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6feeea8700 1 -- start start 2023-11-17T06:29:36.802 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6feeea8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 0x7f6fe80c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.802 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6feeea8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fe80cb400 0x7f6fe815a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.802 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6feeea8700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fe80cba80 0x7f6fe815c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.802 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6feeea8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80b1660 con 0x7f6fe80cb400 2023-11-17T06:29:36.802 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6feeea8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe8156e20 con 0x7f6fe80cb020 2023-11-17T06:29:36.802 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6feeea8700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe80c6de0 con 0x7f6fe80cba80 2023-11-17T06:29:36.803 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6fecc44700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 0x7f6fe80c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.803 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6fecc44700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 0x7f6fe80c68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:58140/0 (socket says 172.21.15.69:58140) 2023-11-17T06:29:36.803 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6fed445700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fe80cba80 0x7f6fe815c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.803 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6fecc44700 1 -- 172.21.15.69:0/1105985296 learned_addr learned my addr 172.21.15.69:0/1105985296 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:36.803 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.797+0000 7f6fe7fff700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fe80cb400 0x7f6fe815a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.804 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6fecc44700 1 -- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fe80cba80 msgr2=0x7f6fe815c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.804 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6fecc44700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fe80cba80 0x7f6fe815c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.804 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6fecc44700 1 -- 172.21.15.69:0/1105985296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fe80cb400 msgr2=0x7f6fe815a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:36.804 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6fecc44700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fe80cb400 0x7f6fe815a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:36.804 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6fecc44700 1 -- 172.21.15.69:0/1105985296 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0094b0 con 0x7f6fe80cb020 2023-11-17T06:29:36.805 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6fecc44700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 0x7f6fe80c68a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80cc790 tx=0x7f6fdc004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:36.805 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6fe57fa700 1 -- 172.21.15.69:0/1105985296 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc01a990 con 0x7f6fe80cb020 2023-11-17T06:29:36.805 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6fe57fa700 1 -- 172.21.15.69:0/1105985296 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc01f070 con 0x7f6fe80cb020 2023-11-17T06:29:36.806 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6feeea8700 1 -- 172.21.15.69:0/1105985296 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe8156b40 con 0x7f6fe80cb020 2023-11-17T06:29:36.806 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6fe57fa700 1 -- 172.21.15.69:0/1105985296 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc01ad30 con 0x7f6fe80cb020 2023-11-17T06:29:36.806 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.801+0000 7f6feeea8700 1 -- 172.21.15.69:0/1105985296 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe815b200 con 0x7f6fe80cb020 2023-11-17T06:29:36.807 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.805+0000 7f6feeea8700 1 -- 172.21.15.69:0/1105985296 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe8071fd0 con 0x7f6fe80cb020 2023-11-17T06:29:36.809 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.805+0000 7f6fe57fa700 1 -- 172.21.15.69:0/1105985296 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7f6fdc01b430 con 0x7f6fe80cb020 2023-11-17T06:29:36.810 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.805+0000 7f6fe57fa700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fcc0664d0 0x7f6fcc068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:36.810 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.805+0000 7f6fe57fa700 1 -- 172.21.15.69:0/1105985296 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6fdc0841c0 con 0x7f6fe80cb020 2023-11-17T06:29:36.811 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.809+0000 7f6fe7fff700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fcc0664d0 0x7f6fcc068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:36.812 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.809+0000 7f6fe7fff700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fcc0664d0 0x7f6fcc068990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80b4920 tx=0x7f6fd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:36.816 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.813+0000 7f6fe57fa700 1 -- 172.21.15.69:0/1105985296 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6fdc052770 con 0x7f6fe80cb020 2023-11-17T06:29:36.999 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.997+0000 7f6feeea8700 1 -- 172.21.15.69:0/1105985296 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fe8071fd0 con 0x7f6fe80cb020 2023-11-17T06:29:37.000 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:36.997+0000 7f6fe57fa700 1 -- 172.21.15.69:0/1105985296 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6fe8071fd0 con 0x7f6fe80cb020 2023-11-17T06:29:37.001 INFO:teuthology.misc.health.smithi069.stdout: 2023-11-17T06:29:37.001 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":10,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:35.317698+0000","last_up_change":"0.000000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 -- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fcc0664d0 msgr2=0x7f6fcc068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fcc0664d0 0x7f6fcc068990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80b4920 tx=0x7f6fd4009040 comp rx=0 tx=0).stop 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 -- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 msgr2=0x7f6fe80c68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 0x7f6fe80c68a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6fe80cc790 tx=0x7f6fdc004770 comp rx=0 tx=0).stop 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 -- 172.21.15.69:0/1105985296 shutdown_connections 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fcc0664d0 0x7f6fcc068990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fe80cba80 0x7f6fe815c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fe80cb400 0x7f6fe815a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 --2- 172.21.15.69:0/1105985296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fe80cb020 0x7f6fe80c68a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 -- 172.21.15.69:0/1105985296 >> 172.21.15.69:0/1105985296 conn(0x7f6fe806a480 msgr2=0x7f6fe80afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:37.004 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 -- 172.21.15.69:0/1105985296 shutdown_connections 2023-11-17T06:29:37.005 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:37.001+0000 7f6feeea8700 1 -- 172.21.15.69:0/1105985296 wait complete. 2023-11-17T06:29:37.021 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-17T06:29:39.941 INFO:tasks.ceph.osd.5.smithi093.stderr:2023-11-17T06:29:39.938+0000 7f81fbf34700 -1 osd.5 0 log_to_monitors true 2023-11-17T06:29:40.025 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-11-17T06:29:40.021+0000 7f3f40a39700 -1 osd.1 0 log_to_monitors true 2023-11-17T06:29:40.026 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-11-17T06:29:40.021+0000 7f0fb7707700 -1 osd.2 0 log_to_monitors true 2023-11-17T06:29:40.059 INFO:tasks.ceph.osd.4.smithi093.stderr:2023-11-17T06:29:40.058+0000 7f23e993c700 -1 osd.4 0 log_to_monitors true 2023-11-17T06:29:40.061 INFO:tasks.ceph.osd.7.smithi093.stderr:2023-11-17T06:29:40.058+0000 7f60de51e700 -1 osd.7 0 log_to_monitors true 2023-11-17T06:29:40.087 INFO:tasks.ceph.osd.3.smithi069.stderr:2023-11-17T06:29:40.085+0000 7f67670e0700 -1 osd.3 0 log_to_monitors true 2023-11-17T06:29:40.149 INFO:tasks.ceph.osd.6.smithi093.stderr:2023-11-17T06:29:40.146+0000 7f5bc54ba700 -1 osd.6 0 log_to_monitors true 2023-11-17T06:29:40.158 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-11-17T06:29:40.153+0000 7fbd58618700 -1 osd.0 0 log_to_monitors true 2023-11-17T06:29:42.703 INFO:tasks.ceph.osd.5.smithi093.stderr:2023-11-17T06:29:42.702+0000 7f81f7550700 -1 osd.5 0 waiting for initial osdmap 2023-11-17T06:29:42.735 INFO:tasks.ceph.osd.5.smithi093.stderr:2023-11-17T06:29:42.734+0000 7f81ef7f1700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:43.827 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:43.984 INFO:tasks.ceph.osd.4.smithi093.stderr:2023-11-17T06:29:43.982+0000 7f23e6903700 -1 osd.4 0 waiting for initial osdmap 2023-11-17T06:29:43.993 INFO:tasks.ceph.osd.4.smithi093.stderr:2023-11-17T06:29:43.990+0000 7f23dd1f1700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:43.994 INFO:tasks.ceph.osd.7.smithi093.stderr:2023-11-17T06:29:43.990+0000 7f60d9b3a700 -1 osd.7 0 waiting for initial osdmap 2023-11-17T06:29:44.002 INFO:tasks.ceph.osd.7.smithi093.stderr:2023-11-17T06:29:43.998+0000 7f60d1df1700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:44.025 INFO:tasks.ceph.osd.6.smithi093.stderr:2023-11-17T06:29:44.022+0000 7f5bc0ad6700 -1 osd.6 0 waiting for initial osdmap 2023-11-17T06:29:44.037 INFO:tasks.ceph.osd.6.smithi093.stderr:2023-11-17T06:29:44.034+0000 7f5bb8bf1700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:44.044 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f6450dc8700 1 Processor -- start 2023-11-17T06:29:44.045 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f6450dc8700 1 -- start start 2023-11-17T06:29:44.046 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f6450dc8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f644c1652b0 0x7f644c0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.046 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f6450dc8700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c165740 0x7f644c0cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.046 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f6450dc8700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644c06c200 con 0x7f644c0c21a0 2023-11-17T06:29:44.046 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f6450dc8700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644c1662c0 con 0x7f644c1652b0 2023-11-17T06:29:44.046 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f6450dc8700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c165d00 con 0x7f644c165740 2023-11-17T06:29:44.046 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f644bfff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c165740 0x7f644c0cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.046 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f644bfff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c165740 0x7f644c0cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:42952/0 (socket says 172.21.15.69:42952) 2023-11-17T06:29:44.046 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f644bfff700 1 -- 172.21.15.69:0/792562861 learned_addr learned my addr 172.21.15.69:0/792562861 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:44.047 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.041+0000 7f644affd700 1 --2- 172.21.15.69:0/792562861 >> v2:172.21.15.69:3300/0 conn(0x7f644c1652b0 0x7f644c0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.047 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f644bfff700 1 -- 172.21.15.69:0/792562861 >> v2:172.21.15.69:3300/0 conn(0x7f644c1652b0 msgr2=0x7f644c0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:44.047 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f644a7fc700 1 -- 172.21.15.69:0/792562861 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3951871690 0 0) 0x7f644c06c200 con 0x7f644c0c21a0 2023-11-17T06:29:44.047 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f644bfff700 1 --2- 172.21.15.69:0/792562861 >> v2:172.21.15.69:3300/0 conn(0x7f644c1652b0 0x7f644c0cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.048 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f644bfff700 1 -- 172.21.15.69:0/792562861 >> v1:172.21.15.69:6789/0 conn(0x7f644c0c21a0 legacy=0x7f644c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.048 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f644bfff700 1 -- 172.21.15.69:0/792562861 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c165fe0 con 0x7f644c165740 2023-11-17T06:29:44.048 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f644affd700 1 --2- 172.21.15.69:0/792562861 >> v2:172.21.15.69:3300/0 conn(0x7f644c1652b0 0x7f644c0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:44.048 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f644bfff700 1 --2- 172.21.15.69:0/792562861 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c165740 0x7f644c0cbd20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6440009e50 tx=0x7f644000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dcdee30fe6da2e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:44.050 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f644a7fc700 1 -- 172.21.15.69:0/792562861 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000e070 con 0x7f644c165740 2023-11-17T06:29:44.050 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f644a7fc700 1 -- 172.21.15.69:0/792562861 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644000b9c0 con 0x7f644c165740 2023-11-17T06:29:44.050 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f644a7fc700 1 -- 172.21.15.69:0/792562861 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644000bd50 con 0x7f644c165740 2023-11-17T06:29:44.050 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f6450dc8700 1 -- 172.21.15.69:0/792562861 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c165740 msgr2=0x7f644c0cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.050 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f6450dc8700 1 --2- 172.21.15.69:0/792562861 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c165740 0x7f644c0cbd20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6440009e50 tx=0x7f644000b330 comp rx=0 tx=0).stop 2023-11-17T06:29:44.051 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f6450dc8700 1 -- 172.21.15.69:0/792562861 shutdown_connections 2023-11-17T06:29:44.051 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f6450dc8700 1 --2- 172.21.15.69:0/792562861 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c165740 0x7f644c0cbd20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.051 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f6450dc8700 1 --2- 172.21.15.69:0/792562861 >> v2:172.21.15.69:3300/0 conn(0x7f644c1652b0 0x7f644c0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.051 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f6450dc8700 1 -- 172.21.15.69:0/792562861 >> 172.21.15.69:0/792562861 conn(0x7f644c0b0900 msgr2=0x7f644c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:44.051 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f6450dc8700 1 -- 172.21.15.69:0/792562861 shutdown_connections 2023-11-17T06:29:44.052 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.045+0000 7f6450dc8700 1 -- 172.21.15.69:0/792562861 wait complete. 2023-11-17T06:29:44.053 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.049+0000 7f6450dc8700 1 Processor -- start 2023-11-17T06:29:44.054 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.049+0000 7f6450dc8700 1 -- start start 2023-11-17T06:29:44.055 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f6450dc8700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c0c21a0 0x7f644c0b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.056 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f6450dc8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f644c1652b0 0x7f644c0c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.056 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f6450dc8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f644c165740 0x7f644c0c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.056 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f6450dc8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c0c33f0 con 0x7f644c165740 2023-11-17T06:29:44.056 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f6450dc8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f644c0c2a90 con 0x7f644c1652b0 2023-11-17T06:29:44.057 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f6450dc8700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644c0c8710 con 0x7f644c0c21a0 2023-11-17T06:29:44.057 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644b7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c0c21a0 0x7f644c0b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.057 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644b7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c0c21a0 0x7f644c0b2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:42958/0 (socket says 172.21.15.69:42958) 2023-11-17T06:29:44.057 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644b7fe700 1 -- 172.21.15.69:0/884957408 learned_addr learned my addr 172.21.15.69:0/884957408 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:44.057 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644affd700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f644c1652b0 0x7f644c0c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.057 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644bfff700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f644c165740 0x7f644c0c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.058 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644affd700 1 -- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c0c21a0 msgr2=0x7f644c0b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.058 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644affd700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c0c21a0 0x7f644c0b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.058 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644affd700 1 -- 172.21.15.69:0/884957408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f644c165740 msgr2=0x7f644c0c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.058 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644affd700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f644c165740 0x7f644c0c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.058 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644affd700 1 -- 172.21.15.69:0/884957408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6440009b30 con 0x7f644c1652b0 2023-11-17T06:29:44.058 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f644affd700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f644c1652b0 0x7f644c0c7de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f643c00c7f0 tx=0x7f643c00cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:44.059 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f6433fff700 1 -- 172.21.15.69:0/884957408 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c011800 con 0x7f644c1652b0 2023-11-17T06:29:44.059 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f6433fff700 1 -- 172.21.15.69:0/884957408 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c011960 con 0x7f644c1652b0 2023-11-17T06:29:44.059 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.053+0000 7f6433fff700 1 -- 172.21.15.69:0/884957408 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c011cd0 con 0x7f644c1652b0 2023-11-17T06:29:44.059 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.057+0000 7f6450dc8700 1 -- 172.21.15.69:0/884957408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644c0c2d30 con 0x7f644c1652b0 2023-11-17T06:29:44.059 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.057+0000 7f6450dc8700 1 -- 172.21.15.69:0/884957408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644c0c8320 con 0x7f644c1652b0 2023-11-17T06:29:44.061 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.057+0000 7f6450dc8700 1 -- 172.21.15.69:0/884957408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644c0c3530 con 0x7f644c1652b0 2023-11-17T06:29:44.062 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.057+0000 7f6433fff700 1 -- 172.21.15.69:0/884957408 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 85794+0+0 (secure 0 0 0) 0x7f643c022350 con 0x7f644c1652b0 2023-11-17T06:29:44.064 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.061+0000 7f6433fff700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6438066480 0x7f6438068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:44.064 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.061+0000 7f6433fff700 1 -- 172.21.15.69:0/884957408 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f643c082f40 con 0x7f644c1652b0 2023-11-17T06:29:44.068 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.061+0000 7f644b7fe700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6438066480 0x7f6438068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:44.069 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.061+0000 7f644b7fe700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6438066480 0x7f6438068940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6444001030 tx=0x7f6444009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:44.077 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.073+0000 7f6433fff700 1 -- 172.21.15.69:0/884957408 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f644c0c3530 con 0x7f644c1652b0 2023-11-17T06:29:44.291 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-11-17T06:29:44.289+0000 7f0fb46ce700 -1 osd.2 0 waiting for initial osdmap 2023-11-17T06:29:44.303 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-11-17T06:29:44.301+0000 7f0faaff1700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:44.371 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-11-17T06:29:44.369+0000 7fbd555df700 -1 osd.0 0 waiting for initial osdmap 2023-11-17T06:29:44.380 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-11-17T06:29:44.377+0000 7fbd4bdf1700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:44.390 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.385+0000 7f6450dc8700 1 -- 172.21.15.69:0/884957408 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f644c0c3530 con 0x7f644c1652b0 2023-11-17T06:29:44.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.389+0000 7f6433fff700 1 -- 172.21.15.69:0/884957408 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7542 (secure 0 0 0) 0x7f644c0c3530 con 0x7f644c1652b0 2023-11-17T06:29:44.392 INFO:teuthology.misc.health.smithi069.stdout: 2023-11-17T06:29:44.392 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":14,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:43.777738+0000","last_up_change":"2023-11-17T06:29:43.777738+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:44.395 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.389+0000 7f6450dc8700 1 -- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6438066480 msgr2=0x7f6438068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.395 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.389+0000 7f6450dc8700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6438066480 0x7f6438068940 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6444001030 tx=0x7f6444009040 comp rx=0 tx=0).stop 2023-11-17T06:29:44.395 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.389+0000 7f6450dc8700 1 -- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f644c1652b0 msgr2=0x7f644c0c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:44.395 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.389+0000 7f6450dc8700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f644c1652b0 0x7f644c0c7de0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f643c00c7f0 tx=0x7f643c00cb00 comp rx=0 tx=0).stop 2023-11-17T06:29:44.395 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.393+0000 7f6450dc8700 1 -- 172.21.15.69:0/884957408 shutdown_connections 2023-11-17T06:29:44.395 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.393+0000 7f6450dc8700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6438066480 0x7f6438068940 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.396 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.393+0000 7f6450dc8700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f644c165740 0x7f644c0c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.396 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.393+0000 7f6450dc8700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f644c1652b0 0x7f644c0c7de0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.396 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.393+0000 7f6450dc8700 1 --2- 172.21.15.69:0/884957408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f644c0c21a0 0x7f644c0b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:44.396 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.393+0000 7f6450dc8700 1 -- 172.21.15.69:0/884957408 >> 172.21.15.69:0/884957408 conn(0x7f644c0b0900 msgr2=0x7f644c0c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:44.396 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.393+0000 7f6450dc8700 1 -- 172.21.15.69:0/884957408 shutdown_connections 2023-11-17T06:29:44.396 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:44.393+0000 7f6450dc8700 1 -- 172.21.15.69:0/884957408 wait complete. 2023-11-17T06:29:44.418 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-11-17T06:29:44.520 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-11-17T06:29:44.517+0000 7f3f3c055700 -1 osd.1 0 waiting for initial osdmap 2023-11-17T06:29:44.521 INFO:tasks.ceph.osd.3.smithi069.stderr:2023-11-17T06:29:44.517+0000 7f67626fc700 -1 osd.3 0 waiting for initial osdmap 2023-11-17T06:29:44.529 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-11-17T06:29:44.525+0000 7f3f341f1700 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:44.531 INFO:tasks.ceph.osd.3.smithi069.stderr:2023-11-17T06:29:44.529+0000 7f675a7f1700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-17T06:29:51.223 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:51.379 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf42f9f700 1 Processor -- start 2023-11-17T06:29:51.380 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf42f9f700 1 -- start start 2023-11-17T06:29:51.381 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf42f9f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf3c0c9420 0x7fbf3c0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.381 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf42f9f700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbf3c0cba60 0x7fbf3c0ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.381 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf42f9f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf3c06c060 con 0x7fbf3c15d3e0 2023-11-17T06:29:51.381 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf42f9f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3c0cbef0 con 0x7fbf3c0c9420 2023-11-17T06:29:51.381 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf42f9f700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf3c06c340 con 0x7fbf3c0cba60 2023-11-17T06:29:51.382 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf4179c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf3c0c9420 0x7fbf3c0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.382 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf4179c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf3c0c9420 0x7fbf3c0cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50994/0 (socket says 172.21.15.69:50994) 2023-11-17T06:29:51.382 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf4179c700 1 -- 172.21.15.69:0/3268282134 learned_addr learned my addr 172.21.15.69:0/3268282134 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:51.382 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf4279e700 1 --2- 172.21.15.69:0/3268282134 >> v2:172.21.15.93:3300/0 conn(0x7fbf3c0cba60 0x7fbf3c0ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.383 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf4179c700 1 -- 172.21.15.69:0/3268282134 >> v2:172.21.15.93:3300/0 conn(0x7fbf3c0cba60 msgr2=0x7fbf3c0ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:51.383 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf4179c700 1 --2- 172.21.15.69:0/3268282134 >> v2:172.21.15.93:3300/0 conn(0x7fbf3c0cba60 0x7fbf3c0ad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.383 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf4179c700 1 -- 172.21.15.69:0/3268282134 >> v1:172.21.15.93:6789/0 conn(0x7fbf3c15d3e0 legacy=0x7fbf3c161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.383 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.376+0000 7fbf4179c700 1 -- 172.21.15.69:0/3268282134 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c06c620 con 0x7fbf3c0c9420 2023-11-17T06:29:51.383 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf4179c700 1 --2- 172.21.15.69:0/3268282134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 0x7fbf3c0cb520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0c5e30 tx=0x7fbf2c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5853f5d5ff12f30f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.384 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf40f9b700 1 -- 172.21.15.69:0/3268282134 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c011830 con 0x7fbf3c0c9420 2023-11-17T06:29:51.384 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf40f9b700 1 -- 172.21.15.69:0/3268282134 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c011990 con 0x7fbf3c0c9420 2023-11-17T06:29:51.384 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf40f9b700 1 -- 172.21.15.69:0/3268282134 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c011d20 con 0x7fbf3c0c9420 2023-11-17T06:29:51.385 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf42f9f700 1 -- 172.21.15.69:0/3268282134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 msgr2=0x7fbf3c0cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.385 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf42f9f700 1 --2- 172.21.15.69:0/3268282134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 0x7fbf3c0cb520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0c5e30 tx=0x7fbf2c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.385 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf42f9f700 1 -- 172.21.15.69:0/3268282134 shutdown_connections 2023-11-17T06:29:51.385 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf42f9f700 1 --2- 172.21.15.69:0/3268282134 >> v2:172.21.15.93:3300/0 conn(0x7fbf3c0cba60 0x7fbf3c0ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.385 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf42f9f700 1 --2- 172.21.15.69:0/3268282134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 0x7fbf3c0cb520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.385 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf42f9f700 1 -- 172.21.15.69:0/3268282134 >> 172.21.15.69:0/3268282134 conn(0x7fbf3c0b0900 msgr2=0x7fbf3c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:51.385 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf42f9f700 1 -- 172.21.15.69:0/3268282134 shutdown_connections 2023-11-17T06:29:51.385 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.380+0000 7fbf42f9f700 1 -- 172.21.15.69:0/3268282134 wait complete. 2023-11-17T06:29:51.388 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf42f9f700 1 Processor -- start 2023-11-17T06:29:51.388 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf42f9f700 1 -- start start 2023-11-17T06:29:51.390 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf42f9f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 0x7fbf3c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.390 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf42f9f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbf3c0cba60 0x7fbf3c0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.390 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf42f9f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf3c15d3e0 0x7fbf3c141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.390 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf42f9f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c15f260 con 0x7fbf3c0c9420 2023-11-17T06:29:51.390 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf42f9f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c153680 con 0x7fbf3c15d3e0 2023-11-17T06:29:51.390 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf42f9f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3c15e650 con 0x7fbf3c0cba60 2023-11-17T06:29:51.390 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf41f9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 0x7fbf3c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.391 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf41f9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 0x7fbf3c152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50998/0 (socket says 172.21.15.69:50998) 2023-11-17T06:29:51.391 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf41f9d700 1 -- 172.21.15.69:0/4000589107 learned_addr learned my addr 172.21.15.69:0/4000589107 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:51.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf4279e700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf3c15d3e0 0x7fbf3c141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.384+0000 7fbf4179c700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbf3c0cba60 0x7fbf3c0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf41f9d700 1 -- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbf3c0cba60 msgr2=0x7fbf3c0c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf41f9d700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbf3c0cba60 0x7fbf3c0c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf41f9d700 1 -- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf3c15d3e0 msgr2=0x7fbf3c141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf41f9d700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf3c15d3e0 0x7fbf3c141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf41f9d700 1 -- 172.21.15.69:0/4000589107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2c009570 con 0x7fbf3c0c9420 2023-11-17T06:29:51.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf41f9d700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 0x7fbf3c152c20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c500 tx=0x7fbf3800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf327fc700 1 -- 172.21.15.69:0/4000589107 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380052d0 con 0x7fbf3c0c9420 2023-11-17T06:29:51.392 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf327fc700 1 -- 172.21.15.69:0/4000589107 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf38005430 con 0x7fbf3c0c9420 2023-11-17T06:29:51.393 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf327fc700 1 -- 172.21.15.69:0/4000589107 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380055a0 con 0x7fbf3c0c9420 2023-11-17T06:29:51.393 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf42f9f700 1 -- 172.21.15.69:0/4000589107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3c15e930 con 0x7fbf3c0c9420 2023-11-17T06:29:51.393 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf42f9f700 1 -- 172.21.15.69:0/4000589107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3c15eef0 con 0x7fbf3c0c9420 2023-11-17T06:29:51.393 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.388+0000 7fbf42f9f700 1 -- 172.21.15.69:0/4000589107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf3c073f00 con 0x7fbf3c0c9420 2023-11-17T06:29:51.395 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.392+0000 7fbf327fc700 1 -- 172.21.15.69:0/4000589107 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbf380038e0 con 0x7fbf3c0c9420 2023-11-17T06:29:51.397 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.392+0000 7fbf327fc700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbf20066510 0x7fbf200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.397 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.392+0000 7fbf327fc700 1 -- 172.21.15.69:0/4000589107 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbf380830b0 con 0x7fbf3c0c9420 2023-11-17T06:29:51.397 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.392+0000 7fbf4179c700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbf20066510 0x7fbf200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.398 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.392+0000 7fbf4179c700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbf20066510 0x7fbf200689d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c000c00 tx=0x7fbf2c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.402 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.396+0000 7fbf327fc700 1 -- 172.21.15.69:0/4000589107 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbf38050750 con 0x7fbf3c0c9420 2023-11-17T06:29:51.578 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.572+0000 7fbf42f9f700 1 -- 172.21.15.69:0/4000589107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf3c153160 con 0x7fbf3c0c9420 2023-11-17T06:29:51.580 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.576+0000 7fbf327fc700 1 -- 172.21.15.69:0/4000589107 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12766 (secure 0 0 0) 0x7fbf38053d70 con 0x7fbf3c0c9420 2023-11-17T06:29:51.581 INFO:teuthology.misc.health.smithi069.stdout: 2023-11-17T06:29:51.581 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":19,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:49.027675+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:51.583 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 -- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbf20066510 msgr2=0x7fbf200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.583 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbf20066510 0x7fbf200689d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c000c00 tx=0x7fbf2c008030 comp rx=0 tx=0).stop 2023-11-17T06:29:51.583 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 -- 172.21.15.69:0/4000589107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 msgr2=0x7fbf3c152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.583 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 0x7fbf3c152c20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbf3800c500 tx=0x7fbf3800c8c0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.583 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 -- 172.21.15.69:0/4000589107 shutdown_connections 2023-11-17T06:29:51.583 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbf20066510 0x7fbf200689d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.584 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf3c15d3e0 0x7fbf3c141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.584 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbf3c0cba60 0x7fbf3c0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.584 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 --2- 172.21.15.69:0/4000589107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf3c0c9420 0x7fbf3c152c20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.584 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 -- 172.21.15.69:0/4000589107 >> 172.21.15.69:0/4000589107 conn(0x7fbf3c0b0900 msgr2=0x7fbf3c0c9860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:51.584 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 -- 172.21.15.69:0/4000589107 shutdown_connections 2023-11-17T06:29:51.584 INFO:teuthology.misc.health.smithi069.stderr:2023-11-17T06:29:51.580+0000 7fbf42f9f700 1 -- 172.21.15.69:0/4000589107 wait complete. 2023-11-17T06:29:51.600 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-17T06:29:51.600 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-17T06:29:51.601 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-17T06:29:51.601 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-17T06:29:51.607 INFO:tasks.ceph.mds.a:Started 2023-11-17T06:29:51.607 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-17T06:29:51.608 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-17T06:29:51.612 INFO:tasks.ceph.mds.c:Started 2023-11-17T06:29:51.612 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-17T06:29:51.612 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-17T06:29:51.619 INFO:tasks.ceph.mds.b:Started 2023-11-17T06:29:51.619 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-17T06:29:51.620 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-17T06:29:51.626 INFO:tasks.ceph.mds.d:Started 2023-11-17T06:29:51.627 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-17T06:29:51.627 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:51.719 INFO:tasks.ceph.mds.a.smithi069.stdout:starting mds.a at 2023-11-17T06:29:51.722 INFO:tasks.ceph.mds.c.smithi069.stdout:starting mds.c at 2023-11-17T06:29:51.742 INFO:tasks.ceph.mds.d.smithi093.stdout:starting mds.d at 2023-11-17T06:29:51.746 INFO:tasks.ceph.mds.b.smithi093.stdout:starting mds.b at 2023-11-17T06:29:51.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.780+0000 7f275f28a700 1 Processor -- start 2023-11-17T06:29:51.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275f28a700 1 -- start start 2023-11-17T06:29:51.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275f28a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 0x7f27580cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275f28a700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580b9000 con 0x7f275815d490 2023-11-17T06:29:51.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275f28a700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580d1bb0 con 0x7f27580ce310 2023-11-17T06:29:51.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275f28a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27580ce790 con 0x7f27580b8bc0 2023-11-17T06:29:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275e288700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f275815d490 0x7f27580d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38718/0 (socket says 172.21.15.69:38718) 2023-11-17T06:29:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275e288700 1 -- 172.21.15.69:0/2826117025 learned_addr learned my addr 172.21.15.69:0/2826117025 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:29:51.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275da87700 1 --2- 172.21.15.69:0/2826117025 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 0x7f27580cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275d286700 1 -- 172.21.15.69:0/2826117025 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985538239 0 0) 0x7f27580d1bb0 con 0x7f27580ce310 2023-11-17T06:29:51.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275d286700 1 -- 172.21.15.69:0/2826117025 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27440035d0 con 0x7f27580ce310 2023-11-17T06:29:51.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275d286700 1 -- 172.21.15.69:0/2826117025 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567188821 0 0) 0x7f2754001110 con 0x7f275815d490 2023-11-17T06:29:51.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.784+0000 7f275d286700 1 -- 172.21.15.69:0/2826117025 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27580d1bb0 con 0x7f275815d490 2023-11-17T06:29:51.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275da87700 1 -- 172.21.15.69:0/2826117025 >> v1:172.21.15.93:6789/0 conn(0x7f27580ce310 legacy=0x7f27580b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275da87700 1 -- 172.21.15.69:0/2826117025 >> v1:172.21.15.69:6789/0 conn(0x7f275815d490 legacy=0x7f27580d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275da87700 1 -- 172.21.15.69:0/2826117025 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580d1e90 con 0x7f27580b8bc0 2023-11-17T06:29:51.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275da87700 1 --2- 172.21.15.69:0/2826117025 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 0x7f27580cddd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2748009880 tx=0x7f2748009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=257bdd0eb7ecfb70 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275d286700 1 -- 172.21.15.69:0/2826117025 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748011830 con 0x7f27580b8bc0 2023-11-17T06:29:51.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275d286700 1 -- 172.21.15.69:0/2826117025 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2748011990 con 0x7f27580b8bc0 2023-11-17T06:29:51.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275d286700 1 -- 172.21.15.69:0/2826117025 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748011d20 con 0x7f27580b8bc0 2023-11-17T06:29:51.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275f28a700 1 -- 172.21.15.69:0/2826117025 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 msgr2=0x7f27580cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275f28a700 1 --2- 172.21.15.69:0/2826117025 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 0x7f27580cddd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2748009880 tx=0x7f2748009b90 comp rx=0 tx=0).stop 2023-11-17T06:29:51.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275f28a700 1 -- 172.21.15.69:0/2826117025 shutdown_connections 2023-11-17T06:29:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275f28a700 1 --2- 172.21.15.69:0/2826117025 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 0x7f27580cddd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275f28a700 1 -- 172.21.15.69:0/2826117025 >> 172.21.15.69:0/2826117025 conn(0x7f275806ab40 msgr2=0x7f275806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275f28a700 1 -- 172.21.15.69:0/2826117025 shutdown_connections 2023-11-17T06:29:51.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.788+0000 7f275f28a700 1 -- 172.21.15.69:0/2826117025 wait complete. 2023-11-17T06:29:51.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.792+0000 7f275f28a700 1 Processor -- start 2023-11-17T06:29:51.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.792+0000 7f275f28a700 1 -- start start 2023-11-17T06:29:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275f28a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 0x7f275815aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275f28a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27580ce310 0x7f27580cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275f28a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f275815d490 0x7f27580cdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275f28a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27581f3930 con 0x7f275815d490 2023-11-17T06:29:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275f28a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27581f2db0 con 0x7f27580ce310 2023-11-17T06:29:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275f28a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27581f3090 con 0x7f27580b8bc0 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275ea89700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f275815d490 0x7f27580cdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275da87700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27580ce310 0x7f27580cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275ea89700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f275815d490 0x7f27580cdbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51034/0 (socket says 172.21.15.69:51034) 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275ea89700 1 -- 172.21.15.69:0/3703943568 learned_addr learned my addr 172.21.15.69:0/3703943568 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275e288700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 0x7f275815aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275ea89700 1 -- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 msgr2=0x7f275815aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275ea89700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 0x7f275815aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275ea89700 1 -- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27580ce310 msgr2=0x7f27580cd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275ea89700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27580ce310 0x7f27580cd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275ea89700 1 -- 172.21.15.69:0/3703943568 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27480094b0 con 0x7f275815d490 2023-11-17T06:29:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275ea89700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f275815d490 0x7f27580cdbe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f275000cc20 tx=0x7f275000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f274effd700 1 -- 172.21.15.69:0/3703943568 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750003c20 con 0x7f275815d490 2023-11-17T06:29:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f274effd700 1 -- 172.21.15.69:0/3703943568 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750003d80 con 0x7f275815d490 2023-11-17T06:29:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275f28a700 1 -- 172.21.15.69:0/3703943568 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27581f3370 con 0x7f275815d490 2023-11-17T06:29:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f274effd700 1 -- 172.21.15.69:0/3703943568 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275000aae0 con 0x7f275815d490 2023-11-17T06:29:51.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.796+0000 7f275f28a700 1 -- 172.21.15.69:0/3703943568 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2758156e40 con 0x7f275815d490 2023-11-17T06:29:51.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.800+0000 7f275f28a700 1 -- 172.21.15.69:0/3703943568 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275815d970 con 0x7f275815d490 2023-11-17T06:29:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.800+0000 7f274effd700 1 -- 172.21.15.69:0/3703943568 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f275000ac40 con 0x7f275815d490 2023-11-17T06:29:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.804+0000 7f274effd700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f273c066510 0x7f273c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.804+0000 7f274effd700 1 -- 172.21.15.69:0/3703943568 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2750083b30 con 0x7f275815d490 2023-11-17T06:29:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.804+0000 7f275e288700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f273c066510 0x7f273c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:51.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.804+0000 7f275e288700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f273c066510 0x7f273c0689d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2754007fd0 tx=0x7f2754007c60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:51.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.808+0000 7f274effd700 1 -- 172.21.15.69:0/3703943568 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f275815d970 con 0x7f275815d490 2023-11-17T06:29:51.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.980+0000 7f275f28a700 1 -- 172.21.15.69:0/3703943568 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f275815d970 con 0x7f275815d490 2023-11-17T06:29:51.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.984+0000 7f274effd700 1 -- 172.21.15.69:0/3703943568 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12766 (secure 0 0 0) 0x7f275815d970 con 0x7f275815d490 2023-11-17T06:29:51.988 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:29:51.988 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":19,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:49.027675+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.984+0000 7f275f28a700 1 -- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f273c066510 msgr2=0x7f273c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.984+0000 7f275f28a700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f273c066510 0x7f273c0689d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2754007fd0 tx=0x7f2754007c60 comp rx=0 tx=0).stop 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.984+0000 7f275f28a700 1 -- 172.21.15.69:0/3703943568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f275815d490 msgr2=0x7f27580cdbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.984+0000 7f275f28a700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f275815d490 0x7f27580cdbe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f275000cc20 tx=0x7f275000cf30 comp rx=0 tx=0).stop 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.988+0000 7f275f28a700 1 -- 172.21.15.69:0/3703943568 shutdown_connections 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.988+0000 7f275f28a700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f273c066510 0x7f273c0689d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.988+0000 7f275f28a700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f275815d490 0x7f27580cdbe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.988+0000 7f275f28a700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f27580ce310 0x7f27580cd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.988+0000 7f275f28a700 1 --2- 172.21.15.69:0/3703943568 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f27580b8bc0 0x7f275815aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:51.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.988+0000 7f275f28a700 1 -- 172.21.15.69:0/3703943568 >> 172.21.15.69:0/3703943568 conn(0x7f275806ab40 msgr2=0x7f27580b75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:51.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.988+0000 7f275f28a700 1 -- 172.21.15.69:0/3703943568 shutdown_connections 2023-11-17T06:29:51.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:51.988+0000 7f275f28a700 1 -- 172.21.15.69:0/3703943568 wait complete. 2023-11-17T06:29:52.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:29:52.011 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:29:52.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.176+0000 7f709ed23700 1 Processor -- start 2023-11-17T06:29:52.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709ed23700 1 -- start start 2023-11-17T06:29:52.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709ed23700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f709815b0d0 0x7f70980cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709ed23700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f70980cebb0 0x7f70980cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709ed23700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f709815b4b0 0x7f70980cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709ed23700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70980701c0 con 0x7f709815b0d0 2023-11-17T06:29:52.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709ed23700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70980cf070 con 0x7f70980cebb0 2023-11-17T06:29:52.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709ed23700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70980cf350 con 0x7f709815b4b0 2023-11-17T06:29:52.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709cabf700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f709815b0d0 0x7f70980cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709cabf700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f709815b0d0 0x7f70980cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51048/0 (socket says 172.21.15.69:51048) 2023-11-17T06:29:52.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709cabf700 1 -- 172.21.15.69:0/2739698232 learned_addr learned my addr 172.21.15.69:0/2739698232 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:52.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f7097fff700 1 --2- 172.21.15.69:0/2739698232 >> v2:172.21.15.93:3300/0 conn(0x7f70980cebb0 0x7f70980cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709d2c0700 1 --2- 172.21.15.69:0/2739698232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f709815b4b0 0x7f70980cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709cabf700 1 -- 172.21.15.69:0/2739698232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f709815b4b0 msgr2=0x7f70980cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:52.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709cabf700 1 --2- 172.21.15.69:0/2739698232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f709815b4b0 0x7f70980cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709cabf700 1 -- 172.21.15.69:0/2739698232 >> v2:172.21.15.93:3300/0 conn(0x7f70980cebb0 msgr2=0x7f70980cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:52.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709cabf700 1 --2- 172.21.15.69:0/2739698232 >> v2:172.21.15.93:3300/0 conn(0x7f70980cebb0 0x7f70980cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f709cabf700 1 -- 172.21.15.69:0/2739698232 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70980cf630 con 0x7f709815b0d0 2023-11-17T06:29:52.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.180+0000 7f7097fff700 1 --2- 172.21.15.69:0/2739698232 >> v2:172.21.15.93:3300/0 conn(0x7f70980cebb0 0x7f70980cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:52.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f709cabf700 1 --2- 172.21.15.69:0/2739698232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f709815b0d0 0x7f70980cc790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f708c009900 tx=0x7f708c009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadaf42eee415f08 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f70977fe700 1 -- 172.21.15.69:0/2739698232 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c011830 con 0x7f709815b0d0 2023-11-17T06:29:52.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f70977fe700 1 -- 172.21.15.69:0/2739698232 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c011990 con 0x7f709815b0d0 2023-11-17T06:29:52.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f70977fe700 1 -- 172.21.15.69:0/2739698232 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c011d40 con 0x7f709815b0d0 2023-11-17T06:29:52.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f709ed23700 1 -- 172.21.15.69:0/2739698232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f709815b0d0 msgr2=0x7f70980cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f709ed23700 1 --2- 172.21.15.69:0/2739698232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f709815b0d0 0x7f70980cc790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f708c009900 tx=0x7f708c009c10 comp rx=0 tx=0).stop 2023-11-17T06:29:52.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f709ed23700 1 -- 172.21.15.69:0/2739698232 shutdown_connections 2023-11-17T06:29:52.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f709ed23700 1 --2- 172.21.15.69:0/2739698232 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f709815b4b0 0x7f70980cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f709ed23700 1 --2- 172.21.15.69:0/2739698232 >> v2:172.21.15.93:3300/0 conn(0x7f70980cebb0 0x7f70980cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f709ed23700 1 --2- 172.21.15.69:0/2739698232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f709815b0d0 0x7f70980cc790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f709ed23700 1 -- 172.21.15.69:0/2739698232 >> 172.21.15.69:0/2739698232 conn(0x7f709809a360 msgr2=0x7f70980d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:52.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f709ed23700 1 -- 172.21.15.69:0/2739698232 shutdown_connections 2023-11-17T06:29:52.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.184+0000 7f709ed23700 1 -- 172.21.15.69:0/2739698232 wait complete. 2023-11-17T06:29:52.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.188+0000 7f709ed23700 1 Processor -- start 2023-11-17T06:29:52.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.188+0000 7f709ed23700 1 -- start start 2023-11-17T06:29:52.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709ed23700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70980cebb0 0x7f709814fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709ed23700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f709815b0d0 0x7f709815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709ed23700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f709815b4b0 0x7f70980c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709ed23700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7098150330 con 0x7f70980cebb0 2023-11-17T06:29:52.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709ed23700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70981f05c0 con 0x7f709815b4b0 2023-11-17T06:29:52.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709ed23700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709815bd10 con 0x7f709815b0d0 2023-11-17T06:29:52.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709cabf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70980cebb0 0x7f709814fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709cabf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70980cebb0 0x7f709814fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51050/0 (socket says 172.21.15.69:51050) 2023-11-17T06:29:52.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709cabf700 1 -- 172.21.15.69:0/4286086064 learned_addr learned my addr 172.21.15.69:0/4286086064 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:52.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709d2c0700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f709815b4b0 0x7f70980c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f7097fff700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f709815b0d0 0x7f709815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709cabf700 1 -- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f709815b0d0 msgr2=0x7f709815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709cabf700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f709815b0d0 0x7f709815cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709cabf700 1 -- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f709815b4b0 msgr2=0x7f70980c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709cabf700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f709815b4b0 0x7f70980c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709cabf700 1 -- 172.21.15.69:0/4286086064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840094b0 con 0x7f70980cebb0 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709cabf700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70980cebb0 0x7f709814fdf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f708c009c50 tx=0x7f708c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f70957fa700 1 -- 172.21.15.69:0/4286086064 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c004220 con 0x7f70980cebb0 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f70957fa700 1 -- 172.21.15.69:0/4286086064 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c01e070 con 0x7f70980cebb0 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709ed23700 1 -- 172.21.15.69:0/4286086064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708c009510 con 0x7f70980cebb0 2023-11-17T06:29:52.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f70957fa700 1 -- 172.21.15.69:0/4286086064 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c0036c0 con 0x7f70980cebb0 2023-11-17T06:29:52.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.192+0000 7f709ed23700 1 -- 172.21.15.69:0/4286086064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709815c2d0 con 0x7f70980cebb0 2023-11-17T06:29:52.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.196+0000 7f709ed23700 1 -- 172.21.15.69:0/4286086064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70980686a0 con 0x7f70980cebb0 2023-11-17T06:29:52.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.196+0000 7f70957fa700 1 -- 172.21.15.69:0/4286086064 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f708c003820 con 0x7f70980cebb0 2023-11-17T06:29:52.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.196+0000 7f70957fa700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f707c066510 0x7f707c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.196+0000 7f70957fa700 1 -- 172.21.15.69:0/4286086064 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f708c084950 con 0x7f70980cebb0 2023-11-17T06:29:52.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.200+0000 7f7097fff700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f707c066510 0x7f707c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.200+0000 7f7097fff700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f707c066510 0x7f707c0689d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f709815dbf0 tx=0x7f7084009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.204+0000 7f70957fa700 1 -- 172.21.15.69:0/4286086064 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f708c052190 con 0x7f70980cebb0 2023-11-17T06:29:52.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.376+0000 7f709ed23700 1 -- 172.21.15.69:0/4286086064 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70980ce660 con 0x7f70980cebb0 2023-11-17T06:29:52.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f70957fa700 1 -- 172.21.15.69:0/4286086064 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f708c0557b0 con 0x7f70980cebb0 2023-11-17T06:29:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:29:52.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 -- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f707c066510 msgr2=0x7f707c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f707c066510 0x7f707c0689d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f709815dbf0 tx=0x7f7084009240 comp rx=0 tx=0).stop 2023-11-17T06:29:52.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 -- 172.21.15.69:0/4286086064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70980cebb0 msgr2=0x7f709814fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70980cebb0 0x7f709814fdf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f708c009c50 tx=0x7f708c004770 comp rx=0 tx=0).stop 2023-11-17T06:29:52.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 -- 172.21.15.69:0/4286086064 shutdown_connections 2023-11-17T06:29:52.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f707c066510 0x7f707c0689d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f709815b4b0 0x7f70980c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f709815b0d0 0x7f709815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 --2- 172.21.15.69:0/4286086064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70980cebb0 0x7f709814fdf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 -- 172.21.15.69:0/4286086064 >> 172.21.15.69:0/4286086064 conn(0x7f709809a360 msgr2=0x7f709806eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:52.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 -- 172.21.15.69:0/4286086064 shutdown_connections 2023-11-17T06:29:52.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.380+0000 7f709ed23700 1 -- 172.21.15.69:0/4286086064 wait complete. 2023-11-17T06:29:52.407 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:29:52.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.580+0000 7f70e759e700 1 Processor -- start 2023-11-17T06:29:52.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.580+0000 7f70e759e700 1 -- start start 2023-11-17T06:29:52.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.580+0000 7f70e759e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f70e815d490 0x7f70e80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e759e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f70e80ce4e0 0x7f70e80b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e759e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e80d1bb0 con 0x7f70e80d13d0 2023-11-17T06:29:52.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e759e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e80d1e90 con 0x7f70e815d490 2023-11-17T06:29:52.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e759e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e80d2170 con 0x7f70e80ce4e0 2023-11-17T06:29:52.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f70e815d490 0x7f70e80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f70e815d490 0x7f70e80b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51052/0 (socket says 172.21.15.69:51052) 2023-11-17T06:29:52.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e659c700 1 -- 172.21.15.69:0/2773292217 learned_addr learned my addr 172.21.15.69:0/2773292217 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:52.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e6d9d700 1 --2- 172.21.15.69:0/2773292217 >> v2:172.21.15.93:3300/0 conn(0x7f70e80ce4e0 0x7f70e80b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e659c700 1 -- 172.21.15.69:0/2773292217 >> v2:172.21.15.93:3300/0 conn(0x7f70e80ce4e0 msgr2=0x7f70e80b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:52.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e659c700 1 --2- 172.21.15.69:0/2773292217 >> v2:172.21.15.93:3300/0 conn(0x7f70e80ce4e0 0x7f70e80b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e659c700 1 -- 172.21.15.69:0/2773292217 >> v1:172.21.15.93:6789/0 conn(0x7f70e80d13d0 legacy=0x7f70e80cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:52.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e659c700 1 -- 172.21.15.69:0/2773292217 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e80d2450 con 0x7f70e815d490 2023-11-17T06:29:52.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e6d9d700 1 --2- 172.21.15.69:0/2773292217 >> v2:172.21.15.93:3300/0 conn(0x7f70e80ce4e0 0x7f70e80b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:52.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e659c700 1 --2- 172.21.15.69:0/2773292217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e815d490 0x7f70e80b8bc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f70e8072960 tx=0x7f70d8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da01c73c6d7afd19 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e559a700 1 -- 172.21.15.69:0/2773292217 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800b8a0 con 0x7f70e815d490 2023-11-17T06:29:52.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e559a700 1 -- 172.21.15.69:0/2773292217 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d800ba00 con 0x7f70e815d490 2023-11-17T06:29:52.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e559a700 1 -- 172.21.15.69:0/2773292217 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800bd90 con 0x7f70e815d490 2023-11-17T06:29:52.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e759e700 1 -- 172.21.15.69:0/2773292217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e815d490 msgr2=0x7f70e80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e759e700 1 --2- 172.21.15.69:0/2773292217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e815d490 0x7f70e80b8bc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f70e8072960 tx=0x7f70d8009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e759e700 1 -- 172.21.15.69:0/2773292217 shutdown_connections 2023-11-17T06:29:52.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e759e700 1 --2- 172.21.15.69:0/2773292217 >> v2:172.21.15.93:3300/0 conn(0x7f70e80ce4e0 0x7f70e80b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e759e700 1 --2- 172.21.15.69:0/2773292217 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e815d490 0x7f70e80b8bc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.584+0000 7f70e759e700 1 -- 172.21.15.69:0/2773292217 >> 172.21.15.69:0/2773292217 conn(0x7f70e806ab40 msgr2=0x7f70e806af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:52.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e759e700 1 -- 172.21.15.69:0/2773292217 shutdown_connections 2023-11-17T06:29:52.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e759e700 1 -- 172.21.15.69:0/2773292217 wait complete. 2023-11-17T06:29:52.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e759e700 1 Processor -- start 2023-11-17T06:29:52.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e759e700 1 -- start start 2023-11-17T06:29:52.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e759e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f70e80ce4e0 0x7f70e814a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e80d13d0 0x7f70e80b7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e759e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70e815d490 0x7f70e80b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e759e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e81f3920 con 0x7f70e80d13d0 2023-11-17T06:29:52.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e759e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e81f42c0 con 0x7f70e815d490 2023-11-17T06:29:52.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e759e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e81f3640 con 0x7f70e80ce4e0 2023-11-17T06:29:52.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.588+0000 7f70e5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e80d13d0 0x7f70e80b7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e5d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e80d13d0 0x7f70e80b7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51058/0 (socket says 172.21.15.69:51058) 2023-11-17T06:29:52.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e5d9b700 1 -- 172.21.15.69:0/1312563027 learned_addr learned my addr 172.21.15.69:0/1312563027 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:52.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e6d9d700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70e815d490 0x7f70e80b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e659c700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f70e80ce4e0 0x7f70e814a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e5d9b700 1 -- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f70e80ce4e0 msgr2=0x7f70e814a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e5d9b700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f70e80ce4e0 0x7f70e814a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e5d9b700 1 -- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70e815d490 msgr2=0x7f70e80b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e5d9b700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70e815d490 0x7f70e80b7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e5d9b700 1 -- 172.21.15.69:0/1312563027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d8009570 con 0x7f70e80d13d0 2023-11-17T06:29:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e5d9b700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e80d13d0 0x7f70e80b7690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00c500 tx=0x7f70dc00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70d6ffd700 1 -- 172.21.15.69:0/1312563027 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0052d0 con 0x7f70e80d13d0 2023-11-17T06:29:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70d6ffd700 1 -- 172.21.15.69:0/1312563027 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70dc005430 con 0x7f70e80d13d0 2023-11-17T06:29:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70d6ffd700 1 -- 172.21.15.69:0/1312563027 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70dc0055a0 con 0x7f70e80d13d0 2023-11-17T06:29:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e759e700 1 -- 172.21.15.69:0/1312563027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e81f3c70 con 0x7f70e80d13d0 2023-11-17T06:29:52.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e759e700 1 -- 172.21.15.69:0/1312563027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e81f2910 con 0x7f70e80d13d0 2023-11-17T06:29:52.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.592+0000 7f70e759e700 1 -- 172.21.15.69:0/1312563027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e81f3ad0 con 0x7f70e80d13d0 2023-11-17T06:29:52.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.596+0000 7f70d6ffd700 1 -- 172.21.15.69:0/1312563027 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f70dc0036a0 con 0x7f70e80d13d0 2023-11-17T06:29:52.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.596+0000 7f70d6ffd700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f70c8066510 0x7f70c80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:52.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.596+0000 7f70d6ffd700 1 -- 172.21.15.69:0/1312563027 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f70dc082d60 con 0x7f70e80d13d0 2023-11-17T06:29:52.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.596+0000 7f70e659c700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f70c8066510 0x7f70c80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:52.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.600+0000 7f70e659c700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f70c8066510 0x7f70c80689d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f70d8000c00 tx=0x7f70d8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:52.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.604+0000 7f70d6ffd700 1 -- 172.21.15.69:0/1312563027 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f70e81f3ad0 con 0x7f70e80d13d0 2023-11-17T06:29:52.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.816+0000 7f70e759e700 1 -- 172.21.15.69:0/1312563027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70e81f3ad0 con 0x7f70e80d13d0 2023-11-17T06:29:52.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.816+0000 7f70d6ffd700 1 -- 172.21.15.69:0/1312563027 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f70e81f3ad0 con 0x7f70e80d13d0 2023-11-17T06:29:52.821 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:29:52.821 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/1178370379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1178370379},{"type":"v1","addr":"172.21.15.93:6835","nonce":1178370379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/2342979080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":2342979080},{"type":"v1","addr":"172.21.15.93:6837","nonce":2342979080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/1839590536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1839590536},{"type":"v1","addr":"172.21.15.69:6833","nonce":1839590536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2440982410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2440982410},{"type":"v1","addr":"172.21.15.69:6835","nonce":2440982410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-17T06:29:52.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 -- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f70c8066510 msgr2=0x7f70c80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f70c8066510 0x7f70c80689d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f70d8000c00 tx=0x7f70d8008030 comp rx=0 tx=0).stop 2023-11-17T06:29:52.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 -- 172.21.15.69:0/1312563027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e80d13d0 msgr2=0x7f70e80b7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:52.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e80d13d0 0x7f70e80b7690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f70dc00c500 tx=0x7f70dc00c810 comp rx=0 tx=0).stop 2023-11-17T06:29:52.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 -- 172.21.15.69:0/1312563027 shutdown_connections 2023-11-17T06:29:52.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f70c8066510 0x7f70c80689d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70e815d490 0x7f70e80b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70e80d13d0 0x7f70e80b7690 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 --2- 172.21.15.69:0/1312563027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f70e80ce4e0 0x7f70e814a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:52.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 -- 172.21.15.69:0/1312563027 >> 172.21.15.69:0/1312563027 conn(0x7f70e806ab40 msgr2=0x7f70e815bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:52.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 -- 172.21.15.69:0/1312563027 shutdown_connections 2023-11-17T06:29:52.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:52.820+0000 7f70e759e700 1 -- 172.21.15.69:0/1312563027 wait complete. 2023-11-17T06:29:52.827 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 3 2023-11-17T06:29:52.847 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:53.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f0295c9d700 1 Processor -- start 2023-11-17T06:29:53.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f0295c9d700 1 -- start start 2023-11-17T06:29:53.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f0295c9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f029015b980 0x7f029015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f0295c9d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f02900c9b30 0x7f029015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f0295c9d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029006fc20 con 0x7f02900719e0 2023-11-17T06:29:53.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f0295c9d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0290070430 con 0x7f029015b980 2023-11-17T06:29:53.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f0295c9d700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029015ed70 con 0x7f02900c9b30 2023-11-17T06:29:53.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f0294c9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f029015b980 0x7f029015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f0294c9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f029015b980 0x7f029015f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51070/0 (socket says 172.21.15.69:51070) 2023-11-17T06:29:53.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f0294c9b700 1 -- 172.21.15.69:0/278360594 learned_addr learned my addr 172.21.15.69:0/278360594 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:53.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.016+0000 7f029549c700 1 --2- 172.21.15.69:0/278360594 >> v2:172.21.15.93:3300/0 conn(0x7f02900c9b30 0x7f029015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0294c9b700 1 -- 172.21.15.69:0/278360594 >> v2:172.21.15.93:3300/0 conn(0x7f02900c9b30 msgr2=0x7f029015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:53.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0294c9b700 1 --2- 172.21.15.69:0/278360594 >> v2:172.21.15.93:3300/0 conn(0x7f02900c9b30 0x7f029015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0294c9b700 1 -- 172.21.15.69:0/278360594 >> v1:172.21.15.93:6789/0 conn(0x7f02900719e0 legacy=0x7f02900c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f028f7fe700 1 -- 172.21.15.69:0/278360594 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617307805 0 0) 0x7f029006fc20 con 0x7f02900719e0 2023-11-17T06:29:53.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0294c9b700 1 -- 172.21.15.69:0/278360594 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029015fcc0 con 0x7f029015b980 2023-11-17T06:29:53.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0294c9b700 1 --2- 172.21.15.69:0/278360594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f029015b980 0x7f029015f780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02900686d0 tx=0x7f0284009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9427fd4f4a314aff server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f028f7fe700 1 -- 172.21.15.69:0/278360594 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284011830 con 0x7f029015b980 2023-11-17T06:29:53.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f028f7fe700 1 -- 172.21.15.69:0/278360594 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0284011990 con 0x7f029015b980 2023-11-17T06:29:53.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f028f7fe700 1 -- 172.21.15.69:0/278360594 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284011d20 con 0x7f029015b980 2023-11-17T06:29:53.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0295c9d700 1 -- 172.21.15.69:0/278360594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f029015b980 msgr2=0x7f029015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0295c9d700 1 --2- 172.21.15.69:0/278360594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f029015b980 0x7f029015f780 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02900686d0 tx=0x7f0284009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0295c9d700 1 -- 172.21.15.69:0/278360594 shutdown_connections 2023-11-17T06:29:53.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0295c9d700 1 --2- 172.21.15.69:0/278360594 >> v2:172.21.15.93:3300/0 conn(0x7f02900c9b30 0x7f029015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0295c9d700 1 --2- 172.21.15.69:0/278360594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f029015b980 0x7f029015f780 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0295c9d700 1 -- 172.21.15.69:0/278360594 >> 172.21.15.69:0/278360594 conn(0x7f02900b0900 msgr2=0x7f02900b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:53.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0295c9d700 1 -- 172.21.15.69:0/278360594 shutdown_connections 2023-11-17T06:29:53.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.020+0000 7f0295c9d700 1 -- 172.21.15.69:0/278360594 wait complete. 2023-11-17T06:29:53.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0295c9d700 1 Processor -- start 2023-11-17T06:29:53.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0295c9d700 1 -- start start 2023-11-17T06:29:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0295c9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02900719e0 0x7f02900c3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0295c9d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f02900c9b30 0x7f02901f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0295c9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f029015b980 0x7f02900c4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0295c9d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02900c4420 con 0x7f02900719e0 2023-11-17T06:29:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0295c9d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029015a230 con 0x7f029015b980 2023-11-17T06:29:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0295c9d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02901596b0 con 0x7f02900c9b30 2023-11-17T06:29:53.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0294c9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02900719e0 0x7f02900c3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0294c9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02900719e0 0x7f02900c3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51086/0 (socket says 172.21.15.69:51086) 2023-11-17T06:29:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0294c9b700 1 -- 172.21.15.69:0/3350429927 learned_addr learned my addr 172.21.15.69:0/3350429927 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f028ffff700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f02900c9b30 0x7f02901f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f029549c700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f029015b980 0x7f02900c4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0294c9b700 1 -- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f02900c9b30 msgr2=0x7f02901f6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0294c9b700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f02900c9b30 0x7f02901f6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0294c9b700 1 -- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f029015b980 msgr2=0x7f02900c4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0294c9b700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f029015b980 0x7f02900c4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f0294c9b700 1 -- 172.21.15.69:0/3350429927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284009570 con 0x7f02900719e0 2023-11-17T06:29:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.024+0000 7f029549c700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f029015b980 0x7f02900c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.028+0000 7f0294c9b700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02900719e0 0x7f02900c3ee0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0284000c00 tx=0x7f0284004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.028+0000 7f028d7fa700 1 -- 172.21.15.69:0/3350429927 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284004510 con 0x7f02900719e0 2023-11-17T06:29:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.028+0000 7f028d7fa700 1 -- 172.21.15.69:0/3350429927 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f028401e070 con 0x7f02900719e0 2023-11-17T06:29:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.028+0000 7f028d7fa700 1 -- 172.21.15.69:0/3350429927 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02840038e0 con 0x7f02900719e0 2023-11-17T06:29:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.028+0000 7f0295c9d700 1 -- 172.21.15.69:0/3350429927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0290159990 con 0x7f02900719e0 2023-11-17T06:29:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.028+0000 7f0295c9d700 1 -- 172.21.15.69:0/3350429927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0290159f50 con 0x7f02900719e0 2023-11-17T06:29:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.028+0000 7f0295c9d700 1 -- 172.21.15.69:0/3350429927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0290073f00 con 0x7f02900719e0 2023-11-17T06:29:53.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.028+0000 7f028d7fa700 1 -- 172.21.15.69:0/3350429927 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0284003a40 con 0x7f02900719e0 2023-11-17T06:29:53.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.032+0000 7f028d7fa700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0274066510 0x7f02740689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.032+0000 7f028d7fa700 1 -- 172.21.15.69:0/3350429927 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0284084950 con 0x7f02900719e0 2023-11-17T06:29:53.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.032+0000 7f028ffff700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0274066510 0x7f02740689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.032+0000 7f028ffff700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0274066510 0x7f02740689d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02900c5e20 tx=0x7f027c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.036+0000 7f028d7fa700 1 -- 172.21.15.69:0/3350429927 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0284052130 con 0x7f02900719e0 2023-11-17T06:29:53.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.216+0000 7f0295c9d700 1 -- 172.21.15.69:0/3350429927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02900cc690 con 0x7f02900719e0 2023-11-17T06:29:53.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.216+0000 7f028d7fa700 1 -- 172.21.15.69:0/3350429927 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12766 (secure 0 0 0) 0x7f0284055750 con 0x7f02900719e0 2023-11-17T06:29:53.221 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:29:53.221 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":19,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:49.027675+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:53.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 -- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0274066510 msgr2=0x7f02740689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0274066510 0x7f02740689d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f02900c5e20 tx=0x7f027c009040 comp rx=0 tx=0).stop 2023-11-17T06:29:53.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 -- 172.21.15.69:0/3350429927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02900719e0 msgr2=0x7f02900c3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02900719e0 0x7f02900c3ee0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0284000c00 tx=0x7f0284004770 comp rx=0 tx=0).stop 2023-11-17T06:29:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 -- 172.21.15.69:0/3350429927 shutdown_connections 2023-11-17T06:29:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0274066510 0x7f02740689d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f029015b980 0x7f02900c4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f02900c9b30 0x7f02901f6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 --2- 172.21.15.69:0/3350429927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02900719e0 0x7f02900c3ee0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 -- 172.21.15.69:0/3350429927 >> 172.21.15.69:0/3350429927 conn(0x7f02900b0900 msgr2=0x7f02900afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 -- 172.21.15.69:0/3350429927 shutdown_connections 2023-11-17T06:29:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.220+0000 7f0295c9d700 1 -- 172.21.15.69:0/3350429927 wait complete. 2023-11-17T06:29:53.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:29:53.251 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:29:53.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.428+0000 7f18d759e700 1 Processor -- start 2023-11-17T06:29:53.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.428+0000 7f18d759e700 1 -- start start 2023-11-17T06:29:53.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d759e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 0x7f18d80cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d759e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f18d80b2600 0x7f18d80d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d759e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d81621b0 con 0x7f18d815d980 2023-11-17T06:29:53.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d759e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d8161630 con 0x7f18d80b2600 2023-11-17T06:29:53.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d759e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d8161910 con 0x7f18d815d5a0 2023-11-17T06:29:53.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d6d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f18d80b2600 0x7f18d80d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d659c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 0x7f18d80cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d6d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f18d80b2600 0x7f18d80d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51096/0 (socket says 172.21.15.69:51096) 2023-11-17T06:29:53.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d659c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 0x7f18d80cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:43052/0 (socket says 172.21.15.69:43052) 2023-11-17T06:29:53.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d6d9d700 1 -- 172.21.15.69:0/4016954037 learned_addr learned my addr 172.21.15.69:0/4016954037 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:53.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d6d9d700 1 -- 172.21.15.69:0/4016954037 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 msgr2=0x7f18d80cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:53.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d6d9d700 1 --2- 172.21.15.69:0/4016954037 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 0x7f18d80cfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d6d9d700 1 -- 172.21.15.69:0/4016954037 >> v1:172.21.15.93:6789/0 conn(0x7f18d815d980 legacy=0x7f18d80b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d6d9d700 1 -- 172.21.15.69:0/4016954037 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d8161bf0 con 0x7f18d80b2600 2023-11-17T06:29:53.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d6d9d700 1 --2- 172.21.15.69:0/4016954037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 0x7f18d80d0060 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009e50 tx=0x7f18d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faaab473cfb358ca server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d559a700 1 -- 172.21.15.69:0/4016954037 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000e070 con 0x7f18d80b2600 2023-11-17T06:29:53.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d559a700 1 -- 172.21.15.69:0/4016954037 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d000b910 con 0x7f18d80b2600 2023-11-17T06:29:53.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d559a700 1 -- 172.21.15.69:0/4016954037 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000bcc0 con 0x7f18d80b2600 2023-11-17T06:29:53.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d759e700 1 -- 172.21.15.69:0/4016954037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 msgr2=0x7f18d80d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.432+0000 7f18d759e700 1 --2- 172.21.15.69:0/4016954037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 0x7f18d80d0060 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009e50 tx=0x7f18d000b330 comp rx=0 tx=0).stop 2023-11-17T06:29:53.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 -- 172.21.15.69:0/4016954037 shutdown_connections 2023-11-17T06:29:53.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 --2- 172.21.15.69:0/4016954037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 0x7f18d80d0060 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 --2- 172.21.15.69:0/4016954037 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 0x7f18d80cfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 -- 172.21.15.69:0/4016954037 >> 172.21.15.69:0/4016954037 conn(0x7f18d806aca0 msgr2=0x7f18d806b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:53.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 -- 172.21.15.69:0/4016954037 shutdown_connections 2023-11-17T06:29:53.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 -- 172.21.15.69:0/4016954037 wait complete. 2023-11-17T06:29:53.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 Processor -- start 2023-11-17T06:29:53.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 -- start start 2023-11-17T06:29:53.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 0x7f18d815a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 0x7f18d815a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18d8158d40 0x7f18d80b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80c9910 con 0x7f18d80b2600 2023-11-17T06:29:53.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80c8d00 con 0x7f18d8158d40 2023-11-17T06:29:53.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.436+0000 7f18d759e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80c8fe0 con 0x7f18d815d5a0 2023-11-17T06:29:53.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 0x7f18d815a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 0x7f18d815a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51102/0 (socket says 172.21.15.69:51102) 2023-11-17T06:29:53.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d659c700 1 -- 172.21.15.69:0/125339784 learned_addr learned my addr 172.21.15.69:0/125339784 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:53.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d5d9b700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 0x7f18d815a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d6d9d700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18d8158d40 0x7f18d80b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d659c700 1 -- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 msgr2=0x7f18d815a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d659c700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 0x7f18d815a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d659c700 1 -- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18d8158d40 msgr2=0x7f18d80b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d659c700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18d8158d40 0x7f18d80b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d659c700 1 -- 172.21.15.69:0/125339784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0009b30 con 0x7f18d80b2600 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d6d9d700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18d8158d40 0x7f18d80b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d659c700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 0x7f18d815a360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f18c800e9d0 tx=0x7f18c800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18c6ffd700 1 -- 172.21.15.69:0/125339784 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8009720 con 0x7f18d80b2600 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18c6ffd700 1 -- 172.21.15.69:0/125339784 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c800c850 con 0x7f18d80b2600 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d759e700 1 -- 172.21.15.69:0/125339784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d80c92c0 con 0x7f18d80b2600 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18c6ffd700 1 -- 172.21.15.69:0/125339784 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c800cbc0 con 0x7f18d80b2600 2023-11-17T06:29:53.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d759e700 1 -- 172.21.15.69:0/125339784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d80b3f20 con 0x7f18d80b2600 2023-11-17T06:29:53.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.440+0000 7f18d759e700 1 -- 172.21.15.69:0/125339784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d80686a0 con 0x7f18d80b2600 2023-11-17T06:29:53.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.444+0000 7f18c6ffd700 1 -- 172.21.15.69:0/125339784 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f18c800cd20 con 0x7f18d80b2600 2023-11-17T06:29:53.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.444+0000 7f18c6ffd700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f18b8066540 0x7f18b8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.444+0000 7f18c6ffd700 1 -- 172.21.15.69:0/125339784 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f18c8083cd0 con 0x7f18d80b2600 2023-11-17T06:29:53.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.444+0000 7f18d5d9b700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f18b8066540 0x7f18b8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.448+0000 7f18d5d9b700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f18b8066540 0x7f18b8068a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f18d81f5dd0 tx=0x7f18cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.448+0000 7f18c6ffd700 1 -- 172.21.15.69:0/125339784 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f18c8051370 con 0x7f18d80b2600 2023-11-17T06:29:53.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.628+0000 7f18d759e700 1 -- 172.21.15.69:0/125339784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18d80d0e90 con 0x7f18d80b2600 2023-11-17T06:29:53.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.628+0000 7f18c6ffd700 1 -- 172.21.15.69:0/125339784 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f18c80210a0 con 0x7f18d80b2600 2023-11-17T06:29:53.635 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:29:53.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 -- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f18b8066540 msgr2=0x7f18b8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f18b8066540 0x7f18b8068a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f18d81f5dd0 tx=0x7f18cc009040 comp rx=0 tx=0).stop 2023-11-17T06:29:53.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 -- 172.21.15.69:0/125339784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 msgr2=0x7f18d815a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 0x7f18d815a360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f18c800e9d0 tx=0x7f18c800ed90 comp rx=0 tx=0).stop 2023-11-17T06:29:53.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 -- 172.21.15.69:0/125339784 shutdown_connections 2023-11-17T06:29:53.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f18b8066540 0x7f18b8068a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f18d8158d40 0x7f18d80b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f18d815d5a0 0x7f18d815a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 --2- 172.21.15.69:0/125339784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18d80b2600 0x7f18d815a360 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 -- 172.21.15.69:0/125339784 >> 172.21.15.69:0/125339784 conn(0x7f18d806aca0 msgr2=0x7f18d80cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:53.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 -- 172.21.15.69:0/125339784 shutdown_connections 2023-11-17T06:29:53.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.632+0000 7f18d759e700 1 -- 172.21.15.69:0/125339784 wait complete. 2023-11-17T06:29:53.657 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-17T06:29:53.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.828+0000 7f3236b5d700 1 Processor -- start 2023-11-17T06:29:53.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.828+0000 7f3236b5d700 1 -- start start 2023-11-17T06:29:53.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.828+0000 7f3236b5d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300ce4e0 0x7f3230167e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.828+0000 7f3236b5d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32300b9000 con 0x7f32300b8bc0 2023-11-17T06:29:53.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.828+0000 7f3236b5d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32300d1bb0 con 0x7f323015d490 2023-11-17T06:29:53.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.828+0000 7f3236b5d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32300d1e90 con 0x7f32300ce4e0 2023-11-17T06:29:53.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.828+0000 7f323535a700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f32300b8bc0 0x7f32300cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38720/0 (socket says 172.21.15.69:38720) 2023-11-17T06:29:53.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.828+0000 7f323535a700 1 -- 172.21.15.69:0/4013536804 learned_addr learned my addr 172.21.15.69:0/4013536804 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:29:53.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f323635c700 1 --2- 172.21.15.69:0/4013536804 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300ce4e0 0x7f3230167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3234b59700 1 -- 172.21.15.69:0/4013536804 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763669696 0 0) 0x7f3220001110 con 0x7f32300b8bc0 2023-11-17T06:29:53.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3234b59700 1 -- 172.21.15.69:0/4013536804 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f321c0035d0 con 0x7f32300b8bc0 2023-11-17T06:29:53.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3234b59700 1 -- 172.21.15.69:0/4013536804 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745454953 0 0) 0x7f32300d1bb0 con 0x7f323015d490 2023-11-17T06:29:53.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3234b59700 1 -- 172.21.15.69:0/4013536804 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3220001110 con 0x7f323015d490 2023-11-17T06:29:53.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f323635c700 1 -- 172.21.15.69:0/4013536804 >> v1:172.21.15.93:6789/0 conn(0x7f323015d490 legacy=0x7f32300d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f323635c700 1 -- 172.21.15.69:0/4013536804 >> v1:172.21.15.69:6789/0 conn(0x7f32300b8bc0 legacy=0x7f32300cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f323635c700 1 -- 172.21.15.69:0/4013536804 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32300d2170 con 0x7f32300ce4e0 2023-11-17T06:29:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f323635c700 1 --2- 172.21.15.69:0/4013536804 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300ce4e0 0x7f3230167e20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3228009880 tx=0x7f3228009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=333c37a89fe4080f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3234b59700 1 -- 172.21.15.69:0/4013536804 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228011830 con 0x7f32300ce4e0 2023-11-17T06:29:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3234b59700 1 -- 172.21.15.69:0/4013536804 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3228011990 con 0x7f32300ce4e0 2023-11-17T06:29:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3234b59700 1 -- 172.21.15.69:0/4013536804 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3228011d00 con 0x7f32300ce4e0 2023-11-17T06:29:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3236b5d700 1 -- 172.21.15.69:0/4013536804 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300ce4e0 msgr2=0x7f3230167e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3236b5d700 1 --2- 172.21.15.69:0/4013536804 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300ce4e0 0x7f3230167e20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3228009880 tx=0x7f3228009b90 comp rx=0 tx=0).stop 2023-11-17T06:29:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3236b5d700 1 -- 172.21.15.69:0/4013536804 shutdown_connections 2023-11-17T06:29:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3236b5d700 1 --2- 172.21.15.69:0/4013536804 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300ce4e0 0x7f3230167e20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3236b5d700 1 -- 172.21.15.69:0/4013536804 >> 172.21.15.69:0/4013536804 conn(0x7f323006ab40 msgr2=0x7f323006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3236b5d700 1 -- 172.21.15.69:0/4013536804 shutdown_connections 2023-11-17T06:29:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.832+0000 7f3236b5d700 1 -- 172.21.15.69:0/4013536804 wait complete. 2023-11-17T06:29:53.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.836+0000 7f3236b5d700 1 Processor -- start 2023-11-17T06:29:53.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f3236b5d700 1 -- start start 2023-11-17T06:29:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f3236b5d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300b8bc0 0x7f32301493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f3236b5d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32300ce4e0 0x7f32300cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f3236b5d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f323015d490 0x7f32300ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f3236b5d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32301f3820 con 0x7f32300ce4e0 2023-11-17T06:29:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f3236b5d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32301f2980 con 0x7f323015d490 2023-11-17T06:29:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f3236b5d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3230149920 con 0x7f32300b8bc0 2023-11-17T06:29:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f323535a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32300ce4e0 0x7f32300cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f323535a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32300ce4e0 0x7f32300cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51118/0 (socket says 172.21.15.69:51118) 2023-11-17T06:29:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f323535a700 1 -- 172.21.15.69:0/2551377943 learned_addr learned my addr 172.21.15.69:0/2551377943 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f323635c700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f323015d490 0x7f32300ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f3235b5b700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300b8bc0 0x7f32301493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f323535a700 1 -- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300b8bc0 msgr2=0x7f32301493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f323535a700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300b8bc0 0x7f32301493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f323535a700 1 -- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f323015d490 msgr2=0x7f32300ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:53.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f323535a700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f323015d490 0x7f32300ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:53.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f323535a700 1 -- 172.21.15.69:0/2551377943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32280094b0 con 0x7f32300ce4e0 2023-11-17T06:29:53.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f323535a700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32300ce4e0 0x7f32300cc9b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f322000c780 tx=0x7f322000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f32267fc700 1 -- 172.21.15.69:0/2551377943 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220005d90 con 0x7f32300ce4e0 2023-11-17T06:29:53.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f32267fc700 1 -- 172.21.15.69:0/2551377943 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3220007070 con 0x7f32300ce4e0 2023-11-17T06:29:53.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f32267fc700 1 -- 172.21.15.69:0/2551377943 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3220007400 con 0x7f32300ce4e0 2023-11-17T06:29:53.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f3236b5d700 1 -- 172.21.15.69:0/2551377943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32301f2ba0 con 0x7f32300ce4e0 2023-11-17T06:29:53.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.840+0000 7f3236b5d700 1 -- 172.21.15.69:0/2551377943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32301f3160 con 0x7f32300ce4e0 2023-11-17T06:29:53.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.844+0000 7f3236b5d700 1 -- 172.21.15.69:0/2551377943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32301f3960 con 0x7f32300ce4e0 2023-11-17T06:29:53.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.844+0000 7f32267fc700 1 -- 172.21.15.69:0/2551377943 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3220007560 con 0x7f32300ce4e0 2023-11-17T06:29:53.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.844+0000 7f32267fc700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3214066510 0x7f32140689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:53.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.844+0000 7f32267fc700 1 -- 172.21.15.69:0/2551377943 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3220082e60 con 0x7f32300ce4e0 2023-11-17T06:29:53.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.844+0000 7f3235b5b700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3214066510 0x7f32140689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:53.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.848+0000 7f3235b5b700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3214066510 0x7f32140689d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f322c0021f0 tx=0x7f322c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:53.852+0000 7f32267fc700 1 -- 172.21.15.69:0/2551377943 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3220050620 con 0x7f32300ce4e0 2023-11-17T06:29:54.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.028+0000 7f3236b5d700 1 -- 172.21.15.69:0/2551377943 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f32300b9000 con 0x7f32300ce4e0 2023-11-17T06:29:54.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.032+0000 7f32267fc700 1 -- 172.21.15.69:0/2551377943 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+65 (secure 0 0 0) 0x7f32300b9000 con 0x7f32300ce4e0 2023-11-17T06:29:54.036 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:29:54.036 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2023-11-17T06:29:54.036 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:29:54.036 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 1, 2023-11-17T06:29:54.036 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": ".mgr" 2023-11-17T06:29:54.036 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:29:54.036 INFO:teuthology.orchestra.run.smithi069.stdout:] 2023-11-17T06:29:54.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 -- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3214066510 msgr2=0x7f32140689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3214066510 0x7f32140689d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f322c0021f0 tx=0x7f322c009040 comp rx=0 tx=0).stop 2023-11-17T06:29:54.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 -- 172.21.15.69:0/2551377943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32300ce4e0 msgr2=0x7f32300cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32300ce4e0 0x7f32300cc9b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f322000c780 tx=0x7f322000ca90 comp rx=0 tx=0).stop 2023-11-17T06:29:54.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 -- 172.21.15.69:0/2551377943 shutdown_connections 2023-11-17T06:29:54.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3214066510 0x7f32140689d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f323015d490 0x7f32300ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32300ce4e0 0x7f32300cc9b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 --2- 172.21.15.69:0/2551377943 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32300b8bc0 0x7f32301493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 -- 172.21.15.69:0/2551377943 >> 172.21.15.69:0/2551377943 conn(0x7f323006ab40 msgr2=0x7f32300b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:54.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 -- 172.21.15.69:0/2551377943 shutdown_connections 2023-11-17T06:29:54.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.036+0000 7f3236b5d700 1 -- 172.21.15.69:0/2551377943 wait complete. 2023-11-17T06:29:54.063 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-17T06:29:54.064 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-17T06:29:54.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.236+0000 7f1e59305700 1 Processor -- start 2023-11-17T06:29:54.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.236+0000 7f1e59305700 1 -- start start 2023-11-17T06:29:54.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e59305700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e5415d380 0x7f1e540cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e59305700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1e540d36a0 0x7f1e54166da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e59305700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e540d0930 con 0x7f1e540cfdf0 2023-11-17T06:29:54.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e59305700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e540cee50 con 0x7f1e540d36a0 2023-11-17T06:29:54.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e59305700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540d0370 con 0x7f1e5415d380 2023-11-17T06:29:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e58b04700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1e540d36a0 0x7f1e54166da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e58b04700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1e540d36a0 0x7f1e54166da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53062/0 (socket says 172.21.15.69:53062) 2023-11-17T06:29:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e58b04700 1 -- 172.21.15.69:0/2542400921 learned_addr learned my addr 172.21.15.69:0/2542400921 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:54.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e53fff700 1 --2- 172.21.15.69:0/2542400921 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e5415d380 0x7f1e540cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e58b04700 1 -- 172.21.15.69:0/2542400921 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e5415d380 msgr2=0x7f1e540cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e58b04700 1 --2- 172.21.15.69:0/2542400921 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e5415d380 0x7f1e540cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e58b04700 1 -- 172.21.15.69:0/2542400921 >> v1:172.21.15.69:6789/0 conn(0x7f1e540cfdf0 legacy=0x7f1e540d2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e58b04700 1 -- 172.21.15.69:0/2542400921 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540d0650 con 0x7f1e540d36a0 2023-11-17T06:29:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e53fff700 1 --2- 172.21.15.69:0/2542400921 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e5415d380 0x7f1e540cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:29:54.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e58b04700 1 --2- 172.21.15.69:0/2542400921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540d36a0 0x7f1e54166da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009e50 tx=0x7f1e4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c32c0ab7f44c8d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e52ffd700 1 -- 172.21.15.69:0/2542400921 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00e070 con 0x7f1e540d36a0 2023-11-17T06:29:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e52ffd700 1 -- 172.21.15.69:0/2542400921 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c00b9c0 con 0x7f1e540d36a0 2023-11-17T06:29:54.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e52ffd700 1 -- 172.21.15.69:0/2542400921 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c00bd70 con 0x7f1e540d36a0 2023-11-17T06:29:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e59305700 1 -- 172.21.15.69:0/2542400921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540d36a0 msgr2=0x7f1e54166da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.240+0000 7f1e59305700 1 --2- 172.21.15.69:0/2542400921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540d36a0 0x7f1e54166da0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c009e50 tx=0x7f1e4c00b330 comp rx=0 tx=0).stop 2023-11-17T06:29:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 -- 172.21.15.69:0/2542400921 shutdown_connections 2023-11-17T06:29:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 --2- 172.21.15.69:0/2542400921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540d36a0 0x7f1e54166da0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 --2- 172.21.15.69:0/2542400921 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e5415d380 0x7f1e540cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 -- 172.21.15.69:0/2542400921 >> 172.21.15.69:0/2542400921 conn(0x7f1e5406ab80 msgr2=0x7f1e5406af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 -- 172.21.15.69:0/2542400921 shutdown_connections 2023-11-17T06:29:54.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 -- 172.21.15.69:0/2542400921 wait complete. 2023-11-17T06:29:54.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 Processor -- start 2023-11-17T06:29:54.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 -- start start 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540cfdf0 0x7f1e54152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e540d36a0 0x7f1e541503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5415d380 0x7f1e54157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540cc170 con 0x7f1e540cfdf0 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540cb880 con 0x7f1e5415d380 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e59305700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54150920 con 0x7f1e540d36a0 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.244+0000 7f1e53fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540cfdf0 0x7f1e54152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e53fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540cfdf0 0x7f1e54152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53064/0 (socket says 172.21.15.69:53064) 2023-11-17T06:29:54.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e53fff700 1 -- 172.21.15.69:0/1705828413 learned_addr learned my addr 172.21.15.69:0/1705828413 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:54.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e58b04700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5415d380 0x7f1e54157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e537fe700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e540d36a0 0x7f1e541503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e53fff700 1 -- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e540d36a0 msgr2=0x7f1e541503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e53fff700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e540d36a0 0x7f1e541503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e53fff700 1 -- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5415d380 msgr2=0x7f1e54157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:54.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e53fff700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5415d380 0x7f1e54157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:54.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e53fff700 1 -- 172.21.15.69:0/1705828413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e4c009b30 con 0x7f1e540cfdf0 2023-11-17T06:29:54.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e53fff700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540cfdf0 0x7f1e54152740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400e760 tx=0x7f1e4400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e50ff9700 1 -- 172.21.15.69:0/1705828413 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e44004230 con 0x7f1e540cfdf0 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e50ff9700 1 -- 172.21.15.69:0/1705828413 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e44004390 con 0x7f1e540cfdf0 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e50ff9700 1 -- 172.21.15.69:0/1705828413 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e440036c0 con 0x7f1e540cfdf0 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e59305700 1 -- 172.21.15.69:0/1705828413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e54150bc0 con 0x7f1e540cfdf0 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e59305700 1 -- 172.21.15.69:0/1705828413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e540cbe00 con 0x7f1e540cfdf0 2023-11-17T06:29:54.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.248+0000 7f1e59305700 1 -- 172.21.15.69:0/1705828413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5404eea0 con 0x7f1e540cfdf0 2023-11-17T06:29:54.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.252+0000 7f1e50ff9700 1 -- 172.21.15.69:0/1705828413 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1e44003840 con 0x7f1e540cfdf0 2023-11-17T06:29:54.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.252+0000 7f1e50ff9700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1e40066510 0x7f1e400689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:54.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.252+0000 7f1e50ff9700 1 -- 172.21.15.69:0/1705828413 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1e44083510 con 0x7f1e540cfdf0 2023-11-17T06:29:54.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.256+0000 7f1e537fe700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1e40066510 0x7f1e400689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:54.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.256+0000 7f1e537fe700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1e40066510 0x7f1e400689d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e540d3d60 tx=0x7f1e48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:54.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.260+0000 7f1e50ff9700 1 -- 172.21.15.69:0/1705828413 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1e44050cd0 con 0x7f1e540cfdf0 2023-11-17T06:29:54.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:54.436+0000 7f1e59305700 1 -- 172.21.15.69:0/1705828413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1e540b6ba0 con 0x7f1e540cfdf0 2023-11-17T06:29:55.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.096+0000 7f1e50ff9700 1 -- 172.21.15.69:0/1705828413 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1e440094e0 con 0x7f1e540cfdf0 2023-11-17T06:29:55.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 -- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1e40066510 msgr2=0x7f1e400689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1e40066510 0x7f1e400689d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1e540d3d60 tx=0x7f1e48009040 comp rx=0 tx=0).stop 2023-11-17T06:29:55.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 -- 172.21.15.69:0/1705828413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540cfdf0 msgr2=0x7f1e54152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540cfdf0 0x7f1e54152740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1e4400e760 tx=0x7f1e4400ea70 comp rx=0 tx=0).stop 2023-11-17T06:29:55.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 -- 172.21.15.69:0/1705828413 shutdown_connections 2023-11-17T06:29:55.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1e40066510 0x7f1e400689d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1e5415d380 0x7f1e54157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1e540d36a0 0x7f1e541503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 --2- 172.21.15.69:0/1705828413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e540cfdf0 0x7f1e54152740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 -- 172.21.15.69:0/1705828413 >> 172.21.15.69:0/1705828413 conn(0x7f1e5406ab80 msgr2=0x7f1e541600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:55.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 -- 172.21.15.69:0/1705828413 shutdown_connections 2023-11-17T06:29:55.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.104+0000 7f1e59305700 1 -- 172.21.15.69:0/1705828413 wait complete. 2023-11-17T06:29:55.112 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' created 2023-11-17T06:29:55.136 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-17T06:29:55.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c69860700 1 Processor -- start 2023-11-17T06:29:55.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c69860700 1 -- start start 2023-11-17T06:29:55.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c69860700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c640ca5f0 0x7f5c6415e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c69860700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5c6406c120 0x7f5c640ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c69860700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c640cca50 con 0x7f5c640c94d0 2023-11-17T06:29:55.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c69860700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6415a670 con 0x7f5c6406c120 2023-11-17T06:29:55.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c69860700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6415ebb0 con 0x7f5c640ca5f0 2023-11-17T06:29:55.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c5bfff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5c6406c120 0x7f5c640ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c62ffd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c640ca5f0 0x7f5c6415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c62ffd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c640ca5f0 0x7f5c6415e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:34818/0 (socket says 172.21.15.69:34818) 2023-11-17T06:29:55.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c62ffd700 1 -- 172.21.15.69:0/1449190813 learned_addr learned my addr 172.21.15.69:0/1449190813 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:55.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.324+0000 7f5c637fe700 1 --1- 172.21.15.69:0/1449190813 >> v1:172.21.15.93:6789/0 conn(0x7f5c640c94d0 0x7f5c640c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:34386/0 (socket says 172.21.15.69:34386) 2023-11-17T06:29:55.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c62ffd700 1 -- 172.21.15.69:0/1449190813 >> v2:172.21.15.93:3300/0 conn(0x7f5c6406c120 msgr2=0x7f5c640ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:55.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c62ffd700 1 --2- 172.21.15.69:0/1449190813 >> v2:172.21.15.93:3300/0 conn(0x7f5c6406c120 0x7f5c640ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c62ffd700 1 -- 172.21.15.69:0/1449190813 >> v1:172.21.15.93:6789/0 conn(0x7f5c640c94d0 legacy=0x7f5c640c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c62ffd700 1 -- 172.21.15.69:0/1449190813 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6415b470 con 0x7f5c640ca5f0 2023-11-17T06:29:55.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c62ffd700 1 --2- 172.21.15.69:0/1449190813 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c640ca5f0 0x7f5c6415e670 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009910 tx=0x7f5c54009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50ffae1dc003085b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:55.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c627fc700 1 -- 172.21.15.69:0/1449190813 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54011830 con 0x7f5c640ca5f0 2023-11-17T06:29:55.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c627fc700 1 -- 172.21.15.69:0/1449190813 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c54011990 con 0x7f5c640ca5f0 2023-11-17T06:29:55.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c627fc700 1 -- 172.21.15.69:0/1449190813 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54011d40 con 0x7f5c640ca5f0 2023-11-17T06:29:55.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c69860700 1 -- 172.21.15.69:0/1449190813 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c640ca5f0 msgr2=0x7f5c6415e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c69860700 1 --2- 172.21.15.69:0/1449190813 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c640ca5f0 0x7f5c6415e670 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5c54009910 tx=0x7f5c54009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:55.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c69860700 1 -- 172.21.15.69:0/1449190813 shutdown_connections 2023-11-17T06:29:55.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c69860700 1 --2- 172.21.15.69:0/1449190813 >> v2:172.21.15.93:3300/0 conn(0x7f5c6406c120 0x7f5c640ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c69860700 1 --2- 172.21.15.69:0/1449190813 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c640ca5f0 0x7f5c6415e670 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c69860700 1 -- 172.21.15.69:0/1449190813 >> 172.21.15.69:0/1449190813 conn(0x7f5c640cee80 msgr2=0x7f5c640cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:55.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c69860700 1 -- 172.21.15.69:0/1449190813 shutdown_connections 2023-11-17T06:29:55.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.328+0000 7f5c69860700 1 -- 172.21.15.69:0/1449190813 wait complete. 2023-11-17T06:29:55.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.332+0000 7f5c69860700 1 Processor -- start 2023-11-17T06:29:55.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.332+0000 7f5c69860700 1 -- start start 2023-11-17T06:29:55.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c69860700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c6406c120 0x7f5c64155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c69860700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5c640c94d0 0x7f5c64155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c69860700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c640ca5f0 0x7f5c640c3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c69860700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64155d80 con 0x7f5c640ca5f0 2023-11-17T06:29:55.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c69860700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640ae780 con 0x7f5c640c94d0 2023-11-17T06:29:55.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c69860700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640c4780 con 0x7f5c6406c120 2023-11-17T06:29:55.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c640ca5f0 0x7f5c640c3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c5bfff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5c640c94d0 0x7f5c64155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c62ffd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c6406c120 0x7f5c64155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c640ca5f0 0x7f5c640c3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53066/0 (socket says 172.21.15.69:53066) 2023-11-17T06:29:55.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c637fe700 1 -- 172.21.15.69:0/1433953234 learned_addr learned my addr 172.21.15.69:0/1433953234 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c637fe700 1 -- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c6406c120 msgr2=0x7f5c64155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c637fe700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c6406c120 0x7f5c64155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c637fe700 1 -- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5c640c94d0 msgr2=0x7f5c64155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c637fe700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5c640c94d0 0x7f5c64155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c637fe700 1 -- 172.21.15.69:0/1433953234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54009570 con 0x7f5c640ca5f0 2023-11-17T06:29:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c62ffd700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c6406c120 0x7f5c64155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:55.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c5bfff700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5c640c94d0 0x7f5c64155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:55.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c637fe700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c640ca5f0 0x7f5c640c3ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00cbd0 tx=0x7f5c5c00cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:55.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c60ff9700 1 -- 172.21.15.69:0/1433953234 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c00aaa0 con 0x7f5c640ca5f0 2023-11-17T06:29:55.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c60ff9700 1 -- 172.21.15.69:0/1433953234 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c00ac00 con 0x7f5c640ca5f0 2023-11-17T06:29:55.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c69860700 1 -- 172.21.15.69:0/1433953234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c640c4a60 con 0x7f5c640ca5f0 2023-11-17T06:29:55.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c60ff9700 1 -- 172.21.15.69:0/1433953234 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c007070 con 0x7f5c640ca5f0 2023-11-17T06:29:55.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.336+0000 7f5c69860700 1 -- 172.21.15.69:0/1433953234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c640c5020 con 0x7f5c640ca5f0 2023-11-17T06:29:55.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.340+0000 7f5c69860700 1 -- 172.21.15.69:0/1433953234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c640ae940 con 0x7f5c640ca5f0 2023-11-17T06:29:55.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.340+0000 7f5c60ff9700 1 -- 172.21.15.69:0/1433953234 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5c5c0071d0 con 0x7f5c640ca5f0 2023-11-17T06:29:55.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.344+0000 7f5c60ff9700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5c48066510 0x7f5c480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:55.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.344+0000 7f5c60ff9700 1 -- 172.21.15.69:0/1433953234 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5c5c083920 con 0x7f5c640ca5f0 2023-11-17T06:29:55.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.344+0000 7f5c62ffd700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5c48066510 0x7f5c480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:55.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.344+0000 7f5c62ffd700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5c48066510 0x7f5c480689d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c54000c00 tx=0x7f5c54008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:55.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.348+0000 7f5c60ff9700 1 -- 172.21.15.69:0/1433953234 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5c5c050fa0 con 0x7f5c640ca5f0 2023-11-17T06:29:55.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:55.532+0000 7f5c69860700 1 -- 172.21.15.69:0/1433953234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5c64073f00 con 0x7f5c640ca5f0 2023-11-17T06:29:56.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.112+0000 7f5c60ff9700 1 -- 172.21.15.69:0/1433953234 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5c5c0545c0 con 0x7f5c640ca5f0 2023-11-17T06:29:56.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.120+0000 7f5c69860700 1 -- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5c48066510 msgr2=0x7f5c480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.120+0000 7f5c69860700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5c48066510 0x7f5c480689d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5c54000c00 tx=0x7f5c54008030 comp rx=0 tx=0).stop 2023-11-17T06:29:56.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.120+0000 7f5c69860700 1 -- 172.21.15.69:0/1433953234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c640ca5f0 msgr2=0x7f5c640c3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.120+0000 7f5c69860700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c640ca5f0 0x7f5c640c3ab0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c00cbd0 tx=0x7f5c5c00cee0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.120+0000 7f5c69860700 1 -- 172.21.15.69:0/1433953234 shutdown_connections 2023-11-17T06:29:56.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.120+0000 7f5c69860700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5c48066510 0x7f5c480689d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.120+0000 7f5c69860700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c640ca5f0 0x7f5c640c3ab0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.120+0000 7f5c69860700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5c640c94d0 0x7f5c64155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.120+0000 7f5c69860700 1 --2- 172.21.15.69:0/1433953234 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5c6406c120 0x7f5c64155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.120+0000 7f5c69860700 1 -- 172.21.15.69:0/1433953234 >> 172.21.15.69:0/1433953234 conn(0x7f5c640cee80 msgr2=0x7f5c640cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:56.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.124+0000 7f5c69860700 1 -- 172.21.15.69:0/1433953234 shutdown_connections 2023-11-17T06:29:56.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.124+0000 7f5c69860700 1 -- 172.21.15.69:0/1433953234 wait complete. 2023-11-17T06:29:56.135 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' created 2023-11-17T06:29:56.168 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-17T06:29:56.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.340+0000 7f1176e08700 1 Processor -- start 2023-11-17T06:29:56.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.340+0000 7f1176e08700 1 -- start start 2023-11-17T06:29:56.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f11701612c0 0x7f11700c98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f11700b0cd0 0x7f11701616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1170161be0 0x7f11700cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11701470e0 con 0x7f11700b0cd0 2023-11-17T06:29:56.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11700cbb70 con 0x7f11701612c0 2023-11-17T06:29:56.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11700b1270 con 0x7f1170161be0 2023-11-17T06:29:56.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f11700b0cd0 0x7f11701616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f11700b0cd0 0x7f11701616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53080/0 (socket says 172.21.15.69:53080) 2023-11-17T06:29:56.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116ffff700 1 -- 172.21.15.69:0/3711407976 learned_addr learned my addr 172.21.15.69:0/3711407976 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:56.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1174ba4700 1 --2- 172.21.15.69:0/3711407976 >> v2:172.21.15.93:3300/0 conn(0x7f11701612c0 0x7f11700c98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116ffff700 1 -- 172.21.15.69:0/3711407976 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1170161be0 msgr2=0x7f11700cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:56.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116ffff700 1 --2- 172.21.15.69:0/3711407976 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1170161be0 0x7f11700cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116ffff700 1 -- 172.21.15.69:0/3711407976 >> v2:172.21.15.93:3300/0 conn(0x7f11701612c0 msgr2=0x7f11700c98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:56.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116ffff700 1 --2- 172.21.15.69:0/3711407976 >> v2:172.21.15.93:3300/0 conn(0x7f11701612c0 0x7f11700c98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116ffff700 1 -- 172.21.15.69:0/3711407976 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700b1550 con 0x7f11700b0cd0 2023-11-17T06:29:56.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116ffff700 1 --2- 172.21.15.69:0/3711407976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11700b0cd0 0x7f11701616a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11700d0350 tx=0x7f115c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec39bd05d481329 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:56.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116f7fe700 1 -- 172.21.15.69:0/3711407976 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c00b8a0 con 0x7f11700b0cd0 2023-11-17T06:29:56.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116f7fe700 1 -- 172.21.15.69:0/3711407976 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c00ba00 con 0x7f11700b0cd0 2023-11-17T06:29:56.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f116f7fe700 1 -- 172.21.15.69:0/3711407976 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c00bd90 con 0x7f11700b0cd0 2023-11-17T06:29:56.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 -- 172.21.15.69:0/3711407976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11700b0cd0 msgr2=0x7f11701616a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 --2- 172.21.15.69:0/3711407976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11700b0cd0 0x7f11701616a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f11700d0350 tx=0x7f115c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 -- 172.21.15.69:0/3711407976 shutdown_connections 2023-11-17T06:29:56.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 --2- 172.21.15.69:0/3711407976 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1170161be0 0x7f11700cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 --2- 172.21.15.69:0/3711407976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11700b0cd0 0x7f11701616a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.344+0000 7f1176e08700 1 --2- 172.21.15.69:0/3711407976 >> v2:172.21.15.93:3300/0 conn(0x7f11701612c0 0x7f11700c98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.348+0000 7f1176e08700 1 -- 172.21.15.69:0/3711407976 >> 172.21.15.69:0/3711407976 conn(0x7f117006c330 msgr2=0x7f117006c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:56.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.348+0000 7f1176e08700 1 -- 172.21.15.69:0/3711407976 shutdown_connections 2023-11-17T06:29:56.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.348+0000 7f1176e08700 1 -- 172.21.15.69:0/3711407976 wait complete. 2023-11-17T06:29:56.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.348+0000 7f1176e08700 1 Processor -- start 2023-11-17T06:29:56.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f1176e08700 1 -- start start 2023-11-17T06:29:56.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f1176e08700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11700b0cd0 0x7f11701f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f1176e08700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f11701612c0 0x7f1170144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f1176e08700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1170161be0 0x7f117014fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f1176e08700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170150430 con 0x7f1170161be0 2023-11-17T06:29:56.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f1176e08700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1170150710 con 0x7f11700b0cd0 2023-11-17T06:29:56.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f1176e08700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11701509f0 con 0x7f11701612c0 2023-11-17T06:29:56.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f11753a5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1170161be0 0x7f117014fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f11753a5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1170161be0 0x7f117014fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53088/0 (socket says 172.21.15.69:53088) 2023-11-17T06:29:56.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f11753a5700 1 -- 172.21.15.69:0/983233054 learned_addr learned my addr 172.21.15.69:0/983233054 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:56.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f1174ba4700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11700b0cd0 0x7f11701f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f116ffff700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f11701612c0 0x7f1170144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f11753a5700 1 -- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f11701612c0 msgr2=0x7f1170144110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f11753a5700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f11701612c0 0x7f1170144110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f11753a5700 1 -- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11700b0cd0 msgr2=0x7f11701f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:56.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f11753a5700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11700b0cd0 0x7f11701f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:56.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f11753a5700 1 -- 172.21.15.69:0/983233054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c009570 con 0x7f1170161be0 2023-11-17T06:29:56.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f11753a5700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1170161be0 0x7f117014fac0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f116800b970 tx=0x7f116800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:56.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f116d7fa700 1 -- 172.21.15.69:0/983233054 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116800c9b0 con 0x7f1170161be0 2023-11-17T06:29:56.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f116d7fa700 1 -- 172.21.15.69:0/983233054 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116800cb30 con 0x7f1170161be0 2023-11-17T06:29:56.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f1176e08700 1 -- 172.21.15.69:0/983233054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11701f64f0 con 0x7f1170161be0 2023-11-17T06:29:56.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.352+0000 7f116d7fa700 1 -- 172.21.15.69:0/983233054 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168014440 con 0x7f1170161be0 2023-11-17T06:29:56.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.356+0000 7f1176e08700 1 -- 172.21.15.69:0/983233054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11701f7230 con 0x7f1170161be0 2023-11-17T06:29:56.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.356+0000 7f1176e08700 1 -- 172.21.15.69:0/983233054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1170067c40 con 0x7f1170161be0 2023-11-17T06:29:56.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.360+0000 7f116d7fa700 1 -- 172.21.15.69:0/983233054 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f116801d3b0 con 0x7f1170161be0 2023-11-17T06:29:56.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.360+0000 7f116d7fa700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1154066510 0x7f11540689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:56.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.360+0000 7f116d7fa700 1 -- 172.21.15.69:0/983233054 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f1168083f90 con 0x7f1170161be0 2023-11-17T06:29:56.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.360+0000 7f1174ba4700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1154066510 0x7f11540689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:56.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.360+0000 7f1174ba4700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1154066510 0x7f11540689d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f116400b9d0 tx=0x7f1164008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:56.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.364+0000 7f116d7fa700 1 -- 172.21.15.69:0/983233054 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f11680514e0 con 0x7f1170161be0 2023-11-17T06:29:56.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:56.572+0000 7f1176e08700 1 -- 172.21.15.69:0/983233054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f11700b1800 con 0x7f1170161be0 2023-11-17T06:29:57.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.124+0000 7f116d7fa700 1 -- 172.21.15.69:0/983233054 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1168019020 con 0x7f1170161be0 2023-11-17T06:29:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 -- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1154066510 msgr2=0x7f11540689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1154066510 0x7f11540689d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f116400b9d0 tx=0x7f1164008040 comp rx=0 tx=0).stop 2023-11-17T06:29:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 -- 172.21.15.69:0/983233054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1170161be0 msgr2=0x7f117014fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1170161be0 0x7f117014fac0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f116800b970 tx=0x7f116800bd30 comp rx=0 tx=0).stop 2023-11-17T06:29:57.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 -- 172.21.15.69:0/983233054 shutdown_connections 2023-11-17T06:29:57.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1154066510 0x7f11540689d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1170161be0 0x7f117014fac0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f11701612c0 0x7f1170144110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 --2- 172.21.15.69:0/983233054 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11700b0cd0 0x7f11701f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 -- 172.21.15.69:0/983233054 >> 172.21.15.69:0/983233054 conn(0x7f117006c330 msgr2=0x7f11700cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 -- 172.21.15.69:0/983233054 shutdown_connections 2023-11-17T06:29:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.132+0000 7f1176e08700 1 -- 172.21.15.69:0/983233054 wait complete. 2023-11-17T06:29:57.142 INFO:teuthology.orchestra.run.smithi069.stderr:new fs with metadata pool 2 and data pool 3 2023-11-17T06:29:57.159 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:57.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.332+0000 7fb49da67700 1 Processor -- start 2023-11-17T06:29:57.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.332+0000 7fb49da67700 1 -- start start 2023-11-17T06:29:57.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb49da67700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb49815d980 0x7fb4980b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb49da67700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980b5270 0x7fb4980d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb49da67700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4980b6750 con 0x7fb4980d1ca0 2023-11-17T06:29:57.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb49da67700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4980d2a30 con 0x7fb49815d980 2023-11-17T06:29:57.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb49da67700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980b6980 con 0x7fb4980b5270 2023-11-17T06:29:57.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb4977fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb49815d980 0x7fb4980b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb496ffd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980b5270 0x7fb4980d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb4977fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb49815d980 0x7fb4980b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:42370/0 (socket says 172.21.15.69:42370) 2023-11-17T06:29:57.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb4977fe700 1 -- 172.21.15.69:0/125828103 learned_addr learned my addr 172.21.15.69:0/125828103 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:57.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb497fff700 1 --1- 172.21.15.69:0/125828103 >> v1:172.21.15.93:6789/0 conn(0x7fb4980d1ca0 0x7fb49806ab00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:34388/0 (socket says 172.21.15.69:34388) 2023-11-17T06:29:57.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb4967fc700 1 -- 172.21.15.69:0/125828103 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079751807 0 0) 0x7fb4980b6750 con 0x7fb4980d1ca0 2023-11-17T06:29:57.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb4967fc700 1 -- 172.21.15.69:0/125828103 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4800035d0 con 0x7fb4980d1ca0 2023-11-17T06:29:57.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb4977fe700 1 -- 172.21.15.69:0/125828103 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980b5270 msgr2=0x7fb4980d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:57.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb4977fe700 1 --2- 172.21.15.69:0/125828103 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980b5270 0x7fb4980d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb4977fe700 1 -- 172.21.15.69:0/125828103 >> v1:172.21.15.93:6789/0 conn(0x7fb4980d1ca0 legacy=0x7fb49806ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb4977fe700 1 -- 172.21.15.69:0/125828103 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4980b56d0 con 0x7fb49815d980 2023-11-17T06:29:57.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb496ffd700 1 --2- 172.21.15.69:0/125828103 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980b5270 0x7fb4980d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.336+0000 7fb4977fe700 1 --2- 172.21.15.69:0/125828103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb49815d980 0x7fb4980b4d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb488009910 tx=0x7fb488009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bdebd3d29399aee server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb4967fc700 1 -- 172.21.15.69:0/125828103 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488011830 con 0x7fb49815d980 2023-11-17T06:29:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb4967fc700 1 -- 172.21.15.69:0/125828103 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb488011990 con 0x7fb49815d980 2023-11-17T06:29:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb4967fc700 1 -- 172.21.15.69:0/125828103 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb488011d40 con 0x7fb49815d980 2023-11-17T06:29:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb49da67700 1 -- 172.21.15.69:0/125828103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb49815d980 msgr2=0x7fb4980b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb49da67700 1 --2- 172.21.15.69:0/125828103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb49815d980 0x7fb4980b4d30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb488009910 tx=0x7fb488009c20 comp rx=0 tx=0).stop 2023-11-17T06:29:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb49da67700 1 -- 172.21.15.69:0/125828103 shutdown_connections 2023-11-17T06:29:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb49da67700 1 --2- 172.21.15.69:0/125828103 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980b5270 0x7fb4980d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb49da67700 1 --2- 172.21.15.69:0/125828103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb49815d980 0x7fb4980b4d30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb49da67700 1 -- 172.21.15.69:0/125828103 >> 172.21.15.69:0/125828103 conn(0x7fb4980cfd30 msgr2=0x7fb4980d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb49da67700 1 -- 172.21.15.69:0/125828103 shutdown_connections 2023-11-17T06:29:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb49da67700 1 -- 172.21.15.69:0/125828103 wait complete. 2023-11-17T06:29:57.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.340+0000 7fb49da67700 1 Processor -- start 2023-11-17T06:29:57.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb49da67700 1 -- start start 2023-11-17T06:29:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb49da67700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4980b5270 0x7fb4981f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb49da67700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980d1ca0 0x7fb4980ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb49da67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4980cf080 0x7fb4980aa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb49da67700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4980cf510 con 0x7fb4980cf080 2023-11-17T06:29:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb49da67700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49815ef10 con 0x7fb4980b5270 2023-11-17T06:29:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb49da67700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49815f1f0 con 0x7fb4980d1ca0 2023-11-17T06:29:57.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb497fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4980cf080 0x7fb4980aa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb497fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4980cf080 0x7fb4980aa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53092/0 (socket says 172.21.15.69:53092) 2023-11-17T06:29:57.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb497fff700 1 -- 172.21.15.69:0/1712176233 learned_addr learned my addr 172.21.15.69:0/1712176233 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:57.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb496ffd700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980d1ca0 0x7fb4980ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb4977fe700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4980b5270 0x7fb4981f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb497fff700 1 -- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980d1ca0 msgr2=0x7fb4980ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb497fff700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980d1ca0 0x7fb4980ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb497fff700 1 -- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4980b5270 msgr2=0x7fb4981f3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb497fff700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4980b5270 0x7fb4981f3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb497fff700 1 -- 172.21.15.69:0/1712176233 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c0094b0 con 0x7fb4980cf080 2023-11-17T06:29:57.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb497fff700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4980cf080 0x7fb4980aa3e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb49000cbc0 tx=0x7fb49000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:57.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb47ffff700 1 -- 172.21.15.69:0/1712176233 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000aa40 con 0x7fb4980cf080 2023-11-17T06:29:57.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb47ffff700 1 -- 172.21.15.69:0/1712176233 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49000aba0 con 0x7fb4980cf080 2023-11-17T06:29:57.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb47ffff700 1 -- 172.21.15.69:0/1712176233 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490007070 con 0x7fb4980cf080 2023-11-17T06:29:57.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.344+0000 7fb49da67700 1 -- 172.21.15.69:0/1712176233 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb488009570 con 0x7fb4980cf080 2023-11-17T06:29:57.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.348+0000 7fb49da67700 1 -- 172.21.15.69:0/1712176233 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49815f7b0 con 0x7fb4980cf080 2023-11-17T06:29:57.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.348+0000 7fb49da67700 1 -- 172.21.15.69:0/1712176233 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb498073f00 con 0x7fb4980cf080 2023-11-17T06:29:57.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.348+0000 7fb47ffff700 1 -- 172.21.15.69:0/1712176233 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb4900071d0 con 0x7fb4980cf080 2023-11-17T06:29:57.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.352+0000 7fb47ffff700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb484066510 0x7fb4840689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.352+0000 7fb47ffff700 1 -- 172.21.15.69:0/1712176233 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb490083b40 con 0x7fb4980cf080 2023-11-17T06:29:57.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.352+0000 7fb4977fe700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb484066510 0x7fb4840689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.352+0000 7fb4977fe700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb484066510 0x7fb4840689d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb488009c60 tx=0x7fb488008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:57.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.360+0000 7fb47ffff700 1 -- 172.21.15.69:0/1712176233 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb490051050 con 0x7fb4980cf080 2023-11-17T06:29:57.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.528+0000 7fb49da67700 1 -- 172.21.15.69:0/1712176233 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4980c9c90 con 0x7fb4980cf080 2023-11-17T06:29:57.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.532+0000 7fb47ffff700 1 -- 172.21.15.69:0/1712176233 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16438 (secure 0 0 0) 0x7fb490017020 con 0x7fb4980cf080 2023-11-17T06:29:57.537 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:29:57.537 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:56.575794+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:57.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 -- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb484066510 msgr2=0x7fb4840689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb484066510 0x7fb4840689d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb488009c60 tx=0x7fb488008030 comp rx=0 tx=0).stop 2023-11-17T06:29:57.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 -- 172.21.15.69:0/1712176233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4980cf080 msgr2=0x7fb4980aa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4980cf080 0x7fb4980aa3e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb49000cbc0 tx=0x7fb49000ced0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 -- 172.21.15.69:0/1712176233 shutdown_connections 2023-11-17T06:29:57.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb484066510 0x7fb4840689d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4980cf080 0x7fb4980aa3e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4980d1ca0 0x7fb4980ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 --2- 172.21.15.69:0/1712176233 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4980b5270 0x7fb4981f3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 -- 172.21.15.69:0/1712176233 >> 172.21.15.69:0/1712176233 conn(0x7fb4980cfd30 msgr2=0x7fb4980cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:57.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 -- 172.21.15.69:0/1712176233 shutdown_connections 2023-11-17T06:29:57.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.536+0000 7fb49da67700 1 -- 172.21.15.69:0/1712176233 wait complete. 2023-11-17T06:29:57.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:29:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.736+0000 7fc37cd4a700 1 Processor -- start 2023-11-17T06:29:57.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.736+0000 7fc37cd4a700 1 -- start start 2023-11-17T06:29:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.736+0000 7fc37cd4a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3780c21a0 0x7fc37806c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.736+0000 7fc37cd4a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc3781652b0 0x7fc378165710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.736+0000 7fc37cd4a700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc37806c200 con 0x7fc3780cb7e0 2023-11-17T06:29:57.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.736+0000 7fc37cd4a700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3781662c0 con 0x7fc3781652b0 2023-11-17T06:29:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.736+0000 7fc37cd4a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc378165d00 con 0x7fc3780c21a0 2023-11-17T06:29:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.736+0000 7fc377fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc3780cb7e0 0x7fc3780cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53338/0 (socket says 172.21.15.69:53338) 2023-11-17T06:29:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc377fff700 1 -- 172.21.15.69:0/2689816286 learned_addr learned my addr 172.21.15.69:0/2689816286 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:29:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3777fe700 1 --2- 172.21.15.69:0/2689816286 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3780c21a0 0x7fc37806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc376ffd700 1 --2- 172.21.15.69:0/2689816286 >> v2:172.21.15.93:3300/0 conn(0x7fc3781652b0 0x7fc378165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3767fc700 1 -- 172.21.15.69:0/2689816286 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715291906 0 0) 0x7fc37806c200 con 0x7fc3780cb7e0 2023-11-17T06:29:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3767fc700 1 -- 172.21.15.69:0/2689816286 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3600035d0 con 0x7fc3780cb7e0 2023-11-17T06:29:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3777fe700 1 -- 172.21.15.69:0/2689816286 >> v2:172.21.15.93:3300/0 conn(0x7fc3781652b0 msgr2=0x7fc378165710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3777fe700 1 --2- 172.21.15.69:0/2689816286 >> v2:172.21.15.93:3300/0 conn(0x7fc3781652b0 0x7fc378165710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3777fe700 1 -- 172.21.15.69:0/2689816286 >> v1:172.21.15.69:6789/0 conn(0x7fc3780cb7e0 legacy=0x7fc3780cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3777fe700 1 -- 172.21.15.69:0/2689816286 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc378165fe0 con 0x7fc3780c21a0 2023-11-17T06:29:57.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc376ffd700 1 --2- 172.21.15.69:0/2689816286 >> v2:172.21.15.93:3300/0 conn(0x7fc3781652b0 0x7fc378165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:57.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3777fe700 1 --2- 172.21.15.69:0/2689816286 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3780c21a0 0x7fc37806c690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc368009850 tx=0x7fc368009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=649c4e3311346330 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:57.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3767fc700 1 -- 172.21.15.69:0/2689816286 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368011830 con 0x7fc3780c21a0 2023-11-17T06:29:57.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3767fc700 1 -- 172.21.15.69:0/2689816286 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc368011990 con 0x7fc3780c21a0 2023-11-17T06:29:57.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc3767fc700 1 -- 172.21.15.69:0/2689816286 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368011d40 con 0x7fc3780c21a0 2023-11-17T06:29:57.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc37cd4a700 1 -- 172.21.15.69:0/2689816286 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3780c21a0 msgr2=0x7fc37806c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc37cd4a700 1 --2- 172.21.15.69:0/2689816286 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3780c21a0 0x7fc37806c690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc368009850 tx=0x7fc368009b60 comp rx=0 tx=0).stop 2023-11-17T06:29:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc37cd4a700 1 -- 172.21.15.69:0/2689816286 shutdown_connections 2023-11-17T06:29:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc37cd4a700 1 --2- 172.21.15.69:0/2689816286 >> v2:172.21.15.93:3300/0 conn(0x7fc3781652b0 0x7fc378165710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc37cd4a700 1 --2- 172.21.15.69:0/2689816286 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3780c21a0 0x7fc37806c690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.740+0000 7fc37cd4a700 1 -- 172.21.15.69:0/2689816286 >> 172.21.15.69:0/2689816286 conn(0x7fc3780b0900 msgr2=0x7fc3780b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.744+0000 7fc37cd4a700 1 -- 172.21.15.69:0/2689816286 shutdown_connections 2023-11-17T06:29:57.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.744+0000 7fc37cd4a700 1 -- 172.21.15.69:0/2689816286 wait complete. 2023-11-17T06:29:57.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.744+0000 7fc37cd4a700 1 Processor -- start 2023-11-17T06:29:57.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.744+0000 7fc37cd4a700 1 -- start start 2023-11-17T06:29:57.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc37cd4a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3780c21a0 0x7fc3781f75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc37cd4a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780cb7e0 0x7fc3780c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc37cd4a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3781652b0 0x7fc3780c4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc37cd4a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3780b0ce0 con 0x7fc3780c21a0 2023-11-17T06:29:57.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc37cd4a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3781f7150 con 0x7fc3780cb7e0 2023-11-17T06:29:57.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc37cd4a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3781f6b40 con 0x7fc3781652b0 2023-11-17T06:29:57.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc3777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3780c21a0 0x7fc3781f75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc3777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3780c21a0 0x7fc3781f75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53096/0 (socket says 172.21.15.69:53096) 2023-11-17T06:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc3777fe700 1 -- 172.21.15.69:0/3244437400 learned_addr learned my addr 172.21.15.69:0/3244437400 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc376ffd700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780cb7e0 0x7fc3780c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc377fff700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3781652b0 0x7fc3780c4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc3777fe700 1 -- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3781652b0 msgr2=0x7fc3780c4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc3777fe700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3781652b0 0x7fc3780c4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc3777fe700 1 -- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780cb7e0 msgr2=0x7fc3780c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc3777fe700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780cb7e0 0x7fc3780c2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc3777fe700 1 -- 172.21.15.69:0/3244437400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c0094b0 con 0x7fc3780c21a0 2023-11-17T06:29:57.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc3777fe700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3780c21a0 0x7fc3781f75e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc378165e40 tx=0x7fc368004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:57.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc35ffff700 1 -- 172.21.15.69:0/3244437400 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368004510 con 0x7fc3780c21a0 2023-11-17T06:29:57.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc35ffff700 1 -- 172.21.15.69:0/3244437400 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36801f070 con 0x7fc3780c21a0 2023-11-17T06:29:57.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc37cd4a700 1 -- 172.21.15.69:0/3244437400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3680094b0 con 0x7fc3780c21a0 2023-11-17T06:29:57.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc35ffff700 1 -- 172.21.15.69:0/3244437400 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368003900 con 0x7fc3780c21a0 2023-11-17T06:29:57.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.748+0000 7fc37cd4a700 1 -- 172.21.15.69:0/3244437400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3780b0f30 con 0x7fc3780c21a0 2023-11-17T06:29:57.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.752+0000 7fc37cd4a700 1 -- 172.21.15.69:0/3244437400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc378073f00 con 0x7fc3780c21a0 2023-11-17T06:29:57.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.752+0000 7fc35ffff700 1 -- 172.21.15.69:0/3244437400 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc368003a60 con 0x7fc3780c21a0 2023-11-17T06:29:57.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.752+0000 7fc35ffff700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc364066540 0x7fc364068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:57.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.752+0000 7fc35ffff700 1 -- 172.21.15.69:0/3244437400 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc368021070 con 0x7fc3780c21a0 2023-11-17T06:29:57.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.752+0000 7fc376ffd700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc364066540 0x7fc364068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:57.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.756+0000 7fc376ffd700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc364066540 0x7fc364068a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc378070fe0 tx=0x7fc36c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:57.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.756+0000 7fc35ffff700 1 -- 172.21.15.69:0/3244437400 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc3680529a0 con 0x7fc3780c21a0 2023-11-17T06:29:57.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.932+0000 7fc37cd4a700 1 -- 172.21.15.69:0/3244437400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3780b4d50 con 0x7fc3780c21a0 2023-11-17T06:29:57.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.936+0000 7fc35ffff700 1 -- 172.21.15.69:0/3244437400 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16438 (secure 0 0 0) 0x7fc368083e60 con 0x7fc3780c21a0 2023-11-17T06:29:57.941 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:29:57.941 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":22,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:56.575794+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:29:57.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 -- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc364066540 msgr2=0x7fc364068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc364066540 0x7fc364068a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc378070fe0 tx=0x7fc36c008040 comp rx=0 tx=0).stop 2023-11-17T06:29:57.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 -- 172.21.15.69:0/3244437400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3780c21a0 msgr2=0x7fc3781f75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:57.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3780c21a0 0x7fc3781f75e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc378165e40 tx=0x7fc368004770 comp rx=0 tx=0).stop 2023-11-17T06:29:57.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 -- 172.21.15.69:0/3244437400 shutdown_connections 2023-11-17T06:29:57.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc364066540 0x7fc364068a00 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3781652b0 0x7fc3780c4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3780cb7e0 0x7fc3780c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 --2- 172.21.15.69:0/3244437400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3780c21a0 0x7fc3781f75e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:57.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 -- 172.21.15.69:0/3244437400 >> 172.21.15.69:0/3244437400 conn(0x7fc3780b0900 msgr2=0x7fc37806fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:57.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 -- 172.21.15.69:0/3244437400 shutdown_connections 2023-11-17T06:29:57.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:57.940+0000 7fc37cd4a700 1 -- 172.21.15.69:0/3244437400 wait complete. 2023-11-17T06:29:57.965 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-17T06:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.140+0000 7fc439e14700 1 Processor -- start 2023-11-17T06:29:58.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.140+0000 7fc439e14700 1 -- start start 2023-11-17T06:29:58.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.140+0000 7fc439e14700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415d5a0 0x7fc4340cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.140+0000 7fc439e14700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc4340b2600 0x7fc4340d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.140+0000 7fc439e14700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4341621b0 con 0x7fc43415d980 2023-11-17T06:29:58.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.140+0000 7fc439e14700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc434161630 con 0x7fc4340b2600 2023-11-17T06:29:58.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.140+0000 7fc439e14700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc434161910 con 0x7fc43415d5a0 2023-11-17T06:29:58.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc438e12700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415d5a0 0x7fc4340cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc439613700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc4340b2600 0x7fc4340d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc438e12700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415d5a0 0x7fc4340cfb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:34878/0 (socket says 172.21.15.69:34878) 2023-11-17T06:29:58.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc438e12700 1 -- 172.21.15.69:0/2577773177 learned_addr learned my addr 172.21.15.69:0/2577773177 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc438e12700 1 -- 172.21.15.69:0/2577773177 >> v2:172.21.15.93:3300/0 conn(0x7fc4340b2600 msgr2=0x7fc4340d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc438e12700 1 --2- 172.21.15.69:0/2577773177 >> v2:172.21.15.93:3300/0 conn(0x7fc4340b2600 0x7fc4340d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc438e12700 1 -- 172.21.15.69:0/2577773177 >> v1:172.21.15.69:6789/0 conn(0x7fc43415d980 legacy=0x7fc4340b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc438e12700 1 -- 172.21.15.69:0/2577773177 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc434161bf0 con 0x7fc43415d5a0 2023-11-17T06:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc439613700 1 --2- 172.21.15.69:0/2577773177 >> v2:172.21.15.93:3300/0 conn(0x7fc4340b2600 0x7fc4340d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc438e12700 1 --2- 172.21.15.69:0/2577773177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415d5a0 0x7fc4340cfb20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc430009e50 tx=0x7fc43000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcae8ad25b80a714 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc42b7fe700 1 -- 172.21.15.69:0/2577773177 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43000e070 con 0x7fc43415d5a0 2023-11-17T06:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc42b7fe700 1 -- 172.21.15.69:0/2577773177 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc43000b910 con 0x7fc43415d5a0 2023-11-17T06:29:58.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc42b7fe700 1 -- 172.21.15.69:0/2577773177 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43000bcc0 con 0x7fc43415d5a0 2023-11-17T06:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc439e14700 1 -- 172.21.15.69:0/2577773177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415d5a0 msgr2=0x7fc4340cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc439e14700 1 --2- 172.21.15.69:0/2577773177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415d5a0 0x7fc4340cfb20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc430009e50 tx=0x7fc43000b330 comp rx=0 tx=0).stop 2023-11-17T06:29:58.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc439e14700 1 -- 172.21.15.69:0/2577773177 shutdown_connections 2023-11-17T06:29:58.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc439e14700 1 --2- 172.21.15.69:0/2577773177 >> v2:172.21.15.93:3300/0 conn(0x7fc4340b2600 0x7fc4340d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc439e14700 1 --2- 172.21.15.69:0/2577773177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415d5a0 0x7fc4340cfb20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc439e14700 1 -- 172.21.15.69:0/2577773177 >> 172.21.15.69:0/2577773177 conn(0x7fc43406aca0 msgr2=0x7fc43406b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:58.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc439e14700 1 -- 172.21.15.69:0/2577773177 shutdown_connections 2023-11-17T06:29:58.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.144+0000 7fc439e14700 1 -- 172.21.15.69:0/2577773177 wait complete. 2023-11-17T06:29:58.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.148+0000 7fc439e14700 1 Processor -- start 2023-11-17T06:29:58.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.148+0000 7fc439e14700 1 -- start start 2023-11-17T06:29:58.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc439e14700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4340b2600 0x7fc434158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc439e14700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43415d5a0 0x7fc4340cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc439e14700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415f870 0x7fc43415fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc439e14700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc434160230 con 0x7fc4340b2600 2023-11-17T06:29:58.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc439e14700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4340c8ef0 con 0x7fc43415d5a0 2023-11-17T06:29:58.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc439e14700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4340c8320 con 0x7fc43415f870 2023-11-17T06:29:58.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc438e12700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4340b2600 0x7fc434158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc438e12700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4340b2600 0x7fc434158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53112/0 (socket says 172.21.15.69:53112) 2023-11-17T06:29:58.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc438e12700 1 -- 172.21.15.69:0/3126972528 learned_addr learned my addr 172.21.15.69:0/3126972528 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:58.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc439613700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415f870 0x7fc43415fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc42bfff700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43415d5a0 0x7fc4340cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc438e12700 1 -- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415f870 msgr2=0x7fc43415fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:58.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc438e12700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415f870 0x7fc43415fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc438e12700 1 -- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43415d5a0 msgr2=0x7fc4340cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:58.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc438e12700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43415d5a0 0x7fc4340cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:58.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc438e12700 1 -- 172.21.15.69:0/3126972528 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c0094b0 con 0x7fc4340b2600 2023-11-17T06:29:58.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc438e12700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4340b2600 0x7fc434158ba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc43000b370 tx=0x7fc430004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:58.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc4297fa700 1 -- 172.21.15.69:0/3126972528 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430004960 con 0x7fc4340b2600 2023-11-17T06:29:58.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc4297fa700 1 -- 172.21.15.69:0/3126972528 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4300092e0 con 0x7fc4340b2600 2023-11-17T06:29:58.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc439e14700 1 -- 172.21.15.69:0/3126972528 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc430009b30 con 0x7fc4340b2600 2023-11-17T06:29:58.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc4297fa700 1 -- 172.21.15.69:0/3126972528 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43001c680 con 0x7fc4340b2600 2023-11-17T06:29:58.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.152+0000 7fc439e14700 1 -- 172.21.15.69:0/3126972528 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4340c85c0 con 0x7fc4340b2600 2023-11-17T06:29:58.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.156+0000 7fc439e14700 1 -- 172.21.15.69:0/3126972528 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4340686a0 con 0x7fc4340b2600 2023-11-17T06:29:58.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.156+0000 7fc4297fa700 1 -- 172.21.15.69:0/3126972528 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc43001c7e0 con 0x7fc4340b2600 2023-11-17T06:29:58.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.156+0000 7fc4297fa700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc420066540 0x7fc420068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:58.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.156+0000 7fc4297fa700 1 -- 172.21.15.69:0/3126972528 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc430085730 con 0x7fc4340b2600 2023-11-17T06:29:58.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.156+0000 7fc42bfff700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc420066540 0x7fc420068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.160+0000 7fc42bfff700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc420066540 0x7fc420068a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc4340c68f0 tx=0x7fc424009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:58.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.164+0000 7fc4297fa700 1 -- 172.21.15.69:0/3126972528 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc430052c40 con 0x7fc4340b2600 2023-11-17T06:29:58.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:58.376+0000 7fc439e14700 1 -- 172.21.15.69:0/3126972528 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc4340d0e90 con 0x7fc4340b2600 2023-11-17T06:29:59.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.156+0000 7fc4297fa700 1 -- 172.21.15.69:0/3126972528 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc430056260 con 0x7fc4340b2600 2023-11-17T06:29:59.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 -- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc420066540 msgr2=0x7fc420068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc420066540 0x7fc420068a00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc4340c68f0 tx=0x7fc424009040 comp rx=0 tx=0).stop 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 -- 172.21.15.69:0/3126972528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4340b2600 msgr2=0x7fc434158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4340b2600 0x7fc434158ba0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc43000b370 tx=0x7fc430004af0 comp rx=0 tx=0).stop 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 -- 172.21.15.69:0/3126972528 shutdown_connections 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc420066540 0x7fc420068a00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc43415f870 0x7fc43415fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc43415d5a0 0x7fc4340cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 --2- 172.21.15.69:0/3126972528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4340b2600 0x7fc434158ba0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 -- 172.21.15.69:0/3126972528 >> 172.21.15.69:0/3126972528 conn(0x7fc43406aca0 msgr2=0x7fc43415c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 -- 172.21.15.69:0/3126972528 shutdown_connections 2023-11-17T06:29:59.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.160+0000 7fc439e14700 1 -- 172.21.15.69:0/3126972528 wait complete. 2023-11-17T06:29:59.188 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-17T06:29:59.188 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-17T06:29:59.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.372+0000 7fda6359e700 1 Processor -- start 2023-11-17T06:29:59.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.372+0000 7fda6359e700 1 -- start start 2023-11-17T06:29:59.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda6359e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fda640c21a0 0x7fda6406c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:59.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda6359e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda640cbef0 0x7fda640cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:59.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda6359e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6406c200 con 0x7fda641652b0 2023-11-17T06:29:59.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda6359e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda641662c0 con 0x7fda640c21a0 2023-11-17T06:29:59.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda6359e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda64165d00 con 0x7fda640cbef0 2023-11-17T06:29:59.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda5bfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fda641652b0 0x7fda640cb7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53356/0 (socket says 172.21.15.69:53356) 2023-11-17T06:29:59.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda5bfff700 1 -- 172.21.15.69:0/3194845946 learned_addr learned my addr 172.21.15.69:0/3194845946 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:29:59.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda62d9d700 1 --2- 172.21.15.69:0/3194845946 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda640cbef0 0x7fda640cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:59.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda6259c700 1 --2- 172.21.15.69:0/3194845946 >> v2:172.21.15.93:3300/0 conn(0x7fda640c21a0 0x7fda6406c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:59.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda61d9b700 1 -- 172.21.15.69:0/3194845946 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364740854 0 0) 0x7fda6406c200 con 0x7fda641652b0 2023-11-17T06:29:59.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda61d9b700 1 -- 172.21.15.69:0/3194845946 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda500035d0 con 0x7fda641652b0 2023-11-17T06:29:59.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda61d9b700 1 -- 172.21.15.69:0/3194845946 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2928446864 0 0) 0x7fda500035d0 con 0x7fda641652b0 2023-11-17T06:29:59.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda62d9d700 1 -- 172.21.15.69:0/3194845946 >> v2:172.21.15.93:3300/0 conn(0x7fda640c21a0 msgr2=0x7fda6406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:29:59.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda62d9d700 1 --2- 172.21.15.69:0/3194845946 >> v2:172.21.15.93:3300/0 conn(0x7fda640c21a0 0x7fda6406c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:59.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda62d9d700 1 -- 172.21.15.69:0/3194845946 >> v1:172.21.15.69:6789/0 conn(0x7fda641652b0 legacy=0x7fda640cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:59.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda62d9d700 1 -- 172.21.15.69:0/3194845946 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda64165fe0 con 0x7fda640cbef0 2023-11-17T06:29:59.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda62d9d700 1 --2- 172.21.15.69:0/3194845946 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda640cbef0 0x7fda640cc9a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009d90 tx=0x7fda5c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90f2109d447bc640 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:59.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda61d9b700 1 -- 172.21.15.69:0/3194845946 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00e070 con 0x7fda640cbef0 2023-11-17T06:29:59.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda61d9b700 1 -- 172.21.15.69:0/3194845946 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c003a40 con 0x7fda640cbef0 2023-11-17T06:29:59.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.376+0000 7fda61d9b700 1 -- 172.21.15.69:0/3194845946 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c001670 con 0x7fda640cbef0 2023-11-17T06:29:59.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.380+0000 7fda6359e700 1 -- 172.21.15.69:0/3194845946 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda640cbef0 msgr2=0x7fda640cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:59.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.380+0000 7fda6359e700 1 --2- 172.21.15.69:0/3194845946 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda640cbef0 0x7fda640cc9a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009d90 tx=0x7fda5c00b330 comp rx=0 tx=0).stop 2023-11-17T06:29:59.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.380+0000 7fda6359e700 1 -- 172.21.15.69:0/3194845946 shutdown_connections 2023-11-17T06:29:59.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.380+0000 7fda6359e700 1 --2- 172.21.15.69:0/3194845946 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda640cbef0 0x7fda640cc9a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:59.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.380+0000 7fda6359e700 1 --2- 172.21.15.69:0/3194845946 >> v2:172.21.15.93:3300/0 conn(0x7fda640c21a0 0x7fda6406c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:59.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.380+0000 7fda6359e700 1 -- 172.21.15.69:0/3194845946 >> 172.21.15.69:0/3194845946 conn(0x7fda640b0900 msgr2=0x7fda640b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:29:59.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.380+0000 7fda6359e700 1 -- 172.21.15.69:0/3194845946 shutdown_connections 2023-11-17T06:29:59.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.380+0000 7fda6359e700 1 -- 172.21.15.69:0/3194845946 wait complete. 2023-11-17T06:29:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6359e700 1 Processor -- start 2023-11-17T06:29:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6359e700 1 -- start start 2023-11-17T06:29:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6359e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda640c21a0 0x7fda640c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6359e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda640cbef0 0x7fda64152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6359e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda641652b0 0x7fda640c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6359e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640c2d90 con 0x7fda640cbef0 2023-11-17T06:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6359e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640c3070 con 0x7fda640c21a0 2023-11-17T06:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6359e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda640c3350 con 0x7fda641652b0 2023-11-17T06:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda640cbef0 0x7fda64152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda640cbef0 0x7fda64152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53126/0 (socket says 172.21.15.69:53126) 2023-11-17T06:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda5bfff700 1 -- 172.21.15.69:0/742493473 learned_addr learned my addr 172.21.15.69:0/742493473 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6259c700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda640c21a0 0x7fda640c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda62d9d700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda641652b0 0x7fda640c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:59.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda62d9d700 1 -- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda640c21a0 msgr2=0x7fda640c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda62d9d700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda640c21a0 0x7fda640c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda62d9d700 1 -- 172.21.15.69:0/742493473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda640cbef0 msgr2=0x7fda64152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda62d9d700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda640cbef0 0x7fda64152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda62d9d700 1 -- 172.21.15.69:0/742493473 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c009a70 con 0x7fda641652b0 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda5bfff700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda640cbef0 0x7fda64152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda62d9d700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda641652b0 0x7fda640c87e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda5c015000 tx=0x7fda5c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda5affd700 1 -- 172.21.15.69:0/742493473 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c0044c0 con 0x7fda641652b0 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda5affd700 1 -- 172.21.15.69:0/742493473 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c004640 con 0x7fda641652b0 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6359e700 1 -- 172.21.15.69:0/742493473 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda640c3630 con 0x7fda641652b0 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda5affd700 1 -- 172.21.15.69:0/742493473 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c012430 con 0x7fda641652b0 2023-11-17T06:29:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.384+0000 7fda6359e700 1 -- 172.21.15.69:0/742493473 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda640c4370 con 0x7fda641652b0 2023-11-17T06:29:59.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.388+0000 7fda6359e700 1 -- 172.21.15.69:0/742493473 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda640c31b0 con 0x7fda641652b0 2023-11-17T06:29:59.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.388+0000 7fda5affd700 1 -- 172.21.15.69:0/742493473 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fda5c012590 con 0x7fda641652b0 2023-11-17T06:29:59.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.392+0000 7fda5affd700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda44066540 0x7fda44068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:29:59.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.392+0000 7fda5affd700 1 -- 172.21.15.69:0/742493473 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda5c0859f0 con 0x7fda641652b0 2023-11-17T06:29:59.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.392+0000 7fda6259c700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda44066540 0x7fda44068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:29:59.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.392+0000 7fda6259c700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda44066540 0x7fda44068a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda54009bf0 tx=0x7fda54009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:29:59.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.400+0000 7fda5affd700 1 -- 172.21.15.69:0/742493473 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fda640c31b0 con 0x7fda641652b0 2023-11-17T06:29:59.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:29:59.612+0000 7fda6359e700 1 -- 172.21.15.69:0/742493473 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fda640c31b0 con 0x7fda641652b0 2023-11-17T06:30:00.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.160+0000 7fda5affd700 1 -- 172.21.15.69:0/742493473 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda640c31b0 con 0x7fda641652b0 2023-11-17T06:30:00.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.164+0000 7fda6359e700 1 -- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda44066540 msgr2=0x7fda44068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.164+0000 7fda6359e700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda44066540 0x7fda44068a00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda54009bf0 tx=0x7fda54009240 comp rx=0 tx=0).stop 2023-11-17T06:30:00.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.164+0000 7fda6359e700 1 -- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda641652b0 msgr2=0x7fda640c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.164+0000 7fda6359e700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda641652b0 0x7fda640c87e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fda5c015000 tx=0x7fda5c004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.168+0000 7fda6359e700 1 -- 172.21.15.69:0/742493473 shutdown_connections 2023-11-17T06:30:00.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.168+0000 7fda6359e700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda44066540 0x7fda44068a00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.168+0000 7fda6359e700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda641652b0 0x7fda640c87e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.168+0000 7fda6359e700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda640cbef0 0x7fda64152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.168+0000 7fda6359e700 1 --2- 172.21.15.69:0/742493473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda640c21a0 0x7fda640c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.168+0000 7fda6359e700 1 -- 172.21.15.69:0/742493473 >> 172.21.15.69:0/742493473 conn(0x7fda640b0900 msgr2=0x7fda640cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:00.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.168+0000 7fda6359e700 1 -- 172.21.15.69:0/742493473 shutdown_connections 2023-11-17T06:30:00.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.168+0000 7fda6359e700 1 -- 172.21.15.69:0/742493473 wait complete. 2023-11-17T06:30:00.196 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-17T06:30:00.196 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:30:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.368+0000 7fa85da72700 1 Processor -- start 2023-11-17T06:30:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.368+0000 7fa85da72700 1 -- start start 2023-11-17T06:30:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cdd40 0x7fa85806bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85806cf40 con 0x7fa8580cd960 2023-11-17T06:30:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa85806d1e0 con 0x7fa8580cea20 2023-11-17T06:30:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580703c0 con 0x7fa8580cdd40 2023-11-17T06:30:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85ca70700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa8580cd960 0x7fa8580d0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53368/0 (socket says 172.21.15.69:53368) 2023-11-17T06:30:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85ca70700 1 -- 172.21.15.69:0/3316435018 learned_addr learned my addr 172.21.15.69:0/3316435018 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84ffff700 1 --2- 172.21.15.69:0/3316435018 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cdd40 0x7fa85806bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84f7fe700 1 -- 172.21.15.69:0/3316435018 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246344425 0 0) 0x7fa85806d1e0 con 0x7fa8580cea20 2023-11-17T06:30:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84f7fe700 1 -- 172.21.15.69:0/3316435018 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8400035d0 con 0x7fa8580cea20 2023-11-17T06:30:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84f7fe700 1 -- 172.21.15.69:0/3316435018 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097355633 0 0) 0x7fa85806cf40 con 0x7fa8580cd960 2023-11-17T06:30:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84f7fe700 1 -- 172.21.15.69:0/3316435018 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa85806d1e0 con 0x7fa8580cd960 2023-11-17T06:30:00.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84ffff700 1 -- 172.21.15.69:0/3316435018 >> v1:172.21.15.93:6789/0 conn(0x7fa8580cea20 legacy=0x7fa8580cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84ffff700 1 -- 172.21.15.69:0/3316435018 >> v1:172.21.15.69:6789/0 conn(0x7fa8580cd960 legacy=0x7fa8580d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84ffff700 1 -- 172.21.15.69:0/3316435018 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8580706a0 con 0x7fa8580cdd40 2023-11-17T06:30:00.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84ffff700 1 --2- 172.21.15.69:0/3316435018 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cdd40 0x7fa85806bde0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa848009880 tx=0x7fa848009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34ccb884059b259 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:00.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84f7fe700 1 -- 172.21.15.69:0/3316435018 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848011830 con 0x7fa8580cdd40 2023-11-17T06:30:00.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84f7fe700 1 -- 172.21.15.69:0/3316435018 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa848011990 con 0x7fa8580cdd40 2023-11-17T06:30:00.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa84f7fe700 1 -- 172.21.15.69:0/3316435018 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848011d00 con 0x7fa8580cdd40 2023-11-17T06:30:00.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 -- 172.21.15.69:0/3316435018 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cdd40 msgr2=0x7fa85806bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 --2- 172.21.15.69:0/3316435018 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cdd40 0x7fa85806bde0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa848009880 tx=0x7fa848009b90 comp rx=0 tx=0).stop 2023-11-17T06:30:00.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 -- 172.21.15.69:0/3316435018 shutdown_connections 2023-11-17T06:30:00.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 --2- 172.21.15.69:0/3316435018 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cdd40 0x7fa85806bde0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 -- 172.21.15.69:0/3316435018 >> 172.21.15.69:0/3316435018 conn(0x7fa85806de60 msgr2=0x7fa85806e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:00.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 -- 172.21.15.69:0/3316435018 shutdown_connections 2023-11-17T06:30:00.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.372+0000 7fa85da72700 1 -- 172.21.15.69:0/3316435018 wait complete. 2023-11-17T06:30:00.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.376+0000 7fa85da72700 1 Processor -- start 2023-11-17T06:30:00.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.376+0000 7fa85da72700 1 -- start start 2023-11-17T06:30:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.376+0000 7fa85da72700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cd960 0x7fa8581f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.376+0000 7fa85da72700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8580cdd40 0x7fa85815c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.376+0000 7fa85da72700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8580cea20 0x7fa8580b2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.376+0000 7fa85da72700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580ca300 con 0x7fa8580cdd40 2023-11-17T06:30:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.376+0000 7fa85da72700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8581f38c0 con 0x7fa8580cea20 2023-11-17T06:30:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.376+0000 7fa85da72700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580c9260 con 0x7fa8580cd960 2023-11-17T06:30:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.376+0000 7fa84ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8580cdd40 0x7fa85815c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8580cdd40 0x7fa85815c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53136/0 (socket says 172.21.15.69:53136) 2023-11-17T06:30:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84ffff700 1 -- 172.21.15.69:0/2154188686 learned_addr learned my addr 172.21.15.69:0/2154188686 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:00.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa85ca70700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cd960 0x7fa8581f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa85d271700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8580cea20 0x7fa8580b2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84ffff700 1 -- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cd960 msgr2=0x7fa8581f3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84ffff700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cd960 0x7fa8581f3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84ffff700 1 -- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8580cea20 msgr2=0x7fa8580b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84ffff700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8580cea20 0x7fa8580b2300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84ffff700 1 -- 172.21.15.69:0/2154188686 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8480094b0 con 0x7fa8580cdd40 2023-11-17T06:30:00.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa85d271700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8580cea20 0x7fa8580b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:00.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84ffff700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8580cdd40 0x7fa85815c6c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8480090b0 tx=0x7fa848004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:00.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84d7fa700 1 -- 172.21.15.69:0/2154188686 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848004590 con 0x7fa8580cdd40 2023-11-17T06:30:00.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84d7fa700 1 -- 172.21.15.69:0/2154188686 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8480036c0 con 0x7fa8580cdd40 2023-11-17T06:30:00.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa85da72700 1 -- 172.21.15.69:0/2154188686 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8580c9540 con 0x7fa8580cdd40 2023-11-17T06:30:00.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa84d7fa700 1 -- 172.21.15.69:0/2154188686 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848003a70 con 0x7fa8580cdd40 2023-11-17T06:30:00.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa85da72700 1 -- 172.21.15.69:0/2154188686 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8580c9b00 con 0x7fa8580cdd40 2023-11-17T06:30:00.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.380+0000 7fa85da72700 1 -- 172.21.15.69:0/2154188686 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8580d1d80 con 0x7fa8580cdd40 2023-11-17T06:30:00.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.384+0000 7fa84d7fa700 1 -- 172.21.15.69:0/2154188686 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa848003bd0 con 0x7fa8580cdd40 2023-11-17T06:30:00.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.384+0000 7fa84d7fa700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa844066510 0x7fa8440689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.384+0000 7fa84d7fa700 1 -- 172.21.15.69:0/2154188686 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa848085350 con 0x7fa8580cdd40 2023-11-17T06:30:00.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.384+0000 7fa85ca70700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa844066510 0x7fa8440689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.388+0000 7fa85ca70700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa844066510 0x7fa8440689d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa854005930 tx=0x7fa854009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:00.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.388+0000 7fa84d7fa700 1 -- 172.21.15.69:0/2154188686 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa8480527c0 con 0x7fa8580cdd40 2023-11-17T06:30:00.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.600+0000 7fa85da72700 1 -- 172.21.15.69:0/2154188686 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa858073f00 con 0x7fa8580cdd40 2023-11-17T06:30:00.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa84d7fa700 1 -- 172.21.15.69:0/2154188686 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fa848055de0 con 0x7fa8580cdd40 2023-11-17T06:30:00.608 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:00.608 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/1178370379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1178370379},{"type":"v1","addr":"172.21.15.93:6835","nonce":1178370379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/2342979080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":2342979080},{"type":"v1","addr":"172.21.15.93:6837","nonce":2342979080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/1839590536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1839590536},{"type":"v1","addr":"172.21.15.69:6833","nonce":1839590536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:56.576603+0000","modified":"2023-11-17T06:29:59.616825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2440982410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2440982410},{"type":"v1","addr":"172.21.15.69:6835","nonce":2440982410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:30:00.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 -- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa844066510 msgr2=0x7fa8440689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa844066510 0x7fa8440689d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa854005930 tx=0x7fa854009040 comp rx=0 tx=0).stop 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 -- 172.21.15.69:0/2154188686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8580cdd40 msgr2=0x7fa85815c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8580cdd40 0x7fa85815c6c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa8480090b0 tx=0x7fa848004770 comp rx=0 tx=0).stop 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 -- 172.21.15.69:0/2154188686 shutdown_connections 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa844066510 0x7fa8440689d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa8580cea20 0x7fa8580b2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8580cdd40 0x7fa85815c6c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 --2- 172.21.15.69:0/2154188686 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa8580cd960 0x7fa8581f3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 -- 172.21.15.69:0/2154188686 >> 172.21.15.69:0/2154188686 conn(0x7fa85806de60 msgr2=0x7fa8581600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 -- 172.21.15.69:0/2154188686 shutdown_connections 2023-11-17T06:30:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.604+0000 7fa85da72700 1 -- 172.21.15.69:0/2154188686 wait complete. 2023-11-17T06:30:00.613 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-11-17T06:30:00.631 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:00.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.800+0000 7f54bab4b700 1 Processor -- start 2023-11-17T06:30:00.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.800+0000 7f54bab4b700 1 -- start start 2023-11-17T06:30:00.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.800+0000 7f54bab4b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54b40cc190 0x7f54b415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.800+0000 7f54bab4b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40b09e0 con 0x7f54b40cb400 2023-11-17T06:30:00.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54bab4b700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54b40b0cc0 con 0x7f54b40cb020 2023-11-17T06:30:00.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54bab4b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b415fd90 con 0x7f54b40cc190 2023-11-17T06:30:00.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54abfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f54b40cb400 0x7f54b40cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53374/0 (socket says 172.21.15.69:53374) 2023-11-17T06:30:00.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54abfff700 1 -- 172.21.15.69:0/2388934611 learned_addr learned my addr 172.21.15.69:0/2388934611 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:00.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54b90e8700 1 --2- 172.21.15.69:0/2388934611 >> v2:172.21.15.93:3300/0 conn(0x7f54b40cc190 0x7f54b415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666851603 0 0) 0x7f54b40b09e0 con 0x7f54b40cb400 2023-11-17T06:30:00.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f549c0035d0 con 0x7f54b40cb400 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703091343 0 0) 0x7f54b40b0cc0 con 0x7f54b40cb020 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b40b09e0 con 0x7f54b40cb020 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 346025480 0 0) 0x7f549c0035d0 con 0x7f54b40cb400 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 >> v2:172.21.15.93:3300/0 conn(0x7f54b40cc190 msgr2=0x7f54b415ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 --2- 172.21.15.69:0/2388934611 >> v2:172.21.15.93:3300/0 conn(0x7f54b40cc190 0x7f54b415ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 >> v1:172.21.15.93:6789/0 conn(0x7f54b40cb020 legacy=0x7f54b406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b40b0fa0 con 0x7f54b40cb400 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f54a4001670 con 0x7f54b40cb400 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 >> v1:172.21.15.69:6789/0 conn(0x7f54b40cb400 legacy=0x7f54b40cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f549c003c00 0x7f549c004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549c004870 0x7f549c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f549c005280 0x7f549c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b415fd90 con 0x7f549c004870 2023-11-17T06:30:00.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c00c1b0 con 0x7f549c003c00 2023-11-17T06:30:00.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c00c370 con 0x7f549c005280 2023-11-17T06:30:00.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54abfff700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549c004870 0x7f549c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54b88e7700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f549c003c00 0x7f549c004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54b90e8700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f549c005280 0x7f549c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54abfff700 1 -- 172.21.15.69:0/2388934611 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f549c005280 msgr2=0x7f549c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54abfff700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f549c005280 0x7f549c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54abfff700 1 -- 172.21.15.69:0/2388934611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f549c003c00 msgr2=0x7f549c004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54abfff700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f549c003c00 0x7f549c004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54abfff700 1 -- 172.21.15.69:0/2388934611 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c0035d0 con 0x7f549c004870 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.804+0000 7f54b90e8700 1 -- 172.21.15.69:0/2388934611 reap_dead start 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54abfff700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549c004870 0x7f549c004cf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54b40ae7f0 tx=0x7f549c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c25bedf53cc786 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a400cc30 con 0x7f549c004870 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a400cd90 con 0x7f549c004870 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54ab7fe700 1 -- 172.21.15.69:0/2388934611 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4005bc0 con 0x7f549c004870 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54bab4b700 1 -- 172.21.15.69:0/2388934611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549c004870 msgr2=0x7f549c004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54bab4b700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549c004870 0x7f549c004cf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f54b40ae7f0 tx=0x7f549c0058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54bab4b700 1 -- 172.21.15.69:0/2388934611 shutdown_connections 2023-11-17T06:30:00.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54bab4b700 1 --2- 172.21.15.69:0/2388934611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f549c004870 0x7f549c004cf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54bab4b700 1 -- 172.21.15.69:0/2388934611 >> 172.21.15.69:0/2388934611 conn(0x7f54b406a480 msgr2=0x7f54b406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:00.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54bab4b700 1 -- 172.21.15.69:0/2388934611 shutdown_connections 2023-11-17T06:30:00.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.808+0000 7f54bab4b700 1 -- 172.21.15.69:0/2388934611 wait complete. 2023-11-17T06:30:00.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54bab4b700 1 Processor -- start 2023-11-17T06:30:00.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54bab4b700 1 -- start start 2023-11-17T06:30:00.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54bab4b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f549c004870 0x7f54b41f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54bab4b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b40b4510 0x7f54b40b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54bab4b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f54b415a260 0x7f54b415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54bab4b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40b1660 con 0x7f54b40b4510 2023-11-17T06:30:00.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54bab4b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b415ac20 con 0x7f549c004870 2023-11-17T06:30:00.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54bab4b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b40c7da0 con 0x7f54b415a260 2023-11-17T06:30:00.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54abfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b40b4510 0x7f54b40b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54abfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b40b4510 0x7f54b40b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53162/0 (socket says 172.21.15.69:53162) 2023-11-17T06:30:00.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54b88e7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f549c004870 0x7f54b41f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54abfff700 1 -- 172.21.15.69:0/2391097497 learned_addr learned my addr 172.21.15.69:0/2391097497 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:00.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54b90e8700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f54b415a260 0x7f54b415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54abfff700 1 -- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f54b415a260 msgr2=0x7f54b415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54abfff700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f54b415a260 0x7f54b415a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54abfff700 1 -- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f549c004870 msgr2=0x7f54b41f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:00.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54abfff700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f549c004870 0x7f54b41f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:00.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.812+0000 7f54abfff700 1 -- 172.21.15.69:0/2391097497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b41f6f10 con 0x7f54b40b4510 2023-11-17T06:30:00.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.816+0000 7f54abfff700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b40b4510 0x7f54b40b4990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c180 tx=0x7f54a4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:00.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.816+0000 7f54a97fa700 1 -- 172.21.15.69:0/2391097497 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4007a90 con 0x7f54b40b4510 2023-11-17T06:30:00.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.816+0000 7f54a97fa700 1 -- 172.21.15.69:0/2391097497 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a4001430 con 0x7f54b40b4510 2023-11-17T06:30:00.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.816+0000 7f54bab4b700 1 -- 172.21.15.69:0/2391097497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b41f6390 con 0x7f54b40b4510 2023-11-17T06:30:00.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.816+0000 7f54a97fa700 1 -- 172.21.15.69:0/2391097497 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4004890 con 0x7f54b40b4510 2023-11-17T06:30:00.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.816+0000 7f54bab4b700 1 -- 172.21.15.69:0/2391097497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54b41f6950 con 0x7f54b40b4510 2023-11-17T06:30:00.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.816+0000 7f54bab4b700 1 -- 172.21.15.69:0/2391097497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b4073f00 con 0x7f54b40b4510 2023-11-17T06:30:00.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.820+0000 7f54a97fa700 1 -- 172.21.15.69:0/2391097497 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f54a4019070 con 0x7f54b40b4510 2023-11-17T06:30:00.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.820+0000 7f54a97fa700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54a0066590 0x7f54a0068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:00.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.820+0000 7f54a97fa700 1 -- 172.21.15.69:0/2391097497 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54a4084fb0 con 0x7f54b40b4510 2023-11-17T06:30:00.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.820+0000 7f54b88e7700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54a0066590 0x7f54a0068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:00.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.820+0000 7f54b88e7700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54a0066590 0x7f54a0068a50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54b0000c00 tx=0x7f54b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:00.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.824+0000 7f54a97fa700 1 -- 172.21.15.69:0/2391097497 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f54a40525c0 con 0x7f54b40b4510 2023-11-17T06:30:01.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:00.996+0000 7f54bab4b700 1 -- 172.21.15.69:0/2391097497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54b406c710 con 0x7f54b40b4510 2023-11-17T06:30:01.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.000+0000 7f54a97fa700 1 -- 172.21.15.69:0/2391097497 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f54a4055be0 con 0x7f54b40b4510 2023-11-17T06:30:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:01.003 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:58.004301+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:01.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 -- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54a0066590 msgr2=0x7f54a0068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54a0066590 0x7f54a0068a50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f54b0000c00 tx=0x7f54b0009040 comp rx=0 tx=0).stop 2023-11-17T06:30:01.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 -- 172.21.15.69:0/2391097497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b40b4510 msgr2=0x7f54b40b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b40b4510 0x7f54b40b4990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c180 tx=0x7f54a4001930 comp rx=0 tx=0).stop 2023-11-17T06:30:01.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 -- 172.21.15.69:0/2391097497 shutdown_connections 2023-11-17T06:30:01.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54a0066590 0x7f54a0068a50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f54b415a260 0x7f54b415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54b40b4510 0x7f54b40b4990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 --2- 172.21.15.69:0/2391097497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f549c004870 0x7f54b41f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 -- 172.21.15.69:0/2391097497 >> 172.21.15.69:0/2391097497 conn(0x7f54b406a480 msgr2=0x7f54b40ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:01.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 -- 172.21.15.69:0/2391097497 shutdown_connections 2023-11-17T06:30:01.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.004+0000 7f54bab4b700 1 -- 172.21.15.69:0/2391097497 wait complete. 2023-11-17T06:30:01.033 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-17T06:30:01.034 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:30:01.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.204+0000 7f7b5c807700 1 Processor -- start 2023-11-17T06:30:01.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.204+0000 7f7b5c807700 1 -- start start 2023-11-17T06:30:01.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.204+0000 7f7b5c807700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7b5815d420 0x7f7b580d16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.204+0000 7f7b5c807700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b580d1c30 0x7f7b580b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.204+0000 7f7b5c807700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b580d1540 con 0x7f7b580b3340 2023-11-17T06:30:01.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.204+0000 7f7b5c807700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b580b2970 con 0x7f7b5815d420 2023-11-17T06:30:01.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.204+0000 7f7b5c807700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580d2090 con 0x7f7b580d1c30 2023-11-17T06:30:01.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5759e700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7b580b3340 0x7f7b580b37b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53378/0 (socket says 172.21.15.69:53378) 2023-11-17T06:30:01.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5759e700 1 -- 172.21.15.69:0/2139386896 learned_addr learned my addr 172.21.15.69:0/2139386896 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:01.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b56d9d700 1 --2- 172.21.15.69:0/2139386896 >> v2:172.21.15.69:3300/0 conn(0x7f7b5815d420 0x7f7b580d16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b4e59c700 1 --2- 172.21.15.69:0/2139386896 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b580d1c30 0x7f7b580b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5659c700 1 -- 172.21.15.69:0/2139386896 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1659748668 0 0) 0x7f7b580d1540 con 0x7f7b580b3340 2023-11-17T06:30:01.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5659c700 1 -- 172.21.15.69:0/2139386896 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b440035d0 con 0x7f7b580b3340 2023-11-17T06:30:01.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5659c700 1 -- 172.21.15.69:0/2139386896 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1603162999 0 0) 0x7f7b440035d0 con 0x7f7b580b3340 2023-11-17T06:30:01.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b56d9d700 1 -- 172.21.15.69:0/2139386896 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b580d1c30 msgr2=0x7f7b580b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:01.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b56d9d700 1 --2- 172.21.15.69:0/2139386896 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b580d1c30 0x7f7b580b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b56d9d700 1 -- 172.21.15.69:0/2139386896 >> v1:172.21.15.69:6789/0 conn(0x7f7b580b3340 legacy=0x7f7b580b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b56d9d700 1 -- 172.21.15.69:0/2139386896 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b580d0d80 con 0x7f7b5815d420 2023-11-17T06:30:01.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b56d9d700 1 --2- 172.21.15.69:0/2139386896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5815d420 0x7f7b580d16f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009850 tx=0x7f7b48009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d90870120dd3b53 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:01.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5659c700 1 -- 172.21.15.69:0/2139386896 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b50001670 con 0x7f7b5815d420 2023-11-17T06:30:01.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5659c700 1 -- 172.21.15.69:0/2139386896 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b48004030 con 0x7f7b5815d420 2023-11-17T06:30:01.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5659c700 1 -- 172.21.15.69:0/2139386896 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b480043e0 con 0x7f7b5815d420 2023-11-17T06:30:01.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5c807700 1 -- 172.21.15.69:0/2139386896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5815d420 msgr2=0x7f7b580d16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5c807700 1 --2- 172.21.15.69:0/2139386896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5815d420 0x7f7b580d16f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b48009850 tx=0x7f7b48009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:01.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5c807700 1 -- 172.21.15.69:0/2139386896 shutdown_connections 2023-11-17T06:30:01.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5c807700 1 --2- 172.21.15.69:0/2139386896 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b580d1c30 0x7f7b580b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5c807700 1 --2- 172.21.15.69:0/2139386896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5815d420 0x7f7b580d16f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5c807700 1 -- 172.21.15.69:0/2139386896 >> 172.21.15.69:0/2139386896 conn(0x7f7b580d3110 msgr2=0x7f7b580d3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:01.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5c807700 1 -- 172.21.15.69:0/2139386896 shutdown_connections 2023-11-17T06:30:01.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.208+0000 7f7b5c807700 1 -- 172.21.15.69:0/2139386896 wait complete. 2023-11-17T06:30:01.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.212+0000 7f7b5c807700 1 Processor -- start 2023-11-17T06:30:01.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.212+0000 7f7b5c807700 1 -- start start 2023-11-17T06:30:01.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.212+0000 7f7b5c807700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b580b3340 0x7f7b580b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.212+0000 7f7b5c807700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b580d1c30 0x7f7b58155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.212+0000 7f7b5c807700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b5815d420 0x7f7b5815d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.212+0000 7f7b5c807700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580b7870 con 0x7f7b580d1c30 2023-11-17T06:30:01.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.212+0000 7f7b5c807700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580b7b50 con 0x7f7b580b3340 2023-11-17T06:30:01.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.212+0000 7f7b5c807700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b580b7e30 con 0x7f7b5815d420 2023-11-17T06:30:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.212+0000 7f7b4e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b580d1c30 0x7f7b58155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b580d1c30 0x7f7b58155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53180/0 (socket says 172.21.15.69:53180) 2023-11-17T06:30:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4e59c700 1 -- 172.21.15.69:0/1721321571 learned_addr learned my addr 172.21.15.69:0/1721321571 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b56d9d700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b580b3340 0x7f7b580b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b5759e700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b5815d420 0x7f7b5815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4e59c700 1 -- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b5815d420 msgr2=0x7f7b5815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4e59c700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b5815d420 0x7f7b5815d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4e59c700 1 -- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b580b3340 msgr2=0x7f7b580b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4e59c700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b580b3340 0x7f7b580b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4e59c700 1 -- 172.21.15.69:0/1721321571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480094b0 con 0x7f7b580d1c30 2023-11-17T06:30:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4e59c700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b580d1c30 0x7f7b58155880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000efc0 tx=0x7f7b4000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4ffff700 1 -- 172.21.15.69:0/1721321571 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4000cd10 con 0x7f7b580d1c30 2023-11-17T06:30:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4ffff700 1 -- 172.21.15.69:0/1721321571 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4000f040 con 0x7f7b580d1c30 2023-11-17T06:30:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b4ffff700 1 -- 172.21.15.69:0/1721321571 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b400146a0 con 0x7f7b580d1c30 2023-11-17T06:30:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b5c807700 1 -- 172.21.15.69:0/1721321571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b580b8110 con 0x7f7b580d1c30 2023-11-17T06:30:01.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b5c807700 1 -- 172.21.15.69:0/1721321571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b580b7540 con 0x7f7b580d1c30 2023-11-17T06:30:01.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.216+0000 7f7b5c807700 1 -- 172.21.15.69:0/1721321571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b58073f00 con 0x7f7b580d1c30 2023-11-17T06:30:01.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.220+0000 7f7b4ffff700 1 -- 172.21.15.69:0/1721321571 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7b40014800 con 0x7f7b580d1c30 2023-11-17T06:30:01.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.220+0000 7f7b4ffff700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7b38066510 0x7f7b380689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.220+0000 7f7b4ffff700 1 -- 172.21.15.69:0/1721321571 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b400845a0 con 0x7f7b580d1c30 2023-11-17T06:30:01.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.220+0000 7f7b56d9d700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7b38066510 0x7f7b380689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.224+0000 7f7b56d9d700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7b38066510 0x7f7b380689d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b480090b0 tx=0x7f7b48008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:01.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.224+0000 7f7b4ffff700 1 -- 172.21.15.69:0/1721321571 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7b40051ab0 con 0x7f7b580d1c30 2023-11-17T06:30:01.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.404+0000 7f7b5c807700 1 -- 172.21.15.69:0/1721321571 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b580d1060 con 0x7f7b38066510 2023-11-17T06:30:01.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.424+0000 7f7b4ffff700 1 -- 172.21.15.69:0/1721321571 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264460 (secure 0 0 0) 0x7f7b48004460 con 0x7f7b38066510 2023-11-17T06:30:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:01.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 -- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7b38066510 msgr2=0x7f7b380689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7b38066510 0x7f7b380689d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b480090b0 tx=0x7f7b48008030 comp rx=0 tx=0).stop 2023-11-17T06:30:01.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 -- 172.21.15.69:0/1721321571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b580d1c30 msgr2=0x7f7b58155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b580d1c30 0x7f7b58155880 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7b4000efc0 tx=0x7f7b4000c3a0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 -- 172.21.15.69:0/1721321571 shutdown_connections 2023-11-17T06:30:01.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7b38066510 0x7f7b380689d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7b5815d420 0x7f7b5815d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b580d1c30 0x7f7b58155880 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 --2- 172.21.15.69:0/1721321571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7b580b3340 0x7f7b580b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 -- 172.21.15.69:0/1721321571 >> 172.21.15.69:0/1721321571 conn(0x7f7b580d3110 msgr2=0x7f7b580b4ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:01.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 -- 172.21.15.69:0/1721321571 shutdown_connections 2023-11-17T06:30:01.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.432+0000 7f7b5c807700 1 -- 172.21.15.69:0/1721321571 wait complete. 2023-11-17T06:30:01.441 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:30:01.461 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-11-17T06:30:00.363262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219244,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755476,"statfs":{"total":773094113280,"available":772869607424,"internally_reserved":0,"allocated":3121152,"data_stored":1832844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.258040"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566813+0000","last_change":"2023-11-17T06:29:57.048765+0000","last_active":"2023-11-17T06:29:58.566813+0000","last_peered":"2023-11-17T06:29:58.566813+0000","last_clean":"2023-11-17T06:29:58.566813+0000","last_became_active":"2023-11-17T06:29:57.048355+0000","last_became_peered":"2023-11-17T06:29:57.048355+0000","last_unstale":"2023-11-17T06:29:58.566813+0000","last_undegraded":"2023-11-17T06:29:58.566813+0000","last_fullsized":"2023-11-17T06:29:58.566813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:56:31.946595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017546+0000","last_change":"2023-11-17T06:29:57.026689+0000","last_active":"2023-11-17T06:29:58.017546+0000","last_peered":"2023-11-17T06:29:58.017546+0000","last_clean":"2023-11-17T06:29:58.017546+0000","last_became_active":"2023-11-17T06:29:57.026110+0000","last_became_peered":"2023-11-17T06:29:57.026110+0000","last_unstale":"2023-11-17T06:29:58.017546+0000","last_undegraded":"2023-11-17T06:29:58.017546+0000","last_fullsized":"2023-11-17T06:29:58.017546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:13:19.132028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017185+0000","last_change":"2023-11-17T06:29:57.035489+0000","last_active":"2023-11-17T06:29:58.017185+0000","last_peered":"2023-11-17T06:29:58.017185+0000","last_clean":"2023-11-17T06:29:58.017185+0000","last_became_active":"2023-11-17T06:29:57.035039+0000","last_became_peered":"2023-11-17T06:29:57.035039+0000","last_unstale":"2023-11-17T06:29:58.017185+0000","last_undegraded":"2023-11-17T06:29:58.017185+0000","last_fullsized":"2023-11-17T06:29:58.017185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:33:15.530438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013600+0000","last_change":"2023-11-17T06:29:57.037868+0000","last_active":"2023-11-17T06:29:58.013600+0000","last_peered":"2023-11-17T06:29:58.013600+0000","last_clean":"2023-11-17T06:29:58.013600+0000","last_became_active":"2023-11-17T06:29:57.036721+0000","last_became_peered":"2023-11-17T06:29:57.036721+0000","last_unstale":"2023-11-17T06:29:58.013600+0000","last_undegraded":"2023-11-17T06:29:58.013600+0000","last_fullsized":"2023-11-17T06:29:58.013600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566412+0000","last_change":"2023-11-17T06:29:57.050034+0000","last_active":"2023-11-17T06:29:58.566412+0000","last_peered":"2023-11-17T06:29:58.566412+0000","last_clean":"2023-11-17T06:29:58.566412+0000","last_became_active":"2023-11-17T06:29:57.048335+0000","last_became_peered":"2023-11-17T06:29:57.048335+0000","last_unstale":"2023-11-17T06:29:58.566412+0000","last_undegraded":"2023-11-17T06:29:58.566412+0000","last_fullsized":"2023-11-17T06:29:58.566412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:00:33.615466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013438+0000","last_change":"2023-11-17T06:29:57.035919+0000","last_active":"2023-11-17T06:29:58.013438+0000","last_peered":"2023-11-17T06:29:58.013438+0000","last_clean":"2023-11-17T06:29:58.013438+0000","last_became_active":"2023-11-17T06:29:57.035533+0000","last_became_peered":"2023-11-17T06:29:57.035533+0000","last_unstale":"2023-11-17T06:29:58.013438+0000","last_undegraded":"2023-11-17T06:29:58.013438+0000","last_fullsized":"2023-11-17T06:29:58.013438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565360+0000","last_change":"2023-11-17T06:29:57.044538+0000","last_active":"2023-11-17T06:29:58.565360+0000","last_peered":"2023-11-17T06:29:58.565360+0000","last_clean":"2023-11-17T06:29:58.565360+0000","last_became_active":"2023-11-17T06:29:57.044209+0000","last_became_peered":"2023-11-17T06:29:57.044209+0000","last_unstale":"2023-11-17T06:29:58.565360+0000","last_undegraded":"2023-11-17T06:29:58.565360+0000","last_fullsized":"2023-11-17T06:29:58.565360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:36:15.068137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016567+0000","last_change":"2023-11-17T06:29:57.050415+0000","last_active":"2023-11-17T06:29:58.016567+0000","last_peered":"2023-11-17T06:29:58.016567+0000","last_clean":"2023-11-17T06:29:58.016567+0000","last_became_active":"2023-11-17T06:29:57.050130+0000","last_became_peered":"2023-11-17T06:29:57.050130+0000","last_unstale":"2023-11-17T06:29:58.016567+0000","last_undegraded":"2023-11-17T06:29:58.016567+0000","last_fullsized":"2023-11-17T06:29:58.016567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:10:40.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567762+0000","last_change":"2023-11-17T06:29:57.021824+0000","last_active":"2023-11-17T06:29:58.567762+0000","last_peered":"2023-11-17T06:29:58.567762+0000","last_clean":"2023-11-17T06:29:58.567762+0000","last_became_active":"2023-11-17T06:29:57.021520+0000","last_became_peered":"2023-11-17T06:29:57.021520+0000","last_unstale":"2023-11-17T06:29:58.567762+0000","last_undegraded":"2023-11-17T06:29:58.567762+0000","last_fullsized":"2023-11-17T06:29:58.567762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566326+0000","last_change":"2023-11-17T06:29:57.049308+0000","last_active":"2023-11-17T06:29:58.566326+0000","last_peered":"2023-11-17T06:29:58.566326+0000","last_clean":"2023-11-17T06:29:58.566326+0000","last_became_active":"2023-11-17T06:29:57.048874+0000","last_became_peered":"2023-11-17T06:29:57.048874+0000","last_unstale":"2023-11-17T06:29:58.566326+0000","last_undegraded":"2023-11-17T06:29:58.566326+0000","last_fullsized":"2023-11-17T06:29:58.566326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:53:02.810684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567455+0000","last_change":"2023-11-17T06:29:57.049230+0000","last_active":"2023-11-17T06:29:58.567455+0000","last_peered":"2023-11-17T06:29:58.567455+0000","last_clean":"2023-11-17T06:29:58.567455+0000","last_became_active":"2023-11-17T06:29:57.048585+0000","last_became_peered":"2023-11-17T06:29:57.048585+0000","last_unstale":"2023-11-17T06:29:58.567455+0000","last_undegraded":"2023-11-17T06:29:58.567455+0000","last_fullsized":"2023-11-17T06:29:58.567455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:24:12.818384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566673+0000","last_change":"2023-11-17T06:29:57.040860+0000","last_active":"2023-11-17T06:29:58.566673+0000","last_peered":"2023-11-17T06:29:58.566673+0000","last_clean":"2023-11-17T06:29:58.566673+0000","last_became_active":"2023-11-17T06:29:57.040400+0000","last_became_peered":"2023-11-17T06:29:57.040400+0000","last_unstale":"2023-11-17T06:29:58.566673+0000","last_undegraded":"2023-11-17T06:29:58.566673+0000","last_fullsized":"2023-11-17T06:29:58.566673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:38:04.919402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063054+0000","last_change":"2023-11-17T06:29:57.051422+0000","last_active":"2023-11-17T06:29:58.063054+0000","last_peered":"2023-11-17T06:29:58.063054+0000","last_clean":"2023-11-17T06:29:58.063054+0000","last_became_active":"2023-11-17T06:29:57.051220+0000","last_became_peered":"2023-11-17T06:29:57.051220+0000","last_unstale":"2023-11-17T06:29:58.063054+0000","last_undegraded":"2023-11-17T06:29:58.063054+0000","last_fullsized":"2023-11-17T06:29:58.063054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:25.572533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062869+0000","last_change":"2023-11-17T06:29:57.027124+0000","last_active":"2023-11-17T06:29:58.062869+0000","last_peered":"2023-11-17T06:29:58.062869+0000","last_clean":"2023-11-17T06:29:58.062869+0000","last_became_active":"2023-11-17T06:29:57.025556+0000","last_became_peered":"2023-11-17T06:29:57.025556+0000","last_unstale":"2023-11-17T06:29:58.062869+0000","last_undegraded":"2023-11-17T06:29:58.062869+0000","last_fullsized":"2023-11-17T06:29:58.062869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:46.928281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016155+0000","last_change":"2023-11-17T06:29:57.051705+0000","last_active":"2023-11-17T06:29:58.016155+0000","last_peered":"2023-11-17T06:29:58.016155+0000","last_clean":"2023-11-17T06:29:58.016155+0000","last_became_active":"2023-11-17T06:29:57.051139+0000","last_became_peered":"2023-11-17T06:29:57.051139+0000","last_unstale":"2023-11-17T06:29:58.016155+0000","last_undegraded":"2023-11-17T06:29:58.016155+0000","last_fullsized":"2023-11-17T06:29:58.016155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:43:38.839375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199207+0000","last_change":"2023-11-17T06:29:57.040316+0000","last_active":"2023-11-17T06:29:58.199207+0000","last_peered":"2023-11-17T06:29:58.199207+0000","last_clean":"2023-11-17T06:29:58.199207+0000","last_became_active":"2023-11-17T06:29:57.039952+0000","last_became_peered":"2023-11-17T06:29:57.039952+0000","last_unstale":"2023-11-17T06:29:58.199207+0000","last_undegraded":"2023-11-17T06:29:58.199207+0000","last_fullsized":"2023-11-17T06:29:58.199207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:08:15.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200121+0000","last_change":"2023-11-17T06:29:57.053274+0000","last_active":"2023-11-17T06:29:58.200121+0000","last_peered":"2023-11-17T06:29:58.200121+0000","last_clean":"2023-11-17T06:29:58.200121+0000","last_became_active":"2023-11-17T06:29:57.050580+0000","last_became_peered":"2023-11-17T06:29:57.050580+0000","last_unstale":"2023-11-17T06:29:58.200121+0000","last_undegraded":"2023-11-17T06:29:58.200121+0000","last_fullsized":"2023-11-17T06:29:58.200121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:40:22.670143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565972+0000","last_change":"2023-11-17T06:29:57.039046+0000","last_active":"2023-11-17T06:29:58.565972+0000","last_peered":"2023-11-17T06:29:58.565972+0000","last_clean":"2023-11-17T06:29:58.565972+0000","last_became_active":"2023-11-17T06:29:57.038686+0000","last_became_peered":"2023-11-17T06:29:57.038686+0000","last_unstale":"2023-11-17T06:29:58.565972+0000","last_undegraded":"2023-11-17T06:29:58.565972+0000","last_fullsized":"2023-11-17T06:29:58.565972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200277+0000","last_change":"2023-11-17T06:29:57.038796+0000","last_active":"2023-11-17T06:29:58.200277+0000","last_peered":"2023-11-17T06:29:58.200277+0000","last_clean":"2023-11-17T06:29:58.200277+0000","last_became_active":"2023-11-17T06:29:57.038343+0000","last_became_peered":"2023-11-17T06:29:57.038343+0000","last_unstale":"2023-11-17T06:29:58.200277+0000","last_undegraded":"2023-11-17T06:29:58.200277+0000","last_fullsized":"2023-11-17T06:29:58.200277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:31.062867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567003+0000","last_change":"2023-11-17T06:29:57.039524+0000","last_active":"2023-11-17T06:29:58.567003+0000","last_peered":"2023-11-17T06:29:58.567003+0000","last_clean":"2023-11-17T06:29:58.567003+0000","last_became_active":"2023-11-17T06:29:57.039223+0000","last_became_peered":"2023-11-17T06:29:57.039223+0000","last_unstale":"2023-11-17T06:29:58.567003+0000","last_undegraded":"2023-11-17T06:29:58.567003+0000","last_fullsized":"2023-11-17T06:29:58.567003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:42:16.411887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014811+0000","last_change":"2023-11-17T06:29:57.035054+0000","last_active":"2023-11-17T06:29:58.014811+0000","last_peered":"2023-11-17T06:29:58.014811+0000","last_clean":"2023-11-17T06:29:58.014811+0000","last_became_active":"2023-11-17T06:29:57.034678+0000","last_became_peered":"2023-11-17T06:29:57.034678+0000","last_unstale":"2023-11-17T06:29:58.014811+0000","last_undegraded":"2023-11-17T06:29:58.014811+0000","last_fullsized":"2023-11-17T06:29:58.014811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:56.074236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566287+0000","last_change":"2023-11-17T06:29:57.049846+0000","last_active":"2023-11-17T06:29:58.566287+0000","last_peered":"2023-11-17T06:29:58.566287+0000","last_clean":"2023-11-17T06:29:58.566287+0000","last_became_active":"2023-11-17T06:29:57.049537+0000","last_became_peered":"2023-11-17T06:29:57.049537+0000","last_unstale":"2023-11-17T06:29:58.566287+0000","last_undegraded":"2023-11-17T06:29:58.566287+0000","last_fullsized":"2023-11-17T06:29:58.566287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016429+0000","last_change":"2023-11-17T06:29:57.039185+0000","last_active":"2023-11-17T06:29:58.016429+0000","last_peered":"2023-11-17T06:29:58.016429+0000","last_clean":"2023-11-17T06:29:58.016429+0000","last_became_active":"2023-11-17T06:29:57.038833+0000","last_became_peered":"2023-11-17T06:29:57.038833+0000","last_unstale":"2023-11-17T06:29:58.016429+0000","last_undegraded":"2023-11-17T06:29:58.016429+0000","last_fullsized":"2023-11-17T06:29:58.016429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:35:36.870837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199139+0000","last_change":"2023-11-17T06:29:57.028933+0000","last_active":"2023-11-17T06:29:58.199139+0000","last_peered":"2023-11-17T06:29:58.199139+0000","last_clean":"2023-11-17T06:29:58.199139+0000","last_became_active":"2023-11-17T06:29:57.028654+0000","last_became_peered":"2023-11-17T06:29:57.028654+0000","last_unstale":"2023-11-17T06:29:58.199139+0000","last_undegraded":"2023-11-17T06:29:58.199139+0000","last_fullsized":"2023-11-17T06:29:58.199139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:44:58.041380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017531+0000","last_change":"2023-11-17T06:29:57.028712+0000","last_active":"2023-11-17T06:29:58.017531+0000","last_peered":"2023-11-17T06:29:58.017531+0000","last_clean":"2023-11-17T06:29:58.017531+0000","last_became_active":"2023-11-17T06:29:57.027965+0000","last_became_peered":"2023-11-17T06:29:57.027965+0000","last_unstale":"2023-11-17T06:29:58.017531+0000","last_undegraded":"2023-11-17T06:29:58.017531+0000","last_fullsized":"2023-11-17T06:29:58.017531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:15:20.965141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013827+0000","last_change":"2023-11-17T06:29:57.037004+0000","last_active":"2023-11-17T06:29:58.013827+0000","last_peered":"2023-11-17T06:29:58.013827+0000","last_clean":"2023-11-17T06:29:58.013827+0000","last_became_active":"2023-11-17T06:29:57.036152+0000","last_became_peered":"2023-11-17T06:29:57.036152+0000","last_unstale":"2023-11-17T06:29:58.013827+0000","last_undegraded":"2023-11-17T06:29:58.013827+0000","last_fullsized":"2023-11-17T06:29:58.013827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:28.425909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063473+0000","last_change":"2023-11-17T06:29:57.030368+0000","last_active":"2023-11-17T06:29:58.063473+0000","last_peered":"2023-11-17T06:29:58.063473+0000","last_clean":"2023-11-17T06:29:58.063473+0000","last_became_active":"2023-11-17T06:29:57.028975+0000","last_became_peered":"2023-11-17T06:29:57.028975+0000","last_unstale":"2023-11-17T06:29:58.063473+0000","last_undegraded":"2023-11-17T06:29:58.063473+0000","last_fullsized":"2023-11-17T06:29:58.063473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:53.263320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063141+0000","last_change":"2023-11-17T06:29:57.049939+0000","last_active":"2023-11-17T06:29:58.063141+0000","last_peered":"2023-11-17T06:29:58.063141+0000","last_clean":"2023-11-17T06:29:58.063141+0000","last_became_active":"2023-11-17T06:29:57.049684+0000","last_became_peered":"2023-11-17T06:29:57.049684+0000","last_unstale":"2023-11-17T06:29:58.063141+0000","last_undegraded":"2023-11-17T06:29:58.063141+0000","last_fullsized":"2023-11-17T06:29:58.063141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:56.074236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017151+0000","last_change":"2023-11-17T06:29:57.024239+0000","last_active":"2023-11-17T06:29:58.017151+0000","last_peered":"2023-11-17T06:29:58.017151+0000","last_clean":"2023-11-17T06:29:58.017151+0000","last_became_active":"2023-11-17T06:29:57.023966+0000","last_became_peered":"2023-11-17T06:29:57.023966+0000","last_unstale":"2023-11-17T06:29:58.017151+0000","last_undegraded":"2023-11-17T06:29:58.017151+0000","last_fullsized":"2023-11-17T06:29:58.017151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:53:17.880921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199372+0000","last_change":"2023-11-17T06:29:57.027928+0000","last_active":"2023-11-17T06:29:58.199372+0000","last_peered":"2023-11-17T06:29:58.199372+0000","last_clean":"2023-11-17T06:29:58.199372+0000","last_became_active":"2023-11-17T06:29:57.027636+0000","last_became_peered":"2023-11-17T06:29:57.027636+0000","last_unstale":"2023-11-17T06:29:58.199372+0000","last_undegraded":"2023-11-17T06:29:58.199372+0000","last_fullsized":"2023-11-17T06:29:58.199372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:24:12.818384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565276+0000","last_change":"2023-11-17T06:29:57.031701+0000","last_active":"2023-11-17T06:29:58.565276+0000","last_peered":"2023-11-17T06:29:58.565276+0000","last_clean":"2023-11-17T06:29:58.565276+0000","last_became_active":"2023-11-17T06:29:57.031397+0000","last_became_peered":"2023-11-17T06:29:57.031397+0000","last_unstale":"2023-11-17T06:29:58.565276+0000","last_undegraded":"2023-11-17T06:29:58.565276+0000","last_fullsized":"2023-11-17T06:29:58.565276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013173+0000","last_change":"2023-11-17T06:29:57.037976+0000","last_active":"2023-11-17T06:29:58.013173+0000","last_peered":"2023-11-17T06:29:58.013173+0000","last_clean":"2023-11-17T06:29:58.013173+0000","last_became_active":"2023-11-17T06:29:57.036999+0000","last_became_peered":"2023-11-17T06:29:57.036999+0000","last_unstale":"2023-11-17T06:29:58.013173+0000","last_undegraded":"2023-11-17T06:29:58.013173+0000","last_fullsized":"2023-11-17T06:29:58.013173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:54.949043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566569+0000","last_change":"2023-11-17T06:29:57.028161+0000","last_active":"2023-11-17T06:29:58.566569+0000","last_peered":"2023-11-17T06:29:58.566569+0000","last_clean":"2023-11-17T06:29:58.566569+0000","last_became_active":"2023-11-17T06:29:57.027719+0000","last_became_peered":"2023-11-17T06:29:57.027719+0000","last_unstale":"2023-11-17T06:29:58.566569+0000","last_undegraded":"2023-11-17T06:29:58.566569+0000","last_fullsized":"2023-11-17T06:29:58.566569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017219+0000","last_change":"2023-11-17T06:29:56.148518+0000","last_active":"2023-11-17T06:29:58.017219+0000","last_peered":"2023-11-17T06:29:58.017219+0000","last_clean":"2023-11-17T06:29:58.017219+0000","last_became_active":"2023-11-17T06:29:56.148230+0000","last_became_peered":"2023-11-17T06:29:56.148230+0000","last_unstale":"2023-11-17T06:29:58.017219+0000","last_undegraded":"2023-11-17T06:29:58.017219+0000","last_fullsized":"2023-11-17T06:29:58.017219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:41:17.136054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015028+0000","last_change":"2023-11-17T06:29:57.052500+0000","last_active":"2023-11-17T06:29:58.015028+0000","last_peered":"2023-11-17T06:29:58.015028+0000","last_clean":"2023-11-17T06:29:58.015028+0000","last_became_active":"2023-11-17T06:29:57.052003+0000","last_became_peered":"2023-11-17T06:29:57.052003+0000","last_unstale":"2023-11-17T06:29:58.015028+0000","last_undegraded":"2023-11-17T06:29:58.015028+0000","last_fullsized":"2023-11-17T06:29:58.015028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:18.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199730+0000","last_change":"2023-11-17T06:29:56.155235+0000","last_active":"2023-11-17T06:29:58.199730+0000","last_peered":"2023-11-17T06:29:58.199730+0000","last_clean":"2023-11-17T06:29:58.199730+0000","last_became_active":"2023-11-17T06:29:56.154957+0000","last_became_peered":"2023-11-17T06:29:56.154957+0000","last_unstale":"2023-11-17T06:29:58.199730+0000","last_undegraded":"2023-11-17T06:29:58.199730+0000","last_fullsized":"2023-11-17T06:29:58.199730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:16.431952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062637+0000","last_change":"2023-11-17T06:29:56.156231+0000","last_active":"2023-11-17T06:29:58.062637+0000","last_peered":"2023-11-17T06:29:58.062637+0000","last_clean":"2023-11-17T06:29:58.062637+0000","last_became_active":"2023-11-17T06:29:56.155931+0000","last_became_peered":"2023-11-17T06:29:56.155931+0000","last_unstale":"2023-11-17T06:29:58.062637+0000","last_undegraded":"2023-11-17T06:29:58.062637+0000","last_fullsized":"2023-11-17T06:29:58.062637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:38.948788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016874+0000","last_change":"2023-11-17T06:29:57.033651+0000","last_active":"2023-11-17T06:29:58.016874+0000","last_peered":"2023-11-17T06:29:58.016874+0000","last_clean":"2023-11-17T06:29:58.016874+0000","last_became_active":"2023-11-17T06:29:57.030915+0000","last_became_peered":"2023-11-17T06:29:57.030915+0000","last_unstale":"2023-11-17T06:29:58.016874+0000","last_undegraded":"2023-11-17T06:29:58.016874+0000","last_fullsized":"2023-11-17T06:29:58.016874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:04:42.619958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199317+0000","last_change":"2023-11-17T06:29:56.137466+0000","last_active":"2023-11-17T06:29:58.199317+0000","last_peered":"2023-11-17T06:29:58.199317+0000","last_clean":"2023-11-17T06:29:58.199317+0000","last_became_active":"2023-11-17T06:29:56.137116+0000","last_became_peered":"2023-11-17T06:29:56.137116+0000","last_unstale":"2023-11-17T06:29:58.199317+0000","last_undegraded":"2023-11-17T06:29:58.199317+0000","last_fullsized":"2023-11-17T06:29:58.199317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:45.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016060+0000","last_change":"2023-11-17T06:29:57.029054+0000","last_active":"2023-11-17T06:29:58.016060+0000","last_peered":"2023-11-17T06:29:58.016060+0000","last_clean":"2023-11-17T06:29:58.016060+0000","last_became_active":"2023-11-17T06:29:57.028739+0000","last_became_peered":"2023-11-17T06:29:57.028739+0000","last_unstale":"2023-11-17T06:29:58.016060+0000","last_undegraded":"2023-11-17T06:29:58.016060+0000","last_fullsized":"2023-11-17T06:29:58.016060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:17.448030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567805+0000","last_change":"2023-11-17T06:29:56.145242+0000","last_active":"2023-11-17T06:29:58.567805+0000","last_peered":"2023-11-17T06:29:58.567805+0000","last_clean":"2023-11-17T06:29:58.567805+0000","last_became_active":"2023-11-17T06:29:56.144329+0000","last_became_peered":"2023-11-17T06:29:56.144329+0000","last_unstale":"2023-11-17T06:29:58.567805+0000","last_undegraded":"2023-11-17T06:29:58.567805+0000","last_fullsized":"2023-11-17T06:29:58.567805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:53.932965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014039+0000","last_change":"2023-11-17T06:29:57.036204+0000","last_active":"2023-11-17T06:29:58.014039+0000","last_peered":"2023-11-17T06:29:58.014039+0000","last_clean":"2023-11-17T06:29:58.014039+0000","last_became_active":"2023-11-17T06:29:57.035669+0000","last_became_peered":"2023-11-17T06:29:57.035669+0000","last_unstale":"2023-11-17T06:29:58.014039+0000","last_undegraded":"2023-11-17T06:29:58.014039+0000","last_fullsized":"2023-11-17T06:29:58.014039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566699+0000","last_change":"2023-11-17T06:29:56.155411+0000","last_active":"2023-11-17T06:29:58.566699+0000","last_peered":"2023-11-17T06:29:58.566699+0000","last_clean":"2023-11-17T06:29:58.566699+0000","last_became_active":"2023-11-17T06:29:56.154619+0000","last_became_peered":"2023-11-17T06:29:56.154619+0000","last_unstale":"2023-11-17T06:29:58.566699+0000","last_undegraded":"2023-11-17T06:29:58.566699+0000","last_fullsized":"2023-11-17T06:29:58.566699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:52.247242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017631+0000","last_change":"2023-11-17T06:29:57.025598+0000","last_active":"2023-11-17T06:29:58.017631+0000","last_peered":"2023-11-17T06:29:58.017631+0000","last_clean":"2023-11-17T06:29:58.017631+0000","last_became_active":"2023-11-17T06:29:57.025303+0000","last_became_peered":"2023-11-17T06:29:57.025303+0000","last_unstale":"2023-11-17T06:29:58.017631+0000","last_undegraded":"2023-11-17T06:29:58.017631+0000","last_fullsized":"2023-11-17T06:29:58.017631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:36:40.100721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565504+0000","last_change":"2023-11-17T06:29:56.149115+0000","last_active":"2023-11-17T06:29:58.565504+0000","last_peered":"2023-11-17T06:29:58.565504+0000","last_clean":"2023-11-17T06:29:58.565504+0000","last_became_active":"2023-11-17T06:29:56.147653+0000","last_became_peered":"2023-11-17T06:29:56.147653+0000","last_unstale":"2023-11-17T06:29:58.565504+0000","last_undegraded":"2023-11-17T06:29:58.565504+0000","last_fullsized":"2023-11-17T06:29:58.565504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:38:11.759914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199421+0000","last_change":"2023-11-17T06:29:57.034094+0000","last_active":"2023-11-17T06:29:58.199421+0000","last_peered":"2023-11-17T06:29:58.199421+0000","last_clean":"2023-11-17T06:29:58.199421+0000","last_became_active":"2023-11-17T06:29:57.033817+0000","last_became_peered":"2023-11-17T06:29:57.033817+0000","last_unstale":"2023-11-17T06:29:58.199421+0000","last_undegraded":"2023-11-17T06:29:58.199421+0000","last_fullsized":"2023-11-17T06:29:58.199421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:30:22.132748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013489+0000","last_change":"2023-11-17T06:29:56.143656+0000","last_active":"2023-11-17T06:29:58.013489+0000","last_peered":"2023-11-17T06:29:58.013489+0000","last_clean":"2023-11-17T06:29:58.013489+0000","last_became_active":"2023-11-17T06:29:56.140088+0000","last_became_peered":"2023-11-17T06:29:56.140088+0000","last_unstale":"2023-11-17T06:29:58.013489+0000","last_undegraded":"2023-11-17T06:29:58.013489+0000","last_fullsized":"2023-11-17T06:29:58.013489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:38:11.759914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567240+0000","last_change":"2023-11-17T06:29:57.051158+0000","last_active":"2023-11-17T06:29:58.567240+0000","last_peered":"2023-11-17T06:29:58.567240+0000","last_clean":"2023-11-17T06:29:58.567240+0000","last_became_active":"2023-11-17T06:29:57.049255+0000","last_became_peered":"2023-11-17T06:29:57.049255+0000","last_unstale":"2023-11-17T06:29:58.567240+0000","last_undegraded":"2023-11-17T06:29:58.567240+0000","last_fullsized":"2023-11-17T06:29:58.567240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:08:15.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565414+0000","last_change":"2023-11-17T06:29:56.154434+0000","last_active":"2023-11-17T06:29:58.565414+0000","last_peered":"2023-11-17T06:29:58.565414+0000","last_clean":"2023-11-17T06:29:58.565414+0000","last_became_active":"2023-11-17T06:29:56.154071+0000","last_became_peered":"2023-11-17T06:29:56.154071+0000","last_unstale":"2023-11-17T06:29:58.565414+0000","last_undegraded":"2023-11-17T06:29:58.565414+0000","last_fullsized":"2023-11-17T06:29:58.565414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:35:22.859890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062922+0000","last_change":"2023-11-17T06:29:57.028693+0000","last_active":"2023-11-17T06:29:58.062922+0000","last_peered":"2023-11-17T06:29:58.062922+0000","last_clean":"2023-11-17T06:29:58.062922+0000","last_became_active":"2023-11-17T06:29:57.027326+0000","last_became_peered":"2023-11-17T06:29:57.027326+0000","last_unstale":"2023-11-17T06:29:58.062922+0000","last_undegraded":"2023-11-17T06:29:58.062922+0000","last_fullsized":"2023-11-17T06:29:58.062922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:33.609630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199813+0000","last_change":"2023-11-17T06:29:56.145651+0000","last_active":"2023-11-17T06:29:58.199813+0000","last_peered":"2023-11-17T06:29:58.199813+0000","last_clean":"2023-11-17T06:29:58.199813+0000","last_became_active":"2023-11-17T06:29:56.145385+0000","last_became_peered":"2023-11-17T06:29:56.145385+0000","last_unstale":"2023-11-17T06:29:58.199813+0000","last_undegraded":"2023-11-17T06:29:58.199813+0000","last_fullsized":"2023-11-17T06:29:58.199813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:36:14.052058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200161+0000","last_change":"2023-11-17T06:29:57.053050+0000","last_active":"2023-11-17T06:29:58.200161+0000","last_peered":"2023-11-17T06:29:58.200161+0000","last_clean":"2023-11-17T06:29:58.200161+0000","last_became_active":"2023-11-17T06:29:57.052675+0000","last_became_peered":"2023-11-17T06:29:57.052675+0000","last_unstale":"2023-11-17T06:29:58.200161+0000","last_undegraded":"2023-11-17T06:29:58.200161+0000","last_fullsized":"2023-11-17T06:29:58.200161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:38:38.807009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565388+0000","last_change":"2023-11-17T06:29:56.153805+0000","last_active":"2023-11-17T06:29:58.565388+0000","last_peered":"2023-11-17T06:29:58.565388+0000","last_clean":"2023-11-17T06:29:58.565388+0000","last_became_active":"2023-11-17T06:29:56.153075+0000","last_became_peered":"2023-11-17T06:29:56.153075+0000","last_unstale":"2023-11-17T06:29:58.565388+0000","last_undegraded":"2023-11-17T06:29:58.565388+0000","last_fullsized":"2023-11-17T06:29:58.565388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:27.409831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565490+0000","last_change":"2023-11-17T06:29:57.035110+0000","last_active":"2023-11-17T06:29:58.565490+0000","last_peered":"2023-11-17T06:29:58.565490+0000","last_clean":"2023-11-17T06:29:58.565490+0000","last_became_active":"2023-11-17T06:29:57.034811+0000","last_became_peered":"2023-11-17T06:29:57.034811+0000","last_unstale":"2023-11-17T06:29:58.565490+0000","last_undegraded":"2023-11-17T06:29:58.565490+0000","last_fullsized":"2023-11-17T06:29:58.565490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014497+0000","last_change":"2023-11-17T06:29:56.144056+0000","last_active":"2023-11-17T06:29:58.014497+0000","last_peered":"2023-11-17T06:29:58.014497+0000","last_clean":"2023-11-17T06:29:58.014497+0000","last_became_active":"2023-11-17T06:29:56.143742+0000","last_became_peered":"2023-11-17T06:29:56.143742+0000","last_unstale":"2023-11-17T06:29:58.014497+0000","last_undegraded":"2023-11-17T06:29:58.014497+0000","last_fullsized":"2023-11-17T06:29:58.014497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:35.694108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199521+0000","last_change":"2023-11-17T06:29:57.036273+0000","last_active":"2023-11-17T06:29:58.199521+0000","last_peered":"2023-11-17T06:29:58.199521+0000","last_clean":"2023-11-17T06:29:58.199521+0000","last_became_active":"2023-11-17T06:29:57.036003+0000","last_became_peered":"2023-11-17T06:29:57.036003+0000","last_unstale":"2023-11-17T06:29:58.199521+0000","last_undegraded":"2023-11-17T06:29:58.199521+0000","last_fullsized":"2023-11-17T06:29:58.199521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:01:56.186044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567381+0000","last_change":"2023-11-17T06:29:56.153641+0000","last_active":"2023-11-17T06:29:58.567381+0000","last_peered":"2023-11-17T06:29:58.567381+0000","last_clean":"2023-11-17T06:29:58.567381+0000","last_became_active":"2023-11-17T06:29:56.153177+0000","last_became_peered":"2023-11-17T06:29:56.153177+0000","last_unstale":"2023-11-17T06:29:58.567381+0000","last_undegraded":"2023-11-17T06:29:58.567381+0000","last_fullsized":"2023-11-17T06:29:58.567381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:55.058158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014195+0000","last_change":"2023-11-17T06:29:57.053038+0000","last_active":"2023-11-17T06:29:58.014195+0000","last_peered":"2023-11-17T06:29:58.014195+0000","last_clean":"2023-11-17T06:29:58.014195+0000","last_became_active":"2023-11-17T06:29:57.052719+0000","last_became_peered":"2023-11-17T06:29:57.052719+0000","last_unstale":"2023-11-17T06:29:58.014195+0000","last_undegraded":"2023-11-17T06:29:58.014195+0000","last_fullsized":"2023-11-17T06:29:58.014195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:46.928281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015589+0000","last_change":"2023-11-17T06:29:56.151539+0000","last_active":"2023-11-17T06:29:58.015589+0000","last_peered":"2023-11-17T06:29:58.015589+0000","last_clean":"2023-11-17T06:29:58.015589+0000","last_became_active":"2023-11-17T06:29:56.151254+0000","last_became_peered":"2023-11-17T06:29:56.151254+0000","last_unstale":"2023-11-17T06:29:58.015589+0000","last_undegraded":"2023-11-17T06:29:58.015589+0000","last_fullsized":"2023-11-17T06:29:58.015589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:10.132222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567142+0000","last_change":"2023-11-17T06:29:57.050538+0000","last_active":"2023-11-17T06:29:58.567142+0000","last_peered":"2023-11-17T06:29:58.567142+0000","last_clean":"2023-11-17T06:29:58.567142+0000","last_became_active":"2023-11-17T06:29:57.048902+0000","last_became_peered":"2023-11-17T06:29:57.048902+0000","last_unstale":"2023-11-17T06:29:58.567142+0000","last_undegraded":"2023-11-17T06:29:58.567142+0000","last_fullsized":"2023-11-17T06:29:58.567142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:24:54.358531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017259+0000","last_change":"2023-11-17T06:29:56.149833+0000","last_active":"2023-11-17T06:29:58.017259+0000","last_peered":"2023-11-17T06:29:58.017259+0000","last_clean":"2023-11-17T06:29:58.017259+0000","last_became_active":"2023-11-17T06:29:56.149492+0000","last_became_peered":"2023-11-17T06:29:56.149492+0000","last_unstale":"2023-11-17T06:29:58.017259+0000","last_undegraded":"2023-11-17T06:29:58.017259+0000","last_fullsized":"2023-11-17T06:29:58.017259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:14:19.896244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567068+0000","last_change":"2023-11-17T06:29:57.040669+0000","last_active":"2023-11-17T06:29:58.567068+0000","last_peered":"2023-11-17T06:29:58.567068+0000","last_clean":"2023-11-17T06:29:58.567068+0000","last_became_active":"2023-11-17T06:29:57.040042+0000","last_became_peered":"2023-11-17T06:29:57.040042+0000","last_unstale":"2023-11-17T06:29:58.567068+0000","last_undegraded":"2023-11-17T06:29:58.567068+0000","last_fullsized":"2023-11-17T06:29:58.567068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:44:58.041380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063361+0000","last_change":"2023-11-17T06:29:56.157174+0000","last_active":"2023-11-17T06:29:58.063361+0000","last_peered":"2023-11-17T06:29:58.063361+0000","last_clean":"2023-11-17T06:29:58.063361+0000","last_became_active":"2023-11-17T06:29:56.156944+0000","last_became_peered":"2023-11-17T06:29:56.156944+0000","last_unstale":"2023-11-17T06:29:58.063361+0000","last_undegraded":"2023-11-17T06:29:58.063361+0000","last_fullsized":"2023-11-17T06:29:58.063361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:35.694108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200093+0000","last_change":"2023-11-17T06:29:57.020240+0000","last_active":"2023-11-17T06:29:58.200093+0000","last_peered":"2023-11-17T06:29:58.200093+0000","last_clean":"2023-11-17T06:29:58.200093+0000","last_became_active":"2023-11-17T06:29:57.019851+0000","last_became_peered":"2023-11-17T06:29:57.019851+0000","last_unstale":"2023-11-17T06:29:58.200093+0000","last_undegraded":"2023-11-17T06:29:58.200093+0000","last_fullsized":"2023-11-17T06:29:58.200093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:08:16.650719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:57.021221+0000","last_change":"2023-11-17T06:29:48.031659+0000","last_active":"2023-11-17T06:29:57.021221+0000","last_peered":"2023-11-17T06:29:57.021221+0000","last_clean":"2023-11-17T06:29:57.021221+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:29:57.021221+0000","last_undegraded":"2023-11-17T06:29:57.021221+0000","last_fullsized":"2023-11-17T06:29:57.021221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_clean_scrub_stamp":"2023-11-17T06:29:47.005420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:11:29.801860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200114+0000","last_change":"2023-11-17T06:29:56.148120+0000","last_active":"2023-11-17T06:29:58.200114+0000","last_peered":"2023-11-17T06:29:58.200114+0000","last_clean":"2023-11-17T06:29:58.200114+0000","last_became_active":"2023-11-17T06:29:56.147781+0000","last_became_peered":"2023-11-17T06:29:56.147781+0000","last_unstale":"2023-11-17T06:29:58.200114+0000","last_undegraded":"2023-11-17T06:29:58.200114+0000","last_fullsized":"2023-11-17T06:29:58.200114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:24.556455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015195+0000","last_change":"2023-11-17T06:29:57.037133+0000","last_active":"2023-11-17T06:29:58.015195+0000","last_peered":"2023-11-17T06:29:58.015195+0000","last_clean":"2023-11-17T06:29:58.015195+0000","last_became_active":"2023-11-17T06:29:57.036216+0000","last_became_peered":"2023-11-17T06:29:57.036216+0000","last_unstale":"2023-11-17T06:29:58.015195+0000","last_undegraded":"2023-11-17T06:29:58.015195+0000","last_fullsized":"2023-11-17T06:29:58.015195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:53.263320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199454+0000","last_change":"2023-11-17T06:29:56.147063+0000","last_active":"2023-11-17T06:29:58.199454+0000","last_peered":"2023-11-17T06:29:58.199454+0000","last_clean":"2023-11-17T06:29:58.199454+0000","last_became_active":"2023-11-17T06:29:56.146762+0000","last_became_peered":"2023-11-17T06:29:56.146762+0000","last_unstale":"2023-11-17T06:29:58.199454+0000","last_undegraded":"2023-11-17T06:29:58.199454+0000","last_fullsized":"2023-11-17T06:29:58.199454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:32.593552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062691+0000","last_change":"2023-11-17T06:29:57.037884+0000","last_active":"2023-11-17T06:29:58.062691+0000","last_peered":"2023-11-17T06:29:58.062691+0000","last_clean":"2023-11-17T06:29:58.062691+0000","last_became_active":"2023-11-17T06:29:57.037620+0000","last_became_peered":"2023-11-17T06:29:57.037620+0000","last_unstale":"2023-11-17T06:29:58.062691+0000","last_undegraded":"2023-11-17T06:29:58.062691+0000","last_fullsized":"2023-11-17T06:29:58.062691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565109+0000","last_change":"2023-11-17T06:29:56.147310+0000","last_active":"2023-11-17T06:29:58.565109+0000","last_peered":"2023-11-17T06:29:58.565109+0000","last_clean":"2023-11-17T06:29:58.565109+0000","last_became_active":"2023-11-17T06:29:56.146894+0000","last_became_peered":"2023-11-17T06:29:56.146894+0000","last_unstale":"2023-11-17T06:29:58.565109+0000","last_undegraded":"2023-11-17T06:29:58.565109+0000","last_fullsized":"2023-11-17T06:29:58.565109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:09:09.862678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016713+0000","last_change":"2023-11-17T06:29:57.024088+0000","last_active":"2023-11-17T06:29:58.016713+0000","last_peered":"2023-11-17T06:29:58.016713+0000","last_clean":"2023-11-17T06:29:58.016713+0000","last_became_active":"2023-11-17T06:29:57.023805+0000","last_became_peered":"2023-11-17T06:29:57.023805+0000","last_unstale":"2023-11-17T06:29:58.016713+0000","last_undegraded":"2023-11-17T06:29:58.016713+0000","last_fullsized":"2023-11-17T06:29:58.016713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:25:07.897379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200019+0000","last_change":"2023-11-17T06:29:56.143041+0000","last_active":"2023-11-17T06:29:58.200019+0000","last_peered":"2023-11-17T06:29:58.200019+0000","last_clean":"2023-11-17T06:29:58.200019+0000","last_became_active":"2023-11-17T06:29:56.142647+0000","last_became_peered":"2023-11-17T06:29:56.142647+0000","last_unstale":"2023-11-17T06:29:58.200019+0000","last_undegraded":"2023-11-17T06:29:58.200019+0000","last_fullsized":"2023-11-17T06:29:58.200019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:56:51.565071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566104+0000","last_change":"2023-11-17T06:29:57.049541+0000","last_active":"2023-11-17T06:29:58.566104+0000","last_peered":"2023-11-17T06:29:58.566104+0000","last_clean":"2023-11-17T06:29:58.566104+0000","last_became_active":"2023-11-17T06:29:57.049268+0000","last_became_peered":"2023-11-17T06:29:57.049268+0000","last_unstale":"2023-11-17T06:29:58.566104+0000","last_undegraded":"2023-11-17T06:29:58.566104+0000","last_fullsized":"2023-11-17T06:29:58.566104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:56:52.581149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017143+0000","last_change":"2023-11-17T06:29:56.147186+0000","last_active":"2023-11-17T06:29:58.017143+0000","last_peered":"2023-11-17T06:29:58.017143+0000","last_clean":"2023-11-17T06:29:58.017143+0000","last_became_active":"2023-11-17T06:29:56.146837+0000","last_became_peered":"2023-11-17T06:29:56.146837+0000","last_unstale":"2023-11-17T06:29:58.017143+0000","last_undegraded":"2023-11-17T06:29:58.017143+0000","last_fullsized":"2023-11-17T06:29:58.017143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:52:20.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013443+0000","last_change":"2023-11-17T06:29:57.041411+0000","last_active":"2023-11-17T06:29:58.013443+0000","last_peered":"2023-11-17T06:29:58.013443+0000","last_clean":"2023-11-17T06:29:58.013443+0000","last_became_active":"2023-11-17T06:29:57.041080+0000","last_became_peered":"2023-11-17T06:29:57.041080+0000","last_unstale":"2023-11-17T06:29:58.013443+0000","last_undegraded":"2023-11-17T06:29:58.013443+0000","last_fullsized":"2023-11-17T06:29:58.013443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200289+0000","last_change":"2023-11-17T06:29:56.143922+0000","last_active":"2023-11-17T06:29:58.200289+0000","last_peered":"2023-11-17T06:29:58.200289+0000","last_clean":"2023-11-17T06:29:58.200289+0000","last_became_active":"2023-11-17T06:29:56.143475+0000","last_became_peered":"2023-11-17T06:29:56.143475+0000","last_unstale":"2023-11-17T06:29:58.200289+0000","last_undegraded":"2023-11-17T06:29:58.200289+0000","last_fullsized":"2023-11-17T06:29:58.200289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:00:32.599388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063284+0000","last_change":"2023-11-17T06:29:57.029861+0000","last_active":"2023-11-17T06:29:58.063284+0000","last_peered":"2023-11-17T06:29:58.063284+0000","last_clean":"2023-11-17T06:29:58.063284+0000","last_became_active":"2023-11-17T06:29:57.029360+0000","last_became_peered":"2023-11-17T06:29:57.029360+0000","last_unstale":"2023-11-17T06:29:58.063284+0000","last_undegraded":"2023-11-17T06:29:58.063284+0000","last_fullsized":"2023-11-17T06:29:58.063284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:18.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015784+0000","last_change":"2023-11-17T06:29:56.152922+0000","last_active":"2023-11-17T06:29:58.015784+0000","last_peered":"2023-11-17T06:29:58.015784+0000","last_clean":"2023-11-17T06:29:58.015784+0000","last_became_active":"2023-11-17T06:29:56.152632+0000","last_became_peered":"2023-11-17T06:29:56.152632+0000","last_unstale":"2023-11-17T06:29:58.015784+0000","last_undegraded":"2023-11-17T06:29:58.015784+0000","last_fullsized":"2023-11-17T06:29:58.015784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:32.593552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015562+0000","last_change":"2023-11-17T06:29:57.036541+0000","last_active":"2023-11-17T06:29:58.015562+0000","last_peered":"2023-11-17T06:29:58.015562+0000","last_clean":"2023-11-17T06:29:58.015562+0000","last_became_active":"2023-11-17T06:29:57.034954+0000","last_became_peered":"2023-11-17T06:29:57.034954+0000","last_unstale":"2023-11-17T06:29:58.015562+0000","last_undegraded":"2023-11-17T06:29:58.015562+0000","last_fullsized":"2023-11-17T06:29:58.015562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:13:22.110656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200289+0000","last_change":"2023-11-17T06:29:56.156668+0000","last_active":"2023-11-17T06:29:58.200289+0000","last_peered":"2023-11-17T06:29:58.200289+0000","last_clean":"2023-11-17T06:29:58.200289+0000","last_became_active":"2023-11-17T06:29:56.155662+0000","last_became_peered":"2023-11-17T06:29:56.155662+0000","last_unstale":"2023-11-17T06:29:58.200289+0000","last_undegraded":"2023-11-17T06:29:58.200289+0000","last_fullsized":"2023-11-17T06:29:58.200289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:56:30.930517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015394+0000","last_change":"2023-11-17T06:29:57.034365+0000","last_active":"2023-11-17T06:29:58.015394+0000","last_peered":"2023-11-17T06:29:58.015394+0000","last_clean":"2023-11-17T06:29:58.015394+0000","last_became_active":"2023-11-17T06:29:57.034154+0000","last_became_peered":"2023-11-17T06:29:57.034154+0000","last_unstale":"2023-11-17T06:29:58.015394+0000","last_undegraded":"2023-11-17T06:29:58.015394+0000","last_fullsized":"2023-11-17T06:29:58.015394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:31:15.968761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565274+0000","last_change":"2023-11-17T06:29:56.153356+0000","last_active":"2023-11-17T06:29:58.565274+0000","last_peered":"2023-11-17T06:29:58.565274+0000","last_clean":"2023-11-17T06:29:58.565274+0000","last_became_active":"2023-11-17T06:29:56.153004+0000","last_became_peered":"2023-11-17T06:29:56.153004+0000","last_unstale":"2023-11-17T06:29:58.565274+0000","last_undegraded":"2023-11-17T06:29:58.565274+0000","last_fullsized":"2023-11-17T06:29:58.565274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:17.338010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199179+0000","last_change":"2023-11-17T06:29:57.029538+0000","last_active":"2023-11-17T06:29:58.199179+0000","last_peered":"2023-11-17T06:29:58.199179+0000","last_clean":"2023-11-17T06:29:58.199179+0000","last_became_active":"2023-11-17T06:29:57.029210+0000","last_became_peered":"2023-11-17T06:29:57.029210+0000","last_unstale":"2023-11-17T06:29:58.199179+0000","last_undegraded":"2023-11-17T06:29:58.199179+0000","last_fullsized":"2023-11-17T06:29:58.199179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:24:54.358531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014921+0000","last_change":"2023-11-17T06:29:56.154270+0000","last_active":"2023-11-17T06:29:58.014921+0000","last_peered":"2023-11-17T06:29:58.014921+0000","last_clean":"2023-11-17T06:29:58.014921+0000","last_became_active":"2023-11-17T06:29:56.153931+0000","last_became_peered":"2023-11-17T06:29:56.153931+0000","last_unstale":"2023-11-17T06:29:58.014921+0000","last_undegraded":"2023-11-17T06:29:58.014921+0000","last_fullsized":"2023-11-17T06:29:58.014921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:27.409831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014523+0000","last_change":"2023-11-17T06:29:57.023492+0000","last_active":"2023-11-17T06:29:58.014523+0000","last_peered":"2023-11-17T06:29:58.014523+0000","last_clean":"2023-11-17T06:29:58.014523+0000","last_became_active":"2023-11-17T06:29:57.023199+0000","last_became_peered":"2023-11-17T06:29:57.023199+0000","last_unstale":"2023-11-17T06:29:58.014523+0000","last_undegraded":"2023-11-17T06:29:58.014523+0000","last_fullsized":"2023-11-17T06:29:58.014523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:25.572533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063127+0000","last_change":"2023-11-17T06:29:56.151644+0000","last_active":"2023-11-17T06:29:58.063127+0000","last_peered":"2023-11-17T06:29:58.063127+0000","last_clean":"2023-11-17T06:29:58.063127+0000","last_became_active":"2023-11-17T06:29:56.151334+0000","last_became_peered":"2023-11-17T06:29:56.151334+0000","last_unstale":"2023-11-17T06:29:58.063127+0000","last_undegraded":"2023-11-17T06:29:58.063127+0000","last_fullsized":"2023-11-17T06:29:58.063127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:50.793814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565539+0000","last_change":"2023-11-17T06:29:57.030102+0000","last_active":"2023-11-17T06:29:58.565539+0000","last_peered":"2023-11-17T06:29:58.565539+0000","last_clean":"2023-11-17T06:29:58.565539+0000","last_became_active":"2023-11-17T06:29:57.028292+0000","last_became_peered":"2023-11-17T06:29:57.028292+0000","last_unstale":"2023-11-17T06:29:58.565539+0000","last_undegraded":"2023-11-17T06:29:58.565539+0000","last_fullsized":"2023-11-17T06:29:58.565539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199917+0000","last_change":"2023-11-17T06:29:56.147463+0000","last_active":"2023-11-17T06:29:58.199917+0000","last_peered":"2023-11-17T06:29:58.199917+0000","last_clean":"2023-11-17T06:29:58.199917+0000","last_became_active":"2023-11-17T06:29:56.147172+0000","last_became_peered":"2023-11-17T06:29:56.147172+0000","last_unstale":"2023-11-17T06:29:58.199917+0000","last_undegraded":"2023-11-17T06:29:58.199917+0000","last_fullsized":"2023-11-17T06:29:58.199917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:31:14.952683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199574+0000","last_change":"2023-11-17T06:29:57.030874+0000","last_active":"2023-11-17T06:29:58.199574+0000","last_peered":"2023-11-17T06:29:58.199574+0000","last_clean":"2023-11-17T06:29:58.199574+0000","last_became_active":"2023-11-17T06:29:57.030602+0000","last_became_peered":"2023-11-17T06:29:57.030602+0000","last_unstale":"2023-11-17T06:29:58.199574+0000","last_undegraded":"2023-11-17T06:29:58.199574+0000","last_fullsized":"2023-11-17T06:29:58.199574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:40:17.803427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199948+0000","last_change":"2023-11-17T06:29:57.050840+0000","last_active":"2023-11-17T06:29:58.199948+0000","last_peered":"2023-11-17T06:29:58.199948+0000","last_clean":"2023-11-17T06:29:58.199948+0000","last_became_active":"2023-11-17T06:29:57.050346+0000","last_became_peered":"2023-11-17T06:29:57.050346+0000","last_unstale":"2023-11-17T06:29:58.199948+0000","last_undegraded":"2023-11-17T06:29:58.199948+0000","last_fullsized":"2023-11-17T06:29:58.199948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:25:35.354706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567223+0000","last_change":"2023-11-17T06:29:56.153913+0000","last_active":"2023-11-17T06:29:58.567223+0000","last_peered":"2023-11-17T06:29:58.567223+0000","last_clean":"2023-11-17T06:29:58.567223+0000","last_became_active":"2023-11-17T06:29:56.153474+0000","last_became_peered":"2023-11-17T06:29:56.153474+0000","last_unstale":"2023-11-17T06:29:58.567223+0000","last_undegraded":"2023-11-17T06:29:58.567223+0000","last_fullsized":"2023-11-17T06:29:58.567223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:53.932965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567084+0000","last_change":"2023-11-17T06:29:57.041986+0000","last_active":"2023-11-17T06:29:58.567084+0000","last_peered":"2023-11-17T06:29:58.567084+0000","last_clean":"2023-11-17T06:29:58.567084+0000","last_became_active":"2023-11-17T06:29:57.041251+0000","last_became_peered":"2023-11-17T06:29:57.041251+0000","last_unstale":"2023-11-17T06:29:58.567084+0000","last_undegraded":"2023-11-17T06:29:58.567084+0000","last_fullsized":"2023-11-17T06:29:58.567084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:28.425909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567460+0000","last_change":"2023-11-17T06:29:56.155103+0000","last_active":"2023-11-17T06:29:58.567460+0000","last_peered":"2023-11-17T06:29:58.567460+0000","last_clean":"2023-11-17T06:29:58.567460+0000","last_became_active":"2023-11-17T06:29:56.154824+0000","last_became_peered":"2023-11-17T06:29:56.154824+0000","last_unstale":"2023-11-17T06:29:58.567460+0000","last_undegraded":"2023-11-17T06:29:58.567460+0000","last_fullsized":"2023-11-17T06:29:58.567460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:13:21.094578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017560+0000","last_change":"2023-11-17T06:29:57.028924+0000","last_active":"2023-11-17T06:29:58.017560+0000","last_peered":"2023-11-17T06:29:58.017560+0000","last_clean":"2023-11-17T06:29:58.017560+0000","last_became_active":"2023-11-17T06:29:57.028381+0000","last_became_peered":"2023-11-17T06:29:57.028381+0000","last_unstale":"2023-11-17T06:29:58.017560+0000","last_undegraded":"2023-11-17T06:29:58.017560+0000","last_fullsized":"2023-11-17T06:29:58.017560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:16:29.542871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017697+0000","last_change":"2023-11-17T06:29:56.147117+0000","last_active":"2023-11-17T06:29:58.017697+0000","last_peered":"2023-11-17T06:29:58.017697+0000","last_clean":"2023-11-17T06:29:58.017697+0000","last_became_active":"2023-11-17T06:29:56.146805+0000","last_became_peered":"2023-11-17T06:29:56.146805+0000","last_unstale":"2023-11-17T06:29:58.017697+0000","last_undegraded":"2023-11-17T06:29:58.017697+0000","last_fullsized":"2023-11-17T06:29:58.017697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:24:37.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017661+0000","last_change":"2023-11-17T06:29:57.046219+0000","last_active":"2023-11-17T06:29:58.017661+0000","last_peered":"2023-11-17T06:29:58.017661+0000","last_clean":"2023-11-17T06:29:58.017661+0000","last_became_active":"2023-11-17T06:29:57.045949+0000","last_became_peered":"2023-11-17T06:29:57.045949+0000","last_unstale":"2023-11-17T06:29:58.017661+0000","last_undegraded":"2023-11-17T06:29:58.017661+0000","last_fullsized":"2023-11-17T06:29:58.017661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:31:49.682905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015780+0000","last_change":"2023-11-17T06:29:56.141229+0000","last_active":"2023-11-17T06:29:58.015780+0000","last_peered":"2023-11-17T06:29:58.015780+0000","last_clean":"2023-11-17T06:29:58.015780+0000","last_became_active":"2023-11-17T06:29:56.140850+0000","last_became_peered":"2023-11-17T06:29:56.140850+0000","last_unstale":"2023-11-17T06:29:58.015780+0000","last_undegraded":"2023-11-17T06:29:58.015780+0000","last_fullsized":"2023-11-17T06:29:58.015780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:45.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":80911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8440000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":83195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7949999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.829}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7250000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8560000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.889}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.716}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.754}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":80967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":671371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7250000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:30:01.469 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:30:01.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.668+0000 7f8c6b40f700 1 Processor -- start 2023-11-17T06:30:01.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.668+0000 7f8c6b40f700 1 -- start start 2023-11-17T06:30:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c6b40f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 0x7f8c640716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c6b40f700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8c6415e420 0x7f8c640cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c6b40f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c640cc420 con 0x7f8c640cba80 2023-11-17T06:30:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c6b40f700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c640cb490 con 0x7f8c6415e420 2023-11-17T06:30:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c6b40f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c64071c10 con 0x7f8c6415d6d0 2023-11-17T06:30:01.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c691ab700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 0x7f8c640716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c691ab700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 0x7f8c640716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:34956/0 (socket says 172.21.15.69:34956) 2023-11-17T06:30:01.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c691ab700 1 -- 172.21.15.69:0/3725420504 learned_addr learned my addr 172.21.15.69:0/3725420504 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:01.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c699ac700 1 --2- 172.21.15.69:0/3725420504 >> v2:172.21.15.93:3300/0 conn(0x7f8c6415e420 0x7f8c640cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c691ab700 1 -- 172.21.15.69:0/3725420504 >> v2:172.21.15.93:3300/0 conn(0x7f8c6415e420 msgr2=0x7f8c640cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c691ab700 1 --2- 172.21.15.69:0/3725420504 >> v2:172.21.15.93:3300/0 conn(0x7f8c6415e420 0x7f8c640cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c691ab700 1 -- 172.21.15.69:0/3725420504 >> v1:172.21.15.93:6789/0 conn(0x7f8c640cba80 legacy=0x7f8c6415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.672+0000 7f8c691ab700 1 -- 172.21.15.69:0/3725420504 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64070980 con 0x7f8c6415d6d0 2023-11-17T06:30:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c691ab700 1 --2- 172.21.15.69:0/3725420504 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 0x7f8c640716d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009910 tx=0x7f8c60009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c3f99ff76310374 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c5bfff700 1 -- 172.21.15.69:0/3725420504 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000f8a0 con 0x7f8c6415d6d0 2023-11-17T06:30:01.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c5bfff700 1 -- 172.21.15.69:0/3725420504 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6000fa00 con 0x7f8c6415d6d0 2023-11-17T06:30:01.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c5bfff700 1 -- 172.21.15.69:0/3725420504 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000fdb0 con 0x7f8c6415d6d0 2023-11-17T06:30:01.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c6b40f700 1 -- 172.21.15.69:0/3725420504 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 msgr2=0x7f8c640716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c6b40f700 1 --2- 172.21.15.69:0/3725420504 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 0x7f8c640716d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8c60009910 tx=0x7f8c60009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:01.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c6b40f700 1 -- 172.21.15.69:0/3725420504 shutdown_connections 2023-11-17T06:30:01.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c6b40f700 1 --2- 172.21.15.69:0/3725420504 >> v2:172.21.15.93:3300/0 conn(0x7f8c6415e420 0x7f8c640cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c6b40f700 1 --2- 172.21.15.69:0/3725420504 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 0x7f8c640716d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c6b40f700 1 -- 172.21.15.69:0/3725420504 >> 172.21.15.69:0/3725420504 conn(0x7f8c6406a480 msgr2=0x7f8c6406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:01.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c6b40f700 1 -- 172.21.15.69:0/3725420504 shutdown_connections 2023-11-17T06:30:01.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.676+0000 7f8c6b40f700 1 -- 172.21.15.69:0/3725420504 wait complete. 2023-11-17T06:30:01.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c6b40f700 1 Processor -- start 2023-11-17T06:30:01.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c6b40f700 1 -- start start 2023-11-17T06:30:01.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c6b40f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c640cba80 0x7f8c64158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c6b40f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 0x7f8c64159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c6b40f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c6415e420 0x7f8c640c8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c6b40f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6415b540 con 0x7f8c640cba80 2023-11-17T06:30:01.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c6b40f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6415ac50 con 0x7f8c6415e420 2023-11-17T06:30:01.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c6b40f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c641589a0 con 0x7f8c6415d6d0 2023-11-17T06:30:01.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c691ab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c640cba80 0x7f8c64158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c691ab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c640cba80 0x7f8c64158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53186/0 (socket says 172.21.15.69:53186) 2023-11-17T06:30:01.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c699ac700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c6415e420 0x7f8c640c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c689aa700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 0x7f8c64159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c691ab700 1 -- 172.21.15.69:0/412446783 learned_addr learned my addr 172.21.15.69:0/412446783 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:01.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c699ac700 1 -- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 msgr2=0x7f8c64159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c699ac700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 0x7f8c64159fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c699ac700 1 -- 172.21.15.69:0/412446783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c640cba80 msgr2=0x7f8c64158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c699ac700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c640cba80 0x7f8c64158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c699ac700 1 -- 172.21.15.69:0/412446783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60009570 con 0x7f8c6415e420 2023-11-17T06:30:01.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c691ab700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c640cba80 0x7f8c64158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:01.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.680+0000 7f8c699ac700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c6415e420 0x7f8c640c8060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00eba0 tx=0x7f8c5c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:01.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.684+0000 7f8c59ffb700 1 -- 172.21.15.69:0/412446783 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c009a80 con 0x7f8c6415e420 2023-11-17T06:30:01.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.684+0000 7f8c59ffb700 1 -- 172.21.15.69:0/412446783 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c00f040 con 0x7f8c6415e420 2023-11-17T06:30:01.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.684+0000 7f8c6b40f700 1 -- 172.21.15.69:0/412446783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6415aef0 con 0x7f8c6415e420 2023-11-17T06:30:01.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.684+0000 7f8c59ffb700 1 -- 172.21.15.69:0/412446783 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00cc40 con 0x7f8c6415e420 2023-11-17T06:30:01.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.684+0000 7f8c6b40f700 1 -- 172.21.15.69:0/412446783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6415a910 con 0x7f8c6415e420 2023-11-17T06:30:01.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.684+0000 7f8c6b40f700 1 -- 172.21.15.69:0/412446783 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6415b6b0 con 0x7f8c6415e420 2023-11-17T06:30:01.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.688+0000 7f8c59ffb700 1 -- 172.21.15.69:0/412446783 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8c5c014480 con 0x7f8c6415e420 2023-11-17T06:30:01.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.688+0000 7f8c59ffb700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8c48066510 0x7f8c480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:01.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.688+0000 7f8c59ffb700 1 -- 172.21.15.69:0/412446783 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c5c084d80 con 0x7f8c6415e420 2023-11-17T06:30:01.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.688+0000 7f8c691ab700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8c48066510 0x7f8c480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:01.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.692+0000 7f8c691ab700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8c48066510 0x7f8c480689d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000e330 tx=0x7f8c6001b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:01.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.696+0000 7f8c59ffb700 1 -- 172.21.15.69:0/412446783 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8c5c052370 con 0x7f8c6415e420 2023-11-17T06:30:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.872+0000 7f8c6b40f700 1 -- 172.21.15.69:0/412446783 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c64070ed0 con 0x7f8c48066510 2023-11-17T06:30:01.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.888+0000 7f8c59ffb700 1 -- 172.21.15.69:0/412446783 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264460 (secure 0 0 0) 0x7f8c60006ca0 con 0x7f8c48066510 2023-11-17T06:30:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 -- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8c48066510 msgr2=0x7f8c480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8c48066510 0x7f8c480689d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000e330 tx=0x7f8c6001b040 comp rx=0 tx=0).stop 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 -- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c6415e420 msgr2=0x7f8c640c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c6415e420 0x7f8c640c8060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00eba0 tx=0x7f8c5c00eeb0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 -- 172.21.15.69:0/412446783 shutdown_connections 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8c48066510 0x7f8c480689d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c6415e420 0x7f8c640c8060 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8c6415d6d0 0x7f8c64159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 --2- 172.21.15.69:0/412446783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c640cba80 0x7f8c64158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 -- 172.21.15.69:0/412446783 >> 172.21.15.69:0/412446783 conn(0x7f8c6406a480 msgr2=0x7f8c640c5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 -- 172.21.15.69:0/412446783 shutdown_connections 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:01.896+0000 7f8c6b40f700 1 -- 172.21.15.69:0/412446783 wait complete. 2023-11-17T06:30:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:30:01.922 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-11-17T06:30:00.363262+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219244,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755476,"statfs":{"total":773094113280,"available":772869607424,"internally_reserved":0,"allocated":3121152,"data_stored":1832844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.258040"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566813+0000","last_change":"2023-11-17T06:29:57.048765+0000","last_active":"2023-11-17T06:29:58.566813+0000","last_peered":"2023-11-17T06:29:58.566813+0000","last_clean":"2023-11-17T06:29:58.566813+0000","last_became_active":"2023-11-17T06:29:57.048355+0000","last_became_peered":"2023-11-17T06:29:57.048355+0000","last_unstale":"2023-11-17T06:29:58.566813+0000","last_undegraded":"2023-11-17T06:29:58.566813+0000","last_fullsized":"2023-11-17T06:29:58.566813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:56:31.946595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017546+0000","last_change":"2023-11-17T06:29:57.026689+0000","last_active":"2023-11-17T06:29:58.017546+0000","last_peered":"2023-11-17T06:29:58.017546+0000","last_clean":"2023-11-17T06:29:58.017546+0000","last_became_active":"2023-11-17T06:29:57.026110+0000","last_became_peered":"2023-11-17T06:29:57.026110+0000","last_unstale":"2023-11-17T06:29:58.017546+0000","last_undegraded":"2023-11-17T06:29:58.017546+0000","last_fullsized":"2023-11-17T06:29:58.017546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:13:19.132028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017185+0000","last_change":"2023-11-17T06:29:57.035489+0000","last_active":"2023-11-17T06:29:58.017185+0000","last_peered":"2023-11-17T06:29:58.017185+0000","last_clean":"2023-11-17T06:29:58.017185+0000","last_became_active":"2023-11-17T06:29:57.035039+0000","last_became_peered":"2023-11-17T06:29:57.035039+0000","last_unstale":"2023-11-17T06:29:58.017185+0000","last_undegraded":"2023-11-17T06:29:58.017185+0000","last_fullsized":"2023-11-17T06:29:58.017185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:33:15.530438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013600+0000","last_change":"2023-11-17T06:29:57.037868+0000","last_active":"2023-11-17T06:29:58.013600+0000","last_peered":"2023-11-17T06:29:58.013600+0000","last_clean":"2023-11-17T06:29:58.013600+0000","last_became_active":"2023-11-17T06:29:57.036721+0000","last_became_peered":"2023-11-17T06:29:57.036721+0000","last_unstale":"2023-11-17T06:29:58.013600+0000","last_undegraded":"2023-11-17T06:29:58.013600+0000","last_fullsized":"2023-11-17T06:29:58.013600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566412+0000","last_change":"2023-11-17T06:29:57.050034+0000","last_active":"2023-11-17T06:29:58.566412+0000","last_peered":"2023-11-17T06:29:58.566412+0000","last_clean":"2023-11-17T06:29:58.566412+0000","last_became_active":"2023-11-17T06:29:57.048335+0000","last_became_peered":"2023-11-17T06:29:57.048335+0000","last_unstale":"2023-11-17T06:29:58.566412+0000","last_undegraded":"2023-11-17T06:29:58.566412+0000","last_fullsized":"2023-11-17T06:29:58.566412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:00:33.615466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013438+0000","last_change":"2023-11-17T06:29:57.035919+0000","last_active":"2023-11-17T06:29:58.013438+0000","last_peered":"2023-11-17T06:29:58.013438+0000","last_clean":"2023-11-17T06:29:58.013438+0000","last_became_active":"2023-11-17T06:29:57.035533+0000","last_became_peered":"2023-11-17T06:29:57.035533+0000","last_unstale":"2023-11-17T06:29:58.013438+0000","last_undegraded":"2023-11-17T06:29:58.013438+0000","last_fullsized":"2023-11-17T06:29:58.013438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565360+0000","last_change":"2023-11-17T06:29:57.044538+0000","last_active":"2023-11-17T06:29:58.565360+0000","last_peered":"2023-11-17T06:29:58.565360+0000","last_clean":"2023-11-17T06:29:58.565360+0000","last_became_active":"2023-11-17T06:29:57.044209+0000","last_became_peered":"2023-11-17T06:29:57.044209+0000","last_unstale":"2023-11-17T06:29:58.565360+0000","last_undegraded":"2023-11-17T06:29:58.565360+0000","last_fullsized":"2023-11-17T06:29:58.565360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:36:15.068137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016567+0000","last_change":"2023-11-17T06:29:57.050415+0000","last_active":"2023-11-17T06:29:58.016567+0000","last_peered":"2023-11-17T06:29:58.016567+0000","last_clean":"2023-11-17T06:29:58.016567+0000","last_became_active":"2023-11-17T06:29:57.050130+0000","last_became_peered":"2023-11-17T06:29:57.050130+0000","last_unstale":"2023-11-17T06:29:58.016567+0000","last_undegraded":"2023-11-17T06:29:58.016567+0000","last_fullsized":"2023-11-17T06:29:58.016567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:10:40.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567762+0000","last_change":"2023-11-17T06:29:57.021824+0000","last_active":"2023-11-17T06:29:58.567762+0000","last_peered":"2023-11-17T06:29:58.567762+0000","last_clean":"2023-11-17T06:29:58.567762+0000","last_became_active":"2023-11-17T06:29:57.021520+0000","last_became_peered":"2023-11-17T06:29:57.021520+0000","last_unstale":"2023-11-17T06:29:58.567762+0000","last_undegraded":"2023-11-17T06:29:58.567762+0000","last_fullsized":"2023-11-17T06:29:58.567762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566326+0000","last_change":"2023-11-17T06:29:57.049308+0000","last_active":"2023-11-17T06:29:58.566326+0000","last_peered":"2023-11-17T06:29:58.566326+0000","last_clean":"2023-11-17T06:29:58.566326+0000","last_became_active":"2023-11-17T06:29:57.048874+0000","last_became_peered":"2023-11-17T06:29:57.048874+0000","last_unstale":"2023-11-17T06:29:58.566326+0000","last_undegraded":"2023-11-17T06:29:58.566326+0000","last_fullsized":"2023-11-17T06:29:58.566326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:53:02.810684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567455+0000","last_change":"2023-11-17T06:29:57.049230+0000","last_active":"2023-11-17T06:29:58.567455+0000","last_peered":"2023-11-17T06:29:58.567455+0000","last_clean":"2023-11-17T06:29:58.567455+0000","last_became_active":"2023-11-17T06:29:57.048585+0000","last_became_peered":"2023-11-17T06:29:57.048585+0000","last_unstale":"2023-11-17T06:29:58.567455+0000","last_undegraded":"2023-11-17T06:29:58.567455+0000","last_fullsized":"2023-11-17T06:29:58.567455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:24:12.818384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566673+0000","last_change":"2023-11-17T06:29:57.040860+0000","last_active":"2023-11-17T06:29:58.566673+0000","last_peered":"2023-11-17T06:29:58.566673+0000","last_clean":"2023-11-17T06:29:58.566673+0000","last_became_active":"2023-11-17T06:29:57.040400+0000","last_became_peered":"2023-11-17T06:29:57.040400+0000","last_unstale":"2023-11-17T06:29:58.566673+0000","last_undegraded":"2023-11-17T06:29:58.566673+0000","last_fullsized":"2023-11-17T06:29:58.566673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:38:04.919402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063054+0000","last_change":"2023-11-17T06:29:57.051422+0000","last_active":"2023-11-17T06:29:58.063054+0000","last_peered":"2023-11-17T06:29:58.063054+0000","last_clean":"2023-11-17T06:29:58.063054+0000","last_became_active":"2023-11-17T06:29:57.051220+0000","last_became_peered":"2023-11-17T06:29:57.051220+0000","last_unstale":"2023-11-17T06:29:58.063054+0000","last_undegraded":"2023-11-17T06:29:58.063054+0000","last_fullsized":"2023-11-17T06:29:58.063054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:25.572533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062869+0000","last_change":"2023-11-17T06:29:57.027124+0000","last_active":"2023-11-17T06:29:58.062869+0000","last_peered":"2023-11-17T06:29:58.062869+0000","last_clean":"2023-11-17T06:29:58.062869+0000","last_became_active":"2023-11-17T06:29:57.025556+0000","last_became_peered":"2023-11-17T06:29:57.025556+0000","last_unstale":"2023-11-17T06:29:58.062869+0000","last_undegraded":"2023-11-17T06:29:58.062869+0000","last_fullsized":"2023-11-17T06:29:58.062869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:46.928281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016155+0000","last_change":"2023-11-17T06:29:57.051705+0000","last_active":"2023-11-17T06:29:58.016155+0000","last_peered":"2023-11-17T06:29:58.016155+0000","last_clean":"2023-11-17T06:29:58.016155+0000","last_became_active":"2023-11-17T06:29:57.051139+0000","last_became_peered":"2023-11-17T06:29:57.051139+0000","last_unstale":"2023-11-17T06:29:58.016155+0000","last_undegraded":"2023-11-17T06:29:58.016155+0000","last_fullsized":"2023-11-17T06:29:58.016155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:43:38.839375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199207+0000","last_change":"2023-11-17T06:29:57.040316+0000","last_active":"2023-11-17T06:29:58.199207+0000","last_peered":"2023-11-17T06:29:58.199207+0000","last_clean":"2023-11-17T06:29:58.199207+0000","last_became_active":"2023-11-17T06:29:57.039952+0000","last_became_peered":"2023-11-17T06:29:57.039952+0000","last_unstale":"2023-11-17T06:29:58.199207+0000","last_undegraded":"2023-11-17T06:29:58.199207+0000","last_fullsized":"2023-11-17T06:29:58.199207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:08:15.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200121+0000","last_change":"2023-11-17T06:29:57.053274+0000","last_active":"2023-11-17T06:29:58.200121+0000","last_peered":"2023-11-17T06:29:58.200121+0000","last_clean":"2023-11-17T06:29:58.200121+0000","last_became_active":"2023-11-17T06:29:57.050580+0000","last_became_peered":"2023-11-17T06:29:57.050580+0000","last_unstale":"2023-11-17T06:29:58.200121+0000","last_undegraded":"2023-11-17T06:29:58.200121+0000","last_fullsized":"2023-11-17T06:29:58.200121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:40:22.670143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565972+0000","last_change":"2023-11-17T06:29:57.039046+0000","last_active":"2023-11-17T06:29:58.565972+0000","last_peered":"2023-11-17T06:29:58.565972+0000","last_clean":"2023-11-17T06:29:58.565972+0000","last_became_active":"2023-11-17T06:29:57.038686+0000","last_became_peered":"2023-11-17T06:29:57.038686+0000","last_unstale":"2023-11-17T06:29:58.565972+0000","last_undegraded":"2023-11-17T06:29:58.565972+0000","last_fullsized":"2023-11-17T06:29:58.565972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200277+0000","last_change":"2023-11-17T06:29:57.038796+0000","last_active":"2023-11-17T06:29:58.200277+0000","last_peered":"2023-11-17T06:29:58.200277+0000","last_clean":"2023-11-17T06:29:58.200277+0000","last_became_active":"2023-11-17T06:29:57.038343+0000","last_became_peered":"2023-11-17T06:29:57.038343+0000","last_unstale":"2023-11-17T06:29:58.200277+0000","last_undegraded":"2023-11-17T06:29:58.200277+0000","last_fullsized":"2023-11-17T06:29:58.200277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:31.062867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567003+0000","last_change":"2023-11-17T06:29:57.039524+0000","last_active":"2023-11-17T06:29:58.567003+0000","last_peered":"2023-11-17T06:29:58.567003+0000","last_clean":"2023-11-17T06:29:58.567003+0000","last_became_active":"2023-11-17T06:29:57.039223+0000","last_became_peered":"2023-11-17T06:29:57.039223+0000","last_unstale":"2023-11-17T06:29:58.567003+0000","last_undegraded":"2023-11-17T06:29:58.567003+0000","last_fullsized":"2023-11-17T06:29:58.567003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:42:16.411887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014811+0000","last_change":"2023-11-17T06:29:57.035054+0000","last_active":"2023-11-17T06:29:58.014811+0000","last_peered":"2023-11-17T06:29:58.014811+0000","last_clean":"2023-11-17T06:29:58.014811+0000","last_became_active":"2023-11-17T06:29:57.034678+0000","last_became_peered":"2023-11-17T06:29:57.034678+0000","last_unstale":"2023-11-17T06:29:58.014811+0000","last_undegraded":"2023-11-17T06:29:58.014811+0000","last_fullsized":"2023-11-17T06:29:58.014811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:56.074236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566287+0000","last_change":"2023-11-17T06:29:57.049846+0000","last_active":"2023-11-17T06:29:58.566287+0000","last_peered":"2023-11-17T06:29:58.566287+0000","last_clean":"2023-11-17T06:29:58.566287+0000","last_became_active":"2023-11-17T06:29:57.049537+0000","last_became_peered":"2023-11-17T06:29:57.049537+0000","last_unstale":"2023-11-17T06:29:58.566287+0000","last_undegraded":"2023-11-17T06:29:58.566287+0000","last_fullsized":"2023-11-17T06:29:58.566287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016429+0000","last_change":"2023-11-17T06:29:57.039185+0000","last_active":"2023-11-17T06:29:58.016429+0000","last_peered":"2023-11-17T06:29:58.016429+0000","last_clean":"2023-11-17T06:29:58.016429+0000","last_became_active":"2023-11-17T06:29:57.038833+0000","last_became_peered":"2023-11-17T06:29:57.038833+0000","last_unstale":"2023-11-17T06:29:58.016429+0000","last_undegraded":"2023-11-17T06:29:58.016429+0000","last_fullsized":"2023-11-17T06:29:58.016429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:35:36.870837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199139+0000","last_change":"2023-11-17T06:29:57.028933+0000","last_active":"2023-11-17T06:29:58.199139+0000","last_peered":"2023-11-17T06:29:58.199139+0000","last_clean":"2023-11-17T06:29:58.199139+0000","last_became_active":"2023-11-17T06:29:57.028654+0000","last_became_peered":"2023-11-17T06:29:57.028654+0000","last_unstale":"2023-11-17T06:29:58.199139+0000","last_undegraded":"2023-11-17T06:29:58.199139+0000","last_fullsized":"2023-11-17T06:29:58.199139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:44:58.041380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017531+0000","last_change":"2023-11-17T06:29:57.028712+0000","last_active":"2023-11-17T06:29:58.017531+0000","last_peered":"2023-11-17T06:29:58.017531+0000","last_clean":"2023-11-17T06:29:58.017531+0000","last_became_active":"2023-11-17T06:29:57.027965+0000","last_became_peered":"2023-11-17T06:29:57.027965+0000","last_unstale":"2023-11-17T06:29:58.017531+0000","last_undegraded":"2023-11-17T06:29:58.017531+0000","last_fullsized":"2023-11-17T06:29:58.017531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:15:20.965141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013827+0000","last_change":"2023-11-17T06:29:57.037004+0000","last_active":"2023-11-17T06:29:58.013827+0000","last_peered":"2023-11-17T06:29:58.013827+0000","last_clean":"2023-11-17T06:29:58.013827+0000","last_became_active":"2023-11-17T06:29:57.036152+0000","last_became_peered":"2023-11-17T06:29:57.036152+0000","last_unstale":"2023-11-17T06:29:58.013827+0000","last_undegraded":"2023-11-17T06:29:58.013827+0000","last_fullsized":"2023-11-17T06:29:58.013827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:28.425909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063473+0000","last_change":"2023-11-17T06:29:57.030368+0000","last_active":"2023-11-17T06:29:58.063473+0000","last_peered":"2023-11-17T06:29:58.063473+0000","last_clean":"2023-11-17T06:29:58.063473+0000","last_became_active":"2023-11-17T06:29:57.028975+0000","last_became_peered":"2023-11-17T06:29:57.028975+0000","last_unstale":"2023-11-17T06:29:58.063473+0000","last_undegraded":"2023-11-17T06:29:58.063473+0000","last_fullsized":"2023-11-17T06:29:58.063473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:53.263320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063141+0000","last_change":"2023-11-17T06:29:57.049939+0000","last_active":"2023-11-17T06:29:58.063141+0000","last_peered":"2023-11-17T06:29:58.063141+0000","last_clean":"2023-11-17T06:29:58.063141+0000","last_became_active":"2023-11-17T06:29:57.049684+0000","last_became_peered":"2023-11-17T06:29:57.049684+0000","last_unstale":"2023-11-17T06:29:58.063141+0000","last_undegraded":"2023-11-17T06:29:58.063141+0000","last_fullsized":"2023-11-17T06:29:58.063141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:56.074236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017151+0000","last_change":"2023-11-17T06:29:57.024239+0000","last_active":"2023-11-17T06:29:58.017151+0000","last_peered":"2023-11-17T06:29:58.017151+0000","last_clean":"2023-11-17T06:29:58.017151+0000","last_became_active":"2023-11-17T06:29:57.023966+0000","last_became_peered":"2023-11-17T06:29:57.023966+0000","last_unstale":"2023-11-17T06:29:58.017151+0000","last_undegraded":"2023-11-17T06:29:58.017151+0000","last_fullsized":"2023-11-17T06:29:58.017151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:53:17.880921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199372+0000","last_change":"2023-11-17T06:29:57.027928+0000","last_active":"2023-11-17T06:29:58.199372+0000","last_peered":"2023-11-17T06:29:58.199372+0000","last_clean":"2023-11-17T06:29:58.199372+0000","last_became_active":"2023-11-17T06:29:57.027636+0000","last_became_peered":"2023-11-17T06:29:57.027636+0000","last_unstale":"2023-11-17T06:29:58.199372+0000","last_undegraded":"2023-11-17T06:29:58.199372+0000","last_fullsized":"2023-11-17T06:29:58.199372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:24:12.818384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565276+0000","last_change":"2023-11-17T06:29:57.031701+0000","last_active":"2023-11-17T06:29:58.565276+0000","last_peered":"2023-11-17T06:29:58.565276+0000","last_clean":"2023-11-17T06:29:58.565276+0000","last_became_active":"2023-11-17T06:29:57.031397+0000","last_became_peered":"2023-11-17T06:29:57.031397+0000","last_unstale":"2023-11-17T06:29:58.565276+0000","last_undegraded":"2023-11-17T06:29:58.565276+0000","last_fullsized":"2023-11-17T06:29:58.565276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013173+0000","last_change":"2023-11-17T06:29:57.037976+0000","last_active":"2023-11-17T06:29:58.013173+0000","last_peered":"2023-11-17T06:29:58.013173+0000","last_clean":"2023-11-17T06:29:58.013173+0000","last_became_active":"2023-11-17T06:29:57.036999+0000","last_became_peered":"2023-11-17T06:29:57.036999+0000","last_unstale":"2023-11-17T06:29:58.013173+0000","last_undegraded":"2023-11-17T06:29:58.013173+0000","last_fullsized":"2023-11-17T06:29:58.013173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:54.949043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566569+0000","last_change":"2023-11-17T06:29:57.028161+0000","last_active":"2023-11-17T06:29:58.566569+0000","last_peered":"2023-11-17T06:29:58.566569+0000","last_clean":"2023-11-17T06:29:58.566569+0000","last_became_active":"2023-11-17T06:29:57.027719+0000","last_became_peered":"2023-11-17T06:29:57.027719+0000","last_unstale":"2023-11-17T06:29:58.566569+0000","last_undegraded":"2023-11-17T06:29:58.566569+0000","last_fullsized":"2023-11-17T06:29:58.566569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017219+0000","last_change":"2023-11-17T06:29:56.148518+0000","last_active":"2023-11-17T06:29:58.017219+0000","last_peered":"2023-11-17T06:29:58.017219+0000","last_clean":"2023-11-17T06:29:58.017219+0000","last_became_active":"2023-11-17T06:29:56.148230+0000","last_became_peered":"2023-11-17T06:29:56.148230+0000","last_unstale":"2023-11-17T06:29:58.017219+0000","last_undegraded":"2023-11-17T06:29:58.017219+0000","last_fullsized":"2023-11-17T06:29:58.017219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:41:17.136054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015028+0000","last_change":"2023-11-17T06:29:57.052500+0000","last_active":"2023-11-17T06:29:58.015028+0000","last_peered":"2023-11-17T06:29:58.015028+0000","last_clean":"2023-11-17T06:29:58.015028+0000","last_became_active":"2023-11-17T06:29:57.052003+0000","last_became_peered":"2023-11-17T06:29:57.052003+0000","last_unstale":"2023-11-17T06:29:58.015028+0000","last_undegraded":"2023-11-17T06:29:58.015028+0000","last_fullsized":"2023-11-17T06:29:58.015028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:18.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199730+0000","last_change":"2023-11-17T06:29:56.155235+0000","last_active":"2023-11-17T06:29:58.199730+0000","last_peered":"2023-11-17T06:29:58.199730+0000","last_clean":"2023-11-17T06:29:58.199730+0000","last_became_active":"2023-11-17T06:29:56.154957+0000","last_became_peered":"2023-11-17T06:29:56.154957+0000","last_unstale":"2023-11-17T06:29:58.199730+0000","last_undegraded":"2023-11-17T06:29:58.199730+0000","last_fullsized":"2023-11-17T06:29:58.199730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:16.431952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062637+0000","last_change":"2023-11-17T06:29:56.156231+0000","last_active":"2023-11-17T06:29:58.062637+0000","last_peered":"2023-11-17T06:29:58.062637+0000","last_clean":"2023-11-17T06:29:58.062637+0000","last_became_active":"2023-11-17T06:29:56.155931+0000","last_became_peered":"2023-11-17T06:29:56.155931+0000","last_unstale":"2023-11-17T06:29:58.062637+0000","last_undegraded":"2023-11-17T06:29:58.062637+0000","last_fullsized":"2023-11-17T06:29:58.062637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:38.948788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016874+0000","last_change":"2023-11-17T06:29:57.033651+0000","last_active":"2023-11-17T06:29:58.016874+0000","last_peered":"2023-11-17T06:29:58.016874+0000","last_clean":"2023-11-17T06:29:58.016874+0000","last_became_active":"2023-11-17T06:29:57.030915+0000","last_became_peered":"2023-11-17T06:29:57.030915+0000","last_unstale":"2023-11-17T06:29:58.016874+0000","last_undegraded":"2023-11-17T06:29:58.016874+0000","last_fullsized":"2023-11-17T06:29:58.016874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:04:42.619958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199317+0000","last_change":"2023-11-17T06:29:56.137466+0000","last_active":"2023-11-17T06:29:58.199317+0000","last_peered":"2023-11-17T06:29:58.199317+0000","last_clean":"2023-11-17T06:29:58.199317+0000","last_became_active":"2023-11-17T06:29:56.137116+0000","last_became_peered":"2023-11-17T06:29:56.137116+0000","last_unstale":"2023-11-17T06:29:58.199317+0000","last_undegraded":"2023-11-17T06:29:58.199317+0000","last_fullsized":"2023-11-17T06:29:58.199317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:45.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016060+0000","last_change":"2023-11-17T06:29:57.029054+0000","last_active":"2023-11-17T06:29:58.016060+0000","last_peered":"2023-11-17T06:29:58.016060+0000","last_clean":"2023-11-17T06:29:58.016060+0000","last_became_active":"2023-11-17T06:29:57.028739+0000","last_became_peered":"2023-11-17T06:29:57.028739+0000","last_unstale":"2023-11-17T06:29:58.016060+0000","last_undegraded":"2023-11-17T06:29:58.016060+0000","last_fullsized":"2023-11-17T06:29:58.016060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:17.448030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567805+0000","last_change":"2023-11-17T06:29:56.145242+0000","last_active":"2023-11-17T06:29:58.567805+0000","last_peered":"2023-11-17T06:29:58.567805+0000","last_clean":"2023-11-17T06:29:58.567805+0000","last_became_active":"2023-11-17T06:29:56.144329+0000","last_became_peered":"2023-11-17T06:29:56.144329+0000","last_unstale":"2023-11-17T06:29:58.567805+0000","last_undegraded":"2023-11-17T06:29:58.567805+0000","last_fullsized":"2023-11-17T06:29:58.567805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:53.932965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014039+0000","last_change":"2023-11-17T06:29:57.036204+0000","last_active":"2023-11-17T06:29:58.014039+0000","last_peered":"2023-11-17T06:29:58.014039+0000","last_clean":"2023-11-17T06:29:58.014039+0000","last_became_active":"2023-11-17T06:29:57.035669+0000","last_became_peered":"2023-11-17T06:29:57.035669+0000","last_unstale":"2023-11-17T06:29:58.014039+0000","last_undegraded":"2023-11-17T06:29:58.014039+0000","last_fullsized":"2023-11-17T06:29:58.014039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566699+0000","last_change":"2023-11-17T06:29:56.155411+0000","last_active":"2023-11-17T06:29:58.566699+0000","last_peered":"2023-11-17T06:29:58.566699+0000","last_clean":"2023-11-17T06:29:58.566699+0000","last_became_active":"2023-11-17T06:29:56.154619+0000","last_became_peered":"2023-11-17T06:29:56.154619+0000","last_unstale":"2023-11-17T06:29:58.566699+0000","last_undegraded":"2023-11-17T06:29:58.566699+0000","last_fullsized":"2023-11-17T06:29:58.566699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:52.247242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017631+0000","last_change":"2023-11-17T06:29:57.025598+0000","last_active":"2023-11-17T06:29:58.017631+0000","last_peered":"2023-11-17T06:29:58.017631+0000","last_clean":"2023-11-17T06:29:58.017631+0000","last_became_active":"2023-11-17T06:29:57.025303+0000","last_became_peered":"2023-11-17T06:29:57.025303+0000","last_unstale":"2023-11-17T06:29:58.017631+0000","last_undegraded":"2023-11-17T06:29:58.017631+0000","last_fullsized":"2023-11-17T06:29:58.017631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:36:40.100721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565504+0000","last_change":"2023-11-17T06:29:56.149115+0000","last_active":"2023-11-17T06:29:58.565504+0000","last_peered":"2023-11-17T06:29:58.565504+0000","last_clean":"2023-11-17T06:29:58.565504+0000","last_became_active":"2023-11-17T06:29:56.147653+0000","last_became_peered":"2023-11-17T06:29:56.147653+0000","last_unstale":"2023-11-17T06:29:58.565504+0000","last_undegraded":"2023-11-17T06:29:58.565504+0000","last_fullsized":"2023-11-17T06:29:58.565504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:38:11.759914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199421+0000","last_change":"2023-11-17T06:29:57.034094+0000","last_active":"2023-11-17T06:29:58.199421+0000","last_peered":"2023-11-17T06:29:58.199421+0000","last_clean":"2023-11-17T06:29:58.199421+0000","last_became_active":"2023-11-17T06:29:57.033817+0000","last_became_peered":"2023-11-17T06:29:57.033817+0000","last_unstale":"2023-11-17T06:29:58.199421+0000","last_undegraded":"2023-11-17T06:29:58.199421+0000","last_fullsized":"2023-11-17T06:29:58.199421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:30:22.132748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013489+0000","last_change":"2023-11-17T06:29:56.143656+0000","last_active":"2023-11-17T06:29:58.013489+0000","last_peered":"2023-11-17T06:29:58.013489+0000","last_clean":"2023-11-17T06:29:58.013489+0000","last_became_active":"2023-11-17T06:29:56.140088+0000","last_became_peered":"2023-11-17T06:29:56.140088+0000","last_unstale":"2023-11-17T06:29:58.013489+0000","last_undegraded":"2023-11-17T06:29:58.013489+0000","last_fullsized":"2023-11-17T06:29:58.013489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:38:11.759914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567240+0000","last_change":"2023-11-17T06:29:57.051158+0000","last_active":"2023-11-17T06:29:58.567240+0000","last_peered":"2023-11-17T06:29:58.567240+0000","last_clean":"2023-11-17T06:29:58.567240+0000","last_became_active":"2023-11-17T06:29:57.049255+0000","last_became_peered":"2023-11-17T06:29:57.049255+0000","last_unstale":"2023-11-17T06:29:58.567240+0000","last_undegraded":"2023-11-17T06:29:58.567240+0000","last_fullsized":"2023-11-17T06:29:58.567240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:08:15.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565414+0000","last_change":"2023-11-17T06:29:56.154434+0000","last_active":"2023-11-17T06:29:58.565414+0000","last_peered":"2023-11-17T06:29:58.565414+0000","last_clean":"2023-11-17T06:29:58.565414+0000","last_became_active":"2023-11-17T06:29:56.154071+0000","last_became_peered":"2023-11-17T06:29:56.154071+0000","last_unstale":"2023-11-17T06:29:58.565414+0000","last_undegraded":"2023-11-17T06:29:58.565414+0000","last_fullsized":"2023-11-17T06:29:58.565414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:35:22.859890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062922+0000","last_change":"2023-11-17T06:29:57.028693+0000","last_active":"2023-11-17T06:29:58.062922+0000","last_peered":"2023-11-17T06:29:58.062922+0000","last_clean":"2023-11-17T06:29:58.062922+0000","last_became_active":"2023-11-17T06:29:57.027326+0000","last_became_peered":"2023-11-17T06:29:57.027326+0000","last_unstale":"2023-11-17T06:29:58.062922+0000","last_undegraded":"2023-11-17T06:29:58.062922+0000","last_fullsized":"2023-11-17T06:29:58.062922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:33.609630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199813+0000","last_change":"2023-11-17T06:29:56.145651+0000","last_active":"2023-11-17T06:29:58.199813+0000","last_peered":"2023-11-17T06:29:58.199813+0000","last_clean":"2023-11-17T06:29:58.199813+0000","last_became_active":"2023-11-17T06:29:56.145385+0000","last_became_peered":"2023-11-17T06:29:56.145385+0000","last_unstale":"2023-11-17T06:29:58.199813+0000","last_undegraded":"2023-11-17T06:29:58.199813+0000","last_fullsized":"2023-11-17T06:29:58.199813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:36:14.052058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200161+0000","last_change":"2023-11-17T06:29:57.053050+0000","last_active":"2023-11-17T06:29:58.200161+0000","last_peered":"2023-11-17T06:29:58.200161+0000","last_clean":"2023-11-17T06:29:58.200161+0000","last_became_active":"2023-11-17T06:29:57.052675+0000","last_became_peered":"2023-11-17T06:29:57.052675+0000","last_unstale":"2023-11-17T06:29:58.200161+0000","last_undegraded":"2023-11-17T06:29:58.200161+0000","last_fullsized":"2023-11-17T06:29:58.200161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:38:38.807009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565388+0000","last_change":"2023-11-17T06:29:56.153805+0000","last_active":"2023-11-17T06:29:58.565388+0000","last_peered":"2023-11-17T06:29:58.565388+0000","last_clean":"2023-11-17T06:29:58.565388+0000","last_became_active":"2023-11-17T06:29:56.153075+0000","last_became_peered":"2023-11-17T06:29:56.153075+0000","last_unstale":"2023-11-17T06:29:58.565388+0000","last_undegraded":"2023-11-17T06:29:58.565388+0000","last_fullsized":"2023-11-17T06:29:58.565388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:27.409831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565490+0000","last_change":"2023-11-17T06:29:57.035110+0000","last_active":"2023-11-17T06:29:58.565490+0000","last_peered":"2023-11-17T06:29:58.565490+0000","last_clean":"2023-11-17T06:29:58.565490+0000","last_became_active":"2023-11-17T06:29:57.034811+0000","last_became_peered":"2023-11-17T06:29:57.034811+0000","last_unstale":"2023-11-17T06:29:58.565490+0000","last_undegraded":"2023-11-17T06:29:58.565490+0000","last_fullsized":"2023-11-17T06:29:58.565490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014497+0000","last_change":"2023-11-17T06:29:56.144056+0000","last_active":"2023-11-17T06:29:58.014497+0000","last_peered":"2023-11-17T06:29:58.014497+0000","last_clean":"2023-11-17T06:29:58.014497+0000","last_became_active":"2023-11-17T06:29:56.143742+0000","last_became_peered":"2023-11-17T06:29:56.143742+0000","last_unstale":"2023-11-17T06:29:58.014497+0000","last_undegraded":"2023-11-17T06:29:58.014497+0000","last_fullsized":"2023-11-17T06:29:58.014497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:35.694108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199521+0000","last_change":"2023-11-17T06:29:57.036273+0000","last_active":"2023-11-17T06:29:58.199521+0000","last_peered":"2023-11-17T06:29:58.199521+0000","last_clean":"2023-11-17T06:29:58.199521+0000","last_became_active":"2023-11-17T06:29:57.036003+0000","last_became_peered":"2023-11-17T06:29:57.036003+0000","last_unstale":"2023-11-17T06:29:58.199521+0000","last_undegraded":"2023-11-17T06:29:58.199521+0000","last_fullsized":"2023-11-17T06:29:58.199521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:01:56.186044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567381+0000","last_change":"2023-11-17T06:29:56.153641+0000","last_active":"2023-11-17T06:29:58.567381+0000","last_peered":"2023-11-17T06:29:58.567381+0000","last_clean":"2023-11-17T06:29:58.567381+0000","last_became_active":"2023-11-17T06:29:56.153177+0000","last_became_peered":"2023-11-17T06:29:56.153177+0000","last_unstale":"2023-11-17T06:29:58.567381+0000","last_undegraded":"2023-11-17T06:29:58.567381+0000","last_fullsized":"2023-11-17T06:29:58.567381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:55.058158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014195+0000","last_change":"2023-11-17T06:29:57.053038+0000","last_active":"2023-11-17T06:29:58.014195+0000","last_peered":"2023-11-17T06:29:58.014195+0000","last_clean":"2023-11-17T06:29:58.014195+0000","last_became_active":"2023-11-17T06:29:57.052719+0000","last_became_peered":"2023-11-17T06:29:57.052719+0000","last_unstale":"2023-11-17T06:29:58.014195+0000","last_undegraded":"2023-11-17T06:29:58.014195+0000","last_fullsized":"2023-11-17T06:29:58.014195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:46.928281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015589+0000","last_change":"2023-11-17T06:29:56.151539+0000","last_active":"2023-11-17T06:29:58.015589+0000","last_peered":"2023-11-17T06:29:58.015589+0000","last_clean":"2023-11-17T06:29:58.015589+0000","last_became_active":"2023-11-17T06:29:56.151254+0000","last_became_peered":"2023-11-17T06:29:56.151254+0000","last_unstale":"2023-11-17T06:29:58.015589+0000","last_undegraded":"2023-11-17T06:29:58.015589+0000","last_fullsized":"2023-11-17T06:29:58.015589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:10.132222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567142+0000","last_change":"2023-11-17T06:29:57.050538+0000","last_active":"2023-11-17T06:29:58.567142+0000","last_peered":"2023-11-17T06:29:58.567142+0000","last_clean":"2023-11-17T06:29:58.567142+0000","last_became_active":"2023-11-17T06:29:57.048902+0000","last_became_peered":"2023-11-17T06:29:57.048902+0000","last_unstale":"2023-11-17T06:29:58.567142+0000","last_undegraded":"2023-11-17T06:29:58.567142+0000","last_fullsized":"2023-11-17T06:29:58.567142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:24:54.358531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017259+0000","last_change":"2023-11-17T06:29:56.149833+0000","last_active":"2023-11-17T06:29:58.017259+0000","last_peered":"2023-11-17T06:29:58.017259+0000","last_clean":"2023-11-17T06:29:58.017259+0000","last_became_active":"2023-11-17T06:29:56.149492+0000","last_became_peered":"2023-11-17T06:29:56.149492+0000","last_unstale":"2023-11-17T06:29:58.017259+0000","last_undegraded":"2023-11-17T06:29:58.017259+0000","last_fullsized":"2023-11-17T06:29:58.017259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:14:19.896244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567068+0000","last_change":"2023-11-17T06:29:57.040669+0000","last_active":"2023-11-17T06:29:58.567068+0000","last_peered":"2023-11-17T06:29:58.567068+0000","last_clean":"2023-11-17T06:29:58.567068+0000","last_became_active":"2023-11-17T06:29:57.040042+0000","last_became_peered":"2023-11-17T06:29:57.040042+0000","last_unstale":"2023-11-17T06:29:58.567068+0000","last_undegraded":"2023-11-17T06:29:58.567068+0000","last_fullsized":"2023-11-17T06:29:58.567068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:44:58.041380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063361+0000","last_change":"2023-11-17T06:29:56.157174+0000","last_active":"2023-11-17T06:29:58.063361+0000","last_peered":"2023-11-17T06:29:58.063361+0000","last_clean":"2023-11-17T06:29:58.063361+0000","last_became_active":"2023-11-17T06:29:56.156944+0000","last_became_peered":"2023-11-17T06:29:56.156944+0000","last_unstale":"2023-11-17T06:29:58.063361+0000","last_undegraded":"2023-11-17T06:29:58.063361+0000","last_fullsized":"2023-11-17T06:29:58.063361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:35.694108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200093+0000","last_change":"2023-11-17T06:29:57.020240+0000","last_active":"2023-11-17T06:29:58.200093+0000","last_peered":"2023-11-17T06:29:58.200093+0000","last_clean":"2023-11-17T06:29:58.200093+0000","last_became_active":"2023-11-17T06:29:57.019851+0000","last_became_peered":"2023-11-17T06:29:57.019851+0000","last_unstale":"2023-11-17T06:29:58.200093+0000","last_undegraded":"2023-11-17T06:29:58.200093+0000","last_fullsized":"2023-11-17T06:29:58.200093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:08:16.650719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:57.021221+0000","last_change":"2023-11-17T06:29:48.031659+0000","last_active":"2023-11-17T06:29:57.021221+0000","last_peered":"2023-11-17T06:29:57.021221+0000","last_clean":"2023-11-17T06:29:57.021221+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:29:57.021221+0000","last_undegraded":"2023-11-17T06:29:57.021221+0000","last_fullsized":"2023-11-17T06:29:57.021221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_clean_scrub_stamp":"2023-11-17T06:29:47.005420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:11:29.801860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200114+0000","last_change":"2023-11-17T06:29:56.148120+0000","last_active":"2023-11-17T06:29:58.200114+0000","last_peered":"2023-11-17T06:29:58.200114+0000","last_clean":"2023-11-17T06:29:58.200114+0000","last_became_active":"2023-11-17T06:29:56.147781+0000","last_became_peered":"2023-11-17T06:29:56.147781+0000","last_unstale":"2023-11-17T06:29:58.200114+0000","last_undegraded":"2023-11-17T06:29:58.200114+0000","last_fullsized":"2023-11-17T06:29:58.200114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:24.556455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015195+0000","last_change":"2023-11-17T06:29:57.037133+0000","last_active":"2023-11-17T06:29:58.015195+0000","last_peered":"2023-11-17T06:29:58.015195+0000","last_clean":"2023-11-17T06:29:58.015195+0000","last_became_active":"2023-11-17T06:29:57.036216+0000","last_became_peered":"2023-11-17T06:29:57.036216+0000","last_unstale":"2023-11-17T06:29:58.015195+0000","last_undegraded":"2023-11-17T06:29:58.015195+0000","last_fullsized":"2023-11-17T06:29:58.015195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:53.263320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199454+0000","last_change":"2023-11-17T06:29:56.147063+0000","last_active":"2023-11-17T06:29:58.199454+0000","last_peered":"2023-11-17T06:29:58.199454+0000","last_clean":"2023-11-17T06:29:58.199454+0000","last_became_active":"2023-11-17T06:29:56.146762+0000","last_became_peered":"2023-11-17T06:29:56.146762+0000","last_unstale":"2023-11-17T06:29:58.199454+0000","last_undegraded":"2023-11-17T06:29:58.199454+0000","last_fullsized":"2023-11-17T06:29:58.199454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:32.593552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062691+0000","last_change":"2023-11-17T06:29:57.037884+0000","last_active":"2023-11-17T06:29:58.062691+0000","last_peered":"2023-11-17T06:29:58.062691+0000","last_clean":"2023-11-17T06:29:58.062691+0000","last_became_active":"2023-11-17T06:29:57.037620+0000","last_became_peered":"2023-11-17T06:29:57.037620+0000","last_unstale":"2023-11-17T06:29:58.062691+0000","last_undegraded":"2023-11-17T06:29:58.062691+0000","last_fullsized":"2023-11-17T06:29:58.062691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565109+0000","last_change":"2023-11-17T06:29:56.147310+0000","last_active":"2023-11-17T06:29:58.565109+0000","last_peered":"2023-11-17T06:29:58.565109+0000","last_clean":"2023-11-17T06:29:58.565109+0000","last_became_active":"2023-11-17T06:29:56.146894+0000","last_became_peered":"2023-11-17T06:29:56.146894+0000","last_unstale":"2023-11-17T06:29:58.565109+0000","last_undegraded":"2023-11-17T06:29:58.565109+0000","last_fullsized":"2023-11-17T06:29:58.565109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:09:09.862678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016713+0000","last_change":"2023-11-17T06:29:57.024088+0000","last_active":"2023-11-17T06:29:58.016713+0000","last_peered":"2023-11-17T06:29:58.016713+0000","last_clean":"2023-11-17T06:29:58.016713+0000","last_became_active":"2023-11-17T06:29:57.023805+0000","last_became_peered":"2023-11-17T06:29:57.023805+0000","last_unstale":"2023-11-17T06:29:58.016713+0000","last_undegraded":"2023-11-17T06:29:58.016713+0000","last_fullsized":"2023-11-17T06:29:58.016713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:25:07.897379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200019+0000","last_change":"2023-11-17T06:29:56.143041+0000","last_active":"2023-11-17T06:29:58.200019+0000","last_peered":"2023-11-17T06:29:58.200019+0000","last_clean":"2023-11-17T06:29:58.200019+0000","last_became_active":"2023-11-17T06:29:56.142647+0000","last_became_peered":"2023-11-17T06:29:56.142647+0000","last_unstale":"2023-11-17T06:29:58.200019+0000","last_undegraded":"2023-11-17T06:29:58.200019+0000","last_fullsized":"2023-11-17T06:29:58.200019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:56:51.565071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566104+0000","last_change":"2023-11-17T06:29:57.049541+0000","last_active":"2023-11-17T06:29:58.566104+0000","last_peered":"2023-11-17T06:29:58.566104+0000","last_clean":"2023-11-17T06:29:58.566104+0000","last_became_active":"2023-11-17T06:29:57.049268+0000","last_became_peered":"2023-11-17T06:29:57.049268+0000","last_unstale":"2023-11-17T06:29:58.566104+0000","last_undegraded":"2023-11-17T06:29:58.566104+0000","last_fullsized":"2023-11-17T06:29:58.566104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:56:52.581149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017143+0000","last_change":"2023-11-17T06:29:56.147186+0000","last_active":"2023-11-17T06:29:58.017143+0000","last_peered":"2023-11-17T06:29:58.017143+0000","last_clean":"2023-11-17T06:29:58.017143+0000","last_became_active":"2023-11-17T06:29:56.146837+0000","last_became_peered":"2023-11-17T06:29:56.146837+0000","last_unstale":"2023-11-17T06:29:58.017143+0000","last_undegraded":"2023-11-17T06:29:58.017143+0000","last_fullsized":"2023-11-17T06:29:58.017143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:52:20.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013443+0000","last_change":"2023-11-17T06:29:57.041411+0000","last_active":"2023-11-17T06:29:58.013443+0000","last_peered":"2023-11-17T06:29:58.013443+0000","last_clean":"2023-11-17T06:29:58.013443+0000","last_became_active":"2023-11-17T06:29:57.041080+0000","last_became_peered":"2023-11-17T06:29:57.041080+0000","last_unstale":"2023-11-17T06:29:58.013443+0000","last_undegraded":"2023-11-17T06:29:58.013443+0000","last_fullsized":"2023-11-17T06:29:58.013443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200289+0000","last_change":"2023-11-17T06:29:56.143922+0000","last_active":"2023-11-17T06:29:58.200289+0000","last_peered":"2023-11-17T06:29:58.200289+0000","last_clean":"2023-11-17T06:29:58.200289+0000","last_became_active":"2023-11-17T06:29:56.143475+0000","last_became_peered":"2023-11-17T06:29:56.143475+0000","last_unstale":"2023-11-17T06:29:58.200289+0000","last_undegraded":"2023-11-17T06:29:58.200289+0000","last_fullsized":"2023-11-17T06:29:58.200289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:00:32.599388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063284+0000","last_change":"2023-11-17T06:29:57.029861+0000","last_active":"2023-11-17T06:29:58.063284+0000","last_peered":"2023-11-17T06:29:58.063284+0000","last_clean":"2023-11-17T06:29:58.063284+0000","last_became_active":"2023-11-17T06:29:57.029360+0000","last_became_peered":"2023-11-17T06:29:57.029360+0000","last_unstale":"2023-11-17T06:29:58.063284+0000","last_undegraded":"2023-11-17T06:29:58.063284+0000","last_fullsized":"2023-11-17T06:29:58.063284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:18.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015784+0000","last_change":"2023-11-17T06:29:56.152922+0000","last_active":"2023-11-17T06:29:58.015784+0000","last_peered":"2023-11-17T06:29:58.015784+0000","last_clean":"2023-11-17T06:29:58.015784+0000","last_became_active":"2023-11-17T06:29:56.152632+0000","last_became_peered":"2023-11-17T06:29:56.152632+0000","last_unstale":"2023-11-17T06:29:58.015784+0000","last_undegraded":"2023-11-17T06:29:58.015784+0000","last_fullsized":"2023-11-17T06:29:58.015784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:32.593552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015562+0000","last_change":"2023-11-17T06:29:57.036541+0000","last_active":"2023-11-17T06:29:58.015562+0000","last_peered":"2023-11-17T06:29:58.015562+0000","last_clean":"2023-11-17T06:29:58.015562+0000","last_became_active":"2023-11-17T06:29:57.034954+0000","last_became_peered":"2023-11-17T06:29:57.034954+0000","last_unstale":"2023-11-17T06:29:58.015562+0000","last_undegraded":"2023-11-17T06:29:58.015562+0000","last_fullsized":"2023-11-17T06:29:58.015562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:13:22.110656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200289+0000","last_change":"2023-11-17T06:29:56.156668+0000","last_active":"2023-11-17T06:29:58.200289+0000","last_peered":"2023-11-17T06:29:58.200289+0000","last_clean":"2023-11-17T06:29:58.200289+0000","last_became_active":"2023-11-17T06:29:56.155662+0000","last_became_peered":"2023-11-17T06:29:56.155662+0000","last_unstale":"2023-11-17T06:29:58.200289+0000","last_undegraded":"2023-11-17T06:29:58.200289+0000","last_fullsized":"2023-11-17T06:29:58.200289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:56:30.930517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015394+0000","last_change":"2023-11-17T06:29:57.034365+0000","last_active":"2023-11-17T06:29:58.015394+0000","last_peered":"2023-11-17T06:29:58.015394+0000","last_clean":"2023-11-17T06:29:58.015394+0000","last_became_active":"2023-11-17T06:29:57.034154+0000","last_became_peered":"2023-11-17T06:29:57.034154+0000","last_unstale":"2023-11-17T06:29:58.015394+0000","last_undegraded":"2023-11-17T06:29:58.015394+0000","last_fullsized":"2023-11-17T06:29:58.015394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:31:15.968761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565274+0000","last_change":"2023-11-17T06:29:56.153356+0000","last_active":"2023-11-17T06:29:58.565274+0000","last_peered":"2023-11-17T06:29:58.565274+0000","last_clean":"2023-11-17T06:29:58.565274+0000","last_became_active":"2023-11-17T06:29:56.153004+0000","last_became_peered":"2023-11-17T06:29:56.153004+0000","last_unstale":"2023-11-17T06:29:58.565274+0000","last_undegraded":"2023-11-17T06:29:58.565274+0000","last_fullsized":"2023-11-17T06:29:58.565274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:17.338010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199179+0000","last_change":"2023-11-17T06:29:57.029538+0000","last_active":"2023-11-17T06:29:58.199179+0000","last_peered":"2023-11-17T06:29:58.199179+0000","last_clean":"2023-11-17T06:29:58.199179+0000","last_became_active":"2023-11-17T06:29:57.029210+0000","last_became_peered":"2023-11-17T06:29:57.029210+0000","last_unstale":"2023-11-17T06:29:58.199179+0000","last_undegraded":"2023-11-17T06:29:58.199179+0000","last_fullsized":"2023-11-17T06:29:58.199179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:24:54.358531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014921+0000","last_change":"2023-11-17T06:29:56.154270+0000","last_active":"2023-11-17T06:29:58.014921+0000","last_peered":"2023-11-17T06:29:58.014921+0000","last_clean":"2023-11-17T06:29:58.014921+0000","last_became_active":"2023-11-17T06:29:56.153931+0000","last_became_peered":"2023-11-17T06:29:56.153931+0000","last_unstale":"2023-11-17T06:29:58.014921+0000","last_undegraded":"2023-11-17T06:29:58.014921+0000","last_fullsized":"2023-11-17T06:29:58.014921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:27.409831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014523+0000","last_change":"2023-11-17T06:29:57.023492+0000","last_active":"2023-11-17T06:29:58.014523+0000","last_peered":"2023-11-17T06:29:58.014523+0000","last_clean":"2023-11-17T06:29:58.014523+0000","last_became_active":"2023-11-17T06:29:57.023199+0000","last_became_peered":"2023-11-17T06:29:57.023199+0000","last_unstale":"2023-11-17T06:29:58.014523+0000","last_undegraded":"2023-11-17T06:29:58.014523+0000","last_fullsized":"2023-11-17T06:29:58.014523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:25.572533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063127+0000","last_change":"2023-11-17T06:29:56.151644+0000","last_active":"2023-11-17T06:29:58.063127+0000","last_peered":"2023-11-17T06:29:58.063127+0000","last_clean":"2023-11-17T06:29:58.063127+0000","last_became_active":"2023-11-17T06:29:56.151334+0000","last_became_peered":"2023-11-17T06:29:56.151334+0000","last_unstale":"2023-11-17T06:29:58.063127+0000","last_undegraded":"2023-11-17T06:29:58.063127+0000","last_fullsized":"2023-11-17T06:29:58.063127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:50.793814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565539+0000","last_change":"2023-11-17T06:29:57.030102+0000","last_active":"2023-11-17T06:29:58.565539+0000","last_peered":"2023-11-17T06:29:58.565539+0000","last_clean":"2023-11-17T06:29:58.565539+0000","last_became_active":"2023-11-17T06:29:57.028292+0000","last_became_peered":"2023-11-17T06:29:57.028292+0000","last_unstale":"2023-11-17T06:29:58.565539+0000","last_undegraded":"2023-11-17T06:29:58.565539+0000","last_fullsized":"2023-11-17T06:29:58.565539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199917+0000","last_change":"2023-11-17T06:29:56.147463+0000","last_active":"2023-11-17T06:29:58.199917+0000","last_peered":"2023-11-17T06:29:58.199917+0000","last_clean":"2023-11-17T06:29:58.199917+0000","last_became_active":"2023-11-17T06:29:56.147172+0000","last_became_peered":"2023-11-17T06:29:56.147172+0000","last_unstale":"2023-11-17T06:29:58.199917+0000","last_undegraded":"2023-11-17T06:29:58.199917+0000","last_fullsized":"2023-11-17T06:29:58.199917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:31:14.952683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199574+0000","last_change":"2023-11-17T06:29:57.030874+0000","last_active":"2023-11-17T06:29:58.199574+0000","last_peered":"2023-11-17T06:29:58.199574+0000","last_clean":"2023-11-17T06:29:58.199574+0000","last_became_active":"2023-11-17T06:29:57.030602+0000","last_became_peered":"2023-11-17T06:29:57.030602+0000","last_unstale":"2023-11-17T06:29:58.199574+0000","last_undegraded":"2023-11-17T06:29:58.199574+0000","last_fullsized":"2023-11-17T06:29:58.199574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:40:17.803427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199948+0000","last_change":"2023-11-17T06:29:57.050840+0000","last_active":"2023-11-17T06:29:58.199948+0000","last_peered":"2023-11-17T06:29:58.199948+0000","last_clean":"2023-11-17T06:29:58.199948+0000","last_became_active":"2023-11-17T06:29:57.050346+0000","last_became_peered":"2023-11-17T06:29:57.050346+0000","last_unstale":"2023-11-17T06:29:58.199948+0000","last_undegraded":"2023-11-17T06:29:58.199948+0000","last_fullsized":"2023-11-17T06:29:58.199948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:25:35.354706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567223+0000","last_change":"2023-11-17T06:29:56.153913+0000","last_active":"2023-11-17T06:29:58.567223+0000","last_peered":"2023-11-17T06:29:58.567223+0000","last_clean":"2023-11-17T06:29:58.567223+0000","last_became_active":"2023-11-17T06:29:56.153474+0000","last_became_peered":"2023-11-17T06:29:56.153474+0000","last_unstale":"2023-11-17T06:29:58.567223+0000","last_undegraded":"2023-11-17T06:29:58.567223+0000","last_fullsized":"2023-11-17T06:29:58.567223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:53.932965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567084+0000","last_change":"2023-11-17T06:29:57.041986+0000","last_active":"2023-11-17T06:29:58.567084+0000","last_peered":"2023-11-17T06:29:58.567084+0000","last_clean":"2023-11-17T06:29:58.567084+0000","last_became_active":"2023-11-17T06:29:57.041251+0000","last_became_peered":"2023-11-17T06:29:57.041251+0000","last_unstale":"2023-11-17T06:29:58.567084+0000","last_undegraded":"2023-11-17T06:29:58.567084+0000","last_fullsized":"2023-11-17T06:29:58.567084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:28.425909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567460+0000","last_change":"2023-11-17T06:29:56.155103+0000","last_active":"2023-11-17T06:29:58.567460+0000","last_peered":"2023-11-17T06:29:58.567460+0000","last_clean":"2023-11-17T06:29:58.567460+0000","last_became_active":"2023-11-17T06:29:56.154824+0000","last_became_peered":"2023-11-17T06:29:56.154824+0000","last_unstale":"2023-11-17T06:29:58.567460+0000","last_undegraded":"2023-11-17T06:29:58.567460+0000","last_fullsized":"2023-11-17T06:29:58.567460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:13:21.094578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017560+0000","last_change":"2023-11-17T06:29:57.028924+0000","last_active":"2023-11-17T06:29:58.017560+0000","last_peered":"2023-11-17T06:29:58.017560+0000","last_clean":"2023-11-17T06:29:58.017560+0000","last_became_active":"2023-11-17T06:29:57.028381+0000","last_became_peered":"2023-11-17T06:29:57.028381+0000","last_unstale":"2023-11-17T06:29:58.017560+0000","last_undegraded":"2023-11-17T06:29:58.017560+0000","last_fullsized":"2023-11-17T06:29:58.017560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:16:29.542871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017697+0000","last_change":"2023-11-17T06:29:56.147117+0000","last_active":"2023-11-17T06:29:58.017697+0000","last_peered":"2023-11-17T06:29:58.017697+0000","last_clean":"2023-11-17T06:29:58.017697+0000","last_became_active":"2023-11-17T06:29:56.146805+0000","last_became_peered":"2023-11-17T06:29:56.146805+0000","last_unstale":"2023-11-17T06:29:58.017697+0000","last_undegraded":"2023-11-17T06:29:58.017697+0000","last_fullsized":"2023-11-17T06:29:58.017697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:24:37.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017661+0000","last_change":"2023-11-17T06:29:57.046219+0000","last_active":"2023-11-17T06:29:58.017661+0000","last_peered":"2023-11-17T06:29:58.017661+0000","last_clean":"2023-11-17T06:29:58.017661+0000","last_became_active":"2023-11-17T06:29:57.045949+0000","last_became_peered":"2023-11-17T06:29:57.045949+0000","last_unstale":"2023-11-17T06:29:58.017661+0000","last_undegraded":"2023-11-17T06:29:58.017661+0000","last_fullsized":"2023-11-17T06:29:58.017661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:31:49.682905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015780+0000","last_change":"2023-11-17T06:29:56.141229+0000","last_active":"2023-11-17T06:29:58.015780+0000","last_peered":"2023-11-17T06:29:58.015780+0000","last_clean":"2023-11-17T06:29:58.015780+0000","last_became_active":"2023-11-17T06:29:56.140850+0000","last_became_peered":"2023-11-17T06:29:56.140850+0000","last_unstale":"2023-11-17T06:29:58.015780+0000","last_undegraded":"2023-11-17T06:29:58.015780+0000","last_fullsized":"2023-11-17T06:29:58.015780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:45.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6379999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.746}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]}]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":80911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.635}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8440000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":83195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.224}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7949999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.829}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7250000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8560000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.889}]}]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4710000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.716}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.754}]}]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":80967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3740000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]}]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":671371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7729999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7250000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:30:01.926 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-17T06:30:01.927 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-17T06:30:01.927 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-17T06:30:01.927 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-17T06:30:01.927 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-17T06:30:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.144+0000 7f57c8b5d700 1 Processor -- start 2023-11-17T06:30:02.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.144+0000 7f57c8b5d700 1 -- start start 2023-11-17T06:30:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c8b5d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c415a2b0 0x7f57c40ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c8b5d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f57c40c98c0 0x7f57c40cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c8b5d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c40cca40 con 0x7f57c4159ed0 2023-11-17T06:30:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c8b5d700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c40ccdb0 con 0x7f57c40c98c0 2023-11-17T06:30:02.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c8b5d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40caef0 con 0x7f57c415a2b0 2023-11-17T06:30:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c37fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f57c4159ed0 0x7f57c40706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53388/0 (socket says 172.21.15.69:53388) 2023-11-17T06:30:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c37fe700 1 -- 172.21.15.69:0/2730481726 learned_addr learned my addr 172.21.15.69:0/2730481726 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c3fff700 1 --2- 172.21.15.69:0/2730481726 >> v2:172.21.15.93:3300/0 conn(0x7f57c40c98c0 0x7f57c40cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57baffd700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c415a2b0 0x7f57c40ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528866484 0 0) 0x7f57c40cca40 con 0x7f57c4159ed0 2023-11-17T06:30:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a40035d0 con 0x7f57c4159ed0 2023-11-17T06:30:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1757788835 0 0) 0x7f57a40035d0 con 0x7f57c4159ed0 2023-11-17T06:30:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c415a2b0 msgr2=0x7f57c40ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c415a2b0 0x7f57c40ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 >> v2:172.21.15.93:3300/0 conn(0x7f57c40c98c0 msgr2=0x7f57c40cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 --2- 172.21.15.69:0/2730481726 >> v2:172.21.15.93:3300/0 conn(0x7f57c40c98c0 0x7f57c40cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40cdf60 con 0x7f57c4159ed0 2023-11-17T06:30:02.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f57b4001670 con 0x7f57c4159ed0 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 >> v1:172.21.15.69:6789/0 conn(0x7f57c4159ed0 legacy=0x7f57c40706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a4003a20 0x7f57a4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57a4004870 0x7f57a4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c415a2b0 0x7f57a4005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40ccdb0 con 0x7f57a4004870 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40caef0 con 0x7f57a4003a20 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a400ba60 con 0x7f57c415a2b0 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57baffd700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57a4004870 0x7f57a4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.148+0000 7f57c37fe700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a4003a20 0x7f57a4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c3fff700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c415a2b0 0x7f57a4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57baffd700 1 -- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c415a2b0 msgr2=0x7f57a4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:02.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57baffd700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c415a2b0 0x7f57a4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57baffd700 1 -- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a4003a20 msgr2=0x7f57a4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:02.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57baffd700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a4003a20 0x7f57a4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57baffd700 1 -- 172.21.15.69:0/2730481726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a40035d0 con 0x7f57a4004870 2023-11-17T06:30:02.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57baffd700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57a4004870 0x7f57a4004cf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009b70 tx=0x7f57a40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19164fd5ab4eb64 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:02.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00e660 con 0x7f57a4004870 2023-11-17T06:30:02.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00e7c0 con 0x7f57a4004870 2023-11-17T06:30:02.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c2ffd700 1 -- 172.21.15.69:0/2730481726 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00eb30 con 0x7f57a4004870 2023-11-17T06:30:02.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2730481726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57a4004870 msgr2=0x7f57a4004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c8b5d700 1 --2- 172.21.15.69:0/2730481726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57a4004870 0x7f57a4004cf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009b70 tx=0x7f57a40058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c3fff700 1 -- 172.21.15.69:0/2730481726 reap_dead start 2023-11-17T06:30:02.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2730481726 shutdown_connections 2023-11-17T06:30:02.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2730481726 >> 172.21.15.69:0/2730481726 conn(0x7f57c40b0900 msgr2=0x7f57c40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:02.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2730481726 shutdown_connections 2023-11-17T06:30:02.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.152+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2730481726 wait complete. 2023-11-17T06:30:02.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c8b5d700 1 Processor -- start 2023-11-17T06:30:02.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c8b5d700 1 -- start start 2023-11-17T06:30:02.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c8b5d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a4004870 0x7f57c40b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c8b5d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c40b43a0 0x7f57c40c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c8b5d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57c40b18d0 0x7f57c4150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c8b5d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40b2aa0 con 0x7f57c40b18d0 2023-11-17T06:30:02.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c8b5d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40b1e90 con 0x7f57a4004870 2023-11-17T06:30:02.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c8b5d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40b2170 con 0x7f57c40b43a0 2023-11-17T06:30:02.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57c40b18d0 0x7f57c4150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57c40b18d0 0x7f57c4150f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53190/0 (socket says 172.21.15.69:53190) 2023-11-17T06:30:02.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c3fff700 1 -- 172.21.15.69:0/2694268567 learned_addr learned my addr 172.21.15.69:0/2694268567 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:02.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57c37fe700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a4004870 0x7f57c40b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.156+0000 7f57baffd700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c40b43a0 0x7f57c40c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c3fff700 1 -- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c40b43a0 msgr2=0x7f57c40c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c3fff700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c40b43a0 0x7f57c40c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c3fff700 1 -- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a4004870 msgr2=0x7f57c40b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c3fff700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a4004870 0x7f57c40b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c3fff700 1 -- 172.21.15.69:0/2694268567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40b2450 con 0x7f57c40b18d0 2023-11-17T06:30:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57baffd700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c40b43a0 0x7f57c40c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c3fff700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57c40b18d0 0x7f57c4150f90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f57c40cfed0 tx=0x7f57bc011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c0ff9700 1 -- 172.21.15.69:0/2694268567 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc003a40 con 0x7f57c40b18d0 2023-11-17T06:30:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c0ff9700 1 -- 172.21.15.69:0/2694268567 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc003ba0 con 0x7f57c40b18d0 2023-11-17T06:30:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2694268567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c40b2730 con 0x7f57c40b18d0 2023-11-17T06:30:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c0ff9700 1 -- 172.21.15.69:0/2694268567 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc004030 con 0x7f57c40b18d0 2023-11-17T06:30:02.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2694268567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c40c7f90 con 0x7f57c40b18d0 2023-11-17T06:30:02.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.160+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2694268567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c40b28c0 con 0x7f57c40b18d0 2023-11-17T06:30:02.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.164+0000 7f57c0ff9700 1 -- 172.21.15.69:0/2694268567 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f57bc004190 con 0x7f57c40b18d0 2023-11-17T06:30:02.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.164+0000 7f57c0ff9700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57a8066510 0x7f57a80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.164+0000 7f57c0ff9700 1 -- 172.21.15.69:0/2694268567 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57bc084520 con 0x7f57c40b18d0 2023-11-17T06:30:02.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.164+0000 7f57c37fe700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57a8066510 0x7f57a80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.168+0000 7f57c37fe700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57a8066510 0x7f57a80689d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f57b4001050 tx=0x7f57b4007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:02.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.172+0000 7f57c0ff9700 1 -- 172.21.15.69:0/2694268567 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f57bc051910 con 0x7f57c40b18d0 2023-11-17T06:30:02.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.400+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2694268567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f57c4073f00 con 0x7f57c40b18d0 2023-11-17T06:30:02.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.408+0000 7f57c0ff9700 1 -- 172.21.15.69:0/2694268567 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164428 (secure 0 0 0) 0x7f57bc054f30 con 0x7f57c40b18d0 2023-11-17T06:30:02.415 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57a8066510 msgr2=0x7f57a80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57a8066510 0x7f57a80689d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f57b4001050 tx=0x7f57b4007040 comp rx=0 tx=0).stop 2023-11-17T06:30:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2694268567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57c40b18d0 msgr2=0x7f57c4150f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57c40b18d0 0x7f57c4150f90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f57c40cfed0 tx=0x7f57bc011f90 comp rx=0 tx=0).stop 2023-11-17T06:30:02.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2694268567 shutdown_connections 2023-11-17T06:30:02.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57a8066510 0x7f57a80689d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57c40b18d0 0x7f57c4150f90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57c40b43a0 0x7f57c40c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 --2- 172.21.15.69:0/2694268567 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57a4004870 0x7f57c40b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2694268567 >> 172.21.15.69:0/2694268567 conn(0x7f57c40b0900 msgr2=0x7f57c415ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:02.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2694268567 shutdown_connections 2023-11-17T06:30:02.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.412+0000 7f57c8b5d700 1 -- 172.21.15.69:0/2694268567 wait complete. 2023-11-17T06:30:02.440 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1112302525},{"type":"v1","addr":"172.21.15.93:6801","nonce":1112302525}]},"active_addr":"172.21.15.93:6801/1112302525","active_change":"2023-11-17T06:28:38.327647+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":1242754785}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":2100692035}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":826431195}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":282680123}]}]} 2023-11-17T06:30:02.443 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-17T06:30:02.444 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-17T06:30:02.444 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:02.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.612+0000 7efe4b59e700 1 Processor -- start 2023-11-17T06:30:02.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.612+0000 7efe4b59e700 1 -- start start 2023-11-17T06:30:02.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.612+0000 7efe4b59e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efe4c0cd5a0 0x7efe4c159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.612+0000 7efe4b59e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efe4c0cebb0 0x7efe4c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4b59e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4c0cdb10 con 0x7efe4c06b5e0 2023-11-17T06:30:02.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4b59e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c0665a0 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4b59e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c0cddf0 con 0x7efe4c0cebb0 2023-11-17T06:30:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4a59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efe4c0cd5a0 0x7efe4c159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4a59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efe4c0cd5a0 0x7efe4c159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53204/0 (socket says 172.21.15.69:53204) 2023-11-17T06:30:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4a59c700 1 -- 172.21.15.69:0/2337167851 learned_addr learned my addr 172.21.15.69:0/2337167851 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:02.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4ad9d700 1 --2- 172.21.15.69:0/2337167851 >> v2:172.21.15.93:3300/0 conn(0x7efe4c0cebb0 0x7efe4c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4a59c700 1 -- 172.21.15.69:0/2337167851 >> v2:172.21.15.93:3300/0 conn(0x7efe4c0cebb0 msgr2=0x7efe4c15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:02.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4a59c700 1 --2- 172.21.15.69:0/2337167851 >> v2:172.21.15.93:3300/0 conn(0x7efe4c0cebb0 0x7efe4c15d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4a59c700 1 -- 172.21.15.69:0/2337167851 >> v1:172.21.15.93:6789/0 conn(0x7efe4c06b5e0 legacy=0x7efe4c065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:02.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4a59c700 1 -- 172.21.15.69:0/2337167851 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c0ce0d0 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4ad9d700 1 --2- 172.21.15.69:0/2337167851 >> v2:172.21.15.93:3300/0 conn(0x7efe4c0cebb0 0x7efe4c15d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:02.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe4a59c700 1 --2- 172.21.15.69:0/2337167851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 0x7efe4c159750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0ca2b0 tx=0x7efe3c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32b43acce2589ec server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:02.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe49d9b700 1 -- 172.21.15.69:0/2337167851 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c00ba20 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe49d9b700 1 -- 172.21.15.69:0/2337167851 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3c00bb80 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.616+0000 7efe49d9b700 1 -- 172.21.15.69:0/2337167851 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3c009e60 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.620+0000 7efe4b59e700 1 -- 172.21.15.69:0/2337167851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 msgr2=0x7efe4c159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.620+0000 7efe4b59e700 1 --2- 172.21.15.69:0/2337167851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 0x7efe4c159750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe4c0ca2b0 tx=0x7efe3c009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:02.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.620+0000 7efe4b59e700 1 -- 172.21.15.69:0/2337167851 shutdown_connections 2023-11-17T06:30:02.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.620+0000 7efe4b59e700 1 --2- 172.21.15.69:0/2337167851 >> v2:172.21.15.93:3300/0 conn(0x7efe4c0cebb0 0x7efe4c15d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.620+0000 7efe4b59e700 1 --2- 172.21.15.69:0/2337167851 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 0x7efe4c159750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.620+0000 7efe4b59e700 1 -- 172.21.15.69:0/2337167851 >> 172.21.15.69:0/2337167851 conn(0x7efe4c0cf5d0 msgr2=0x7efe4c0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:02.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.620+0000 7efe4b59e700 1 -- 172.21.15.69:0/2337167851 shutdown_connections 2023-11-17T06:30:02.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.620+0000 7efe4b59e700 1 -- 172.21.15.69:0/2337167851 wait complete. 2023-11-17T06:30:02.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe4b59e700 1 Processor -- start 2023-11-17T06:30:02.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe4b59e700 1 -- start start 2023-11-17T06:30:02.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe4b59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c06b5e0 0x7efe4c14b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe4b59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 0x7efe4c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe4b59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe4c0cebb0 0x7efe4c15d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe4b59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c14bf00 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe4b59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0c8e10 con 0x7efe4c06b5e0 2023-11-17T06:30:02.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe4b59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0c90f0 con 0x7efe4c0cebb0 2023-11-17T06:30:02.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe41d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 0x7efe4c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe41d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 0x7efe4c0c8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53212/0 (socket says 172.21.15.69:53212) 2023-11-17T06:30:02.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe41d9b700 1 -- 172.21.15.69:0/1170585780 learned_addr learned my addr 172.21.15.69:0/1170585780 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:02.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe4a59c700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c06b5e0 0x7efe4c14b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe4ad9d700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe4c0cebb0 0x7efe4c15d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe41d9b700 1 -- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe4c0cebb0 msgr2=0x7efe4c15d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe41d9b700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe4c0cebb0 0x7efe4c15d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe41d9b700 1 -- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c06b5e0 msgr2=0x7efe4c14b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe41d9b700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c06b5e0 0x7efe4c14b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.624+0000 7efe41d9b700 1 -- 172.21.15.69:0/1170585780 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c009570 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.628+0000 7efe41d9b700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 0x7efe4c0c8400 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe3400cc20 tx=0x7efe3400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:02.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.628+0000 7efe437fe700 1 -- 172.21.15.69:0/1170585780 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe34003c20 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.628+0000 7efe4b59e700 1 -- 172.21.15.69:0/1170585780 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4c0c93d0 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.628+0000 7efe437fe700 1 -- 172.21.15.69:0/1170585780 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe34003da0 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.628+0000 7efe437fe700 1 -- 172.21.15.69:0/1170585780 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3400ac60 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.628+0000 7efe4b59e700 1 -- 172.21.15.69:0/1170585780 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c166700 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.628+0000 7efe4b59e700 1 -- 172.21.15.69:0/1170585780 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4c166920 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.632+0000 7efe437fe700 1 -- 172.21.15.69:0/1170585780 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efe340050d0 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.632+0000 7efe437fe700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efe2c066510 0x7efe2c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:02.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.632+0000 7efe437fe700 1 -- 172.21.15.69:0/1170585780 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe340840a0 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.632+0000 7efe4a59c700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efe2c066510 0x7efe2c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:02.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.636+0000 7efe4a59c700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efe2c066510 0x7efe2c0689d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe3c000c00 tx=0x7efe3c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:02.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.640+0000 7efe437fe700 1 -- 172.21.15.69:0/1170585780 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efe340b5090 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.745 INFO:tasks.ceph.mds.c.smithi069.stderr:2023-11-17T06:30:02.740+0000 7f0119ae5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:30:02.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.820+0000 7efe4b59e700 1 -- 172.21.15.69:0/1170585780 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe4c073f00 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.824+0000 7efe437fe700 1 -- 172.21.15.69:0/1170585780 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7efe34051400 con 0x7efe4c0cd5a0 2023-11-17T06:30:02.828 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:02.829 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:58.004301+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:02.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.824+0000 7efe4b59e700 1 -- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efe2c066510 msgr2=0x7efe2c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.824+0000 7efe4b59e700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efe2c066510 0x7efe2c0689d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efe3c000c00 tx=0x7efe3c008030 comp rx=0 tx=0).stop 2023-11-17T06:30:02.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.824+0000 7efe4b59e700 1 -- 172.21.15.69:0/1170585780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 msgr2=0x7efe4c0c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:02.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.824+0000 7efe4b59e700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 0x7efe4c0c8400 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe3400cc20 tx=0x7efe3400a060 comp rx=0 tx=0).stop 2023-11-17T06:30:02.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.828+0000 7efe4b59e700 1 -- 172.21.15.69:0/1170585780 shutdown_connections 2023-11-17T06:30:02.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.828+0000 7efe4b59e700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efe2c066510 0x7efe2c0689d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.828+0000 7efe4b59e700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efe4c0cebb0 0x7efe4c15d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.828+0000 7efe4b59e700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe4c0cd5a0 0x7efe4c0c8400 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.828+0000 7efe4b59e700 1 --2- 172.21.15.69:0/1170585780 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c06b5e0 0x7efe4c14b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:02.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.828+0000 7efe4b59e700 1 -- 172.21.15.69:0/1170585780 >> 172.21.15.69:0/1170585780 conn(0x7efe4c0cf5d0 msgr2=0x7efe4c0731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:02.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.828+0000 7efe4b59e700 1 -- 172.21.15.69:0/1170585780 shutdown_connections 2023-11-17T06:30:02.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:02.828+0000 7efe4b59e700 1 -- 172.21.15.69:0/1170585780 wait complete. 2023-11-17T06:30:02.854 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-17T06:30:02.854 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.032+0000 7fbbf1523700 1 Processor -- start 2023-11-17T06:30:03.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.032+0000 7fbbf1523700 1 -- start start 2023-11-17T06:30:03.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.032+0000 7fbbf1523700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbbec15d460 0x7fbbec06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.032+0000 7fbbf1523700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec06b290 con 0x7fbbec0d4270 2023-11-17T06:30:03.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.032+0000 7fbbf1523700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec0d3790 con 0x7fbbec15d840 2023-11-17T06:30:03.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.032+0000 7fbbf1523700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec0d3a70 con 0x7fbbec15d460 2023-11-17T06:30:03.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbebfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fbbec0d4270 0x7fbbec0b4eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53398/0 (socket says 172.21.15.69:53398) 2023-11-17T06:30:03.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbebfff700 1 -- 172.21.15.69:0/3962179238 learned_addr learned my addr 172.21.15.69:0/3962179238 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbeaffd700 1 --2- 172.21.15.69:0/3962179238 >> v2:172.21.15.93:3300/0 conn(0x7fbbec15d460 0x7fbbec06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbe9ffb700 1 -- 172.21.15.69:0/3962179238 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1500430899 0 0) 0x7fbbec06b290 con 0x7fbbec0d4270 2023-11-17T06:30:03.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbe9ffb700 1 -- 172.21.15.69:0/3962179238 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd40035d0 con 0x7fbbec0d4270 2023-11-17T06:30:03.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbeaffd700 1 -- 172.21.15.69:0/3962179238 >> v1:172.21.15.93:6789/0 conn(0x7fbbec15d840 legacy=0x7fbbec0cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbeaffd700 1 -- 172.21.15.69:0/3962179238 >> v1:172.21.15.69:6789/0 conn(0x7fbbec0d4270 legacy=0x7fbbec0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbeaffd700 1 -- 172.21.15.69:0/3962179238 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec0d3d50 con 0x7fbbec15d460 2023-11-17T06:30:03.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbeaffd700 1 --2- 172.21.15.69:0/3962179238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbec15d460 0x7fbbec06acb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009850 tx=0x7fbbdc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b55a34d395447c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbe9ffb700 1 -- 172.21.15.69:0/3962179238 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc011830 con 0x7fbbec15d460 2023-11-17T06:30:03.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbe9ffb700 1 -- 172.21.15.69:0/3962179238 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc011990 con 0x7fbbec15d460 2023-11-17T06:30:03.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbe9ffb700 1 -- 172.21.15.69:0/3962179238 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc011d40 con 0x7fbbec15d460 2023-11-17T06:30:03.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbf1523700 1 -- 172.21.15.69:0/3962179238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbec15d460 msgr2=0x7fbbec06acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbf1523700 1 --2- 172.21.15.69:0/3962179238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbec15d460 0x7fbbec06acb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009850 tx=0x7fbbdc009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:03.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbf1523700 1 -- 172.21.15.69:0/3962179238 shutdown_connections 2023-11-17T06:30:03.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbf1523700 1 --2- 172.21.15.69:0/3962179238 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbec15d460 0x7fbbec06acb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbf1523700 1 -- 172.21.15.69:0/3962179238 >> 172.21.15.69:0/3962179238 conn(0x7fbbec09de80 msgr2=0x7fbbec0d4960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbf1523700 1 -- 172.21.15.69:0/3962179238 shutdown_connections 2023-11-17T06:30:03.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.036+0000 7fbbf1523700 1 -- 172.21.15.69:0/3962179238 wait complete. 2023-11-17T06:30:03.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.040+0000 7fbbf1523700 1 Processor -- start 2023-11-17T06:30:03.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.040+0000 7fbbf1523700 1 -- start start 2023-11-17T06:30:03.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.040+0000 7fbbf1523700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbec0d4270 0x7fbbec0b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.040+0000 7fbbf1523700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbec15d460 0x7fbbec14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.040+0000 7fbbf1523700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbec15d840 0x7fbbec0b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.040+0000 7fbbf1523700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0b7f50 con 0x7fbbec0d4270 2023-11-17T06:30:03.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.040+0000 7fbbf1523700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0b8230 con 0x7fbbec15d840 2023-11-17T06:30:03.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.040+0000 7fbbf1523700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec0b8510 con 0x7fbbec15d460 2023-11-17T06:30:03.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbeaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbec0d4270 0x7fbbec0b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbeaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbec0d4270 0x7fbbec0b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53224/0 (socket says 172.21.15.69:53224) 2023-11-17T06:30:03.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbeaffd700 1 -- 172.21.15.69:0/1934182960 learned_addr learned my addr 172.21.15.69:0/1934182960 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbea7fc700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbec15d460 0x7fbbec14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbebfff700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbec15d840 0x7fbbec0b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbeaffd700 1 -- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbec15d460 msgr2=0x7fbbec14f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbeaffd700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbec15d460 0x7fbbec14f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbeaffd700 1 -- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbec15d840 msgr2=0x7fbbec0b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbeaffd700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbec15d840 0x7fbbec0b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbeaffd700 1 -- 172.21.15.69:0/1934182960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0094b0 con 0x7fbbec0d4270 2023-11-17T06:30:03.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbeaffd700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbec0d4270 0x7fbbec0b1590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc014040 tx=0x7fbbdc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbd37fe700 1 -- 172.21.15.69:0/1934182960 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc019980 con 0x7fbbec0d4270 2023-11-17T06:30:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbd37fe700 1 -- 172.21.15.69:0/1934182960 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc01e070 con 0x7fbbec0d4270 2023-11-17T06:30:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbf1523700 1 -- 172.21.15.69:0/1934182960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec0b87f0 con 0x7fbbec0d4270 2023-11-17T06:30:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbd37fe700 1 -- 172.21.15.69:0/1934182960 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc019d20 con 0x7fbbec0d4270 2023-11-17T06:30:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.044+0000 7fbbf1523700 1 -- 172.21.15.69:0/1934182960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec14fa00 con 0x7fbbec0d4270 2023-11-17T06:30:03.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.048+0000 7fbbf1523700 1 -- 172.21.15.69:0/1934182960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec0b8d10 con 0x7fbbec0d4270 2023-11-17T06:30:03.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.048+0000 7fbbd37fe700 1 -- 172.21.15.69:0/1934182960 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbbdc02d450 con 0x7fbbec0d4270 2023-11-17T06:30:03.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.052+0000 7fbbd37fe700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbbd8066510 0x7fbbd80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.052+0000 7fbbd37fe700 1 -- 172.21.15.69:0/1934182960 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbdc084df0 con 0x7fbbec0d4270 2023-11-17T06:30:03.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.052+0000 7fbbea7fc700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbbd8066510 0x7fbbd80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.052+0000 7fbbea7fc700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbbd8066510 0x7fbbd80689d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbbec150740 tx=0x7fbbe0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.056+0000 7fbbd37fe700 1 -- 172.21.15.69:0/1934182960 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbbec0b8d10 con 0x7fbbec0d4270 2023-11-17T06:30:03.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.240+0000 7fbbf1523700 1 -- 172.21.15.69:0/1934182960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbec0b8d10 con 0x7fbbec0d4270 2023-11-17T06:30:03.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.240+0000 7fbbd37fe700 1 -- 172.21.15.69:0/1934182960 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fbbec0b8d10 con 0x7fbbec0d4270 2023-11-17T06:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:03.246 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:58.004301+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:03.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 -- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbbd8066510 msgr2=0x7fbbd80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbbd8066510 0x7fbbd80689d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbbec150740 tx=0x7fbbe0009040 comp rx=0 tx=0).stop 2023-11-17T06:30:03.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 -- 172.21.15.69:0/1934182960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbec0d4270 msgr2=0x7fbbec0b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbec0d4270 0x7fbbec0b1590 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc014040 tx=0x7fbbdc004770 comp rx=0 tx=0).stop 2023-11-17T06:30:03.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 -- 172.21.15.69:0/1934182960 shutdown_connections 2023-11-17T06:30:03.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbbd8066510 0x7fbbd80689d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbec15d840 0x7fbbec0b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbbec15d460 0x7fbbec14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 --2- 172.21.15.69:0/1934182960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbec0d4270 0x7fbbec0b1590 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 -- 172.21.15.69:0/1934182960 >> 172.21.15.69:0/1934182960 conn(0x7fbbec09de80 msgr2=0x7fbbec15ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 -- 172.21.15.69:0/1934182960 shutdown_connections 2023-11-17T06:30:03.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.244+0000 7fbbf1523700 1 -- 172.21.15.69:0/1934182960 wait complete. 2023-11-17T06:30:03.269 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-17T06:30:03.269 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-17T06:30:03.270 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-17T06:30:03.270 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-17T06:30:03.271 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-17T06:30:03.271 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-17T06:30:03.271 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-17T06:30:03.272 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-17T06:30:03.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.500+0000 7fa9d1954700 1 Processor -- start 2023-11-17T06:30:03.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.500+0000 7fa9d1954700 1 -- start start 2023-11-17T06:30:03.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa5848c4700 1 Processor -- start 2023-11-17T06:30:03.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa5848c4700 1 -- start start 2023-11-17T06:30:03.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9d1954700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa9cc0d1150 0x7fa9cc0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9d1954700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 0x7fa9cc0d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9d1954700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9cc0cf880 con 0x7fa9cc15d5d0 2023-11-17T06:30:03.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9d1954700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9cc0d2200 con 0x7fa9cc0d1150 2023-11-17T06:30:03.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9d1954700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0d1570 con 0x7fa9cc0d1830 2023-11-17T06:30:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9ca7fc700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa9cc0d1150 0x7fa9cc0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9ca7fc700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa9cc0d1150 0x7fa9cc0d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:42564/0 (socket says 172.21.15.69:42564) 2023-11-17T06:30:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9ca7fc700 1 -- 172.21.15.69:0/1167655998 learned_addr learned my addr 172.21.15.69:0/1167655998 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9cb7fe700 1 --2- 172.21.15.69:0/1167655998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 0x7fa9cc0d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa5848c4700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa580157500 0x7fa58015df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa5848c4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa5800c9e20 0x7fa5800cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa5848c4700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa5800b0840 0x7fa5800b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa5848c4700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa58015a980 con 0x7fa5800b0840 2023-11-17T06:30:03.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa5848c4700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5800ca650 con 0x7fa5800c9e20 2023-11-17T06:30:03.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa5848c4700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800b11e0 con 0x7fa580157500 2023-11-17T06:30:03.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa57e59c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa580157500 0x7fa58015df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa57e59c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa580157500 0x7fa58015df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:35036/0 (socket says 172.21.15.69:35036) 2023-11-17T06:30:03.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa57e59c700 1 -- 172.21.15.69:0/1922408651 learned_addr learned my addr 172.21.15.69:0/1922408651 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9c9ffb700 1 -- 172.21.15.69:0/1167655998 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505440863 0 0) 0x7fa9cc0cf880 con 0x7fa9cc15d5d0 2023-11-17T06:30:03.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9c9ffb700 1 -- 172.21.15.69:0/1167655998 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b40035d0 con 0x7fa9cc15d5d0 2023-11-17T06:30:03.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9ca7fc700 1 -- 172.21.15.69:0/1167655998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 msgr2=0x7fa9cc0d1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9ca7fc700 1 --2- 172.21.15.69:0/1167655998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 0x7fa9cc0d1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9ca7fc700 1 -- 172.21.15.69:0/1167655998 >> v1:172.21.15.93:6789/0 conn(0x7fa9cc15d5d0 legacy=0x7fa9cc0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.504+0000 7fa9ca7fc700 1 -- 172.21.15.69:0/1167655998 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9cc0cefe0 con 0x7fa9cc0d1150 2023-11-17T06:30:03.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9ca7fc700 1 --2- 172.21.15.69:0/1167655998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0d1150 0x7fa9cc0d05b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009910 tx=0x7fa9c0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a80604dda63d7a11 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa57dd9b700 1 --2- 172.21.15.69:0/1922408651 >> v2:172.21.15.93:3300/0 conn(0x7fa5800c9e20 0x7fa5800cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa57e59c700 1 -- 172.21.15.69:0/1922408651 >> v2:172.21.15.93:3300/0 conn(0x7fa5800c9e20 msgr2=0x7fa5800cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa57e59c700 1 --2- 172.21.15.69:0/1922408651 >> v2:172.21.15.93:3300/0 conn(0x7fa5800c9e20 0x7fa5800cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa57e59c700 1 -- 172.21.15.69:0/1922408651 >> v2:172.21.15.69:3300/0 conn(0x7fa5800b0840 msgr2=0x7fa5800b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa57e59c700 1 --2- 172.21.15.69:0/1922408651 >> v2:172.21.15.69:3300/0 conn(0x7fa5800b0840 0x7fa5800b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa57e59c700 1 -- 172.21.15.69:0/1922408651 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580159d60 con 0x7fa580157500 2023-11-17T06:30:03.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fc08aa17700 1 Processor -- start 2023-11-17T06:30:03.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fc08aa17700 1 -- start start 2023-11-17T06:30:03.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9c9ffb700 1 -- 172.21.15.69:0/1167655998 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0011830 con 0x7fa9cc0d1150 2023-11-17T06:30:03.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9c9ffb700 1 -- 172.21.15.69:0/1167655998 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c0011990 con 0x7fa9cc0d1150 2023-11-17T06:30:03.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9c9ffb700 1 -- 172.21.15.69:0/1167655998 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0011d40 con 0x7fa9cc0d1150 2023-11-17T06:30:03.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9d1954700 1 -- 172.21.15.69:0/1167655998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0d1150 msgr2=0x7fa9cc0d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9d1954700 1 --2- 172.21.15.69:0/1167655998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0d1150 0x7fa9cc0d05b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009910 tx=0x7fa9c0009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:03.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9d1954700 1 -- 172.21.15.69:0/1167655998 shutdown_connections 2023-11-17T06:30:03.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9d1954700 1 --2- 172.21.15.69:0/1167655998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 0x7fa9cc0d1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9d1954700 1 --2- 172.21.15.69:0/1167655998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0d1150 0x7fa9cc0d05b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9d1954700 1 -- 172.21.15.69:0/1167655998 >> 172.21.15.69:0/1167655998 conn(0x7fa9cc0d3250 msgr2=0x7fa9cc0d3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa57e59c700 1 --2- 172.21.15.69:0/1922408651 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa580157500 0x7fa58015df10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa58006ceb0 tx=0x7fa574009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2add5aa72960588a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9d1954700 1 -- 172.21.15.69:0/1167655998 shutdown_connections 2023-11-17T06:30:03.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fef437bf700 1 Processor -- start 2023-11-17T06:30:03.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa57d59a700 1 -- 172.21.15.69:0/1922408651 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400b8a0 con 0x7fa580157500 2023-11-17T06:30:03.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa57d59a700 1 -- 172.21.15.69:0/1922408651 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57400ba00 con 0x7fa580157500 2023-11-17T06:30:03.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa57d59a700 1 -- 172.21.15.69:0/1922408651 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400bd90 con 0x7fa580157500 2023-11-17T06:30:03.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fc08aa17700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc08415d4b0 0x7fc084161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fc08aa17700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc0840b8b20 0x7fc0840cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fc08aa17700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc0840ce430 0x7fc0840b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fc08aa17700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0840ce8e0 con 0x7fc08415d4b0 2023-11-17T06:30:03.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fc08aa17700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0840d1620 con 0x7fc0840ce430 2023-11-17T06:30:03.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fc08aa17700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840d1320 con 0x7fc0840b8b20 2023-11-17T06:30:03.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa5848c4700 1 -- 172.21.15.69:0/1922408651 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa580157500 msgr2=0x7fa58015df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa5848c4700 1 --2- 172.21.15.69:0/1922408651 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa580157500 0x7fa58015df10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa58006ceb0 tx=0x7fa574009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fc089a15700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc08415d4b0 0x7fc084161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fa9d1954700 1 -- 172.21.15.69:0/1167655998 wait complete. 2023-11-17T06:30:03.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.508+0000 7fef437bf700 1 -- start start 2023-11-17T06:30:03.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc089a15700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc08415d4b0 0x7fc084161110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53232/0 (socket says 172.21.15.69:53232) 2023-11-17T06:30:03.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc089a15700 1 -- 172.21.15.69:0/4074678825 learned_addr learned my addr 172.21.15.69:0/4074678825 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc089214700 1 --2- 172.21.15.69:0/4074678825 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc0840b8b20 0x7fc0840cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc08a216700 1 --2- 172.21.15.69:0/4074678825 >> v2:172.21.15.93:3300/0 conn(0x7fc0840ce430 0x7fc0840b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc089a15700 1 -- 172.21.15.69:0/4074678825 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc0840b8b20 msgr2=0x7fc0840cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc089a15700 1 --2- 172.21.15.69:0/4074678825 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc0840b8b20 0x7fc0840cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc089a15700 1 -- 172.21.15.69:0/4074678825 >> v2:172.21.15.93:3300/0 conn(0x7fc0840ce430 msgr2=0x7fc0840b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc089a15700 1 --2- 172.21.15.69:0/4074678825 >> v2:172.21.15.93:3300/0 conn(0x7fc0840ce430 0x7fc0840b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc089a15700 1 -- 172.21.15.69:0/4074678825 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0841619f0 con 0x7fc08415d4b0 2023-11-17T06:30:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fa5848c4700 1 -- 172.21.15.69:0/1922408651 shutdown_connections 2023-11-17T06:30:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fa5848c4700 1 --2- 172.21.15.69:0/1922408651 >> v2:172.21.15.69:3300/0 conn(0x7fa5800b0840 0x7fa5800b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fa5848c4700 1 --2- 172.21.15.69:0/1922408651 >> v2:172.21.15.93:3300/0 conn(0x7fa5800c9e20 0x7fa5800cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fa5848c4700 1 --2- 172.21.15.69:0/1922408651 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa580157500 0x7fa58015df10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fa5848c4700 1 -- 172.21.15.69:0/1922408651 >> 172.21.15.69:0/1922408651 conn(0x7fa58006a480 msgr2=0x7fa58006a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc089a15700 1 --2- 172.21.15.69:0/4074678825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc08415d4b0 0x7fc084161110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc08406c150 tx=0x7fc080009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f1028c43fa5f3c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fa9d1954700 1 Processor -- start 2023-11-17T06:30:03.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc088a13700 1 -- 172.21.15.69:0/4074678825 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000b8a0 con 0x7fc08415d4b0 2023-11-17T06:30:03.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc088a13700 1 -- 172.21.15.69:0/4074678825 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08000ba00 con 0x7fc08415d4b0 2023-11-17T06:30:03.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc088a13700 1 -- 172.21.15.69:0/4074678825 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08000bd90 con 0x7fc08415d4b0 2023-11-17T06:30:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7f13fd42d700 1 Processor -- start 2023-11-17T06:30:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7f173cf9c700 1 Processor -- start 2023-11-17T06:30:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7f13fd42d700 1 -- start start 2023-11-17T06:30:03.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc08aa17700 1 -- 172.21.15.69:0/4074678825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc08415d4b0 msgr2=0x7fc084161110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc08aa17700 1 --2- 172.21.15.69:0/4074678825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc08415d4b0 0x7fc084161110 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc08406c150 tx=0x7fc080009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7f173cf9c700 1 -- start start 2023-11-17T06:30:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc08aa17700 1 -- 172.21.15.69:0/4074678825 shutdown_connections 2023-11-17T06:30:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc08aa17700 1 --2- 172.21.15.69:0/4074678825 >> v2:172.21.15.93:3300/0 conn(0x7fc0840ce430 0x7fc0840b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc08aa17700 1 --2- 172.21.15.69:0/4074678825 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc0840b8b20 0x7fc0840cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc08aa17700 1 --2- 172.21.15.69:0/4074678825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc08415d4b0 0x7fc084161110 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fc08aa17700 1 -- 172.21.15.69:0/4074678825 >> 172.21.15.69:0/4074678825 conn(0x7fc08406ac60 msgr2=0x7fc08406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fa5848c4700 1 -- 172.21.15.69:0/1922408651 shutdown_connections 2023-11-17T06:30:03.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fa5848c4700 1 -- 172.21.15.69:0/1922408651 wait complete. 2023-11-17T06:30:03.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef437bf700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fef3c0d1830 0x7fef3c0d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef437bf700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c0cf880 con 0x7fef3c15d5d0 2023-11-17T06:30:03.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef437bf700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef3c0d1570 con 0x7fef3c0d1150 2023-11-17T06:30:03.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef437bf700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef3c0d21e0 con 0x7fef3c0d1830 2023-11-17T06:30:03.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef40d5a700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fef3c0d1150 0x7fef3c0d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:34446/0 (socket says 172.21.15.69:34446) 2023-11-17T06:30:03.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef40d5a700 1 -- 172.21.15.69:0/3742219925 learned_addr learned my addr 172.21.15.69:0/3742219925 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef41d5c700 1 --2- 172.21.15.69:0/3742219925 >> v2:172.21.15.69:3300/0 conn(0x7fef3c0d1830 0x7fef3c0d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef33fff700 1 -- 172.21.15.69:0/3742219925 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022101256 0 0) 0x7fef3c0d1570 con 0x7fef3c0d1150 2023-11-17T06:30:03.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef33fff700 1 -- 172.21.15.69:0/3742219925 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef2800bde0 con 0x7fef3c0d1150 2023-11-17T06:30:03.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef41d5c700 1 -- 172.21.15.69:0/3742219925 >> v1:172.21.15.93:6789/0 conn(0x7fef3c0d1150 legacy=0x7fef3c0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef41d5c700 1 -- 172.21.15.69:0/3742219925 >> v1:172.21.15.69:6789/0 conn(0x7fef3c15d5d0 legacy=0x7fef3c0ce820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-17T06:30:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef41d5c700 1 -- 172.21.15.69:0/3742219925 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c0cefe0 con 0x7fef3c0d1830 2023-11-17T06:30:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.512+0000 7fef41d5c700 1 --2- 172.21.15.69:0/3742219925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3c0d1830 0x7fef3c0d1ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fef34009d90 tx=0x7fef3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efadbf97b147b047 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fef33fff700 1 -- 172.21.15.69:0/3742219925 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34003c40 con 0x7fef3c0d1830 2023-11-17T06:30:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f173cf9c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f17380cbef0 0x7f17380cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f173cf9c700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f173806c200 con 0x7f17381652b0 2023-11-17T06:30:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f173cf9c700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1738165d00 con 0x7f17380c21a0 2023-11-17T06:30:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f173cf9c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17381662c0 con 0x7f17380cbef0 2023-11-17T06:30:03.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fa9d1954700 1 -- start start 2023-11-17T06:30:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13fd42d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f13f80ce600 0x7f13f81684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13fd42d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f80d1620 con 0x7f13f815d4b0 2023-11-17T06:30:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13fd42d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f80d1320 con 0x7f13f80b8b20 2023-11-17T06:30:03.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13fd42d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f81619f0 con 0x7f13f80ce600 2023-11-17T06:30:03.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fef33fff700 1 -- 172.21.15.69:0/3742219925 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3401f070 con 0x7fef3c0d1830 2023-11-17T06:30:03.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fef33fff700 1 -- 172.21.15.69:0/3742219925 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3400b8d0 con 0x7fef3c0d1830 2023-11-17T06:30:03.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fc08aa17700 1 -- 172.21.15.69:0/4074678825 shutdown_connections 2023-11-17T06:30:03.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f17377fe700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f17380c21a0 0x7f173806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:34458/0 (socket says 172.21.15.69:34458) 2023-11-17T06:30:03.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13fcc2c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f13f80ce600 0x7f13f81684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f77fe700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f13f80b8b20 0x7f13f80cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:34462/0 (socket says 172.21.15.69:34462) 2023-11-17T06:30:03.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f77fe700 1 -- 172.21.15.69:0/3097171186 learned_addr learned my addr 172.21.15.69:0/3097171186 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f17377fe700 1 -- 172.21.15.69:0/1424733915 learned_addr learned my addr 172.21.15.69:0/1424733915 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f1737fff700 1 --2- 172.21.15.69:0/1424733915 >> v2:172.21.15.69:3300/0 conn(0x7f17380cbef0 0x7f17380cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fef437bf700 1 -- 172.21.15.69:0/3742219925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3c0d1830 msgr2=0x7fef3c0d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fef437bf700 1 --2- 172.21.15.69:0/3742219925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3c0d1830 0x7fef3c0d1ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fef34009d90 tx=0x7fef3400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fef437bf700 1 -- 172.21.15.69:0/3742219925 shutdown_connections 2023-11-17T06:30:03.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741940098 0 0) 0x7f13f80d1320 con 0x7f13f80b8b20 2023-11-17T06:30:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fef437bf700 1 --2- 172.21.15.69:0/3742219925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3c0d1830 0x7fef3c0d1ca0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fef437bf700 1 -- 172.21.15.69:0/3742219925 >> 172.21.15.69:0/3742219925 conn(0x7fef3c0d3250 msgr2=0x7fef3c0d3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e00035d0 con 0x7f13f80b8b20 2023-11-17T06:30:03.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fa5848c4700 1 Processor -- start 2023-11-17T06:30:03.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1605006185 0 0) 0x7f13e00035d0 con 0x7f13f80b8b20 2023-11-17T06:30:03.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 >> v2:172.21.15.69:3300/0 conn(0x7f13f80ce600 msgr2=0x7f13f81684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 --2- 172.21.15.69:0/3097171186 >> v2:172.21.15.69:3300/0 conn(0x7f13f80ce600 0x7f13f81684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 >> v1:172.21.15.69:6789/0 conn(0x7f13f815d4b0 legacy=0x7f13f8161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f8161cd0 con 0x7f13f80b8b20 2023-11-17T06:30:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f1737fff700 1 -- 172.21.15.69:0/1424733915 >> v1:172.21.15.93:6789/0 conn(0x7f17380c21a0 legacy=0x7f173806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f1737fff700 1 -- 172.21.15.69:0/1424733915 >> v1:172.21.15.69:6789/0 conn(0x7f17381652b0 legacy=0x7f17380cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f1737fff700 1 -- 172.21.15.69:0/1424733915 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1738165fe0 con 0x7f17380cbef0 2023-11-17T06:30:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fa5848c4700 1 -- start start 2023-11-17T06:30:03.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fa9d1954700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0d1150 0x7fa9cc0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fa9d1954700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 0x7fa9cc1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fa9d1954700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9cc15d5d0 0x7fa9cc0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fef437bf700 1 -- 172.21.15.69:0/3742219925 shutdown_connections 2023-11-17T06:30:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fa9ca7fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 0x7fa9cc1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fef437bf700 1 -- 172.21.15.69:0/3742219925 wait complete. 2023-11-17T06:30:03.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fa9ca7fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 0x7fa9cc1580c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:35064/0 (socket says 172.21.15.69:35064) 2023-11-17T06:30:03.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f13ec001670 con 0x7f13f80b8b20 2023-11-17T06:30:03.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 >> v1:172.21.15.93:6789/0 conn(0x7f13f80b8b20 legacy=0x7f13f80cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13e0003a20 0x7f13e0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0004870 0x7f13e0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13e0005230 0x7f13e000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f81619f0 con 0x7f13e0003a20 2023-11-17T06:30:03.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e000c0b0 con 0x7f13e0004870 2023-11-17T06:30:03.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13e000c270 con 0x7f13e0005230 2023-11-17T06:30:03.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fc08aa17700 1 -- 172.21.15.69:0/4074678825 wait complete. 2023-11-17T06:30:03.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.516+0000 7fc08aa17700 1 Processor -- start 2023-11-17T06:30:03.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9caffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0d1150 0x7fa9cc0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9caffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0d1150 0x7fa9cc0c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:42574/0 (socket says 172.21.15.69:42574) 2023-11-17T06:30:03.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13fcc2c700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13e0005230 0x7f13e000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc08aa17700 1 -- start start 2023-11-17T06:30:03.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9cb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9cc15d5d0 0x7fa9cc0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f77fe700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0004870 0x7f13e0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9cb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9cc15d5d0 0x7fa9cc0b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53258/0 (socket says 172.21.15.69:53258) 2023-11-17T06:30:03.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f1737fff700 1 --2- 172.21.15.69:0/1424733915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17380cbef0 0x7f17380cc9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1730009dc0 tx=0x7f173000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824511977ff9ed76 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f7fff700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13e0003a20 0x7f13e0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f1736ffd700 1 -- 172.21.15.69:0/1424733915 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173000e070 con 0x7f17380cbef0 2023-11-17T06:30:03.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f1736ffd700 1 -- 172.21.15.69:0/1424733915 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173000bad0 con 0x7f17380cbef0 2023-11-17T06:30:03.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f1736ffd700 1 -- 172.21.15.69:0/1424733915 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173000be60 con 0x7f17380cbef0 2023-11-17T06:30:03.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa5848c4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5800b0840 0x7fa5800b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f77fe700 1 -- 172.21.15.69:0/3097171186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13e0005230 msgr2=0x7f13e000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f77fe700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13e0005230 0x7f13e000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f77fe700 1 -- 172.21.15.69:0/3097171186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13e0003a20 msgr2=0x7f13e0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f77fe700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13e0003a20 0x7f13e0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f77fe700 1 -- 172.21.15.69:0/3097171186 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f8161cd0 con 0x7f13e0004870 2023-11-17T06:30:03.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13fcc2c700 1 -- 172.21.15.69:0/3097171186 reap_dead start 2023-11-17T06:30:03.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa5848c4700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5800c9e20 0x7fa580158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa5848c4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa580157500 0x7fa580158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa5848c4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800c6310 con 0x7fa580157500 2023-11-17T06:30:03.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa57ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa580157500 0x7fa580158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa57dd9b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5800c9e20 0x7fa580158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa57ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa580157500 0x7fa580158e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53274/0 (socket says 172.21.15.69:53274) 2023-11-17T06:30:03.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa57ed9d700 1 -- 172.21.15.69:0/3855365275 learned_addr learned my addr 172.21.15.69:0/3855365275 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f173cf9c700 1 -- 172.21.15.69:0/1424733915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17380cbef0 msgr2=0x7f17380cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f77fe700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0004870 0x7f13e0004cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c370 tx=0x7f13e00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849eff7eb2b5e9a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa57e59c700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5800b0840 0x7fa5800b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fef437bf700 1 Processor -- start 2023-11-17T06:30:03.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800c28f0 con 0x7fa5800b0840 2023-11-17T06:30:03.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc08aa17700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0840b8b20 0x7fc0840ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5800b2e40 con 0x7fa5800c9e20 2023-11-17T06:30:03.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fef437bf700 1 -- start start 2023-11-17T06:30:03.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f173cf9c700 1 --2- 172.21.15.69:0/1424733915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17380cbef0 0x7f17380cc9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1730009dc0 tx=0x7f173000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:03.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f173cf9c700 1 -- 172.21.15.69:0/1424733915 shutdown_connections 2023-11-17T06:30:03.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f173cf9c700 1 --2- 172.21.15.69:0/1424733915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17380cbef0 0x7f17380cc9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f173cf9c700 1 -- 172.21.15.69:0/1424733915 >> 172.21.15.69:0/1424733915 conn(0x7f17380b0900 msgr2=0x7f17380b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f173cf9c700 1 -- 172.21.15.69:0/1424733915 shutdown_connections 2023-11-17T06:30:03.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc08aa17700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc0840ce430 0x7fc0841ff460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f173cf9c700 1 -- 172.21.15.69:0/1424733915 wait complete. 2023-11-17T06:30:03.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc08aa17700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc08415d4b0 0x7fc0840c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec007be0 con 0x7f13e0004870 2023-11-17T06:30:03.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9ca7fc700 1 -- 172.21.15.69:0/1370896021 learned_addr learned my addr 172.21.15.69:0/1370896021 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc0c7730 con 0x7fa9cc15d5d0 2023-11-17T06:30:03.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ec005980 con 0x7f13e0004870 2023-11-17T06:30:03.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc15e850 con 0x7fa9cc0d1150 2023-11-17T06:30:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc08aa17700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840cabf0 con 0x7fc0840b8b20 2023-11-17T06:30:03.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9cc15eb30 con 0x7fa9cc0d1830 2023-11-17T06:30:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc08aa17700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840cbb10 con 0x7fc08415d4b0 2023-11-17T06:30:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc08aa17700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0840cae90 con 0x7fc0840ce430 2023-11-17T06:30:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc089a15700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0840b8b20 0x7fc0840ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc089a15700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0840b8b20 0x7fc0840ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53276/0 (socket says 172.21.15.69:53276) 2023-11-17T06:30:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc089214700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc0840ce430 0x7fc0841ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc089a15700 1 -- 172.21.15.69:0/3315514762 learned_addr learned my addr 172.21.15.69:0/3315514762 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fc08a216700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc08415d4b0 0x7fc0840c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7f13f6ffd700 1 -- 172.21.15.69:0/3097171186 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec005d30 con 0x7f13e0004870 2023-11-17T06:30:03.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9caffd700 1 -- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 msgr2=0x7fa9cc1580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9caffd700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 0x7fa9cc1580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9caffd700 1 -- 172.21.15.69:0/1370896021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9cc15d5d0 msgr2=0x7fa9cc0b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.520+0000 7fa9caffd700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9cc15d5d0 0x7fa9cc0b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa9caffd700 1 -- 172.21.15.69:0/1370896021 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c0009570 con 0x7fa9cc0d1150 2023-11-17T06:30:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef437bf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef3c0d1150 0x7fef3c150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa9ca7fc700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa9cc0d1830 0x7fa9cc1580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef437bf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3c0d1830 0x7fef3c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef437bf700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fef3c15d5d0 0x7fef3c158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc08a216700 1 -- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc0840ce430 msgr2=0x7fc0841ff460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7f13fd42d700 1 -- 172.21.15.69:0/3097171186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0004870 msgr2=0x7f13e0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7f13fd42d700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0004870 0x7f13e0004cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c370 tx=0x7f13e00058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa9caffd700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0d1150 0x7fa9cc0c8180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c410 tx=0x7fa9bc00c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7f13fd42d700 1 -- 172.21.15.69:0/3097171186 shutdown_connections 2023-11-17T06:30:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef437bf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c14bf20 con 0x7fef3c0d1830 2023-11-17T06:30:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7f13fd42d700 1 --2- 172.21.15.69:0/3097171186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0004870 0x7f13e0004cf0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00c370 tx=0x7f13e00058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7f13fd42d700 1 -- 172.21.15.69:0/3097171186 >> 172.21.15.69:0/3097171186 conn(0x7f13f806ac60 msgr2=0x7f13f806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa57e59c700 1 -- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5800c9e20 msgr2=0x7fa580158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa57e59c700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa5800c9e20 0x7fa580158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa57e59c700 1 -- 172.21.15.69:0/3855365275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa580157500 msgr2=0x7fa580158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef437bf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0b0120 con 0x7fef3c0d1150 2023-11-17T06:30:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa57e59c700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa580157500 0x7fa580158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa57e59c700 1 -- 172.21.15.69:0/3855365275 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574009570 con 0x7fa5800b0840 2023-11-17T06:30:03.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef437bf700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c0cd190 con 0x7fef3c15d5d0 2023-11-17T06:30:03.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc08a216700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc0840ce430 0x7fc0841ff460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc08a216700 1 -- 172.21.15.69:0/3315514762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0840b8b20 msgr2=0x7fc0840ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc08a216700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0840b8b20 0x7fc0840ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc08a216700 1 -- 172.21.15.69:0/3315514762 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc080009570 con 0x7fc08415d4b0 2023-11-17T06:30:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef4155b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef3c0d1150 0x7fef3c150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc089a15700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0840b8b20 0x7fc0840ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef4155b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef3c0d1150 0x7fef3c150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:42610/0 (socket says 172.21.15.69:42610) 2023-11-17T06:30:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc089214700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc0840ce430 0x7fc0841ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef4155b700 1 -- 172.21.15.69:0/1761405273 learned_addr learned my addr 172.21.15.69:0/1761405273 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef41d5c700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fef3c15d5d0 0x7fef3c158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa57e59c700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5800b0840 0x7fa5800b20f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa574016000 tx=0x7fa574004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc08a216700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc08415d4b0 0x7fc0840c8160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc07c007cf0 tx=0x7fc07c00e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7f13fd42d700 1 -- 172.21.15.69:0/3097171186 shutdown_connections 2023-11-17T06:30:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7f13fd42d700 1 -- 172.21.15.69:0/3097171186 wait complete. 2023-11-17T06:30:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa56effd700 1 -- 172.21.15.69:0/3855365275 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400bee0 con 0x7fa5800b0840 2023-11-17T06:30:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa56effd700 1 -- 172.21.15.69:0/3855365275 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57401f070 con 0x7fa5800b0840 2023-11-17T06:30:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5800b3120 con 0x7fa5800b0840 2023-11-17T06:30:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc07a7fc700 1 -- 172.21.15.69:0/3315514762 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c018070 con 0x7fc08415d4b0 2023-11-17T06:30:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7f173cf9c700 1 Processor -- start 2023-11-17T06:30:03.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa56effd700 1 -- 172.21.15.69:0/3855365275 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57400bee0 con 0x7fa5800b0840 2023-11-17T06:30:03.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc07a7fc700 1 -- 172.21.15.69:0/3315514762 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c003a40 con 0x7fc08415d4b0 2023-11-17T06:30:03.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc07a7fc700 1 -- 172.21.15.69:0/3315514762 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c003dd0 con 0x7fc08415d4b0 2023-11-17T06:30:03.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa9b3fff700 1 -- 172.21.15.69:0/1370896021 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc0052d0 con 0x7fa9cc0d1150 2023-11-17T06:30:03.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa9b3fff700 1 -- 172.21.15.69:0/1370896021 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc005430 con 0x7fa9cc0d1150 2023-11-17T06:30:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa9b3fff700 1 -- 172.21.15.69:0/1370896021 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc0055a0 con 0x7fa9cc0d1150 2023-11-17T06:30:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9cc0c7980 con 0x7fa9cc0d1150 2023-11-17T06:30:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9cc158b90 con 0x7fa9cc0d1150 2023-11-17T06:30:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7f173cf9c700 1 -- start start 2023-11-17T06:30:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0840cb170 con 0x7fc08415d4b0 2023-11-17T06:30:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0840cb730 con 0x7fc08415d4b0 2023-11-17T06:30:03.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5800b3400 con 0x7fa5800b0840 2023-11-17T06:30:03.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.524+0000 7fef40d5a700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3c0d1830 0x7fef3c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa9cc0cfdb0 con 0x7fa9cc0d1150 2023-11-17T06:30:03.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f13fd42d700 1 Processor -- start 2023-11-17T06:30:03.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef41d5c700 1 -- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef3c0d1150 msgr2=0x7fef3c150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef41d5c700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fef3c0d1150 0x7fef3c150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef41d5c700 1 -- 172.21.15.69:0/1761405273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3c0d1830 msgr2=0x7fef3c1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef41d5c700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3c0d1830 0x7fef3c1559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef41d5c700 1 -- 172.21.15.69:0/1761405273 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef34009a70 con 0x7fef3c15d5d0 2023-11-17T06:30:03.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef40d5a700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef3c0d1830 0x7fef3c1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:03.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef41d5c700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fef3c15d5d0 0x7fef3c158b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef34026000 tx=0x7fef34004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f173cf9c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17380c21a0 0x7f173815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f173cf9c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17380cbef0 0x7f17380b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f173cf9c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17381652b0 0x7f17380b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f173cf9c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380c82d0 con 0x7f17381652b0 2023-11-17T06:30:03.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f173cf9c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17380b1d70 con 0x7f17380c21a0 2023-11-17T06:30:03.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f173cf9c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17380c7ff0 con 0x7f17380cbef0 2023-11-17T06:30:03.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa58015a2c0 con 0x7fa5800b0840 2023-11-17T06:30:03.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef31ffb700 1 -- 172.21.15.69:0/1761405273 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34004440 con 0x7fef3c15d5d0 2023-11-17T06:30:03.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef31ffb700 1 -- 172.21.15.69:0/1761405273 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef340045c0 con 0x7fef3c15d5d0 2023-11-17T06:30:03.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef31ffb700 1 -- 172.21.15.69:0/1761405273 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34004970 con 0x7fef3c15d5d0 2023-11-17T06:30:03.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1737fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17381652b0 0x7f17380b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1737fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17381652b0 0x7f17380b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53282/0 (socket says 172.21.15.69:53282) 2023-11-17T06:30:03.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1737fff700 1 -- 172.21.15.69:0/708052981 learned_addr learned my addr 172.21.15.69:0/708052981 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f17377fe700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17380c21a0 0x7f173815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f8ab16e9700 1 Processor -- start 2023-11-17T06:30:03.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f8ab16e9700 1 -- start start 2023-11-17T06:30:03.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef3c0cc8f0 con 0x7fef3c15d5d0 2023-11-17T06:30:03.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1737fff700 1 -- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17380cbef0 msgr2=0x7f17380b1830 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-17T06:30:03.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1737fff700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17380cbef0 0x7f17380b1830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1737fff700 1 -- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17380c21a0 msgr2=0x7f173815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1737fff700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17380c21a0 0x7f173815ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1737fff700 1 -- 172.21.15.69:0/708052981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1730009a70 con 0x7f17381652b0 2023-11-17T06:30:03.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef3c0cceb0 con 0x7fef3c15d5d0 2023-11-17T06:30:03.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1737fff700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17381652b0 0x7f17380b4570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f173000b370 tx=0x7f1730004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1734ff9700 1 -- 172.21.15.69:0/708052981 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730012650 con 0x7f17381652b0 2023-11-17T06:30:03.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f3143fff700 1 Processor -- start 2023-11-17T06:30:03.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f13fd42d700 1 -- start start 2023-11-17T06:30:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f13fd42d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13f81f6710 0x7f13f80c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f13fd42d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13f80cbb40 0x7f13f81f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f13fd42d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13f81f7030 0x7f13f81f74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f13fd42d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80c7220 con 0x7f13f81f6710 2023-11-17T06:30:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f13fd42d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80c6bf0 con 0x7f13f81f7030 2023-11-17T06:30:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f13fd42d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f81f7fc0 con 0x7f13f80cbb40 2023-11-17T06:30:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1734ff9700 1 -- 172.21.15.69:0/708052981 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17300127b0 con 0x7f17381652b0 2023-11-17T06:30:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f1734ff9700 1 -- 172.21.15.69:0/708052981 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730012b60 con 0x7f17381652b0 2023-11-17T06:30:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f3143fff700 1 -- start start 2023-11-17T06:30:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17380c33b0 con 0x7f17381652b0 2023-11-17T06:30:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f8ab16e9700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8aac0b2fe0 0x7f8aac15bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f8ab16e9700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac0b3730 con 0x7f8aac15b040 2023-11-17T06:30:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f8ab16e9700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aac15c4e0 con 0x7f8aac15ead0 2023-11-17T06:30:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f8ab16e9700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aac15b420 con 0x7f8aac0b2fe0 2023-11-17T06:30:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f8aab7fe700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8aac15ead0 0x7f8aac0b28d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:34476/0 (socket says 172.21.15.69:34476) 2023-11-17T06:30:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7f8aab7fe700 1 -- 172.21.15.69:0/740842177 learned_addr learned my addr 172.21.15.69:0/740842177 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17380c3970 con 0x7f17381652b0 2023-11-17T06:30:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef3c0cfdb0 con 0x7fef3c15d5d0 2023-11-17T06:30:03.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8ab0ee8700 1 --2- 172.21.15.69:0/740842177 >> v2:172.21.15.93:3300/0 conn(0x7f8aac0b2fe0 0x7f8aac15bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585737957 0 0) 0x7f8aa0001110 con 0x7f8aac15ead0 2023-11-17T06:30:03.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a940035d0 con 0x7f8aac15ead0 2023-11-17T06:30:03.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f173806be90 con 0x7f17381652b0 2023-11-17T06:30:03.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.528+0000 7fa9b3fff700 1 -- 172.21.15.69:0/1370896021 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa9bc0038e0 con 0x7fa9cc0d1150 2023-11-17T06:30:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa9b3fff700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa9b8066560 0x7fa9b8068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa56effd700 1 -- 172.21.15.69:0/3855365275 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa574021030 con 0x7fa5800b0840 2023-11-17T06:30:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa56effd700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa5600665d0 0x7fa560068a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa56effd700 1 -- 172.21.15.69:0/3855365275 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa574085040 con 0x7fa5800b0840 2023-11-17T06:30:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa56effd700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x7fa56006e770 0x7fa560070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa56effd700 1 -- 172.21.15.69:0/3855365275 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa560071240 con 0x7fa56006e770 2023-11-17T06:30:03.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc084161fb0 con 0x7fc08415d4b0 2023-11-17T06:30:03.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa9b3fff700 1 -- 172.21.15.69:0/1370896021 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9bc0550c0 con 0x7fa9cc0d1150 2023-11-17T06:30:03.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa9b3fff700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x7fa9b806f460 0x7fa9b8071900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa9ca7fc700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa9b8066560 0x7fa9b8068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fef31ffb700 1 -- 172.21.15.69:0/1761405273 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fef34023440 con 0x7fef3c15d5d0 2023-11-17T06:30:03.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f13f77fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13f80cbb40 0x7f13f81f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f13f77fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13f80cbb40 0x7f13f81f6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:35110/0 (socket says 172.21.15.69:35110) 2023-11-17T06:30:03.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f13f77fe700 1 -- 172.21.15.69:0/766804673 learned_addr learned my addr 172.21.15.69:0/766804673 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f13f77fe700 1 -- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13f81f7030 msgr2=0x7f13f81f74e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-17T06:30:03.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f13f77fe700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13f81f7030 0x7f13f81f74e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f13f77fe700 1 -- 172.21.15.69:0/766804673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13f81f6710 msgr2=0x7f13f80c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f13f77fe700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13f81f6710 0x7f13f80c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f13f77fe700 1 -- 172.21.15.69:0/766804673 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f80cc320 con 0x7f13f80cbb40 2023-11-17T06:30:03.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f3143fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f314415d490 0x7f31440b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f3143fff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440ce4e0 0x7f31440b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f3143fff700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31440d1bb0 con 0x7f31440d13d0 2023-11-17T06:30:03.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f3143fff700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31440d1e90 con 0x7f314415d490 2023-11-17T06:30:03.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f3143fff700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440d2170 con 0x7f31440ce4e0 2023-11-17T06:30:03.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f31427fc700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f31440d13d0 0x7f31440cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:34482/0 (socket says 172.21.15.69:34482) 2023-11-17T06:30:03.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f31427fc700 1 -- 172.21.15.69:0/3956172467 learned_addr learned my addr 172.21.15.69:0/3956172467 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3266880685 0 0) 0x7f8a940035d0 con 0x7f8aac15ead0 2023-11-17T06:30:03.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 >> v2:172.21.15.93:3300/0 conn(0x7f8aac0b2fe0 msgr2=0x7f8aac15bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 --2- 172.21.15.69:0/740842177 >> v2:172.21.15.93:3300/0 conn(0x7f8aac0b2fe0 0x7f8aac15bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 >> v1:172.21.15.69:6789/0 conn(0x7f8aac15b040 legacy=0x7f8aac0ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0cd4a0 con 0x7f8aac15ead0 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f8aa0001800 con 0x7f8aac15ead0 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 >> v1:172.21.15.93:6789/0 conn(0x7f8aac15ead0 legacy=0x7f8aac0b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a94003a20 0x7f8a94003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a94004870 0x7f8a94004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a94005230 0x7f8a9400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac15b420 con 0x7f8a94003a20 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9400c180 con 0x7f8a94004870 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9400c340 con 0x7f8a94005230 2023-11-17T06:30:03.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa9b3fff700 1 -- 172.21.15.69:0/1370896021 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9b8071fd0 con 0x7fa9b806f460 2023-11-17T06:30:03.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f31437fe700 1 --2- 172.21.15.69:0/3956172467 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440ce4e0 0x7f31440b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa9b3fff700 1 -- 172.21.15.69:0/1370896021 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9bc007ea0 con 0x7fa9cc0d1150 2023-11-17T06:30:03.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa9cb7fe700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x7fa9b806f460 0x7fa9b8071900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa57dd9b700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa5600665d0 0x7fa560068a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fa57ed9d700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x7fa56006e770 0x7fa560070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8ab0ee8700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a94005230 0x7f8a9400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7f8aab7fe700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a94004870 0x7f8a94004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fef31ffb700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef200665e0 0x7fef20068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fef31ffb700 1 -- 172.21.15.69:0/1761405273 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef34097960 con 0x7fef3c15d5d0 2023-11-17T06:30:03.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f3142ffd700 1 --2- 172.21.15.69:0/3956172467 >> v2:172.21.15.69:3300/0 conn(0x7f314415d490 0x7f31440b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fef31ffb700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x7fef2006e800 0x7fef20070c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fef31ffb700 1 -- 172.21.15.69:0/1761405273 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef200712d0 con 0x7fef2006e800 2023-11-17T06:30:03.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fef31ffb700 1 -- 172.21.15.69:0/1761405273 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef34097d10 con 0x7fef3c15d5d0 2023-11-17T06:30:03.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fa57ed9d700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x7fa56006e770 0x7fa560070b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.532+0000 7fc07a7fc700 1 -- 172.21.15.69:0/3315514762 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc07c00ea20 con 0x7fc08415d4b0 2023-11-17T06:30:03.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fc07a7fc700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc0680665e0 0x7fc068068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f3142ffd700 1 -- 172.21.15.69:0/3956172467 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440ce4e0 msgr2=0x7f31440b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f3142ffd700 1 --2- 172.21.15.69:0/3956172467 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440ce4e0 0x7f31440b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f3142ffd700 1 -- 172.21.15.69:0/3956172467 >> v1:172.21.15.93:6789/0 conn(0x7f31440d13d0 legacy=0x7f31440cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f3142ffd700 1 -- 172.21.15.69:0/3956172467 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31440d2450 con 0x7f314415d490 2023-11-17T06:30:03.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f13f77fe700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13f80cbb40 0x7f13f81f6af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f13e000c240 tx=0x7f13ec001930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fa57dd9b700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa5600665d0 0x7fa560068a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa580159bf0 tx=0x7fa570008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fa9cb7fe700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x7fa9b806f460 0x7fa9b8071900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aabfff700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a94003a20 0x7f8a94003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fef40d5a700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x7fef2006e800 0x7fef20070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fef4155b700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef200665e0 0x7fef20068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f3142ffd700 1 --2- 172.21.15.69:0/3956172467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f314415d490 0x7f31440b8bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3138009850 tx=0x7f3138009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabad26773ae84bc server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aab7fe700 1 -- 172.21.15.69:0/740842177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a94005230 msgr2=0x7f8a9400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aab7fe700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a94005230 0x7f8a9400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fa56effd700 1 -- 172.21.15.69:0/3855365275 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa57400bee0 con 0x7fa5800b0840 2023-11-17T06:30:03.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fc07a7fc700 1 -- 172.21.15.69:0/3315514762 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc07c083d40 con 0x7fc08415d4b0 2023-11-17T06:30:03.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fc089a15700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc0680665e0 0x7fc068068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fa9ca7fc700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa9b8066560 0x7fa9b8068a20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009c60 tx=0x7fa9c0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fef40d5a700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x7fef2006e800 0x7fef20070c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fef4155b700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef200665e0 0x7fef20068aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef38009aa0 tx=0x7fef38009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f13f4ff9700 1 -- 172.21.15.69:0/766804673 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec004ca0 con 0x7f13f80cbb40 2023-11-17T06:30:03.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f13f4ff9700 1 -- 172.21.15.69:0/766804673 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ec004e00 con 0x7f13f80cbb40 2023-11-17T06:30:03.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f13f4ff9700 1 -- 172.21.15.69:0/766804673 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec0072f0 con 0x7f13f80cbb40 2023-11-17T06:30:03.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f80cc600 con 0x7f13f80cbb40 2023-11-17T06:30:03.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f80cbfa0 con 0x7f13f80cbb40 2023-11-17T06:30:03.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aab7fe700 1 -- 172.21.15.69:0/740842177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a94003a20 msgr2=0x7f8a94003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aab7fe700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a94003a20 0x7f8a94003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aab7fe700 1 -- 172.21.15.69:0/740842177 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0cd4a0 con 0x7f8a94004870 2023-11-17T06:30:03.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aabfff700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a94003a20 0x7f8a94003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:03.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fa9b3fff700 1 -- 172.21.15.69:0/1370896021 <== osd.2 v2:172.21.15.69:6808/576340262 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa9b8071fd0 con 0x7fa9b806f460 2023-11-17T06:30:03.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f1734ff9700 1 -- 172.21.15.69:0/708052981 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f173002f420 con 0x7f17381652b0 2023-11-17T06:30:03.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8ab0ee8700 1 -- 172.21.15.69:0/740842177 reap_dead start 2023-11-17T06:30:03.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aab7fe700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a94004870 0x7f8a94004cf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000c260 tx=0x7f8a940058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7014c4e206c24a8a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fa56effd700 1 -- 172.21.15.69:0/3855365275 <== osd.0 v2:172.21.15.69:6800/3449021474 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa560071240 con 0x7fa56006e770 2023-11-17T06:30:03.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f3141ffb700 1 -- 172.21.15.69:0/3956172467 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138011830 con 0x7f314415d490 2023-11-17T06:30:03.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f3141ffb700 1 -- 172.21.15.69:0/3956172467 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3138011990 con 0x7f314415d490 2023-11-17T06:30:03.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f3141ffb700 1 -- 172.21.15.69:0/3956172467 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138011d40 con 0x7f314415d490 2023-11-17T06:30:03.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000ce00 con 0x7f8a94004870 2023-11-17T06:30:03.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa0005980 con 0x7f8a94004870 2023-11-17T06:30:03.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fc07a7fc700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x7fc06806e780 0x7fc068070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fc07a7fc700 1 -- 172.21.15.69:0/3315514762 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc068071250 con 0x7fc06806e780 2023-11-17T06:30:03.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fc07a7fc700 1 -- 172.21.15.69:0/3315514762 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc07c088030 con 0x7fc08415d4b0 2023-11-17T06:30:03.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fc089a15700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc0680665e0 0x7fc068068aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc080009c30 tx=0x7fc080008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7fef31ffb700 1 -- 172.21.15.69:0/1761405273 <== osd.3 v2:172.21.15.69:6824/183679214 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fef200712d0 con 0x7fef2006e800 2023-11-17T06:30:03.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f13f8161fb0 con 0x7f13f80cbb40 2023-11-17T06:30:03.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f1734ff9700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1718066560 0x7f1718068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f1734ff9700 1 -- 172.21.15.69:0/708052981 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1730086120 con 0x7f17381652b0 2023-11-17T06:30:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7fc089214700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x7fc06806e780 0x7fc068070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f1734ff9700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x7f171806e780 0x7f1718070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f3143fff700 1 -- 172.21.15.69:0/3956172467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f314415d490 msgr2=0x7f31440b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f3143fff700 1 --2- 172.21.15.69:0/3956172467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f314415d490 0x7f31440b8bc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3138009850 tx=0x7f3138009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f1734ff9700 1 -- 172.21.15.69:0/708052981 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1718071250 con 0x7f171806e780 2023-11-17T06:30:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f1734ff9700 1 -- 172.21.15.69:0/708052981 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1730086490 con 0x7f17381652b0 2023-11-17T06:30:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f172ffff700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x7f171806e780 0x7f1718070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f172ffff700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x7f171806e780 0x7f1718070ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f3143fff700 1 -- 172.21.15.69:0/3956172467 shutdown_connections 2023-11-17T06:30:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f3143fff700 1 --2- 172.21.15.69:0/3956172467 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440ce4e0 0x7f31440b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f3143fff700 1 --2- 172.21.15.69:0/3956172467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f314415d490 0x7f31440b8bc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f3143fff700 1 -- 172.21.15.69:0/3956172467 >> 172.21.15.69:0/3956172467 conn(0x7f314406ab40 msgr2=0x7f314406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f3143fff700 1 -- 172.21.15.69:0/3956172467 shutdown_connections 2023-11-17T06:30:03.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.536+0000 7f8aaaffd700 1 -- 172.21.15.69:0/740842177 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0005d10 con 0x7f8a94004870 2023-11-17T06:30:03.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f8ab16e9700 1 -- 172.21.15.69:0/740842177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a94004870 msgr2=0x7f8a94004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f8ab16e9700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a94004870 0x7f8a94004cf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000c260 tx=0x7f8a940058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f1734ff9700 1 -- 172.21.15.69:0/708052981 <== osd.4 v2:172.21.15.93:6812/1712617818 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f1718071250 con 0x7f171806e780 2023-11-17T06:30:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f17377fe700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1718066560 0x7f1718068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f13f4ff9700 1 -- 172.21.15.69:0/766804673 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f13ec007450 con 0x7f13f80cbb40 2023-11-17T06:30:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f13f4ff9700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f13e4066610 0x7f13e4068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f13f4ff9700 1 -- 172.21.15.69:0/766804673 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13ec084fe0 con 0x7f13f80cbb40 2023-11-17T06:30:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f13f4ff9700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x7f13e406e7b0 0x7f13e4070bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f13f4ff9700 1 -- 172.21.15.69:0/766804673 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f13e4071280 con 0x7f13e406e7b0 2023-11-17T06:30:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.540+0000 7f3143fff700 1 -- 172.21.15.69:0/3956172467 wait complete. 2023-11-17T06:30:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f13f7fff700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f13e4066610 0x7f13e4068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f3143fff700 1 Processor -- start 2023-11-17T06:30:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f8ab16e9700 1 -- 172.21.15.69:0/740842177 shutdown_connections 2023-11-17T06:30:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f8ab16e9700 1 --2- 172.21.15.69:0/740842177 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a94004870 0x7f8a94004cf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f8ab16e9700 1 -- 172.21.15.69:0/740842177 >> 172.21.15.69:0/740842177 conn(0x7f8aac06de60 msgr2=0x7f8aac06e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7fc089214700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x7fc06806e780 0x7fc068070ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f13f4ff9700 1 -- 172.21.15.69:0/766804673 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13ec0524d0 con 0x7f13f80cbb40 2023-11-17T06:30:03.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f13fcc2c700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x7f13e406e7b0 0x7f13e4070bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f17377fe700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1718066560 0x7f1718068a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f17280013e0 tx=0x7f1728001370 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f3143fff700 1 -- start start 2023-11-17T06:30:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f8ab16e9700 1 -- 172.21.15.69:0/740842177 shutdown_connections 2023-11-17T06:30:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f8ab16e9700 1 -- 172.21.15.69:0/740842177 wait complete. 2023-11-17T06:30:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f13fcc2c700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x7f13e406e7b0 0x7f13e4070bd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7fc07a7fc700 1 -- 172.21.15.69:0/3315514762 <== osd.1 v2:172.21.15.69:6809/346628569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc068071250 con 0x7fc06806e780 2023-11-17T06:30:03.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f3143fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31440ce4e0 0x7f314416a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f3143fff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440d13d0 0x7f314415f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.544+0000 7f13f4ff9700 1 -- 172.21.15.69:0/766804673 <== osd.5 v2:172.21.15.93:6802/753754499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f13e4071280 con 0x7f13e406e7b0 2023-11-17T06:30:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f13f7fff700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f13e4066610 0x7f13e4068ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13e8004dd0 tx=0x7f13e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f3143fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f314415d490 0x7f31440c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f3142ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31440ce4e0 0x7f314416a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f3142ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31440ce4e0 0x7f314416a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:42646/0 (socket says 172.21.15.69:42646) 2023-11-17T06:30:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31427fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440d13d0 0x7f314415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31427fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440d13d0 0x7f314415f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:35142/0 (socket says 172.21.15.69:35142) 2023-11-17T06:30:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31427fc700 1 -- 172.21.15.69:0/3311015811 learned_addr learned my addr 172.21.15.69:0/3311015811 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31441465d0 con 0x7f314415d490 2023-11-17T06:30:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314416a9e0 con 0x7f31440ce4e0 2023-11-17T06:30:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314415f840 con 0x7f31440d13d0 2023-11-17T06:30:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f8ab16e9700 1 Processor -- start 2023-11-17T06:30:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31437fe700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f314415d490 0x7f31440c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31427fc700 1 -- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31440ce4e0 msgr2=0x7f314416a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31427fc700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31440ce4e0 0x7f314416a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31427fc700 1 -- 172.21.15.69:0/3311015811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f314415d490 msgr2=0x7f31440c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31427fc700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f314415d490 0x7f31440c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31427fc700 1 -- 172.21.15.69:0/3311015811 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31380094b0 con 0x7f31440d13d0 2023-11-17T06:30:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31437fe700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f314415d490 0x7f31440c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:03.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f8ab16e9700 1 -- start start 2023-11-17T06:30:03.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f31427fc700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440d13d0 0x7f314415f300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f313c00cb10 tx=0x7f313c00cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f312b7fe700 1 -- 172.21.15.69:0/3311015811 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00a770 con 0x7f31440d13d0 2023-11-17T06:30:03.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f312b7fe700 1 -- 172.21.15.69:0/3311015811 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c00a8d0 con 0x7f31440d13d0 2023-11-17T06:30:03.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.548+0000 7f312b7fe700 1 -- 172.21.15.69:0/3311015811 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00a770 con 0x7f31440d13d0 2023-11-17T06:30:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab16e9700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a94004870 0x7f8aac14e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab16e9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8aac15dbb0 0x7f8aac0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8aabfff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a94004870 0x7f8aac14e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8aabfff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a94004870 0x7f8aac14e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:35152/0 (socket says 172.21.15.69:35152) 2023-11-17T06:30:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8aab7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8aac15dbb0 0x7f8aac0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8aabfff700 1 -- 172.21.15.69:0/2822057457 learned_addr learned my addr 172.21.15.69:0/2822057457 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab16e9700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8aac0c9a60 0x7f8aac148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac14d450 con 0x7f8aac15dbb0 2023-11-17T06:30:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac15e030 con 0x7f8aac0c9a60 2023-11-17T06:30:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac0ca250 con 0x7f8a94004870 2023-11-17T06:30:03.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab0ee8700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8aac0c9a60 0x7f8aac148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab0ee8700 1 -- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a94004870 msgr2=0x7f8aac14e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab0ee8700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8a94004870 0x7f8aac14e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab0ee8700 1 -- 172.21.15.69:0/2822057457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8aac15dbb0 msgr2=0x7f8aac0c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab0ee8700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8aac15dbb0 0x7f8aac0c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab0ee8700 1 -- 172.21.15.69:0/2822057457 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0c9f70 con 0x7f8aac0c9a60 2023-11-17T06:30:03.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31441459c0 con 0x7f31440d13d0 2023-11-17T06:30:03.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3144145f80 con 0x7f31440d13d0 2023-11-17T06:30:03.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab0ee8700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8aac0c9a60 0x7f8aac148260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8aac15eeb0 tx=0x7f8aa4004930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8aa8ff9700 1 -- 172.21.15.69:0/2822057457 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40078a0 con 0x7f8aac0c9a60 2023-11-17T06:30:03.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aac14d630 con 0x7f8aac0c9a60 2023-11-17T06:30:03.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.552+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aac14dbf0 con 0x7f8aac0c9a60 2023-11-17T06:30:03.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.556+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31440d2c50 con 0x7f31440d13d0 2023-11-17T06:30:03.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.556+0000 7f8aa8ff9700 1 -- 172.21.15.69:0/2822057457 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa4007a00 con 0x7f8aac0c9a60 2023-11-17T06:30:03.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.556+0000 7f8aa8ff9700 1 -- 172.21.15.69:0/2822057457 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4007db0 con 0x7f8aac0c9a60 2023-11-17T06:30:03.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.556+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a8c000fc0 con 0x7f8aac0c9a60 2023-11-17T06:30:03.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.556+0000 7f312b7fe700 1 -- 172.21.15.69:0/3311015811 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f313c00aa40 con 0x7f31440d13d0 2023-11-17T06:30:03.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f312b7fe700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31300665a0 0x7f3130068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f312b7fe700 1 -- 172.21.15.69:0/3311015811 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f313c0837a0 con 0x7f31440d13d0 2023-11-17T06:30:03.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f312b7fe700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x7f313006e7c0 0x7f3130070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f312b7fe700 1 -- 172.21.15.69:0/3311015811 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3130071290 con 0x7f313006e7c0 2023-11-17T06:30:03.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f312b7fe700 1 -- 172.21.15.69:0/3311015811 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f313c083b50 con 0x7f31440d13d0 2023-11-17T06:30:03.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f8aa8ff9700 1 -- 172.21.15.69:0/2822057457 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8aa4028430 con 0x7f8aac0c9a60 2023-11-17T06:30:03.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f8aa8ff9700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8a98066510 0x7f8a980689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f8aa8ff9700 1 -- 172.21.15.69:0/2822057457 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8aa4084b40 con 0x7f8aac0c9a60 2023-11-17T06:30:03.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef3c0cfad0 con 0x7fef2006e800 2023-11-17T06:30:03.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f8aa8ff9700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x7f8a9806e6b0 0x7f8a98070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7fef31ffb700 1 -- 172.21.15.69:0/1761405273 <== osd.3 v2:172.21.15.69:6824/183679214 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef2c0014f0 con 0x7fef2006e800 2023-11-17T06:30:03.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f8aa8ff9700 1 -- 172.21.15.69:0/2822057457 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a98071180 con 0x7f8a9806e6b0 2023-11-17T06:30:03.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f8aa8ff9700 1 -- 172.21.15.69:0/2822057457 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aa4084f90 con 0x7f8aac0c9a60 2023-11-17T06:30:03.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x7fef2006e800 msgr2=0x7fef20070c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7fef437bf700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x7fef2006e800 0x7fef20070c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7f31437fe700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x7f313006e7c0 0x7f3130070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef200665e0 msgr2=0x7fef20068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fef437bf700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef200665e0 0x7fef20068aa0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef38009aa0 tx=0x7fef38009190 comp rx=0 tx=0).stop 2023-11-17T06:30:03.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fef3c15d5d0 msgr2=0x7fef3c158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fef437bf700 1 --2- 172.21.15.69:0/1761405273 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fef3c15d5d0 0x7fef3c158b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fef34026000 tx=0x7fef34004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7f3142ffd700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31300665a0 0x7f3130068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f8aabfff700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8a98066510 0x7f8a980689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.560+0000 7f8aab7fe700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x7f8a9806e6b0 0x7f8a98070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7f31437fe700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x7f313006e7c0 0x7f3130070be0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa580159fe0 con 0x7fa56006e770 2023-11-17T06:30:03.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7f8aab7fe700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x7f8a9806e6b0 0x7f8a98070ad0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7f8aabfff700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8a98066510 0x7f8a980689d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0017b0 tx=0x7f8a9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7f3142ffd700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31300665a0 0x7f3130068a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f31380090b0 tx=0x7f313801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fa56effd700 1 -- 172.21.15.69:0/3855365275 <== osd.0 v2:172.21.15.69:6800/3449021474 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa57800f040 con 0x7fa56006e770 2023-11-17T06:30:03.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fef41d5c700 1 -- 172.21.15.69:0/1761405273 reap_dead start 2023-11-17T06:30:03.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 shutdown_connections 2023-11-17T06:30:03.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 >> 172.21.15.69:0/1761405273 conn(0x7fef3c0d3250 msgr2=0x7fef3c0b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 shutdown_connections 2023-11-17T06:30:03.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7fef437bf700 1 -- 172.21.15.69:0/1761405273 wait complete. 2023-11-17T06:30:03.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7f312b7fe700 1 -- 172.21.15.69:0/3311015811 <== osd.6 v2:172.21.15.93:6826/2665225471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3130071290 con 0x7f313006e7c0 2023-11-17T06:30:03.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.564+0000 7f8aa8ff9700 1 -- 172.21.15.69:0/2822057457 <== osd.7 v2:172.21.15.93:6810/4059179485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8a98071180 con 0x7f8a9806e6b0 2023-11-17T06:30:03.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x7fa56006e770 msgr2=0x7fa560070b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa5848c4700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x7fa56006e770 0x7fa560070b90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa5600665d0 msgr2=0x7fa560068a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa5848c4700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa5600665d0 0x7fa560068a90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa580159bf0 tx=0x7fa570008040 comp rx=0 tx=0).stop 2023-11-17T06:30:03.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5800b0840 msgr2=0x7fa5800b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa5848c4700 1 --2- 172.21.15.69:0/3855365275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa5800b0840 0x7fa5800b20f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa574016000 tx=0x7fa574004770 comp rx=0 tx=0).stop 2023-11-17T06:30:03.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa57ed9d700 1 -- 172.21.15.69:0/3855365275 reap_dead start 2023-11-17T06:30:03.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 shutdown_connections 2023-11-17T06:30:03.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 >> 172.21.15.69:0/3855365275 conn(0x7fa58006a480 msgr2=0x7fa58015ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 shutdown_connections 2023-11-17T06:30:03.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa5848c4700 1 -- 172.21.15.69:0/3855365275 wait complete. 2023-11-17T06:30:03.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1738073f00 con 0x7f171806e780 2023-11-17T06:30:03.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.568+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa9cc0cfad0 con 0x7fa9b806f460 2023-11-17T06:30:03.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc084161cd0 con 0x7fc06806e780 2023-11-17T06:30:03.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7f1734ff9700 1 -- 172.21.15.69:0/708052981 <== osd.4 v2:172.21.15.93:6812/1712617818 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1738073f00 con 0x7f171806e780 2023-11-17T06:30:03.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x7f171806e780 msgr2=0x7f1718070ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7f173cf9c700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x7f171806e780 0x7f1718070ba0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1718066560 msgr2=0x7f1718068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7f173cf9c700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1718066560 0x7f1718068a20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f17280013e0 tx=0x7f1728001370 comp rx=0 tx=0).stop 2023-11-17T06:30:03.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17381652b0 msgr2=0x7f17380b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7f173cf9c700 1 --2- 172.21.15.69:0/708052981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17381652b0 0x7f17380b4570 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f173000b370 tx=0x7f1730004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7fa9b3fff700 1 -- 172.21.15.69:0/1370896021 <== osd.2 v2:172.21.15.69:6808/576340262 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa9c400f040 con 0x7fa9b806f460 2023-11-17T06:30:03.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7f1737fff700 1 -- 172.21.15.69:0/708052981 reap_dead start 2023-11-17T06:30:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7fc07a7fc700 1 -- 172.21.15.69:0/3315514762 <== osd.1 v2:172.21.15.69:6809/346628569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc07400c040 con 0x7fc06806e780 2023-11-17T06:30:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 shutdown_connections 2023-11-17T06:30:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 >> 172.21.15.69:0/708052981 conn(0x7f17380b0900 msgr2=0x7f17381643f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.572+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x7fc06806e780 msgr2=0x7fc068070ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fc08aa17700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x7fc06806e780 0x7fc068070ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc0680665e0 msgr2=0x7fc068068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fc08aa17700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc0680665e0 0x7fc068068aa0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc080009c30 tx=0x7fc080008030 comp rx=0 tx=0).stop 2023-11-17T06:30:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 shutdown_connections 2023-11-17T06:30:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc08415d4b0 msgr2=0x7fc0840c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fc08aa17700 1 --2- 172.21.15.69:0/3315514762 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc08415d4b0 0x7fc0840c8160 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc07c007cf0 tx=0x7fc07c00e0e0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fc08a216700 1 -- 172.21.15.69:0/3315514762 reap_dead start 2023-11-17T06:30:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7f173cf9c700 1 -- 172.21.15.69:0/708052981 wait complete. 2023-11-17T06:30:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x7fa9b806f460 msgr2=0x7fa9b8071900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9d1954700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x7fa9b806f460 0x7fa9b8071900 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa9b8066560 msgr2=0x7fa9b8068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9d1954700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa9b8066560 0x7fa9b8068a20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009c60 tx=0x7fa9c0008030 comp rx=0 tx=0).stop 2023-11-17T06:30:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0d1150 msgr2=0x7fa9cc0c8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9d1954700 1 --2- 172.21.15.69:0/1370896021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa9cc0d1150 0x7fa9cc0c8180 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc00c410 tx=0x7fa9bc00c720 comp rx=0 tx=0).stop 2023-11-17T06:30:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9cb7fe700 1 -- 172.21.15.69:0/1370896021 reap_dead start 2023-11-17T06:30:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 shutdown_connections 2023-11-17T06:30:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 >> 172.21.15.69:0/1370896021 conn(0x7fa9cc0d3250 msgr2=0x7fa9cc0d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 shutdown_connections 2023-11-17T06:30:03.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fa9d1954700 1 -- 172.21.15.69:0/1370896021 wait complete. 2023-11-17T06:30:03.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 shutdown_connections 2023-11-17T06:30:03.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 >> 172.21.15.69:0/3315514762 conn(0x7fc08406ac60 msgr2=0x7fc0840c6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 shutdown_connections 2023-11-17T06:30:03.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.576+0000 7fc08aa17700 1 -- 172.21.15.69:0/3315514762 wait complete. 2023-11-17T06:30:03.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.584+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f13f80c7360 con 0x7f13e406e7b0 2023-11-17T06:30:03.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.584+0000 7f13f4ff9700 1 -- 172.21.15.69:0/766804673 <== osd.5 v2:172.21.15.93:6802/753754499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f13f80c7360 con 0x7f13e406e7b0 2023-11-17T06:30:03.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.588+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31440d2730 con 0x7f313006e7c0 2023-11-17T06:30:03.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.588+0000 7f312b7fe700 1 -- 172.21.15.69:0/3311015811 <== osd.6 v2:172.21.15.93:6826/2665225471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3134009800 con 0x7f313006e7c0 2023-11-17T06:30:03.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x7f13e406e7b0 msgr2=0x7f13e4070bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f13fd42d700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x7f13e406e7b0 0x7f13e4070bd0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f13e4066610 msgr2=0x7f13e4068ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f13fd42d700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f13e4066610 0x7f13e4068ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13e8004dd0 tx=0x7f13e8009040 comp rx=0 tx=0).stop 2023-11-17T06:30:03.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13f80cbb40 msgr2=0x7f13f81f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f13fd42d700 1 --2- 172.21.15.69:0/766804673 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f13f80cbb40 0x7f13f81f6af0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f13e000c240 tx=0x7f13ec001930 comp rx=0 tx=0).stop 2023-11-17T06:30:03.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x7f313006e7c0 msgr2=0x7f3130070be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f3143fff700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x7f313006e7c0 0x7f3130070be0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f13fcc2c700 1 -- 172.21.15.69:0/766804673 reap_dead start 2023-11-17T06:30:03.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 shutdown_connections 2023-11-17T06:30:03.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.592+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 >> 172.21.15.69:0/766804673 conn(0x7f13f806ac60 msgr2=0x7f13f80d3740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 shutdown_connections 2023-11-17T06:30:03.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31300665a0 msgr2=0x7f3130068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f3143fff700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31300665a0 0x7f3130068a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f31380090b0 tx=0x7f313801c040 comp rx=0 tx=0).stop 2023-11-17T06:30:03.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440d13d0 msgr2=0x7f314415f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f3143fff700 1 --2- 172.21.15.69:0/3311015811 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31440d13d0 0x7f314415f300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f313c00cb10 tx=0x7f313c00cb40 comp rx=0 tx=0).stop 2023-11-17T06:30:03.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f31437fe700 1 -- 172.21.15.69:0/3311015811 reap_dead start 2023-11-17T06:30:03.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 shutdown_connections 2023-11-17T06:30:03.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 >> 172.21.15.69:0/3311015811 conn(0x7f314406ab40 msgr2=0x7f31440c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f13fd42d700 1 -- 172.21.15.69:0/766804673 wait complete. 2023-11-17T06:30:03.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 shutdown_connections 2023-11-17T06:30:03.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f3143fff700 1 -- 172.21.15.69:0/3311015811 wait complete. 2023-11-17T06:30:03.629 INFO:teuthology.orchestra.run.smithi069.stdout:64424509447 2023-11-17T06:30:03.630 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-17T06:30:03.631 INFO:teuthology.orchestra.run.smithi069.stdout:64424509447 2023-11-17T06:30:03.631 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-17T06:30:03.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.596+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a8c002d60 con 0x7f8a9806e6b0 2023-11-17T06:30:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.600+0000 7f8aa8ff9700 1 -- 172.21.15.69:0/2822057457 <== osd.7 v2:172.21.15.93:6810/4059179485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8a8c002d60 con 0x7f8a9806e6b0 2023-11-17T06:30:03.632 INFO:teuthology.orchestra.run.smithi069.stdout:64424509446 2023-11-17T06:30:03.633 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x7f8a9806e6b0 msgr2=0x7f8a98070ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab16e9700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x7f8a9806e6b0 0x7f8a98070ad0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8a98066510 msgr2=0x7f8a980689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab16e9700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8a98066510 0x7f8a980689d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0017b0 tx=0x7f8a9c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8aac0c9a60 msgr2=0x7f8aac148260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab16e9700 1 --2- 172.21.15.69:0/2822057457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8aac0c9a60 0x7f8aac148260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8aac15eeb0 tx=0x7f8aa4004930 comp rx=0 tx=0).stop 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab0ee8700 1 -- 172.21.15.69:0/2822057457 reap_dead start 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 shutdown_connections 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 >> 172.21.15.69:0/2822057457 conn(0x7f8aac06de60 msgr2=0x7f8aac06b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 shutdown_connections 2023-11-17T06:30:03.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.604+0000 7f8ab16e9700 1 -- 172.21.15.69:0/2822057457 wait complete. 2023-11-17T06:30:03.635 INFO:teuthology.orchestra.run.smithi069.stdout:64424509447 2023-11-17T06:30:03.635 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-17T06:30:03.636 INFO:teuthology.orchestra.run.smithi069.stdout:64424509445 2023-11-17T06:30:03.636 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-17T06:30:03.637 INFO:teuthology.orchestra.run.smithi069.stdout:64424509445 2023-11-17T06:30:03.637 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-17T06:30:03.638 INFO:teuthology.orchestra.run.smithi069.stdout:64424509446 2023-11-17T06:30:03.638 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-17T06:30:03.639 INFO:teuthology.orchestra.run.smithi069.stdout:60129542150 2023-11-17T06:30:03.639 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-17T06:30:03.798 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:30:03.808 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:30:03.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.904+0000 7f25af762700 1 Processor -- start 2023-11-17T06:30:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.904+0000 7f25af762700 1 -- start start 2023-11-17T06:30:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.904+0000 7f25af762700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f25a806ca40 0x7f25a80b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f25af762700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a80b11d0 con 0x7f25a8159590 2023-11-17T06:30:03.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f25af762700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a80c9e60 con 0x7f25a80b0d80 2023-11-17T06:30:03.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f25af762700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a80ca140 con 0x7f25a806ca40 2023-11-17T06:30:03.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f25ad4fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f25a8159590 0x7f25a80c9410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59034/0 (socket says 172.21.15.69:59034) 2023-11-17T06:30:03.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f25ad4fe700 1 -- 172.21.15.69:0/3735457473 learned_addr learned my addr 172.21.15.69:0/3735457473 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1546130861 0 0) 0x7f25a80c9e60 con 0x7f25a80b0d80 2023-11-17T06:30:03.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25940035d0 con 0x7f25a80b0d80 2023-11-17T06:30:03.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155412570 0 0) 0x7f2598001040 con 0x7f25a8159590 2023-11-17T06:30:03.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a80c9e60 con 0x7f25a8159590 2023-11-17T06:30:03.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1586139292 0 0) 0x7f25940035d0 con 0x7f25a80b0d80 2023-11-17T06:30:03.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 >> v2:172.21.15.93:3300/0 conn(0x7f25a806ca40 msgr2=0x7f25a80b0840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-17T06:30:03.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 --2- 172.21.15.69:0/3735457473 >> v2:172.21.15.93:3300/0 conn(0x7f25a806ca40 0x7f25a80b0840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 >> v1:172.21.15.69:6789/0 conn(0x7f25a8159590 legacy=0x7f25a80c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a806bf60 con 0x7f25a80b0d80 2023-11-17T06:30:03.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f25a00019f0 con 0x7f25a80b0d80 2023-11-17T06:30:03.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 >> v1:172.21.15.93:6789/0 conn(0x7f25a80b0d80 legacy=0x7f25a80ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594004c60 0x7f2594005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2594003810 0x7f2594003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25940042f0 0x7f2594005a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80ca140 con 0x7f2594004c60 2023-11-17T06:30:03.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25940062e0 con 0x7f2594003810 2023-11-17T06:30:03.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25940064a0 con 0x7f25940042f0 2023-11-17T06:30:03.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f25ad4fe700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594004c60 0x7f2594005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f25adcff700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25940042f0 0x7f2594005a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.908+0000 7f25accfd700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2594003810 0x7f2594003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25adcff700 1 -- 172.21.15.69:0/3735457473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2594003810 msgr2=0x7f2594003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25adcff700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2594003810 0x7f2594003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25adcff700 1 -- 172.21.15.69:0/3735457473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594004c60 msgr2=0x7f2594005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25adcff700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594004c60 0x7f2594005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25adcff700 1 -- 172.21.15.69:0/3735457473 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a806bf60 con 0x7f25940042f0 2023-11-17T06:30:03.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25adcff700 1 -- 172.21.15.69:0/3735457473 reap_dead start 2023-11-17T06:30:03.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25ad4fe700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594004c60 0x7f2594005060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:03.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25adcff700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25940042f0 0x7f2594005a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25a000a8a0 tx=0x7f25940058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67c59b731dac7aee server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0012620 con 0x7f25940042f0 2023-11-17T06:30:03.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a0012780 con 0x7f25940042f0 2023-11-17T06:30:03.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f259ffff700 1 -- 172.21.15.69:0/3735457473 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0012b30 con 0x7f25940042f0 2023-11-17T06:30:03.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25af762700 1 -- 172.21.15.69:0/3735457473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25940042f0 msgr2=0x7f2594005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25af762700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25940042f0 0x7f2594005a00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f25a000a8a0 tx=0x7f25940058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25af762700 1 -- 172.21.15.69:0/3735457473 shutdown_connections 2023-11-17T06:30:03.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25af762700 1 --2- 172.21.15.69:0/3735457473 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25940042f0 0x7f2594005a00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.912+0000 7f25af762700 1 -- 172.21.15.69:0/3735457473 >> 172.21.15.69:0/3735457473 conn(0x7f25a80cb840 msgr2=0x7f25a80cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.916+0000 7f25af762700 1 -- 172.21.15.69:0/3735457473 shutdown_connections 2023-11-17T06:30:03.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.916+0000 7f25af762700 1 -- 172.21.15.69:0/3735457473 wait complete. 2023-11-17T06:30:03.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.916+0000 7f84c6e34700 1 Processor -- start 2023-11-17T06:30:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.916+0000 7f84c6e34700 1 -- start start 2023-11-17T06:30:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.916+0000 7f25af762700 1 Processor -- start 2023-11-17T06:30:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c6e34700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f84b80e3420 0x7f84b803ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c6633700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f84b80544f0 0x7f84b80578c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59042/0 (socket says 172.21.15.69:59042) 2023-11-17T06:30:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c6633700 1 -- 172.21.15.69:0/2585107095 learned_addr learned my addr 172.21.15.69:0/2585107095 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c5e32700 1 --2- 172.21.15.69:0/2585107095 >> v2:172.21.15.93:3300/0 conn(0x7f84b80e3420 0x7f84b803ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c6e34700 1 -- 172.21.15.69:0/2585107095 --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b8057150 con 0x7f84b80544f0 2023-11-17T06:30:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25af762700 1 -- start start 2023-11-17T06:30:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25af762700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25940042f0 0x7f25a81559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25af762700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25a81578f0 0x7f25a80b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25af762700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25a8153ef0 0x7f25a8154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25af762700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8156c40 con 0x7f25940042f0 2023-11-17T06:30:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7fdd15fe6700 1 Processor -- start 2023-11-17T06:30:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7fdd15fe6700 1 -- start start 2023-11-17T06:30:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c6e34700 1 -- 172.21.15.69:0/2585107095 --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b8057430 con 0x7f84b8006c40 2023-11-17T06:30:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c6e34700 1 -- 172.21.15.69:0/2585107095 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b80e3800 con 0x7f84b80e3420 2023-11-17T06:30:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25af762700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8154870 con 0x7f25a81578f0 2023-11-17T06:30:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25af762700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a81560c0 con 0x7f25a8153ef0 2023-11-17T06:30:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25adcff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25a8153ef0 0x7f25a8154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c4e30700 1 -- 172.21.15.69:0/2585107095 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267469471 0 0) 0x7f84b8057150 con 0x7f84b80544f0 2023-11-17T06:30:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c4e30700 1 -- 172.21.15.69:0/2585107095 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84ac0035d0 con 0x7f84b80544f0 2023-11-17T06:30:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25adcff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25a8153ef0 0x7f25a8154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:49198/0 (socket says 172.21.15.69:49198) 2023-11-17T06:30:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25adcff700 1 -- 172.21.15.69:0/2405935655 learned_addr learned my addr 172.21.15.69:0/2405935655 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c5e32700 1 -- 172.21.15.69:0/2585107095 >> v1:172.21.15.93:6789/0 conn(0x7f84b8006c40 legacy=0x7f84b8053de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c5e32700 1 -- 172.21.15.69:0/2585107095 >> v1:172.21.15.69:6789/0 conn(0x7f84b80544f0 legacy=0x7f84b80578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c5e32700 1 -- 172.21.15.69:0/2585107095 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b8007470 con 0x7f84b80e3420 2023-11-17T06:30:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25ad4fe700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25940042f0 0x7f25a81559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25accfd700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25a81578f0 0x7f25a80b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7fdd15fe6700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdd10070a90 0x7fdd100cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f84c5e32700 1 --2- 172.21.15.69:0/2585107095 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 0x7f84b803ecd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009850 tx=0x7f84b0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=631b8107b8fbd092 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7fdd15fe6700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd100ce100 con 0x7fdd101599e0 2023-11-17T06:30:03.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7fdd15fe6700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd100ce3e0 con 0x7fdd1015a440 2023-11-17T06:30:03.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25adcff700 1 -- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25a81578f0 msgr2=0x7f25a80b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25adcff700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25a81578f0 0x7f25a80b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25adcff700 1 -- 172.21.15.69:0/2405935655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25940042f0 msgr2=0x7f25a81559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25adcff700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25940042f0 0x7f25a81559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.920+0000 7f25adcff700 1 -- 172.21.15.69:0/2405935655 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a81563a0 con 0x7f25a8153ef0 2023-11-17T06:30:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f1dc529d700 1 Processor -- start 2023-11-17T06:30:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd14fe4700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fdd1015a440 0x7fdd10070380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:48598/0 (socket says 172.21.15.69:48598) 2023-11-17T06:30:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd14fe4700 1 -- 172.21.15.69:0/1587398346 learned_addr learned my addr 172.21.15.69:0/1587398346 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f84c4e30700 1 -- 172.21.15.69:0/2585107095 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0011830 con 0x7f84b80e3420 2023-11-17T06:30:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f84c4e30700 1 -- 172.21.15.69:0/2585107095 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b0011990 con 0x7f84b80e3420 2023-11-17T06:30:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f84c4e30700 1 -- 172.21.15.69:0/2585107095 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b0011d40 con 0x7f84b80e3420 2023-11-17T06:30:03.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f25adcff700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25a8153ef0 0x7f25a8154330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25a000ae90 tx=0x7f25a0001cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd15fe6700 1 -- 172.21.15.69:0/1587398346 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd10071160 con 0x7fdd10070a90 2023-11-17T06:30:03.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd07fff700 1 --2- 172.21.15.69:0/1587398346 >> v2:172.21.15.93:3300/0 conn(0x7fdd10070a90 0x7fdd100cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f259dffb700 1 -- 172.21.15.69:0/2405935655 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0003e30 con 0x7f25a8153ef0 2023-11-17T06:30:03.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd077fe700 1 -- 172.21.15.69:0/1587398346 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699258164 0 0) 0x7fdd100ce3e0 con 0x7fdd1015a440 2023-11-17T06:30:03.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd077fe700 1 -- 172.21.15.69:0/1587398346 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcf80057e0 con 0x7fdd1015a440 2023-11-17T06:30:03.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f259dffb700 1 -- 172.21.15.69:0/2405935655 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a00128f0 con 0x7f25a8153ef0 2023-11-17T06:30:03.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f259dffb700 1 -- 172.21.15.69:0/2405935655 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0012ca0 con 0x7f25a8153ef0 2023-11-17T06:30:03.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f25af762700 1 -- 172.21.15.69:0/2405935655 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a8156680 con 0x7f25a8153ef0 2023-11-17T06:30:03.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd077fe700 1 -- 172.21.15.69:0/1587398346 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3778295157 0 0) 0x7fdd100ce100 con 0x7fdd101599e0 2023-11-17T06:30:03.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd077fe700 1 -- 172.21.15.69:0/1587398346 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd100ce3e0 con 0x7fdd101599e0 2023-11-17T06:30:03.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f6be8b43700 1 Processor -- start 2023-11-17T06:30:03.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f84c6e34700 1 -- 172.21.15.69:0/2585107095 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 msgr2=0x7f84b803ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f84c6e34700 1 --2- 172.21.15.69:0/2585107095 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 0x7f84b803ecd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009850 tx=0x7f84b0009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:03.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd07fff700 1 -- 172.21.15.69:0/1587398346 >> v1:172.21.15.93:6789/0 conn(0x7fdd1015a440 legacy=0x7fdd10070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd07fff700 1 -- 172.21.15.69:0/1587398346 >> v1:172.21.15.69:6789/0 conn(0x7fdd101599e0 legacy=0x7fdd100c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd07fff700 1 -- 172.21.15.69:0/1587398346 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100ce6c0 con 0x7fdd10070a90 2023-11-17T06:30:03.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f84c6e34700 1 -- 172.21.15.69:0/2585107095 shutdown_connections 2023-11-17T06:30:03.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f84c6e34700 1 --2- 172.21.15.69:0/2585107095 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 0x7f84b803ecd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f84c6e34700 1 -- 172.21.15.69:0/2585107095 >> 172.21.15.69:0/2585107095 conn(0x7f84b80590a0 msgr2=0x7f84b80594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f6be8b43700 1 -- start start 2023-11-17T06:30:03.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f25af762700 1 -- 172.21.15.69:0/2405935655 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a8157d30 con 0x7f25a8153ef0 2023-11-17T06:30:03.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f1dc529d700 1 -- start start 2023-11-17T06:30:03.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f1dc529d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db80340d0 0x7f1db80eb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f1dc529d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1db8048330 0x7f1db80eb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f1dc529d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db804ff40 con 0x7f1db8047de0 2023-11-17T06:30:03.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f1dc529d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db804fca0 con 0x7f1db8048330 2023-11-17T06:30:03.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f1dc529d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80503d0 con 0x7f1db80340d0 2023-11-17T06:30:03.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f84c6e34700 1 -- 172.21.15.69:0/2585107095 shutdown_connections 2023-11-17T06:30:03.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f84c6e34700 1 -- 172.21.15.69:0/2585107095 wait complete. 2023-11-17T06:30:03.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7fdd07fff700 1 --2- 172.21.15.69:0/1587398346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd10070a90 0x7fdd100cd9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000f9b0 tx=0x7fdd0000fcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8199d6212f4127b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f7c60a69700 1 Processor -- start 2023-11-17T06:30:03.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.924+0000 7f1dbffff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db80340d0 0x7f1db80eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1dbf7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1db8048330 0x7f1db80eb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7fdd077fe700 1 -- 172.21.15.69:0/1587398346 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0000fe50 con 0x7fdd10070a90 2023-11-17T06:30:03.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1dbf7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1db8048330 0x7f1db80eb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47840/0 (socket says 172.21.15.69:47840) 2023-11-17T06:30:03.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1dbf7fe700 1 -- 172.21.15.69:0/2814695743 learned_addr learned my addr 172.21.15.69:0/2814695743 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7fdd077fe700 1 -- 172.21.15.69:0/1587398346 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00009b10 con 0x7fdd10070a90 2023-11-17T06:30:03.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7fdd077fe700 1 -- 172.21.15.69:0/1587398346 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00009ea0 con 0x7fdd10070a90 2023-11-17T06:30:03.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f7c60a69700 1 -- start start 2023-11-17T06:30:03.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6be8b43700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6be41652b0 0x7f6be40cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6be8b43700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6be4165740 0x7f6be40cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6be8b43700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be406c200 con 0x7f6be40c21a0 2023-11-17T06:30:03.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6be8b43700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be41662c0 con 0x7f6be41652b0 2023-11-17T06:30:03.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6be8b43700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be4165d00 con 0x7f6be4165740 2023-11-17T06:30:03.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6be37fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6be40c21a0 0x7f6be406c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59072/0 (socket says 172.21.15.69:59072) 2023-11-17T06:30:03.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6be37fe700 1 -- 172.21.15.69:0/2094108264 learned_addr learned my addr 172.21.15.69:0/2094108264 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6bdaffd700 1 --2- 172.21.15.69:0/2094108264 >> v2:172.21.15.69:3300/0 conn(0x7f6be41652b0 0x7f6be40cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1de7fff700 1 Processor -- start 2023-11-17T06:30:03.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6be3fff700 1 --2- 172.21.15.69:0/2094108264 >> v2:172.21.15.93:3300/0 conn(0x7f6be4165740 0x7f6be40cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7fdd15fe6700 1 -- 172.21.15.69:0/1587398346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd10070a90 msgr2=0x7fdd100cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7fdd15fe6700 1 --2- 172.21.15.69:0/1587398346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd10070a90 0x7fdd100cd9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000f9b0 tx=0x7fdd0000fcc0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1de7fff700 1 -- start start 2023-11-17T06:30:03.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6bdaffd700 1 -- 172.21.15.69:0/2094108264 >> v2:172.21.15.93:3300/0 conn(0x7f6be4165740 msgr2=0x7f6be40cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6bdaffd700 1 --2- 172.21.15.69:0/2094108264 >> v2:172.21.15.93:3300/0 conn(0x7f6be4165740 0x7f6be40cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6bdaffd700 1 -- 172.21.15.69:0/2094108264 >> v1:172.21.15.69:6789/0 conn(0x7f6be40c21a0 legacy=0x7f6be406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f84c6e34700 1 Processor -- start 2023-11-17T06:30:03.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6bdaffd700 1 -- 172.21.15.69:0/2094108264 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4165fe0 con 0x7f6be41652b0 2023-11-17T06:30:03.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f25af762700 1 -- 172.21.15.69:0/2405935655 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a8073f00 con 0x7f25a8153ef0 2023-11-17T06:30:03.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f84c6e34700 1 -- start start 2023-11-17T06:30:03.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7fdd15fe6700 1 -- 172.21.15.69:0/1587398346 shutdown_connections 2023-11-17T06:30:03.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7fdd15fe6700 1 --2- 172.21.15.69:0/1587398346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd10070a90 0x7fdd100cd9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7fdd15fe6700 1 -- 172.21.15.69:0/1587398346 >> 172.21.15.69:0/1587398346 conn(0x7fdd100cb850 msgr2=0x7fdd100cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f6bdaffd700 1 --2- 172.21.15.69:0/2094108264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6be41652b0 0x7f6be40cb7e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6be40caab0 tx=0x7f6bd4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6eb7df8a19db21 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7fdd15fe6700 1 -- 172.21.15.69:0/1587398346 shutdown_connections 2023-11-17T06:30:03.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7fdd15fe6700 1 -- 172.21.15.69:0/1587398346 wait complete. 2023-11-17T06:30:03.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f7c60a69700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7c540e3420 0x7f7c5403ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f7c60a69700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54006c40 0x7f7c54053de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f7c60a69700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7c54054320 0x7f7c540e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f7c60a69700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c540547a0 con 0x7f7c54054320 2023-11-17T06:30:03.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f7c60a69700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c540e3800 con 0x7f7c540e3420 2023-11-17T06:30:03.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f7c60a69700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54057150 con 0x7f7c54006c40 2023-11-17T06:30:03.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f259dffb700 1 -- 172.21.15.69:0/2405935655 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f25a0005070 con 0x7f25a8153ef0 2023-11-17T06:30:03.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1dbeffd700 1 -- 172.21.15.69:0/2814695743 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098370340 0 0) 0x7f1db804ff40 con 0x7f1db8047de0 2023-11-17T06:30:03.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1dbeffd700 1 -- 172.21.15.69:0/2814695743 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1db00035d0 con 0x7f1db8047de0 2023-11-17T06:30:03.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1dbf7fe700 1 -- 172.21.15.69:0/2814695743 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db80340d0 msgr2=0x7f1db80eb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1dbf7fe700 1 --2- 172.21.15.69:0/2814695743 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db80340d0 0x7f1db80eb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1dbf7fe700 1 -- 172.21.15.69:0/2814695743 >> v1:172.21.15.93:6789/0 conn(0x7f1db8047de0 legacy=0x7f1db8005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1dbf7fe700 1 -- 172.21.15.69:0/2814695743 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db80ec1e0 con 0x7f1db8048330 2023-11-17T06:30:03.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1dbf7fe700 1 --2- 172.21.15.69:0/2814695743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1db8048330 0x7f1db80eb880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009940 tx=0x7f1dac009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd2caacc8a83cec server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de80b8b20 0x7f1de80cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1de7fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1de80ce430 0x7f1de80d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1de7fff700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de80d1620 con 0x7f1de815d4b0 2023-11-17T06:30:03.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1de7fff700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de80ce8e0 con 0x7f1de80ce430 2023-11-17T06:30:03.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f1de7fff700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80d1320 con 0x7f1de80b8b20 2023-11-17T06:30:03.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.928+0000 7f7c5b7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7c540e3420 0x7f7c5403ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de67fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de80b8b20 0x7f1de80cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de77fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1de80ce430 0x7f1de80d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f259dffb700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f258c066540 0x7f258c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dbeffd700 1 -- 172.21.15.69:0/2814695743 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac011830 con 0x7f1db8048330 2023-11-17T06:30:03.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7fca1f4cb700 1 Processor -- start 2023-11-17T06:30:03.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5b7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7c540e3420 0x7f7c5403ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:35586/0 (socket says 172.21.15.69:35586) 2023-11-17T06:30:03.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5b7fe700 1 -- 172.21.15.69:0/2721675242 learned_addr learned my addr 172.21.15.69:0/2721675242 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de77fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1de80ce430 0x7f1de80d1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47856/0 (socket says 172.21.15.69:47856) 2023-11-17T06:30:03.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de77fe700 1 -- 172.21.15.69:0/2605271010 learned_addr learned my addr 172.21.15.69:0/2605271010 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f259dffb700 1 -- 172.21.15.69:0/2405935655 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25a00851b0 con 0x7f25a8153ef0 2023-11-17T06:30:03.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6e34700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b8006c40 0x7f84b80df400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6e34700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84b80544f0 0x7f84b80dde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6e34700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 0x7f84b80de370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6e34700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b80d0620 con 0x7f84b8006c40 2023-11-17T06:30:03.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6e34700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b804cc70 con 0x7f84b80e3420 2023-11-17T06:30:03.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6e34700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b804cf10 con 0x7f84b80544f0 2023-11-17T06:30:03.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dbeffd700 1 -- 172.21.15.69:0/2814695743 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac011990 con 0x7f1db8048330 2023-11-17T06:30:03.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5affd700 1 --2- 172.21.15.69:0/2721675242 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54006c40 0x7f7c54053de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5bfff700 1 --2- 172.21.15.69:0/2721675242 >> v2:172.21.15.69:3300/0 conn(0x7f7c54054320 0x7f7c540e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6633700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 0x7f84b80de370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6633700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 0x7f84b80de370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:35596/0 (socket says 172.21.15.69:35596) 2023-11-17T06:30:03.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6633700 1 -- 172.21.15.69:0/342148698 learned_addr learned my addr 172.21.15.69:0/342148698 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dbeffd700 1 -- 172.21.15.69:0/2814695743 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac011d00 con 0x7f1db8048330 2023-11-17T06:30:03.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c5e32700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b8006c40 0x7f84b80df400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c5631700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84b80544f0 0x7f84b80dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5b7fe700 1 -- 172.21.15.69:0/2721675242 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54006c40 msgr2=0x7f7c54053de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5b7fe700 1 --2- 172.21.15.69:0/2721675242 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54006c40 0x7f7c54053de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5b7fe700 1 -- 172.21.15.69:0/2721675242 >> v2:172.21.15.69:3300/0 conn(0x7f7c54054320 msgr2=0x7f7c540e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5b7fe700 1 --2- 172.21.15.69:0/2721675242 >> v2:172.21.15.69:3300/0 conn(0x7f7c54054320 0x7f7c540e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5b7fe700 1 -- 172.21.15.69:0/2721675242 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c54057430 con 0x7f7c540e3420 2023-11-17T06:30:03.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f6be2ffd700 1 -- 172.21.15.69:0/2094108264 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4011830 con 0x7f6be41652b0 2023-11-17T06:30:03.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f25ad4fe700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f258c066540 0x7f258c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f6be2ffd700 1 -- 172.21.15.69:0/2094108264 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd4011990 con 0x7f6be41652b0 2023-11-17T06:30:03.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f6be2ffd700 1 -- 172.21.15.69:0/2094108264 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd4011d00 con 0x7f6be41652b0 2023-11-17T06:30:03.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6633700 1 -- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84b80544f0 msgr2=0x7f84b80dde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6633700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84b80544f0 0x7f84b80dde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6633700 1 -- 172.21.15.69:0/342148698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b8006c40 msgr2=0x7f84b80df400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6633700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b8006c40 0x7f84b80df400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6633700 1 -- 172.21.15.69:0/342148698 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b00094b0 con 0x7f84b80e3420 2023-11-17T06:30:03.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c5631700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84b80544f0 0x7f84b80dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:03.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6633700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 0x7f84b80de370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f84bc005930 tx=0x7f84bc00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5b7fe700 1 --2- 172.21.15.69:0/2721675242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540e3420 0x7f7c5403ecd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c069b60 tx=0x7f7c5c074710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdd3cd26c13818c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dc529d700 1 -- 172.21.15.69:0/2814695743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1db8048330 msgr2=0x7f1db80eb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dc529d700 1 --2- 172.21.15.69:0/2814695743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1db8048330 0x7f1db80eb880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009940 tx=0x7f1dac009c50 comp rx=0 tx=0).stop 2023-11-17T06:30:03.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de6ffd700 1 --1- 172.21.15.69:0/2605271010 >> v1:172.21.15.93:6789/0 conn(0x7f1de815d4b0 0x7f1de8161110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:48612/0 (socket says 172.21.15.69:48612) 2023-11-17T06:30:03.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de5ffb700 1 -- 172.21.15.69:0/2605271010 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299093400 0 0) 0x7f1de80d1620 con 0x7f1de815d4b0 2023-11-17T06:30:03.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de5ffb700 1 -- 172.21.15.69:0/2605271010 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1dd00035d0 con 0x7f1de815d4b0 2023-11-17T06:30:03.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de77fe700 1 -- 172.21.15.69:0/2605271010 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de80b8b20 msgr2=0x7f1de80cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:03.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de77fe700 1 --2- 172.21.15.69:0/2605271010 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de80b8b20 0x7f1de80cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de77fe700 1 -- 172.21.15.69:0/2605271010 >> v1:172.21.15.93:6789/0 conn(0x7f1de815d4b0 legacy=0x7f1de8161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de77fe700 1 -- 172.21.15.69:0/2605271010 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de81619f0 con 0x7f1de80ce430 2023-11-17T06:30:03.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1de77fe700 1 --2- 172.21.15.69:0/2605271010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de80ce430 0x7f1de80d1ab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009eb0 tx=0x7f1de000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd31d0b2ae35c298 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dc529d700 1 -- 172.21.15.69:0/2814695743 shutdown_connections 2023-11-17T06:30:03.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dc529d700 1 --2- 172.21.15.69:0/2814695743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1db8048330 0x7f1db80eb880 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dc529d700 1 --2- 172.21.15.69:0/2814695743 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db80340d0 0x7f1db80eb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dc529d700 1 -- 172.21.15.69:0/2814695743 >> 172.21.15.69:0/2814695743 conn(0x7f1db8054c90 msgr2=0x7f1db80550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84b67fc700 1 -- 172.21.15.69:0/342148698 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc005d90 con 0x7f84b80e3420 2023-11-17T06:30:03.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6e34700 1 -- 172.21.15.69:0/342148698 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b804d1f0 con 0x7f84b80e3420 2023-11-17T06:30:03.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f25ad4fe700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f258c066540 0x7f258c068a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f25a80ced90 tx=0x7f2598009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7fca1f4cb700 1 -- start start 2023-11-17T06:30:03.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7fca1f4cb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 0x7fca180d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7fca1f4cb700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca180b6750 con 0x7fca1815d980 2023-11-17T06:30:03.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7fca1f4cb700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca180d2a30 con 0x7fca180b5440 2023-11-17T06:30:03.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7fca1f4cb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca180b6980 con 0x7fca180b8150 2023-11-17T06:30:03.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5a7fc700 1 -- 172.21.15.69:0/2721675242 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c068250 con 0x7f7c540e3420 2023-11-17T06:30:03.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5a7fc700 1 -- 172.21.15.69:0/2721675242 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c08e070 con 0x7f7c540e3420 2023-11-17T06:30:03.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f7c5a7fc700 1 -- 172.21.15.69:0/2721675242 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0685d0 con 0x7f7c540e3420 2023-11-17T06:30:03.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7fca1d267700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fca1815d980 0x7fca180b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59086/0 (socket says 172.21.15.69:59086) 2023-11-17T06:30:03.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7fca1d267700 1 -- 172.21.15.69:0/864654389 learned_addr learned my addr 172.21.15.69:0/864654389 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:03.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f84c6e34700 1 -- 172.21.15.69:0/342148698 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b80df940 con 0x7f84b80e3420 2023-11-17T06:30:03.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dc529d700 1 -- 172.21.15.69:0/2814695743 shutdown_connections 2023-11-17T06:30:03.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f1dc529d700 1 -- 172.21.15.69:0/2814695743 wait complete. 2023-11-17T06:30:03.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7fca1da68700 1 --2- 172.21.15.69:0/864654389 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 0x7fca180d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7fdd15fe6700 1 Processor -- start 2023-11-17T06:30:03.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f84b67fc700 1 -- 172.21.15.69:0/342148698 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc0070d0 con 0x7f84b80e3420 2023-11-17T06:30:03.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f6be8b43700 1 -- 172.21.15.69:0/2094108264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6be41652b0 msgr2=0x7f6be40cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.932+0000 7f6be8b43700 1 --2- 172.21.15.69:0/2094108264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6be41652b0 0x7f6be40cb7e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6be40caab0 tx=0x7f6bd4009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:03.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f84b67fc700 1 -- 172.21.15.69:0/342148698 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc007440 con 0x7f84b80e3420 2023-11-17T06:30:03.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7fca1da68700 1 -- 172.21.15.69:0/864654389 >> v1:172.21.15.93:6789/0 conn(0x7fca180b5440 legacy=0x7fca180d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7fca1da68700 1 -- 172.21.15.69:0/864654389 >> v1:172.21.15.69:6789/0 conn(0x7fca1815d980 legacy=0x7fca180b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7fca1da68700 1 -- 172.21.15.69:0/864654389 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca180d2470 con 0x7fca180b8150 2023-11-17T06:30:03.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7fca1da68700 1 --2- 172.21.15.69:0/864654389 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 0x7fca180d1e70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca10009dc0 tx=0x7fca1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab1a13944d91217a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7fdd15fe6700 1 -- start start 2023-11-17T06:30:03.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f7c60a69700 1 -- 172.21.15.69:0/2721675242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540e3420 msgr2=0x7f7c5403ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f7c60a69700 1 --2- 172.21.15.69:0/2721675242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540e3420 0x7f7c5403ecd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c069b60 tx=0x7f7c5c074710 comp rx=0 tx=0).stop 2023-11-17T06:30:03.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f7c60a69700 1 -- 172.21.15.69:0/2721675242 shutdown_connections 2023-11-17T06:30:03.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f7c60a69700 1 --2- 172.21.15.69:0/2721675242 >> v2:172.21.15.69:3300/0 conn(0x7f7c54054320 0x7f7c540e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f7c60a69700 1 --2- 172.21.15.69:0/2721675242 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54006c40 0x7f7c54053de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f7c60a69700 1 --2- 172.21.15.69:0/2721675242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540e3420 0x7f7c5403ecd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f7c60a69700 1 -- 172.21.15.69:0/2721675242 >> 172.21.15.69:0/2721675242 conn(0x7f7c540590a0 msgr2=0x7f7c540594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1de5ffb700 1 -- 172.21.15.69:0/2605271010 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd8001670 con 0x7f1de80ce430 2023-11-17T06:30:03.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1de5ffb700 1 -- 172.21.15.69:0/2605271010 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de0003a40 con 0x7f1de80ce430 2023-11-17T06:30:03.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1de5ffb700 1 -- 172.21.15.69:0/2605271010 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0003dd0 con 0x7f1de80ce430 2023-11-17T06:30:03.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f7c60a69700 1 -- 172.21.15.69:0/2721675242 shutdown_connections 2023-11-17T06:30:03.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f7c60a69700 1 -- 172.21.15.69:0/2721675242 wait complete. 2023-11-17T06:30:03.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f84c6e34700 1 -- 172.21.15.69:0/342148698 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a8005310 con 0x7f84b80e3420 2023-11-17T06:30:03.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc529d700 1 Processor -- start 2023-11-17T06:30:03.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1de7fff700 1 -- 172.21.15.69:0/2605271010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de80ce430 msgr2=0x7f1de80d1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1de7fff700 1 --2- 172.21.15.69:0/2605271010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de80ce430 0x7f1de80d1ab0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1de0009eb0 tx=0x7f1de000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:03.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f6be8b43700 1 -- 172.21.15.69:0/2094108264 shutdown_connections 2023-11-17T06:30:03.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f6be8b43700 1 --2- 172.21.15.69:0/2094108264 >> v2:172.21.15.93:3300/0 conn(0x7f6be4165740 0x7f6be40cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f6be8b43700 1 --2- 172.21.15.69:0/2094108264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6be41652b0 0x7f6be40cb7e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f6be8b43700 1 -- 172.21.15.69:0/2094108264 >> 172.21.15.69:0/2094108264 conn(0x7f6be40b0900 msgr2=0x7f6be40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc529d700 1 -- start start 2023-11-17T06:30:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1de7fff700 1 -- 172.21.15.69:0/2605271010 shutdown_connections 2023-11-17T06:30:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1de7fff700 1 --2- 172.21.15.69:0/2605271010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de80ce430 0x7f1de80d1ab0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1de7fff700 1 --2- 172.21.15.69:0/2605271010 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de80b8b20 0x7f1de80cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1de7fff700 1 -- 172.21.15.69:0/2605271010 >> 172.21.15.69:0/2605271010 conn(0x7f1de806ac60 msgr2=0x7f1de806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc529d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1db80340d0 0x7f1db80d5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f6be8b43700 1 -- 172.21.15.69:0/2094108264 shutdown_connections 2023-11-17T06:30:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f6be8b43700 1 -- 172.21.15.69:0/2094108264 wait complete. 2023-11-17T06:30:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc529d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db8047de0 0x7f1db8045ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc529d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1db8046420 0x7f1db80e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc529d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80d3280 con 0x7f1db80340d0 2023-11-17T06:30:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc529d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80490b0 con 0x7f1db8046420 2023-11-17T06:30:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc529d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80d34d0 con 0x7f1db8047de0 2023-11-17T06:30:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1de7fff700 1 -- 172.21.15.69:0/2605271010 shutdown_connections 2023-11-17T06:30:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dbffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1db80340d0 0x7f1db80d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dbf7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db8047de0 0x7f1db8045ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc4a9c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1db8046420 0x7f1db80e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc4a9c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1db8046420 0x7f1db80e3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:35612/0 (socket says 172.21.15.69:35612) 2023-11-17T06:30:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f1dc4a9c700 1 -- 172.21.15.69:0/3705828491 learned_addr learned my addr 172.21.15.69:0/3705828491 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7f7c60a69700 1 Processor -- start 2023-11-17T06:30:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.936+0000 7fca0ffff700 1 -- 172.21.15.69:0/864654389 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000e070 con 0x7fca180b8150 2023-11-17T06:30:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fca0ffff700 1 -- 172.21.15.69:0/864654389 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1000bbd0 con 0x7fca180b8150 2023-11-17T06:30:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fca0ffff700 1 -- 172.21.15.69:0/864654389 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10012430 con 0x7fca180b8150 2023-11-17T06:30:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dbf7fe700 1 -- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1db8046420 msgr2=0x7f1db80e3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dbf7fe700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1db8046420 0x7f1db80e3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dbf7fe700 1 -- 172.21.15.69:0/3705828491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1db80340d0 msgr2=0x7f1db80d5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dbf7fe700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1db80340d0 0x7f1db80d5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dbf7fe700 1 -- 172.21.15.69:0/3705828491 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac009570 con 0x7f1db8047de0 2023-11-17T06:30:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f7c60a69700 1 -- start start 2023-11-17T06:30:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dbf7fe700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db8047de0 0x7f1db8045ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1dac016000 tx=0x7f1dac004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd15fe6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd10070a90 0x7fdd100c31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd15fe6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd101599e0 0x7fdd100c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd15fe6700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1015a440 0x7fdd100b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd07fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd101599e0 0x7fdd100c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd07fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd101599e0 0x7fdd100c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:35624/0 (socket says 172.21.15.69:35624) 2023-11-17T06:30:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd10155270 con 0x7fdd10070a90 2023-11-17T06:30:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd07fff700 1 -- 172.21.15.69:0/3458795438 learned_addr learned my addr 172.21.15.69:0/3458795438 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100c5640 con 0x7fdd101599e0 2023-11-17T06:30:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100c40e0 con 0x7fdd1015a440 2023-11-17T06:30:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1de7fff700 1 -- 172.21.15.69:0/2605271010 wait complete. 2023-11-17T06:30:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dbcff9700 1 -- 172.21.15.69:0/3705828491 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac004450 con 0x7f1db8047de0 2023-11-17T06:30:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dbcff9700 1 -- 172.21.15.69:0/3705828491 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dac0036c0 con 0x7f1db8047de0 2023-11-17T06:30:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dc529d700 1 -- 172.21.15.69:0/3705828491 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db80d37b0 con 0x7f1db8047de0 2023-11-17T06:30:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd157e5700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1015a440 0x7fdd100b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dc529d700 1 -- 172.21.15.69:0/3705828491 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db80d3d90 con 0x7f1db8047de0 2023-11-17T06:30:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dbcff9700 1 -- 172.21.15.69:0/3705828491 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dac004610 con 0x7f1db8047de0 2023-11-17T06:30:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f6be8b43700 1 Processor -- start 2023-11-17T06:30:03.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f259dffb700 1 -- 172.21.15.69:0/2405935655 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f25a00527a0 con 0x7f25a8153ef0 2023-11-17T06:30:03.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fca1f4cb700 1 -- 172.21.15.69:0/864654389 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 msgr2=0x7fca180d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fca1f4cb700 1 --2- 172.21.15.69:0/864654389 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 0x7fca180d1e70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca10009dc0 tx=0x7fca1000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:03.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd07fff700 1 -- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1015a440 msgr2=0x7fdd100b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd07fff700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1015a440 0x7fdd100b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd07fff700 1 -- 172.21.15.69:0/3458795438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd10070a90 msgr2=0x7fdd100c31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd07fff700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd10070a90 0x7fdd100c31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd07fff700 1 -- 172.21.15.69:0/3458795438 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0000f610 con 0x7fdd101599e0 2023-11-17T06:30:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f84b67fc700 1 -- 172.21.15.69:0/342148698 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f84bc0075a0 con 0x7f84b80e3420 2023-11-17T06:30:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f84b67fc700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f84a4066510 0x7f84a40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f84b67fc700 1 -- 172.21.15.69:0/342148698 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84bc083730 con 0x7f84b80e3420 2023-11-17T06:30:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fdd07fff700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd101599e0 0x7fdd100c5100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd100cc950 tx=0x7fdd00004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f7c60a69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c54006c40 0x7f7c540df850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f7c60a69700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54054320 0x7f7c540578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f7c60a69700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540e3420 0x7f7c54179970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f7c60a69700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540589b0 con 0x7f7c54006c40 2023-11-17T06:30:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f7c60a69700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c54058110 con 0x7f7c540e3420 2023-11-17T06:30:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f7c60a69700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540583f0 con 0x7f7c54054320 2023-11-17T06:30:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f84c5e32700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f84a4066510 0x7f84a40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7f1dc529d700 1 -- 172.21.15.69:0/3705828491 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da0005310 con 0x7f1db8047de0 2023-11-17T06:30:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fca1f4cb700 1 -- 172.21.15.69:0/864654389 shutdown_connections 2023-11-17T06:30:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fca1f4cb700 1 --2- 172.21.15.69:0/864654389 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 0x7fca180d1e70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.940+0000 7fca1f4cb700 1 -- 172.21.15.69:0/864654389 >> 172.21.15.69:0/864654389 conn(0x7fca180cfd30 msgr2=0x7fca180d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5affd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54054320 0x7f7c540578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c54006c40 0x7f7c540df850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c54006c40 0x7f7c540df850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47874/0 (socket says 172.21.15.69:47874) 2023-11-17T06:30:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5b7fe700 1 -- 172.21.15.69:0/256052514 learned_addr learned my addr 172.21.15.69:0/256052514 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5bfff700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540e3420 0x7f7c54179970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5affd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54054320 0x7f7c540578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:49270/0 (socket says 172.21.15.69:49270) 2023-11-17T06:30:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f84c5e32700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f84a4066510 0x7f84a40689d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84b00090b0 tx=0x7f84b001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5b7fe700 1 -- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54054320 msgr2=0x7f7c540578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5b7fe700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54054320 0x7f7c540578c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5b7fe700 1 -- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540e3420 msgr2=0x7f7c54179970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5b7fe700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540e3420 0x7f7c54179970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5b7fe700 1 -- 172.21.15.69:0/256052514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c066ea0 con 0x7f7c54006c40 2023-11-17T06:30:03.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f1de7fff700 1 Processor -- start 2023-11-17T06:30:03.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c5b7fe700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c54006c40 0x7f7c540df850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c04e920 tx=0x7f7c5c06a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f1de7fff700 1 -- start start 2023-11-17T06:30:03.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f6be8b43700 1 -- start start 2023-11-17T06:30:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f6be8b43700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6be40c21a0 0x7f6be415d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f6be8b43700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6be41652b0 0x7f6be40b21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f6be8b43700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6be4165740 0x7f6be4160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f6be8b43700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be415da00 con 0x7f6be40c21a0 2023-11-17T06:30:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f6be8b43700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40b39e0 con 0x7f6be41652b0 2023-11-17T06:30:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f6be8b43700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40b3cc0 con 0x7f6be4165740 2023-11-17T06:30:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f1dbcff9700 1 -- 172.21.15.69:0/3705828491 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1dac003a70 con 0x7f1db8047de0 2023-11-17T06:30:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f1dbcff9700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1da4066590 0x7f1da4068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f1dbcff9700 1 -- 172.21.15.69:0/3705828491 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dac085170 con 0x7f1db8047de0 2023-11-17T06:30:03.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7fdd057fa700 1 -- 172.21.15.69:0/3458795438 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000038c0 con 0x7fdd101599e0 2023-11-17T06:30:03.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f84b67fc700 1 -- 172.21.15.69:0/342148698 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f84bc050bc0 con 0x7f84b80e3420 2023-11-17T06:30:03.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f1dbffff700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1da4066590 0x7f1da4068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7fdd057fa700 1 -- 172.21.15.69:0/3458795438 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00003a20 con 0x7fdd101599e0 2023-11-17T06:30:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7fdd057fa700 1 -- 172.21.15.69:0/3458795438 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00003d90 con 0x7fdd101599e0 2023-11-17T06:30:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c47fff700 1 -- 172.21.15.69:0/256052514 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c067660 con 0x7f7c54006c40 2023-11-17T06:30:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c47fff700 1 -- 172.21.15.69:0/256052514 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c073ff0 con 0x7f7c54006c40 2023-11-17T06:30:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f7c47fff700 1 -- 172.21.15.69:0/256052514 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c072370 con 0x7f7c54006c40 2023-11-17T06:30:03.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7f1dbffff700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1da4066590 0x7f1da4068a50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009790 tx=0x7f1db4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:03.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd100c3840 con 0x7fdd101599e0 2023-11-17T06:30:03.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7fca1f4cb700 1 -- 172.21.15.69:0/864654389 shutdown_connections 2023-11-17T06:30:03.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.944+0000 7fca1f4cb700 1 -- 172.21.15.69:0/864654389 wait complete. 2023-11-17T06:30:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd100c3e00 con 0x7fdd101599e0 2023-11-17T06:30:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6be40c21a0 0x7f6be415d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6be40c21a0 0x7f6be415d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47878/0 (socket says 172.21.15.69:47878) 2023-11-17T06:30:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be37fe700 1 -- 172.21.15.69:0/519185200 learned_addr learned my addr 172.21.15.69:0/519185200 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f7c60a69700 1 -- 172.21.15.69:0/256052514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c540586d0 con 0x7f7c54006c40 2023-11-17T06:30:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f7c60a69700 1 -- 172.21.15.69:0/256052514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c54057e00 con 0x7f7c54006c40 2023-11-17T06:30:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6bdaffd700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6be41652b0 0x7f6be40b21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be3fff700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6be4165740 0x7f6be4160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd10073f00 con 0x7fdd101599e0 2023-11-17T06:30:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1de80b8b20 0x7f1de815f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de80ce430 0x7f1de8156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de7fff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de815d4b0 0x7f1de81500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de7fff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de815ec80 con 0x7f1de80ce430 2023-11-17T06:30:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de7fff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de815f960 con 0x7f1de80b8b20 2023-11-17T06:30:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de7fff700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de80c6e10 con 0x7f1de815d4b0 2023-11-17T06:30:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de67fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de80ce430 0x7f1de8156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de67fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de80ce430 0x7f1de8156140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47882/0 (socket says 172.21.15.69:47882) 2023-11-17T06:30:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de67fc700 1 -- 172.21.15.69:0/2969535463 learned_addr learned my addr 172.21.15.69:0/2969535463 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de77fe700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de815d4b0 0x7f1de81500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de77fe700 1 -- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1de80b8b20 msgr2=0x7f1de815f420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-17T06:30:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de77fe700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1de80b8b20 0x7f1de815f420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de77fe700 1 -- 172.21.15.69:0/2969535463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de80ce430 msgr2=0x7f1de8156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de77fe700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de80ce430 0x7f1de8156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de77fe700 1 -- 172.21.15.69:0/2969535463 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de0009b30 con 0x7f1de815d4b0 2023-11-17T06:30:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be3fff700 1 -- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6be41652b0 msgr2=0x7f6be40b21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be3fff700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6be41652b0 0x7f6be40b21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be3fff700 1 -- 172.21.15.69:0/519185200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6be40c21a0 msgr2=0x7f6be415d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be3fff700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6be40c21a0 0x7f6be415d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be3fff700 1 -- 172.21.15.69:0/519185200 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd40094b0 con 0x7f6be4165740 2023-11-17T06:30:04.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de77fe700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de815d4b0 0x7f1de81500c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1de001a000 tx=0x7f1de0004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:04.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f7c60a69700 1 -- 172.21.15.69:0/256052514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c540058b0 con 0x7f7c54006c40 2023-11-17T06:30:04.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be3fff700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6be4165740 0x7f6be4160dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00ebd0 tx=0x7f6bdc00eee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:04.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1dcf7fe700 1 -- 172.21.15.69:0/2969535463 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0012070 con 0x7f1de815d4b0 2023-11-17T06:30:04.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7fdd057fa700 1 -- 172.21.15.69:0/3458795438 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdd00020450 con 0x7fdd101599e0 2023-11-17T06:30:04.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de7fff700 1 -- 172.21.15.69:0/2969535463 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de815fbe0 con 0x7f1de815d4b0 2023-11-17T06:30:04.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f1de7fff700 1 -- 172.21.15.69:0/2969535463 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de815e630 con 0x7f1de815d4b0 2023-11-17T06:30:04.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be0ff9700 1 -- 172.21.15.69:0/519185200 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00ca60 con 0x7f6be4165740 2023-11-17T06:30:04.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be0ff9700 1 -- 172.21.15.69:0/519185200 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc00f040 con 0x7f6be4165740 2023-11-17T06:30:04.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.948+0000 7f6be0ff9700 1 -- 172.21.15.69:0/519185200 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc00ce00 con 0x7f6be4165740 2023-11-17T06:30:04.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1f4cb700 1 Processor -- start 2023-11-17T06:30:04.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1f4cb700 1 -- start start 2023-11-17T06:30:04.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7f1dbcff9700 1 -- 172.21.15.69:0/3705828491 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1dac052760 con 0x7f1db8047de0 2023-11-17T06:30:04.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7f1dcf7fe700 1 -- 172.21.15.69:0/2969535463 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de0032030 con 0x7f1de815d4b0 2023-11-17T06:30:04.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7f1dcf7fe700 1 -- 172.21.15.69:0/2969535463 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de0012070 con 0x7f1de815d4b0 2023-11-17T06:30:04.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fdd057fa700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066560 0x7fdcfc068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:04.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fdd057fa700 1 -- 172.21.15.69:0/3458795438 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd00084850 con 0x7fdd101599e0 2023-11-17T06:30:04.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1f4cb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180b5440 0x7fca180caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:04.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1f4cb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 0x7fca181519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:04.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1f4cb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca1815c1f0 0x7fca1815f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:04.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1f4cb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180cb440 con 0x7fca180b5440 2023-11-17T06:30:04.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1f4cb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca18152230 con 0x7fca1815c1f0 2023-11-17T06:30:04.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fdd14fe4700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066560 0x7fdcfc068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:04.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1f4cb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca18152510 con 0x7fca180b8150 2023-11-17T06:30:04.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7f1de7fff700 1 -- 172.21.15.69:0/2969535463 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc8005310 con 0x7f1de815d4b0 2023-11-17T06:30:04.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7f6be8b43700 1 -- 172.21.15.69:0/519185200 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be40b3fa0 con 0x7f6be4165740 2023-11-17T06:30:04.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7f6be8b43700 1 -- 172.21.15.69:0/519185200 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be40b4280 con 0x7f6be4165740 2023-11-17T06:30:04.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1da68700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca1815c1f0 0x7fca1815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:04.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1da68700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca1815c1f0 0x7fca1815f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:35650/0 (socket says 172.21.15.69:35650) 2023-11-17T06:30:04.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1da68700 1 -- 172.21.15.69:0/2315637308 learned_addr learned my addr 172.21.15.69:0/2315637308 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:04.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7f6be8b43700 1 -- 172.21.15.69:0/519185200 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be40c7750 con 0x7f6be4165740 2023-11-17T06:30:04.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1ca66700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 0x7fca181519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:04.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1d267700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180b5440 0x7fca180caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:04.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1da68700 1 -- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 msgr2=0x7fca181519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1da68700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 0x7fca181519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1da68700 1 -- 172.21.15.69:0/2315637308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180b5440 msgr2=0x7fca180caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1da68700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180b5440 0x7fca180caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1da68700 1 -- 172.21.15.69:0/2315637308 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca10009a70 con 0x7fca1815c1f0 2023-11-17T06:30:04.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.952+0000 7fca1d267700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180b5440 0x7fca180caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:04.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7f1dcf7fe700 1 -- 172.21.15.69:0/2969535463 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1de000d2e0 con 0x7f1de815d4b0 2023-11-17T06:30:04.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7f1dcf7fe700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1dd4066570 0x7f1dd4068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:04.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7fdd057fa700 1 -- 172.21.15.69:0/3458795438 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdd00051e60 con 0x7fdd101599e0 2023-11-17T06:30:04.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7f1dcf7fe700 1 -- 172.21.15.69:0/2969535463 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1de0095380 con 0x7f1de815d4b0 2023-11-17T06:30:04.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7f1de6ffd700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1dd4066570 0x7f1dd4068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:04.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7fca1da68700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca1815c1f0 0x7fca1815f790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca1000b370 tx=0x7fca10004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:04.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7fca0dffb700 1 -- 172.21.15.69:0/2315637308 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10004960 con 0x7fca1815c1f0 2023-11-17T06:30:04.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7f6be0ff9700 1 -- 172.21.15.69:0/519185200 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6bdc014480 con 0x7f6be4165740 2023-11-17T06:30:04.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7fca0dffb700 1 -- 172.21.15.69:0/2315637308 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10020070 con 0x7fca1815c1f0 2023-11-17T06:30:04.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7fca0dffb700 1 -- 172.21.15.69:0/2315637308 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca100276c0 con 0x7fca1815c1f0 2023-11-17T06:30:04.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7fca1f4cb700 1 -- 172.21.15.69:0/2315637308 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca181527f0 con 0x7fca1815c1f0 2023-11-17T06:30:04.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7fdd14fe4700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066560 0x7fdcfc068a20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd10155060 tx=0x7fdd0c0079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:04.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7f6be0ff9700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6bc40665e0 0x7f6bc4068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:04.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7f1de6ffd700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1dd4066570 0x7f1dd4068a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80011e0 tx=0x7f1dd8001430 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:04.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.956+0000 7f6be0ff9700 1 -- 172.21.15.69:0/519185200 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bdc084e40 con 0x7f6be4165740 2023-11-17T06:30:04.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.960+0000 7f6be37fe700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6bc40665e0 0x7f6bc4068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:04.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.960+0000 7fca1f4cb700 1 -- 172.21.15.69:0/2315637308 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1815f270 con 0x7fca1815c1f0 2023-11-17T06:30:04.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.960+0000 7f7c47fff700 1 -- 172.21.15.69:0/256052514 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7c5c0724d0 con 0x7f7c54006c40 2023-11-17T06:30:04.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.960+0000 7f7c47fff700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c400665e0 0x7f7c40068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:04.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.960+0000 7f7c47fff700 1 -- 172.21.15.69:0/256052514 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c5c0ff3a0 con 0x7f7c54006c40 2023-11-17T06:30:04.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.960+0000 7f7c5affd700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c400665e0 0x7f7c40068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:04.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.960+0000 7f7c5affd700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c400665e0 0x7f7c40068aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c5417bd00 tx=0x7f7c48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:04.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.960+0000 7f6be37fe700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6bc40665e0 0x7f6bc4068aa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc004ef0 tx=0x7f6bcc001120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:04.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.960+0000 7f6be0ff9700 1 -- 172.21.15.69:0/519185200 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6bdc052330 con 0x7f6be4165740 2023-11-17T06:30:04.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.964+0000 7f7c47fff700 1 -- 172.21.15.69:0/256052514 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c5c0cc9b0 con 0x7f7c54006c40 2023-11-17T06:30:04.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.964+0000 7fc9fb7fe700 1 -- 172.21.15.69:0/2315637308 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca181682e0 con 0x7fca1815c1f0 2023-11-17T06:30:04.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.964+0000 7fca0dffb700 1 -- 172.21.15.69:0/2315637308 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca10027820 con 0x7fca1815c1f0 2023-11-17T06:30:04.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.964+0000 7fca0dffb700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066560 0x7fc9fc068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:04.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.968+0000 7fca0dffb700 1 -- 172.21.15.69:0/2315637308 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca10022070 con 0x7fca1815c1f0 2023-11-17T06:30:04.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.968+0000 7f1dcf7fe700 1 -- 172.21.15.69:0/2969535463 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1de00627f0 con 0x7f1de815d4b0 2023-11-17T06:30:04.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.968+0000 7fca1d267700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066560 0x7fc9fc068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:04.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.968+0000 7fca1d267700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066560 0x7fc9fc068a20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca14007fd0 tx=0x7fca14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:04.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:03.972+0000 7fca0dffb700 1 -- 172.21.15.69:0/2315637308 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca10053a60 con 0x7fca1815c1f0 2023-11-17T06:30:04.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 -- 172.21.15.69:0/342148698 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84a8005890 con 0x7f84b80e3420 2023-11-17T06:30:04.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84b67fc700 1 -- 172.21.15.69:0/342148698 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84bc021020 con 0x7f84b80e3420 2023-11-17T06:30:04.284 INFO:teuthology.orchestra.run.smithi069.stdout:64424509446 2023-11-17T06:30:04.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f25af762700 1 -- 172.21.15.69:0/2405935655 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f25a80b1680 con 0x7f25a8153ef0 2023-11-17T06:30:04.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f1dc529d700 1 -- 172.21.15.69:0/3705828491 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1da0005890 con 0x7f1db8047de0 2023-11-17T06:30:04.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 -- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f84a4066510 msgr2=0x7f84a40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f84a4066510 0x7f84a40689d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f84b00090b0 tx=0x7f84b001c040 comp rx=0 tx=0).stop 2023-11-17T06:30:04.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 -- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 msgr2=0x7f84b80de370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 0x7f84b80de370 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f84bc005930 tx=0x7f84bc00c860 comp rx=0 tx=0).stop 2023-11-17T06:30:04.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 -- 172.21.15.69:0/342148698 shutdown_connections 2023-11-17T06:30:04.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f84a4066510 0x7f84a40689d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84b80e3420 0x7f84b80de370 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f84b80544f0 0x7f84b80dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 --2- 172.21.15.69:0/342148698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84b8006c40 0x7f84b80df400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.280+0000 7f84c6e34700 1 -- 172.21.15.69:0/342148698 >> 172.21.15.69:0/342148698 conn(0x7f84b80590a0 msgr2=0x7f84b80e3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:04.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.284+0000 7f84c6e34700 1 -- 172.21.15.69:0/342148698 shutdown_connections 2023-11-17T06:30:04.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.284+0000 7f84c6e34700 1 -- 172.21.15.69:0/342148698 wait complete. 2023-11-17T06:30:04.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.284+0000 7f259dffb700 1 -- 172.21.15.69:0/2405935655 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f25a0055dc0 con 0x7f25a8153ef0 2023-11-17T06:30:04.289 INFO:teuthology.orchestra.run.smithi069.stdout:64424509446 2023-11-17T06:30:04.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.284+0000 7f1dbcff9700 1 -- 172.21.15.69:0/3705828491 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dac055d80 con 0x7f1db8047de0 2023-11-17T06:30:04.290 INFO:teuthology.orchestra.run.smithi069.stdout:64424509445 2023-11-17T06:30:04.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 -- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f258c066540 msgr2=0x7f258c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f258c066540 0x7f258c068a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f25a80ced90 tx=0x7f2598009040 comp rx=0 tx=0).stop 2023-11-17T06:30:04.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 -- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25a8153ef0 msgr2=0x7f25a8154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25a8153ef0 0x7f25a8154330 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25a000ae90 tx=0x7f25a0001cb0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f6be8b43700 1 -- 172.21.15.69:0/519185200 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6be40c7750 con 0x7f6be4165740 2023-11-17T06:30:04.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 -- 172.21.15.69:0/2405935655 shutdown_connections 2023-11-17T06:30:04.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f258c066540 0x7f258c068a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25a8153ef0 0x7f25a8154330 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25a81578f0 0x7f25a80b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 --2- 172.21.15.69:0/2405935655 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25940042f0 0x7f25a81559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 -- 172.21.15.69:0/2405935655 >> 172.21.15.69:0/2405935655 conn(0x7f25a80cb840 msgr2=0x7f25a8070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:04.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd100b4d50 con 0x7fdd101599e0 2023-11-17T06:30:04.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 -- 172.21.15.69:0/2405935655 shutdown_connections 2023-11-17T06:30:04.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f6be0ff9700 1 -- 172.21.15.69:0/519185200 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bdc018020 con 0x7f6be4165740 2023-11-17T06:30:04.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f25af762700 1 -- 172.21.15.69:0/2405935655 wait complete. 2023-11-17T06:30:04.295 INFO:teuthology.orchestra.run.smithi069.stdout:64424509445 2023-11-17T06:30:04.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f1dc529d700 1 -- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1da4066590 msgr2=0x7f1da4068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f1dc529d700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1da4066590 0x7f1da4068a50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1db4009790 tx=0x7f1db4008040 comp rx=0 tx=0).stop 2023-11-17T06:30:04.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.288+0000 7f1de7fff700 1 -- 172.21.15.69:0/2969535463 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1dc80055c0 con 0x7f1de815d4b0 2023-11-17T06:30:04.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7fdd057fa700 1 -- 172.21.15.69:0/3458795438 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd00055480 con 0x7fdd101599e0 2023-11-17T06:30:04.296 INFO:teuthology.orchestra.run.smithi069.stdout:64424509444 2023-11-17T06:30:04.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dc529d700 1 -- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db8047de0 msgr2=0x7f1db8045ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dc529d700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db8047de0 0x7f1db8045ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1dac016000 tx=0x7f1dac004770 comp rx=0 tx=0).stop 2023-11-17T06:30:04.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dcf7fe700 1 -- 172.21.15.69:0/2969535463 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1de0065e10 con 0x7f1de815d4b0 2023-11-17T06:30:04.297 INFO:teuthology.orchestra.run.smithi069.stdout:60129542149 2023-11-17T06:30:04.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dc529d700 1 -- 172.21.15.69:0/3705828491 shutdown_connections 2023-11-17T06:30:04.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dc529d700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1da4066590 0x7f1da4068a50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dc529d700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1db8046420 0x7f1db80e3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dc529d700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1db8047de0 0x7f1db8045ee0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dc529d700 1 --2- 172.21.15.69:0/3705828491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1db80340d0 0x7f1db80d5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dc529d700 1 -- 172.21.15.69:0/3705828491 >> 172.21.15.69:0/3705828491 conn(0x7f1db8054c90 msgr2=0x7f1db80d96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:04.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dc529d700 1 -- 172.21.15.69:0/3705828491 shutdown_connections 2023-11-17T06:30:04.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f1dc529d700 1 -- 172.21.15.69:0/3705828491 wait complete. 2023-11-17T06:30:04.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7fc9fb7fe700 1 -- 172.21.15.69:0/2315637308 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fca18073f00 con 0x7fca1815c1f0 2023-11-17T06:30:04.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f6be8b43700 1 -- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6bc40665e0 msgr2=0x7f6bc4068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f6be8b43700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6bc40665e0 0x7f6bc4068aa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc004ef0 tx=0x7f6bcc001120 comp rx=0 tx=0).stop 2023-11-17T06:30:04.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f6be8b43700 1 -- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6be4165740 msgr2=0x7f6be4160dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f6be8b43700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6be4165740 0x7f6be4160dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00ebd0 tx=0x7f6bdc00eee0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7fca0dffb700 1 -- 172.21.15.69:0/2315637308 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca10053a60 con 0x7fca1815c1f0 2023-11-17T06:30:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f7c60a69700 1 -- 172.21.15.69:0/256052514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7c54058530 con 0x7f7c54006c40 2023-11-17T06:30:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f6be8b43700 1 -- 172.21.15.69:0/519185200 shutdown_connections 2023-11-17T06:30:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f6be8b43700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6bc40665e0 0x7f6bc4068aa0 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc004ef0 tx=0x7f6bcc001120 comp rx=0 tx=0).stop 2023-11-17T06:30:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f6be8b43700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6be4165740 0x7f6be4160dc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f6be8b43700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6be41652b0 0x7f6be40b21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f6be8b43700 1 --2- 172.21.15.69:0/519185200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6be40c21a0 0x7f6be415d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.292+0000 7f6be8b43700 1 -- 172.21.15.69:0/519185200 >> 172.21.15.69:0/519185200 conn(0x7f6be40b0900 msgr2=0x7f6be40714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:04.301 INFO:teuthology.orchestra.run.smithi069.stdout:64424509446 2023-11-17T06:30:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f6be8b43700 1 -- 172.21.15.69:0/519185200 shutdown_connections 2023-11-17T06:30:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f6be8b43700 1 -- 172.21.15.69:0/519185200 wait complete. 2023-11-17T06:30:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f7c47fff700 1 -- 172.21.15.69:0/256052514 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c54058530 con 0x7f7c54006c40 2023-11-17T06:30:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 -- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1dd4066570 msgr2=0x7f1dd4068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1dd4066570 0x7f1dd4068a30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80011e0 tx=0x7f1dd8001430 comp rx=0 tx=0).stop 2023-11-17T06:30:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 -- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de815d4b0 msgr2=0x7f1de81500c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de815d4b0 0x7f1de81500c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1de001a000 tx=0x7f1de0004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 -- 172.21.15.69:0/2969535463 shutdown_connections 2023-11-17T06:30:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1dd4066570 0x7f1dd4068a30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1de815d4b0 0x7f1de81500c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1de80ce430 0x7f1de8156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 --2- 172.21.15.69:0/2969535463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1de80b8b20 0x7f1de815f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 -- 172.21.15.69:0/2969535463 >> 172.21.15.69:0/2969535463 conn(0x7f1de806ac60 msgr2=0x7f1de80b1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 -- 172.21.15.69:0/2969535463 shutdown_connections 2023-11-17T06:30:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7f1de7fff700 1 -- 172.21.15.69:0/2969535463 wait complete. 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066560 msgr2=0x7fdcfc068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066560 0x7fdcfc068a20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdd10155060 tx=0x7fdd0c0079e0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd101599e0 msgr2=0x7fdd100c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd101599e0 0x7fdd100c5100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdd100cc950 tx=0x7fdd00004770 comp rx=0 tx=0).stop 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 shutdown_connections 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066560 0x7fdcfc068a20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1015a440 0x7fdd100b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd101599e0 0x7fdd100c5100 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 --2- 172.21.15.69:0/3458795438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd10070a90 0x7fdd100c31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 >> 172.21.15.69:0/3458795438 conn(0x7fdd100cb850 msgr2=0x7fdd100cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:04.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 shutdown_connections 2023-11-17T06:30:04.305 INFO:teuthology.orchestra.run.smithi069.stdout:64424509444 2023-11-17T06:30:04.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fc9fb7fe700 1 -- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066560 msgr2=0x7fc9fc068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fc9fb7fe700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066560 0x7fc9fc068a20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca14007fd0 tx=0x7fca14009040 comp rx=0 tx=0).stop 2023-11-17T06:30:04.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fc9fb7fe700 1 -- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca1815c1f0 msgr2=0x7fca1815f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fc9fb7fe700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca1815c1f0 0x7fca1815f790 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca1000b370 tx=0x7fca10004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fdd15fe6700 1 -- 172.21.15.69:0/3458795438 wait complete. 2023-11-17T06:30:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fc9fb7fe700 1 -- 172.21.15.69:0/2315637308 shutdown_connections 2023-11-17T06:30:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fc9fb7fe700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066560 0x7fc9fc068a20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fc9fb7fe700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca1815c1f0 0x7fca1815f790 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fc9fb7fe700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b8150 0x7fca181519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fc9fb7fe700 1 --2- 172.21.15.69:0/2315637308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180b5440 0x7fca180caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.296+0000 7fc9fb7fe700 1 -- 172.21.15.69:0/2315637308 >> 172.21.15.69:0/2315637308 conn(0x7fca180cfd30 msgr2=0x7fca18157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.300+0000 7fc9fb7fe700 1 -- 172.21.15.69:0/2315637308 shutdown_connections 2023-11-17T06:30:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.300+0000 7fc9fb7fe700 1 -- 172.21.15.69:0/2315637308 wait complete. 2023-11-17T06:30:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.304+0000 7f7c60a69700 1 -- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c400665e0 msgr2=0x7f7c40068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.304+0000 7f7c60a69700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c400665e0 0x7f7c40068aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7c5417bd00 tx=0x7f7c48008040 comp rx=0 tx=0).stop 2023-11-17T06:30:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.304+0000 7f7c60a69700 1 -- 172.21.15.69:0/256052514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c54006c40 msgr2=0x7f7c540df850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.304+0000 7f7c60a69700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c54006c40 0x7f7c540df850 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c04e920 tx=0x7f7c5c06a080 comp rx=0 tx=0).stop 2023-11-17T06:30:04.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.308+0000 7f7c60a69700 1 -- 172.21.15.69:0/256052514 shutdown_connections 2023-11-17T06:30:04.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.308+0000 7f7c60a69700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c400665e0 0x7f7c40068aa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.308+0000 7f7c60a69700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c540e3420 0x7f7c54179970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.308+0000 7f7c60a69700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c54054320 0x7f7c540578c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.308+0000 7f7c60a69700 1 --2- 172.21.15.69:0/256052514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c54006c40 0x7f7c540df850 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:04.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.308+0000 7f7c60a69700 1 -- 172.21.15.69:0/256052514 >> 172.21.15.69:0/256052514 conn(0x7f7c540590a0 msgr2=0x7f7c540e3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:04.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.308+0000 7f7c60a69700 1 -- 172.21.15.69:0/256052514 shutdown_connections 2023-11-17T06:30:04.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:04.308+0000 7f7c60a69700 1 -- 172.21.15.69:0/256052514 wait complete. 2023-11-17T06:30:04.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.0 2023-11-17T06:30:04.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2023-11-17T06:30:04.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2023-11-17T06:30:04.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2023-11-17T06:30:04.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.1 2023-11-17T06:30:04.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.2 2023-11-17T06:30:04.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2023-11-17T06:30:04.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.7 2023-11-17T06:30:05.315 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-17T06:30:05.324 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-17T06:30:05.326 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-17T06:30:05.330 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-17T06:30:05.331 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-17T06:30:05.336 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-17T06:30:05.342 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-17T06:30:05.343 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-17T06:30:05.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.544+0000 7f039e639700 1 Processor -- start 2023-11-17T06:30:05.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.544+0000 7f039e639700 1 -- start start 2023-11-17T06:30:05.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.548+0000 7f039e639700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0398160a60 0x7f03980ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.548+0000 7f039e639700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03980b6420 con 0x7f03980b52f0 2023-11-17T06:30:05.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.548+0000 7f039e639700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0398160e40 con 0x7f03980d0700 2023-11-17T06:30:05.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.548+0000 7f039e639700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03980ca030 con 0x7f0398160a60 2023-11-17T06:30:05.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.548+0000 7f039d3d7700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f03980b52f0 0x7f03980b68b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59100/0 (socket says 172.21.15.69:59100) 2023-11-17T06:30:05.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.548+0000 7f039d3d7700 1 -- 172.21.15.69:0/2374782754 learned_addr learned my addr 172.21.15.69:0/2374782754 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:05.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.548+0000 7f0397fff700 1 --2- 172.21.15.69:0/2374782754 >> v2:172.21.15.69:3300/0 conn(0x7f0398160a60 0x7f03980ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142527865 0 0) 0x7f03980b6420 con 0x7f03980b52f0 2023-11-17T06:30:05.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03880035d0 con 0x7f03980b52f0 2023-11-17T06:30:05.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484096239 0 0) 0x7f0398160e40 con 0x7f03980d0700 2023-11-17T06:30:05.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03980b6420 con 0x7f03980d0700 2023-11-17T06:30:05.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3953555698 0 0) 0x7f03880035d0 con 0x7f03980b52f0 2023-11-17T06:30:05.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 >> v2:172.21.15.69:3300/0 conn(0x7f0398160a60 msgr2=0x7f03980ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 --2- 172.21.15.69:0/2374782754 >> v2:172.21.15.69:3300/0 conn(0x7f0398160a60 0x7f03980ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 >> v1:172.21.15.93:6789/0 conn(0x7f03980d0700 legacy=0x7f03980b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03980d28d0 con 0x7f03980b52f0 2023-11-17T06:30:05.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f0390001770 con 0x7f03980b52f0 2023-11-17T06:30:05.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 >> v1:172.21.15.69:6789/0 conn(0x7f03980b52f0 legacy=0x7f03980b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388003be0 0x7f0388003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0388004870 0x7f0388004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0388005230 0x7f0388014240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0384001230 con 0x7f0388004870 2023-11-17T06:30:05.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980ca030 con 0x7f0388003be0 2023-11-17T06:30:05.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0388014940 con 0x7f0388005230 2023-11-17T06:30:05.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f0397fff700 1 --2- 172.21.15.69:0/2374782754 >> v2:172.21.15.69:3300/0 conn(0x7f0398160a60 0x7f03980ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:05.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f03977fe700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0388004870 0x7f0388004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.552+0000 7f039d3d7700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0388005230 0x7f0388014240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f0397fff700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388003be0 0x7f0388003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f03977fe700 1 -- 172.21.15.69:0/2374782754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0388005230 msgr2=0x7f0388014240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f03977fe700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0388005230 0x7f0388014240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f03977fe700 1 -- 172.21.15.69:0/2374782754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388003be0 msgr2=0x7f0388003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f03977fe700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388003be0 0x7f0388003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f03977fe700 1 -- 172.21.15.69:0/2374782754 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03880035d0 con 0x7f0388004870 2023-11-17T06:30:05.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f039d3d7700 1 -- 172.21.15.69:0/2374782754 reap_dead start 2023-11-17T06:30:05.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f03977fe700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0388004870 0x7f0388004cf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0384007fb0 tx=0x7f03880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e918d2b1178d5c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0384007a20 con 0x7f0388004870 2023-11-17T06:30:05.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03840052d0 con 0x7f0388004870 2023-11-17T06:30:05.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f0396ffd700 1 -- 172.21.15.69:0/2374782754 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038400ca10 con 0x7f0388004870 2023-11-17T06:30:05.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f039e639700 1 -- 172.21.15.69:0/2374782754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0388004870 msgr2=0x7f0388004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.556+0000 7f039e639700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0388004870 0x7f0388004cf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0384007fb0 tx=0x7f03880058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.560+0000 7f039e639700 1 -- 172.21.15.69:0/2374782754 shutdown_connections 2023-11-17T06:30:05.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.560+0000 7f039e639700 1 --2- 172.21.15.69:0/2374782754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0388004870 0x7f0388004cf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.560+0000 7f039e639700 1 -- 172.21.15.69:0/2374782754 >> 172.21.15.69:0/2374782754 conn(0x7f03980cfbe0 msgr2=0x7f03980cfff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.560+0000 7f039e639700 1 -- 172.21.15.69:0/2374782754 shutdown_connections 2023-11-17T06:30:05.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.560+0000 7f039e639700 1 -- 172.21.15.69:0/2374782754 wait complete. 2023-11-17T06:30:05.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.564+0000 7f039e639700 1 Processor -- start 2023-11-17T06:30:05.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.564+0000 7f039e639700 1 -- start start 2023-11-17T06:30:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f039e639700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388004870 0x7f0398152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f039e639700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03981533e0 0x7f03980c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f039e639700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03980b2c80 0x7f03980b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f039e639700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980b3640 con 0x7f03980b2c80 2023-11-17T06:30:05.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f039e639700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03981531a0 con 0x7f0388004870 2023-11-17T06:30:05.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f039e639700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03980c95d0 con 0x7f03981533e0 2023-11-17T06:30:05.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f0397fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388004870 0x7f0398152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f0397fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388004870 0x7f0398152c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:35674/0 (socket says 172.21.15.69:35674) 2023-11-17T06:30:05.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f0397fff700 1 -- 172.21.15.69:0/3533251634 learned_addr learned my addr 172.21.15.69:0/3533251634 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f0397fff700 1 -- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03981533e0 msgr2=0x7f03980c6c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-17T06:30:05.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f039d3d7700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03980b2c80 0x7f03980b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f0397fff700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03981533e0 0x7f03980c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f0397fff700 1 -- 172.21.15.69:0/3533251634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03980b2c80 msgr2=0x7f03980b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f0397fff700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03980b2c80 0x7f03980b3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f0397fff700 1 -- 172.21.15.69:0/3533251634 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03980c8a30 con 0x7f0388004870 2023-11-17T06:30:05.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.568+0000 7f039d3d7700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03980b2c80 0x7f03980b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:05.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.572+0000 7f0397fff700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388004870 0x7f0398152c60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f038c011880 tx=0x7f038c011c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.572+0000 7f0394ff9700 1 -- 172.21.15.69:0/3533251634 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c00fae0 con 0x7f0388004870 2023-11-17T06:30:05.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.572+0000 7f039e639700 1 -- 172.21.15.69:0/3533251634 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03980c9a60 con 0x7f0388004870 2023-11-17T06:30:05.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.572+0000 7f039e639700 1 -- 172.21.15.69:0/3533251634 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03980c8f80 con 0x7f0388004870 2023-11-17T06:30:05.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.572+0000 7f0394ff9700 1 -- 172.21.15.69:0/3533251634 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c00fc40 con 0x7f0388004870 2023-11-17T06:30:05.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.572+0000 7f0394ff9700 1 -- 172.21.15.69:0/3533251634 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c011e80 con 0x7f0388004870 2023-11-17T06:30:05.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.572+0000 7f039e639700 1 -- 172.21.15.69:0/3533251634 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03980686a0 con 0x7f0388004870 2023-11-17T06:30:05.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.576+0000 7f0394ff9700 1 -- 172.21.15.69:0/3533251634 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f038c015460 con 0x7f0388004870 2023-11-17T06:30:05.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.576+0000 7f0394ff9700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f037c066510 0x7f037c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.576+0000 7f0394ff9700 1 -- 172.21.15.69:0/3533251634 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f038c084830 con 0x7f0388004870 2023-11-17T06:30:05.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.576+0000 7f03977fe700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f037c066510 0x7f037c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.580+0000 7f03977fe700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f037c066510 0x7f037c0689d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03980b3890 tx=0x7f038400a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.584+0000 7f0394ff9700 1 -- 172.21.15.69:0/3533251634 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f038c051d40 con 0x7f0388004870 2023-11-17T06:30:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.592+0000 7fe89155b700 1 Processor -- start 2023-11-17T06:30:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.592+0000 7fe89155b700 1 -- start start 2023-11-17T06:30:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe89155b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 0x7fe88c0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe89155b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe88c0ce820 0x7fe88c0d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe89155b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88c0cf880 con 0x7fe88c0d1830 2023-11-17T06:30:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe89155b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88c0cefe0 con 0x7fe88c0ce820 2023-11-17T06:30:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe89155b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0cfad0 con 0x7fe88c15d5d0 2023-11-17T06:30:05.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe88b7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe88c0d1830 0x7fe88c0b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59112/0 (socket says 172.21.15.69:59112) 2023-11-17T06:30:05.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe88b7fe700 1 -- 172.21.15.69:0/2391180555 learned_addr learned my addr 172.21.15.69:0/2391180555 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:05.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe88affd700 1 --2- 172.21.15.69:0/2391180555 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 0x7fe88c0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe88a7fc700 1 --2- 172.21.15.69:0/2391180555 >> v2:172.21.15.93:3300/0 conn(0x7fe88c0ce820 0x7fe88c0d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe889ffb700 1 -- 172.21.15.69:0/2391180555 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937845602 0 0) 0x7fe88c0cf880 con 0x7fe88c0d1830 2023-11-17T06:30:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe889ffb700 1 -- 172.21.15.69:0/2391180555 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8740035d0 con 0x7fe88c0d1830 2023-11-17T06:30:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe88a7fc700 1 -- 172.21.15.69:0/2391180555 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 msgr2=0x7fe88c0d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe88a7fc700 1 --2- 172.21.15.69:0/2391180555 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 0x7fe88c0d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe88a7fc700 1 -- 172.21.15.69:0/2391180555 >> v1:172.21.15.69:6789/0 conn(0x7fe88c0d1830 legacy=0x7fe88c0b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe88a7fc700 1 -- 172.21.15.69:0/2391180555 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c0cfdb0 con 0x7fe88c0ce820 2023-11-17T06:30:05.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a759e700 1 Processor -- start 2023-11-17T06:30:05.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a759e700 1 -- start start 2023-11-17T06:30:05.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a759e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f60a004f910 0x7f60a00df580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f2576bd0700 1 Processor -- start 2023-11-17T06:30:05.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a759e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a0054550 con 0x7f60a0053460 2023-11-17T06:30:05.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe88a7fc700 1 --2- 172.21.15.69:0/2391180555 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe88c0ce820 0x7fe88c0d05b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009850 tx=0x7fe87c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c05e9a86846ed431 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a759e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a0053940 con 0x7f60a004fcf0 2023-11-17T06:30:05.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a5d9b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f60a004f910 0x7f60a00df580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a6d9d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f60a0053460 0x7f60a0006280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59118/0 (socket says 172.21.15.69:59118) 2023-11-17T06:30:05.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a6d9d700 1 -- 172.21.15.69:0/4187464117 learned_addr learned my addr 172.21.15.69:0/4187464117 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:05.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f2576bd0700 1 -- start start 2023-11-17T06:30:05.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe889ffb700 1 -- 172.21.15.69:0/2391180555 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c011830 con 0x7fe88c0ce820 2023-11-17T06:30:05.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe889ffb700 1 -- 172.21.15.69:0/2391180555 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c011990 con 0x7fe88c0ce820 2023-11-17T06:30:05.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7fe889ffb700 1 -- 172.21.15.69:0/2391180555 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c011d40 con 0x7fe88c0ce820 2023-11-17T06:30:05.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a659c700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f60a004fcf0 0x7f60a00500d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:48644/0 (socket says 172.21.15.69:48644) 2023-11-17T06:30:05.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a759e700 1 -- 172.21.15.69:0/4187464117 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a0053c20 con 0x7f60a004f910 2023-11-17T06:30:05.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.596+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860976484 0 0) 0x7f60a0054550 con 0x7f60a0053460 2023-11-17T06:30:05.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7fe89155b700 1 -- 172.21.15.69:0/2391180555 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe88c0ce820 msgr2=0x7fe88c0d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7fe89155b700 1 --2- 172.21.15.69:0/2391180555 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe88c0ce820 0x7fe88c0d05b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe87c009850 tx=0x7fe87c009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:05.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60900057e0 con 0x7f60a0053460 2023-11-17T06:30:05.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535802913 0 0) 0x7f60a0053940 con 0x7f60a004fcf0 2023-11-17T06:30:05.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a0054550 con 0x7f60a004fcf0 2023-11-17T06:30:05.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7fe89155b700 1 -- 172.21.15.69:0/2391180555 shutdown_connections 2023-11-17T06:30:05.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7fe89155b700 1 --2- 172.21.15.69:0/2391180555 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe88c0ce820 0x7fe88c0d05b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7fe89155b700 1 --2- 172.21.15.69:0/2391180555 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 0x7fe88c0d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7fe89155b700 1 -- 172.21.15.69:0/2391180555 >> 172.21.15.69:0/2391180555 conn(0x7fe88c0d3250 msgr2=0x7fe88c0d3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4134136104 0 0) 0x7f60900057e0 con 0x7f60a0053460 2023-11-17T06:30:05.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 >> v2:172.21.15.93:3300/0 conn(0x7f60a004f910 msgr2=0x7f60a00df580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7fe89155b700 1 -- 172.21.15.69:0/2391180555 shutdown_connections 2023-11-17T06:30:05.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 --2- 172.21.15.69:0/4187464117 >> v2:172.21.15.93:3300/0 conn(0x7f60a004f910 0x7f60a00df580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 >> v1:172.21.15.93:6789/0 conn(0x7f60a004fcf0 legacy=0x7f60a00500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a0053f00 con 0x7f60a0053460 2023-11-17T06:30:05.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f2576bd0700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f257015d4b0 0x7f2570161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7fe89155b700 1 -- 172.21.15.69:0/2391180555 wait complete. 2023-11-17T06:30:05.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f609c001670 con 0x7f60a0053460 2023-11-17T06:30:05.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 >> v1:172.21.15.69:6789/0 conn(0x7f60a0053460 legacy=0x7f60a0006280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6090006e20 0x7f6090007220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f2576bd0700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f25700b8b20 0x7f25700cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f2576bd0700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25700d1620 con 0x7f25700ce430 2023-11-17T06:30:05.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f2576bd0700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700ce860 con 0x7f25700b8b20 2023-11-17T06:30:05.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f2576bd0700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25700d1320 con 0x7f257015d4b0 2023-11-17T06:30:05.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6090005a20 0x7f6090005ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 0x7f609000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0053c20 con 0x7f6090005a20 2023-11-17T06:30:05.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609000e230 con 0x7f60900063e0 2023-11-17T06:30:05.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6090003570 con 0x7f6090006e20 2023-11-17T06:30:05.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a659c700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6090006e20 0x7f6090007220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f2575bce700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f257015d4b0 0x7f2570161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f2575bce700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f257015d4b0 0x7f2570161110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:35694/0 (socket says 172.21.15.69:35694) 2023-11-17T06:30:05.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f25763cf700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f25700ce430 0x7f25700b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59120/0 (socket says 172.21.15.69:59120) 2023-11-17T06:30:05.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f25763cf700 1 -- 172.21.15.69:0/1838492021 learned_addr learned my addr 172.21.15.69:0/1838492021 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:05.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f25753cd700 1 --2- 172.21.15.69:0/1838492021 >> v2:172.21.15.69:3300/0 conn(0x7f25700b8b20 0x7f25700cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a6d9d700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 0x7f609000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f6d7e929700 1 Processor -- start 2023-11-17T06:30:05.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f6d7e929700 1 -- start start 2023-11-17T06:30:05.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.600+0000 7f60a5d9b700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6090005a20 0x7f6090005ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a6d9d700 1 -- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6090006e20 msgr2=0x7f6090007220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a6d9d700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6090006e20 0x7f6090007220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a6d9d700 1 -- 172.21.15.69:0/4187464117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6090005a20 msgr2=0x7f6090005ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a6d9d700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6090005a20 0x7f6090005ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a6d9d700 1 -- 172.21.15.69:0/4187464117 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60900057e0 con 0x7f60900063e0 2023-11-17T06:30:05.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a659c700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6090006e20 0x7f6090007220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:05.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a6d9d700 1 -- 172.21.15.69:0/4187464117 reap_dead start 2023-11-17T06:30:05.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe89155b700 1 Processor -- start 2023-11-17T06:30:05.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f6d7e929700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d700df580 0x7f6d7004f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f6d7e929700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d70054550 con 0x7f6d7000c270 2023-11-17T06:30:05.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f6d7e929700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d70053940 con 0x7f6d70053460 2023-11-17T06:30:05.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f6d7e929700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d70053c20 con 0x7f6d700df580 2023-11-17T06:30:05.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe89155b700 1 -- start start 2023-11-17T06:30:05.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a6d9d700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 0x7f609000dc40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c210 tx=0x7f6090007ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1596252e129560a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c00cd70 con 0x7f60900063e0 2023-11-17T06:30:05.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c005980 con 0x7f60900063e0 2023-11-17T06:30:05.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a559a700 1 -- 172.21.15.69:0/4187464117 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c005d30 con 0x7f60900063e0 2023-11-17T06:30:05.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe89155b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe88c0ce820 0x7fe88c14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe89155b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe88c0d1830 0x7fe88c0d38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe89155b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 0x7fe88c0b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe89155b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c14ebb0 con 0x7fe88c0d1830 2023-11-17T06:30:05.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe89155b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c14dbc0 con 0x7fe88c0ce820 2023-11-17T06:30:05.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe89155b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88c0b88b0 con 0x7fe88c15d5d0 2023-11-17T06:30:05.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f6d7e128700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6d7000c270 0x7f6d700ea240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59134/0 (socket says 172.21.15.69:59134) 2023-11-17T06:30:05.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f6d7e128700 1 -- 172.21.15.69:0/661477498 learned_addr learned my addr 172.21.15.69:0/661477498 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:05.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f25753cd700 1 -- 172.21.15.69:0/1838492021 >> v2:172.21.15.93:3300/0 conn(0x7f257015d4b0 msgr2=0x7f2570161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f25753cd700 1 --2- 172.21.15.69:0/1838492021 >> v2:172.21.15.93:3300/0 conn(0x7f257015d4b0 0x7f2570161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f25753cd700 1 -- 172.21.15.69:0/1838492021 >> v1:172.21.15.69:6789/0 conn(0x7f25700ce430 legacy=0x7f25700b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f25753cd700 1 -- 172.21.15.69:0/1838492021 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25701619f0 con 0x7f25700b8b20 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f25753cd700 1 --2- 172.21.15.69:0/1838492021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25700b8b20 0x7f25700cdef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f257006bcc0 tx=0x7f2560009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213cdcfd40adfd86 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2574bcc700 1 -- 172.21.15.69:0/1838492021 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560011830 con 0x7f25700b8b20 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2574bcc700 1 -- 172.21.15.69:0/1838492021 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2560011990 con 0x7f25700b8b20 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2574bcc700 1 -- 172.21.15.69:0/1838492021 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560011d20 con 0x7f25700b8b20 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2576bd0700 1 -- 172.21.15.69:0/1838492021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25700b8b20 msgr2=0x7f25700cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2576bd0700 1 --2- 172.21.15.69:0/1838492021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25700b8b20 0x7f25700cdef0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f257006bcc0 tx=0x7f2560009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2576bd0700 1 -- 172.21.15.69:0/1838492021 shutdown_connections 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2576bd0700 1 --2- 172.21.15.69:0/1838492021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25700b8b20 0x7f25700cdef0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2576bd0700 1 --2- 172.21.15.69:0/1838492021 >> v2:172.21.15.93:3300/0 conn(0x7f257015d4b0 0x7f2570161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2576bd0700 1 -- 172.21.15.69:0/1838492021 >> 172.21.15.69:0/1838492021 conn(0x7f257006ac60 msgr2=0x7f257006b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe88affd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe88c0ce820 0x7fe88c14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe88b7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 0x7fe88c0b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe88b7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 0x7fe88c0b7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:49332/0 (socket says 172.21.15.69:49332) 2023-11-17T06:30:05.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe88b7fe700 1 -- 172.21.15.69:0/1246846082 learned_addr learned my addr 172.21.15.69:0/1246846082 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f6d7d927700 1 --2- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d700df580 0x7f6d7004f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2576bd0700 1 -- 172.21.15.69:0/1838492021 shutdown_connections 2023-11-17T06:30:05.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fb45e287700 1 Processor -- start 2023-11-17T06:30:05.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f2576bd0700 1 -- 172.21.15.69:0/1838492021 wait complete. 2023-11-17T06:30:05.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a759e700 1 -- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 msgr2=0x7f609000dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a759e700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 0x7f609000dc40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f609c00c210 tx=0x7f6090007ab0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fb45e287700 1 -- start start 2023-11-17T06:30:05.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f4579582700 1 Processor -- start 2023-11-17T06:30:05.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a759e700 1 -- 172.21.15.69:0/4187464117 shutdown_connections 2023-11-17T06:30:05.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a759e700 1 --2- 172.21.15.69:0/4187464117 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 0x7f609000dc40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f60a759e700 1 -- 172.21.15.69:0/4187464117 >> 172.21.15.69:0/4187464117 conn(0x7f60a0054c90 msgr2=0x7f60a00550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7fe88a7fc700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe88c0d1830 0x7fe88c0d38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970515016 0 0) 0x7f6d70054550 con 0x7f6d7000c270 2023-11-17T06:30:05.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.604+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d640057e0 con 0x7f6d7000c270 2023-11-17T06:30:05.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fe88b7fe700 1 -- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe88c0ce820 msgr2=0x7fe88c14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fe88b7fe700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe88c0ce820 0x7fe88c14e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fe88b7fe700 1 -- 172.21.15.69:0/1246846082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe88c0d1830 msgr2=0x7fe88c0d38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fe88b7fe700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe88c0d1830 0x7fe88c0d38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fe88b7fe700 1 -- 172.21.15.69:0/1246846082 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c0094b0 con 0x7fe88c15d5d0 2023-11-17T06:30:05.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1354176314 0 0) 0x7f6d640057e0 con 0x7f6d7000c270 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d700df580 msgr2=0x7f6d7004f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 --2- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d700df580 0x7f6d7004f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 >> v1:172.21.15.93:6789/0 conn(0x7f6d70053460 legacy=0x7f6d7004fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70053f00 con 0x7f6d7000c270 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f6d68001670 con 0x7f6d7000c270 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 >> v1:172.21.15.69:6789/0 conn(0x7f6d7000c270 legacy=0x7f6d700ea240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 --2- 172.21.15.69:0/661477498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d64005c60 0x7f6d64006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 --2- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d64006a80 0x7f6d64006f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 --2- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d640074b0 0x7f6d6400dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d70053c20 con 0x7f6d64005c60 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6400e3c0 con 0x7f6d640074b0 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6400e580 con 0x7f6d64006a80 2023-11-17T06:30:05.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7e128700 1 --2- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d640074b0 0x7f6d6400dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb45e287700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb45815d5d0 0x7fb4580d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb45e287700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb4580ce820 0x7fb4580d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb45e287700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4580cf880 con 0x7fb4580d1830 2023-11-17T06:30:05.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb45e287700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4580cefe0 con 0x7fb4580ce820 2023-11-17T06:30:05.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb45e287700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580cfad0 con 0x7fb45815d5d0 2023-11-17T06:30:05.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f4579582700 1 -- start start 2023-11-17T06:30:05.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb44f7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb4580ce820 0x7fb4580d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb44f7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb4580ce820 0x7fb4580d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:35726/0 (socket says 172.21.15.69:35726) 2023-11-17T06:30:05.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7e128700 1 -- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d64006a80 msgr2=0x7f6d64006f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-17T06:30:05.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7e128700 1 --2- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d64006a80 0x7f6d64006f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb44f7fe700 1 -- 172.21.15.69:0/782253719 learned_addr learned my addr 172.21.15.69:0/782253719 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f4579582700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f45740b8b20 0x7f45740cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f2576bd0700 1 Processor -- start 2023-11-17T06:30:05.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb457fff700 1 --2- 172.21.15.69:0/782253719 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb45815d5d0 0x7fb4580d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f4579582700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f45740ce430 0x7f45740d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f4579582700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45740d1620 con 0x7f457415d4b0 2023-11-17T06:30:05.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f4579582700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45740ce860 con 0x7f45740ce430 2023-11-17T06:30:05.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f4579582700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45740d1320 con 0x7f45740b8b20 2023-11-17T06:30:05.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fe88b7fe700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 0x7fe88c0b7df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c4f0 tx=0x7fe88000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f60a759e700 1 -- 172.21.15.69:0/4187464117 shutdown_connections 2023-11-17T06:30:05.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f60a759e700 1 -- 172.21.15.69:0/4187464117 wait complete. 2023-11-17T06:30:05.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7e128700 1 -- 172.21.15.69:0/661477498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d64005c60 msgr2=0x7f6d64006080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7e128700 1 --2- 172.21.15.69:0/661477498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d64005c60 0x7f6d64006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f6d7e128700 1 -- 172.21.15.69:0/661477498 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70053f00 con 0x7f6d640074b0 2023-11-17T06:30:05.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb44f7fe700 1 -- 172.21.15.69:0/782253719 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb45815d5d0 msgr2=0x7fb4580d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb44f7fe700 1 --2- 172.21.15.69:0/782253719 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb45815d5d0 0x7fb4580d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb44f7fe700 1 -- 172.21.15.69:0/782253719 >> v1:172.21.15.93:6789/0 conn(0x7fb4580d1830 legacy=0x7fb4580b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fb44f7fe700 1 -- 172.21.15.69:0/782253719 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580cfdb0 con 0x7fb4580ce820 2023-11-17T06:30:05.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fe8737fe700 1 -- 172.21.15.69:0/1246846082 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880005d90 con 0x7fe88c15d5d0 2023-11-17T06:30:05.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7fe8737fe700 1 -- 172.21.15.69:0/1246846082 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8800070d0 con 0x7fe88c15d5d0 2023-11-17T06:30:05.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f456b7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f45740b8b20 0x7f45740cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f456b7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f45740b8b20 0x7f45740cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:35728/0 (socket says 172.21.15.69:35728) 2023-11-17T06:30:05.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f456b7fe700 1 -- 172.21.15.69:0/4043658527 learned_addr learned my addr 172.21.15.69:0/4043658527 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f4578d81700 1 --2- 172.21.15.69:0/4043658527 >> v2:172.21.15.69:3300/0 conn(0x7f45740ce430 0x7f45740d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb44f7fe700 1 --2- 172.21.15.69:0/782253719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 0x7fb4580d05b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb440009910 tx=0x7fb440009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9468a949f4e4312a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f456b7fe700 1 -- 172.21.15.69:0/4043658527 >> v2:172.21.15.69:3300/0 conn(0x7f45740ce430 msgr2=0x7f45740d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f456b7fe700 1 --2- 172.21.15.69:0/4043658527 >> v2:172.21.15.69:3300/0 conn(0x7f45740ce430 0x7f45740d1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f456b7fe700 1 -- 172.21.15.69:0/4043658527 >> v1:172.21.15.69:6789/0 conn(0x7f457415d4b0 legacy=0x7f4574161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f456b7fe700 1 -- 172.21.15.69:0/4043658527 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45741619f0 con 0x7f45740b8b20 2023-11-17T06:30:05.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.608+0000 7f2576bd0700 1 -- start start 2023-11-17T06:30:05.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2576bd0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b8b20 0x7f25700b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2576bd0700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25700ce430 0x7f25700c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f6d7e128700 1 --2- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d640074b0 0x7f6d6400dc40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800c340 tx=0x7f6d64007ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2a9480084ca7a38 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f456b7fe700 1 --2- 172.21.15.69:0/4043658527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45740b8b20 0x7f45740cdef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f45740d30d0 tx=0x7f455c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=352f382289609b53 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6800ce40 con 0x7f6d640074b0 2023-11-17T06:30:05.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fe8737fe700 1 -- 172.21.15.69:0/1246846082 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880007460 con 0x7fe88c15d5d0 2023-11-17T06:30:05.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fe89155b700 1 -- 172.21.15.69:0/1246846082 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c0b8b90 con 0x7fe88c15d5d0 2023-11-17T06:30:05.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fe89155b700 1 -- 172.21.15.69:0/1246846082 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88c14e150 con 0x7fe88c15d5d0 2023-11-17T06:30:05.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb4577fe700 1 -- 172.21.15.69:0/782253719 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440011830 con 0x7fb4580ce820 2023-11-17T06:30:05.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb4577fe700 1 -- 172.21.15.69:0/782253719 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb440011990 con 0x7fb4580ce820 2023-11-17T06:30:05.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb4577fe700 1 -- 172.21.15.69:0/782253719 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440011d40 con 0x7fb4580ce820 2023-11-17T06:30:05.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f45737fe700 1 -- 172.21.15.69:0/4043658527 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c00b8a0 con 0x7f45740b8b20 2023-11-17T06:30:05.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f60a759e700 1 Processor -- start 2023-11-17T06:30:05.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68005980 con 0x7f6d640074b0 2023-11-17T06:30:05.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f6d7c925700 1 -- 172.21.15.69:0/661477498 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d68005d30 con 0x7f6d640074b0 2023-11-17T06:30:05.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fe89155b700 1 -- 172.21.15.69:0/1246846082 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88c14e340 con 0x7fe88c15d5d0 2023-11-17T06:30:05.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f25753cd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25700ce430 0x7f25700c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2576bd0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f257015d4b0 0x7f25701faa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f25753cd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25700ce430 0x7f25700c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:49350/0 (socket says 172.21.15.69:49350) 2023-11-17T06:30:05.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2575bce700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b8b20 0x7f25700b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25701fa290 con 0x7f257015d4b0 2023-11-17T06:30:05.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f25753cd700 1 -- 172.21.15.69:0/1222013226 learned_addr learned my addr 172.21.15.69:0/1222013226 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25700c92f0 con 0x7f25700b8b20 2023-11-17T06:30:05.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25700c95d0 con 0x7f25700ce430 2023-11-17T06:30:05.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb45e287700 1 -- 172.21.15.69:0/782253719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 msgr2=0x7fb4580d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb45e287700 1 --2- 172.21.15.69:0/782253719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 0x7fb4580d05b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb440009910 tx=0x7fb440009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:05.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb45e287700 1 -- 172.21.15.69:0/782253719 shutdown_connections 2023-11-17T06:30:05.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb45e287700 1 --2- 172.21.15.69:0/782253719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 0x7fb4580d05b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb45e287700 1 --2- 172.21.15.69:0/782253719 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb45815d5d0 0x7fb4580d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb45e287700 1 -- 172.21.15.69:0/782253719 >> 172.21.15.69:0/782253719 conn(0x7fb4580d3250 msgr2=0x7fb4580d3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb45e287700 1 -- 172.21.15.69:0/782253719 shutdown_connections 2023-11-17T06:30:05.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7fb45e287700 1 -- 172.21.15.69:0/782253719 wait complete. 2023-11-17T06:30:05.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f45737fe700 1 -- 172.21.15.69:0/4043658527 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455c00ba00 con 0x7f45740b8b20 2023-11-17T06:30:05.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f45737fe700 1 -- 172.21.15.69:0/4043658527 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455c00bd90 con 0x7f45740b8b20 2023-11-17T06:30:05.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f4579582700 1 -- 172.21.15.69:0/4043658527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45740b8b20 msgr2=0x7f45740cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f4579582700 1 --2- 172.21.15.69:0/4043658527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45740b8b20 0x7f45740cdef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f45740d30d0 tx=0x7f455c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2575bce700 1 -- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25700ce430 msgr2=0x7f25700c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2575bce700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25700ce430 0x7f25700c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2575bce700 1 -- 172.21.15.69:0/1222013226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f257015d4b0 msgr2=0x7f25701faa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2575bce700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f257015d4b0 0x7f25701faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2575bce700 1 -- 172.21.15.69:0/1222013226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25600094b0 con 0x7f25700b8b20 2023-11-17T06:30:05.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f6d7e929700 1 -- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d640074b0 msgr2=0x7f6d6400dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f6d7e929700 1 --2- 172.21.15.69:0/661477498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d640074b0 0x7f6d6400dc40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800c340 tx=0x7f6d64007ab0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2575bce700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b8b20 0x7f25700b5520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f256c00e900 tx=0x7f256c00ec10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f60a759e700 1 -- start start 2023-11-17T06:30:05.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f25667fc700 1 -- 172.21.15.69:0/1222013226 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00ee50 con 0x7f25700b8b20 2023-11-17T06:30:05.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f6d7e128700 1 -- 172.21.15.69:0/661477498 reap_dead start 2023-11-17T06:30:05.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f25667fc700 1 -- 172.21.15.69:0/1222013226 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c00c850 con 0x7f25700b8b20 2023-11-17T06:30:05.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.612+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25700c98b0 con 0x7f25700b8b20 2023-11-17T06:30:05.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f6d7e929700 1 -- 172.21.15.69:0/661477498 shutdown_connections 2023-11-17T06:30:05.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f6d7e929700 1 -- 172.21.15.69:0/661477498 >> 172.21.15.69:0/661477498 conn(0x7f6d70054c90 msgr2=0x7f6d700550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7fe8737fe700 1 -- 172.21.15.69:0/1246846082 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe8800075c0 con 0x7fe88c15d5d0 2023-11-17T06:30:05.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257015bd60 con 0x7f25700b8b20 2023-11-17T06:30:05.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f4579582700 1 -- 172.21.15.69:0/4043658527 shutdown_connections 2023-11-17T06:30:05.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f4579582700 1 --2- 172.21.15.69:0/4043658527 >> v2:172.21.15.69:3300/0 conn(0x7f45740ce430 0x7f45740d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f4579582700 1 --2- 172.21.15.69:0/4043658527 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45740b8b20 0x7f45740cdef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f4579582700 1 -- 172.21.15.69:0/4043658527 >> 172.21.15.69:0/4043658527 conn(0x7f457406ac60 msgr2=0x7f457406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f4579582700 1 -- 172.21.15.69:0/4043658527 shutdown_connections 2023-11-17T06:30:05.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f6329676700 1 Processor -- start 2023-11-17T06:30:05.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f6329676700 1 -- start start 2023-11-17T06:30:05.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7fb45e287700 1 Processor -- start 2023-11-17T06:30:05.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7fb45e287700 1 -- start start 2023-11-17T06:30:05.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f4579582700 1 -- 172.21.15.69:0/4043658527 wait complete. 2023-11-17T06:30:05.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a759e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 0x7f60a004acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f6d7e929700 1 -- 172.21.15.69:0/661477498 shutdown_connections 2023-11-17T06:30:05.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7fe8737fe700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe878066510 0x7fe8780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7fe8737fe700 1 -- 172.21.15.69:0/1246846082 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe880083670 con 0x7fe88c15d5d0 2023-11-17T06:30:05.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f6329676700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 0x7f6324161110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f6329676700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f63240b8b20 0x7f63240cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f6329676700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63240d1620 con 0x7f63240ce430 2023-11-17T06:30:05.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f6329676700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63240ce8e0 con 0x7f63240b8b20 2023-11-17T06:30:05.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f6329676700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63240d1320 con 0x7f632415d4b0 2023-11-17T06:30:05.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60a0036f00 0x7f60a0039500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a759e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60a0039a40 0x7f60a0180020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a759e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0039ef0 con 0x7f60a0036f00 2023-11-17T06:30:05.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a759e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a00daa60 con 0x7f60900063e0 2023-11-17T06:30:05.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a759e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a017ca50 con 0x7f60a0039a40 2023-11-17T06:30:05.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a6d9d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60a0039a40 0x7f60a0180020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a6d9d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60a0039a40 0x7f60a0180020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:49362/0 (socket says 172.21.15.69:49362) 2023-11-17T06:30:05.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a6d9d700 1 -- 172.21.15.69:0/2611855864 learned_addr learned my addr 172.21.15.69:0/2611855864 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a659c700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 0x7f60a004acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f60a5d9b700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60a0036f00 0x7f60a0039500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f631a7fc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f63240b8b20 0x7f63240cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f631a7fc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f63240b8b20 0x7f63240cdef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48010/0 (socket says 172.21.15.69:48010) 2023-11-17T06:30:05.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f631a7fc700 1 -- 172.21.15.69:0/4141682779 learned_addr learned my addr 172.21.15.69:0/4141682779 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f6322ffd700 1 --2- 172.21.15.69:0/4141682779 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 0x7f6324161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f60a659c700 1 -- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60a0039a40 msgr2=0x7f60a0180020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f60a659c700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60a0039a40 0x7f60a0180020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f60a659c700 1 -- 172.21.15.69:0/2611855864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60a0036f00 msgr2=0x7f60a0039500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f60a659c700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60a0036f00 0x7f60a0039500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f60a659c700 1 -- 172.21.15.69:0/2611855864 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a017ccf0 con 0x7f60900063e0 2023-11-17T06:30:05.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7fb45e287700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 0x7fb458159b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb45e287700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4580d1830 0x7fb45815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb45e287700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45815d5d0 0x7fb458152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7fe88affd700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe878066510 0x7fe8780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fe88affd700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe878066510 0x7fe8780689d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe884011340 tx=0x7fe88400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f4579582700 1 Processor -- start 2023-11-17T06:30:05.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f25667fc700 1 -- 172.21.15.69:0/1222013226 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00cbc0 con 0x7f25700b8b20 2023-11-17T06:30:05.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.616+0000 7f25667fc700 1 -- 172.21.15.69:0/1222013226 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f256c00cd20 con 0x7f25700b8b20 2023-11-17T06:30:05.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb45e287700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815f280 con 0x7fb45815d5d0 2023-11-17T06:30:05.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f60a659c700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 0x7f60a004acf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f60a8069b60 tx=0x7f60a8068760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb45e287700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815ef70 con 0x7fb4580ce820 2023-11-17T06:30:05.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f6d7e929700 1 -- 172.21.15.69:0/661477498 wait complete. 2023-11-17T06:30:05.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb45e287700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815def0 con 0x7fb4580d1830 2023-11-17T06:30:05.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f631a7fc700 1 -- 172.21.15.69:0/4141682779 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 msgr2=0x7f6324161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:05.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f25667fc700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2554066510 0x7f25540689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb457fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 0x7fb458159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f6096ffd700 1 -- 172.21.15.69:0/2611855864 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a808f070 con 0x7f60900063e0 2023-11-17T06:30:05.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f6096ffd700 1 -- 172.21.15.69:0/2611855864 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a8067250 con 0x7f60900063e0 2023-11-17T06:30:05.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f6096ffd700 1 -- 172.21.15.69:0/2611855864 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a80675c0 con 0x7f60900063e0 2023-11-17T06:30:05.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f60a759e700 1 -- 172.21.15.69:0/2611855864 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a017cfd0 con 0x7f60900063e0 2023-11-17T06:30:05.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f25667fc700 1 -- 172.21.15.69:0/1222013226 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f256c0841c0 con 0x7f25700b8b20 2023-11-17T06:30:05.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f631a7fc700 1 --2- 172.21.15.69:0/4141682779 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 0x7f6324161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f631a7fc700 1 -- 172.21.15.69:0/4141682779 >> v1:172.21.15.93:6789/0 conn(0x7f63240ce430 legacy=0x7f63240b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f631a7fc700 1 -- 172.21.15.69:0/4141682779 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63241619f0 con 0x7f63240b8b20 2023-11-17T06:30:05.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f60a759e700 1 -- 172.21.15.69:0/2611855864 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a017d590 con 0x7f60900063e0 2023-11-17T06:30:05.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f25753cd700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2554066510 0x7f25540689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f631a7fc700 1 --2- 172.21.15.69:0/4141682779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63240b8b20 0x7f63240cdef0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f630c009910 tx=0x7f630c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3408f2569e99092d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f6322ffd700 1 --2- 172.21.15.69:0/4141682779 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 0x7f6324161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:05.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb44f7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4580d1830 0x7fb45815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb457fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 0x7fb458159b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:35748/0 (socket says 172.21.15.69:35748) 2023-11-17T06:30:05.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb457fff700 1 -- 172.21.15.69:0/3923892365 learned_addr learned my addr 172.21.15.69:0/3923892365 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb457fff700 1 -- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4580d1830 msgr2=0x7fb45815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb457fff700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4580d1830 0x7fb45815d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb457fff700 1 -- 172.21.15.69:0/3923892365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45815d5d0 msgr2=0x7fb458152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f4579582700 1 -- start start 2023-11-17T06:30:05.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb45c824700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45815d5d0 0x7fb458152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f63227fc700 1 -- 172.21.15.69:0/4141682779 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c00ba60 con 0x7f63240b8b20 2023-11-17T06:30:05.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f63227fc700 1 -- 172.21.15.69:0/4141682779 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c00bbc0 con 0x7f63240b8b20 2023-11-17T06:30:05.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f63227fc700 1 -- 172.21.15.69:0/4141682779 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c009e60 con 0x7f63240b8b20 2023-11-17T06:30:05.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb457fff700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45815d5d0 0x7fb458152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb457fff700 1 -- 172.21.15.69:0/3923892365 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440009570 con 0x7fb4580ce820 2023-11-17T06:30:05.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb45c824700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45815d5d0 0x7fb458152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:05.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f60a759e700 1 -- 172.21.15.69:0/2611855864 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a0005460 con 0x7f60900063e0 2023-11-17T06:30:05.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7fb457fff700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 0x7fb458159b80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb44800e840 tx=0x7fb44800eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f6329676700 1 -- 172.21.15.69:0/4141682779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63240b8b20 msgr2=0x7f63240cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25700686a0 con 0x7f25700b8b20 2023-11-17T06:30:05.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.620+0000 7f6329676700 1 --2- 172.21.15.69:0/4141682779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63240b8b20 0x7f63240cdef0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f630c009910 tx=0x7f630c009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:05.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7fe8737fe700 1 -- 172.21.15.69:0/1246846082 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe880050bd0 con 0x7fe88c15d5d0 2023-11-17T06:30:05.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7fb4557fa700 1 -- 172.21.15.69:0/3923892365 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4480095a0 con 0x7fb4580ce820 2023-11-17T06:30:05.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6329676700 1 -- 172.21.15.69:0/4141682779 shutdown_connections 2023-11-17T06:30:05.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6329676700 1 --2- 172.21.15.69:0/4141682779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63240b8b20 0x7f63240cdef0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6329676700 1 --2- 172.21.15.69:0/4141682779 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 0x7f6324161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6329676700 1 -- 172.21.15.69:0/4141682779 >> 172.21.15.69:0/4141682779 conn(0x7f632406ac60 msgr2=0x7f632406b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6096ffd700 1 -- 172.21.15.69:0/2611855864 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60a8071440 con 0x7f60900063e0 2023-11-17T06:30:05.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f25753cd700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2554066510 0x7f25540689d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2560009b70 tx=0x7f256001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6329676700 1 -- 172.21.15.69:0/4141682779 shutdown_connections 2023-11-17T06:30:05.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7fb45e287700 1 -- 172.21.15.69:0/3923892365 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45815e1c0 con 0x7fb4580ce820 2023-11-17T06:30:05.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7fb4557fa700 1 -- 172.21.15.69:0/3923892365 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448013680 con 0x7fb4580ce820 2023-11-17T06:30:05.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7fb4557fa700 1 -- 172.21.15.69:0/3923892365 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4480139f0 con 0x7fb4580ce820 2023-11-17T06:30:05.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7fb45e287700 1 -- 172.21.15.69:0/3923892365 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45815e780 con 0x7fb4580ce820 2023-11-17T06:30:05.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6329676700 1 -- 172.21.15.69:0/4141682779 wait complete. 2023-11-17T06:30:05.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7e929700 1 Processor -- start 2023-11-17T06:30:05.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7e929700 1 -- start start 2023-11-17T06:30:05.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4579582700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45740b8b20 0x7f45740c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4579582700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f45740ce430 0x7f45740b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4579582700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f457415d4b0 0x7f45741f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7e929700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d640074b0 0x7f6d7004c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f456b7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f45740ce430 0x7f45740b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7e929700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d700d9890 0x7f6d7004a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f456b7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f45740ce430 0x7f45740b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:49390/0 (socket says 172.21.15.69:49390) 2023-11-17T06:30:05.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4578d81700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f457415d4b0 0x7f45741f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7d927700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d640074b0 0x7f6d7004c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7fb45e287700 1 -- 172.21.15.69:0/3923892365 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4580686a0 con 0x7fb4580ce820 2023-11-17T06:30:05.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7d927700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d640074b0 0x7f6d7004c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:49398/0 (socket says 172.21.15.69:49398) 2023-11-17T06:30:05.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7d126700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d700d9890 0x7f6d7004a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7d126700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d700d9890 0x7f6d7004a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48048/0 (socket says 172.21.15.69:48048) 2023-11-17T06:30:05.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7d927700 1 -- 172.21.15.69:0/1432317086 learned_addr learned my addr 172.21.15.69:0/1432317086 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4578d81700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f457415d4b0 0x7f45741f5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48044/0 (socket says 172.21.15.69:48044) 2023-11-17T06:30:05.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7e929700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d700d9d10 0x7f6d7004aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700dea50 con 0x7f6d700d9890 2023-11-17T06:30:05.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6096ffd700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60880665e0 0x7f6088068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4573fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45740b8b20 0x7f45740c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4579582700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45740b31c0 con 0x7f457415d4b0 2023-11-17T06:30:05.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4579582700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45740c8350 con 0x7f45740b8b20 2023-11-17T06:30:05.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4579582700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45740c8630 con 0x7f45740ce430 2023-11-17T06:30:05.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f456b7fe700 1 -- 172.21.15.69:0/3975617616 learned_addr learned my addr 172.21.15.69:0/3975617616 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7e128700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d700d9d10 0x7f6d7004aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700dd9b0 con 0x7f6d700d9d10 2023-11-17T06:30:05.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6096ffd700 1 -- 172.21.15.69:0/2611855864 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60a80ff120 con 0x7f60900063e0 2023-11-17T06:30:05.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d700ddc90 con 0x7f6d640074b0 2023-11-17T06:30:05.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f60a5d9b700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60880665e0 0x7f6088068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4578d81700 1 -- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f45740ce430 msgr2=0x7f45740b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6329676700 1 Processor -- start 2023-11-17T06:30:05.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d7d126700 1 -- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d640074b0 msgr2=0x7f6d7004c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d7d126700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d640074b0 0x7f6d7004c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4578d81700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f45740ce430 0x7f45740b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4578d81700 1 -- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45740b8b20 msgr2=0x7f45740c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4578d81700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45740b8b20 0x7f45740c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.624+0000 7f4578d81700 1 -- 172.21.15.69:0/3975617616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c009570 con 0x7f457415d4b0 2023-11-17T06:30:05.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d7d126700 1 -- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d700d9d10 msgr2=0x7f6d7004aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d7d126700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d700d9d10 0x7f6d7004aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d7d126700 1 -- 172.21.15.69:0/1432317086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d700ddf70 con 0x7f6d700d9890 2023-11-17T06:30:05.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f4578d81700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f457415d4b0 0x7f45741f5f30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f456c00d530 tx=0x7f456c00d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6329676700 1 -- start start 2023-11-17T06:30:05.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d7d126700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d700d9890 0x7f6d7004a990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400c450 tx=0x7f6d7400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f45717fa700 1 -- 172.21.15.69:0/3975617616 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c0125f0 con 0x7f457415d4b0 2023-11-17T06:30:05.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d6e7fc700 1 -- 172.21.15.69:0/1432317086 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d740052d0 con 0x7f6d700d9890 2023-11-17T06:30:05.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d6e7fc700 1 -- 172.21.15.69:0/1432317086 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d74005430 con 0x7f6d700d9890 2023-11-17T06:30:05.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f45717fa700 1 -- 172.21.15.69:0/3975617616 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c012750 con 0x7f457415d4b0 2023-11-17T06:30:05.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f60a5d9b700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60880665e0 0x7f6088068aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f60a0037320 tx=0x7f6098008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d700de250 con 0x7f6d700d9890 2023-11-17T06:30:05.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d700db8a0 con 0x7f6d700d9890 2023-11-17T06:30:05.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6329676700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63240b8b20 0x7f63241515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6329676700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63240ce430 0x7f63240b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6329676700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 0x7f63240b7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6329676700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63241f3e50 con 0x7f63240ce430 2023-11-17T06:30:05.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6329676700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63241f40f0 con 0x7f63240b8b20 2023-11-17T06:30:05.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6329676700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63241f43d0 con 0x7f632415d4b0 2023-11-17T06:30:05.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d6e7fc700 1 -- 172.21.15.69:0/1432317086 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d740055a0 con 0x7f6d700d9890 2023-11-17T06:30:05.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f4579582700 1 -- 172.21.15.69:0/3975617616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45740c8910 con 0x7f457415d4b0 2023-11-17T06:30:05.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d70005460 con 0x7f6d700d9890 2023-11-17T06:30:05.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f631a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63240ce430 0x7f63240b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f25667fc700 1 -- 172.21.15.69:0/1222013226 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f256c051630 con 0x7f25700b8b20 2023-11-17T06:30:05.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f4579582700 1 -- 172.21.15.69:0/3975617616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45740c8ed0 con 0x7f457415d4b0 2023-11-17T06:30:05.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f45717fa700 1 -- 172.21.15.69:0/3975617616 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c012b00 con 0x7f457415d4b0 2023-11-17T06:30:05.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f631a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63240ce430 0x7f63240b6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48052/0 (socket says 172.21.15.69:48052) 2023-11-17T06:30:05.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.628+0000 7f631a7fc700 1 -- 172.21.15.69:0/691137048 learned_addr learned my addr 172.21.15.69:0/691137048 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:05.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7f63237fe700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 0x7f63240b7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7f6322ffd700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63240b8b20 0x7f63241515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7f456a7fc700 1 -- 172.21.15.69:0/3975617616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c005310 con 0x7f457415d4b0 2023-11-17T06:30:05.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7f6322ffd700 1 -- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 msgr2=0x7f63240b7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7f6322ffd700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 0x7f63240b7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7f6322ffd700 1 -- 172.21.15.69:0/691137048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63240ce430 msgr2=0x7f63240b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7f6322ffd700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63240ce430 0x7f63240b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7f6322ffd700 1 -- 172.21.15.69:0/691137048 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c009570 con 0x7f63240b8b20 2023-11-17T06:30:05.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7f6322ffd700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63240b8b20 0x7f63241515f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f631400cea0 tx=0x7f631400ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7fb4557fa700 1 -- 172.21.15.69:0/3923892365 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb448013bb0 con 0x7fb4580ce820 2023-11-17T06:30:05.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7f6d6e7fc700 1 -- 172.21.15.69:0/1432317086 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6d740038c0 con 0x7f6d700d9890 2023-11-17T06:30:05.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.632+0000 7fb4557fa700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb438066540 0x7fb438068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7fb44f7fe700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb438066540 0x7fb438068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7f6d6e7fc700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6d5c066560 0x7f6d5c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7f6d6e7fc700 1 -- 172.21.15.69:0/1432317086 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d74083510 con 0x7f6d700d9890 2023-11-17T06:30:05.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7fb4557fa700 1 -- 172.21.15.69:0/3923892365 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb448055d60 con 0x7fb4580ce820 2023-11-17T06:30:05.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7f631bfff700 1 -- 172.21.15.69:0/691137048 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400ad40 con 0x7f63240b8b20 2023-11-17T06:30:05.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7fb44f7fe700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb438066540 0x7fb438068a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb440000c00 tx=0x7fb44001d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7f6329676700 1 -- 172.21.15.69:0/691137048 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63241f46b0 con 0x7f63240b8b20 2023-11-17T06:30:05.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7f6d7d927700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6d5c066560 0x7f6d5c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7f6329676700 1 -- 172.21.15.69:0/691137048 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63240b2b60 con 0x7f63240b8b20 2023-11-17T06:30:05.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7f6096ffd700 1 -- 172.21.15.69:0/2611855864 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60a80cc580 con 0x7f60900063e0 2023-11-17T06:30:05.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7f6d7d927700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6d5c066560 0x7f6d5c068a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d78079670 tx=0x7f6d7808c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.636+0000 7f6329676700 1 -- 172.21.15.69:0/691137048 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63241f4510 con 0x7f63240b8b20 2023-11-17T06:30:05.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.640+0000 7f6d6e7fc700 1 -- 172.21.15.69:0/1432317086 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6d74050a00 con 0x7f6d700d9890 2023-11-17T06:30:05.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.640+0000 7f45717fa700 1 -- 172.21.15.69:0/3975617616 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f456c012c60 con 0x7f457415d4b0 2023-11-17T06:30:05.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.640+0000 7f45717fa700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4554066560 0x7f4554068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.640+0000 7f631bfff700 1 -- 172.21.15.69:0/691137048 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63140079f0 con 0x7f63240b8b20 2023-11-17T06:30:05.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.640+0000 7f631bfff700 1 -- 172.21.15.69:0/691137048 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631400aea0 con 0x7f63240b8b20 2023-11-17T06:30:05.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.640+0000 7f45717fa700 1 -- 172.21.15.69:0/3975617616 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f456c0849a0 con 0x7f457415d4b0 2023-11-17T06:30:05.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.640+0000 7fb4557fa700 1 -- 172.21.15.69:0/3923892365 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb4480519a0 con 0x7fb4580ce820 2023-11-17T06:30:05.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.640+0000 7f4573fff700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4554066560 0x7f4554068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.644+0000 7f631bfff700 1 -- 172.21.15.69:0/691137048 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f631400d430 con 0x7f63240b8b20 2023-11-17T06:30:05.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.644+0000 7f4573fff700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4554066560 0x7f4554068a20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f45640012e0 tx=0x7f4564012bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.648+0000 7f45717fa700 1 -- 172.21.15.69:0/3975617616 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f456c051e00 con 0x7f457415d4b0 2023-11-17T06:30:05.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.648+0000 7f631bfff700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6304066510 0x7f63040689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:05.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.648+0000 7f631bfff700 1 -- 172.21.15.69:0/691137048 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6314084380 con 0x7f63240b8b20 2023-11-17T06:30:05.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.648+0000 7f631bfff700 1 -- 172.21.15.69:0/691137048 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f63140848f0 con 0x7f63240b8b20 2023-11-17T06:30:05.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.648+0000 7f631a7fc700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6304066510 0x7f63040689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:05.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.648+0000 7f631a7fc700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6304066510 0x7f63040689d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f632406b9e0 tx=0x7f630c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:05.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.908+0000 7f039e639700 1 -- 172.21.15.69:0/3533251634 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f03980d1400 con 0x7f0388004870 2023-11-17T06:30:05.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.908+0000 7f0394ff9700 1 -- 172.21.15.69:0/3533251634 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f038c055360 con 0x7f0388004870 2023-11-17T06:30:05.914 INFO:teuthology.orchestra.run.smithi069.stdout:64424509447 2023-11-17T06:30:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 -- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f037c066510 msgr2=0x7f037c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f037c066510 0x7f037c0689d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f03980b3890 tx=0x7f038400a000 comp rx=0 tx=0).stop 2023-11-17T06:30:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 -- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388004870 msgr2=0x7f0398152c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388004870 0x7f0398152c60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f038c011880 tx=0x7f038c011c40 comp rx=0 tx=0).stop 2023-11-17T06:30:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 -- 172.21.15.69:0/3533251634 shutdown_connections 2023-11-17T06:30:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f037c066510 0x7f037c0689d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03980b2c80 0x7f03980b3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f03981533e0 0x7f03980c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 --2- 172.21.15.69:0/3533251634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0388004870 0x7f0398152c60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 -- 172.21.15.69:0/3533251634 >> 172.21.15.69:0/3533251634 conn(0x7f03980cfbe0 msgr2=0x7f03980cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 -- 172.21.15.69:0/3533251634 shutdown_connections 2023-11-17T06:30:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.916+0000 7f039e639700 1 -- 172.21.15.69:0/3533251634 wait complete. 2023-11-17T06:30:05.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.944+0000 7fe89155b700 1 -- 172.21.15.69:0/1246846082 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe88c0686a0 con 0x7fe88c15d5d0 2023-11-17T06:30:05.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.944+0000 7fe8737fe700 1 -- 172.21.15.69:0/1246846082 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8800541f0 con 0x7fe88c15d5d0 2023-11-17T06:30:05.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2023-11-17T06:30:05.951 INFO:teuthology.orchestra.run.smithi069.stdout:64424509446 2023-11-17T06:30:05.951 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:05.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.948+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f25700d0e30 con 0x7f25700b8b20 2023-11-17T06:30:05.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 -- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe878066510 msgr2=0x7fe8780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe878066510 0x7fe8780689d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe884011340 tx=0x7fe88400b040 comp rx=0 tx=0).stop 2023-11-17T06:30:05.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 -- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 msgr2=0x7fe88c0b7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 0x7fe88c0b7df0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe88000c4f0 tx=0x7fe88000c800 comp rx=0 tx=0).stop 2023-11-17T06:30:05.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 -- 172.21.15.69:0/1246846082 shutdown_connections 2023-11-17T06:30:05.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe878066510 0x7fe8780689d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe88c15d5d0 0x7fe88c0b7df0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe88c0d1830 0x7fe88c0d38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 --2- 172.21.15.69:0/1246846082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe88c0ce820 0x7fe88c14e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 -- 172.21.15.69:0/1246846082 >> 172.21.15.69:0/1246846082 conn(0x7fe88c0d3250 msgr2=0x7fe88c15f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 -- 172.21.15.69:0/1246846082 shutdown_connections 2023-11-17T06:30:05.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7fe89155b700 1 -- 172.21.15.69:0/1246846082 wait complete. 2023-11-17T06:30:05.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7f25667fc700 1 -- 172.21.15.69:0/1222013226 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f256c021020 con 0x7f25700b8b20 2023-11-17T06:30:05.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7f60a759e700 1 -- 172.21.15.69:0/2611855864 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f60a004d020 con 0x7f60900063e0 2023-11-17T06:30:05.957 INFO:teuthology.orchestra.run.smithi069.stdout:64424509445 2023-11-17T06:30:05.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.952+0000 7f6096ffd700 1 -- 172.21.15.69:0/2611855864 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f60a80cfba0 con 0x7f60900063e0 2023-11-17T06:30:05.958 INFO:teuthology.orchestra.run.smithi069.stdout:64424509447 2023-11-17T06:30:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 -- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60880665e0 msgr2=0x7f6088068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60880665e0 0x7f6088068aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f60a0037320 tx=0x7f6098008040 comp rx=0 tx=0).stop 2023-11-17T06:30:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 -- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 msgr2=0x7f60a004acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 0x7f60a004acf0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f60a8069b60 tx=0x7f60a8068760 comp rx=0 tx=0).stop 2023-11-17T06:30:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2554066510 msgr2=0x7f25540689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2554066510 0x7f25540689d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2560009b70 tx=0x7f256001c040 comp rx=0 tx=0).stop 2023-11-17T06:30:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b8b20 msgr2=0x7f25700b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b8b20 0x7f25700b5520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f256c00e900 tx=0x7f256c00ec10 comp rx=0 tx=0).stop 2023-11-17T06:30:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 shutdown_connections 2023-11-17T06:30:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2554066510 0x7f25540689d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f257015d4b0 0x7f25701faa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f25700ce430 0x7f25700c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 --2- 172.21.15.69:0/1222013226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25700b8b20 0x7f25700b5520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 >> 172.21.15.69:0/1222013226 conn(0x7f257006ac60 msgr2=0x7f25700b7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 -- 172.21.15.69:0/2611855864 shutdown_connections 2023-11-17T06:30:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60880665e0 0x7f6088068aa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60a0039a40 0x7f60a0180020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60a0036f00 0x7f60a0039500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 --2- 172.21.15.69:0/2611855864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60900063e0 0x7f60a004acf0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 -- 172.21.15.69:0/2611855864 >> 172.21.15.69:0/2611855864 conn(0x7f60a0054c90 msgr2=0x7f60a00e1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 shutdown_connections 2023-11-17T06:30:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f2576bd0700 1 -- 172.21.15.69:0/1222013226 wait complete. 2023-11-17T06:30:05.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 -- 172.21.15.69:0/2611855864 shutdown_connections 2023-11-17T06:30:05.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7f60a759e700 1 -- 172.21.15.69:0/2611855864 wait complete. 2023-11-17T06:30:05.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.956+0000 7fb45e287700 1 -- 172.21.15.69:0/3923892365 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb45808c9a0 con 0x7fb4580ce820 2023-11-17T06:30:05.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb4557fa700 1 -- 172.21.15.69:0/3923892365 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb448021090 con 0x7fb4580ce820 2023-11-17T06:30:05.965 INFO:teuthology.orchestra.run.smithi069.stdout:64424509447 2023-11-17T06:30:05.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f6d700dddd0 con 0x7f6d700d9890 2023-11-17T06:30:05.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb45e287700 1 -- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb438066540 msgr2=0x7fb438068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb45e287700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb438066540 0x7fb438068a00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb440000c00 tx=0x7fb44001d040 comp rx=0 tx=0).stop 2023-11-17T06:30:05.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb45e287700 1 -- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 msgr2=0x7fb458159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb45e287700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 0x7fb458159b80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb44800e840 tx=0x7fb44800eb50 comp rx=0 tx=0).stop 2023-11-17T06:30:05.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb45e287700 1 -- 172.21.15.69:0/3923892365 shutdown_connections 2023-11-17T06:30:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb45e287700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb438066540 0x7fb438068a00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb45e287700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb45815d5d0 0x7fb458152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb45e287700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4580d1830 0x7fb45815d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb45e287700 1 --2- 172.21.15.69:0/3923892365 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb4580ce820 0x7fb458159b80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7fb45e287700 1 -- 172.21.15.69:0/3923892365 >> 172.21.15.69:0/3923892365 conn(0x7fb4580d3250 msgr2=0x7fb4580d1010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.960+0000 7f6d6e7fc700 1 -- 172.21.15.69:0/1432317086 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d74017020 con 0x7f6d700d9890 2023-11-17T06:30:05.967 INFO:teuthology.orchestra.run.smithi069.stdout:64424509446 2023-11-17T06:30:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7fb45e287700 1 -- 172.21.15.69:0/3923892365 shutdown_connections 2023-11-17T06:30:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6d5c066560 msgr2=0x7f6d5c068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6d5c066560 0x7f6d5c068a20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d78079670 tx=0x7f6d7808c040 comp rx=0 tx=0).stop 2023-11-17T06:30:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d700d9890 msgr2=0x7f6d7004a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d700d9890 0x7f6d7004a990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400c450 tx=0x7f6d7400c760 comp rx=0 tx=0).stop 2023-11-17T06:30:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 shutdown_connections 2023-11-17T06:30:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6d5c066560 0x7f6d5c068a20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6d700d9d10 0x7f6d7004aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d700d9890 0x7f6d7004a990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 --2- 172.21.15.69:0/1432317086 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6d640074b0 0x7f6d7004c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 >> 172.21.15.69:0/1432317086 conn(0x7f6d70054c90 msgr2=0x7f6d700e1990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7fb45e287700 1 -- 172.21.15.69:0/3923892365 wait complete. 2023-11-17T06:30:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f456a7fc700 1 -- 172.21.15.69:0/3975617616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f454c005890 con 0x7f457415d4b0 2023-11-17T06:30:05.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 shutdown_connections 2023-11-17T06:30:05.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f6d7e929700 1 -- 172.21.15.69:0/1432317086 wait complete. 2023-11-17T06:30:05.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.964+0000 7f45717fa700 1 -- 172.21.15.69:0/3975617616 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f456c051e00 con 0x7f457415d4b0 2023-11-17T06:30:05.971 INFO:teuthology.orchestra.run.smithi069.stdout:60129542151 2023-11-17T06:30:05.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 -- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4554066560 msgr2=0x7f4554068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4554066560 0x7f4554068a20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f45640012e0 tx=0x7f4564012bb0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 -- 172.21.15.69:0/3975617616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f457415d4b0 msgr2=0x7f45741f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f457415d4b0 0x7f45741f5f30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f456c00d530 tx=0x7f456c00d840 comp rx=0 tx=0).stop 2023-11-17T06:30:05.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f6329676700 1 -- 172.21.15.69:0/691137048 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f63241f4bd0 con 0x7f63240b8b20 2023-11-17T06:30:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 -- 172.21.15.69:0/3975617616 shutdown_connections 2023-11-17T06:30:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4554066560 0x7f4554068a20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f457415d4b0 0x7f45741f5f30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f45740ce430 0x7f45740b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 --2- 172.21.15.69:0/3975617616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f45740b8b20 0x7f45740c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 -- 172.21.15.69:0/3975617616 >> 172.21.15.69:0/3975617616 conn(0x7f457406ac60 msgr2=0x7f45740b73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 -- 172.21.15.69:0/3975617616 shutdown_connections 2023-11-17T06:30:05.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f456a7fc700 1 -- 172.21.15.69:0/3975617616 wait complete. 2023-11-17T06:30:05.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.968+0000 7f631bfff700 1 -- 172.21.15.69:0/691137048 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6314024020 con 0x7f63240b8b20 2023-11-17T06:30:05.975 INFO:teuthology.orchestra.run.smithi069.stdout:64424509445 2023-11-17T06:30:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.972+0000 7f6329676700 1 -- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6304066510 msgr2=0x7f63040689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.972+0000 7f6329676700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6304066510 0x7f63040689d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f632406b9e0 tx=0x7f630c008030 comp rx=0 tx=0).stop 2023-11-17T06:30:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.972+0000 7f6329676700 1 -- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63240b8b20 msgr2=0x7f63241515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.972+0000 7f6329676700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63240b8b20 0x7f63241515f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f631400cea0 tx=0x7f631400ced0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.972+0000 7f6329676700 1 -- 172.21.15.69:0/691137048 shutdown_connections 2023-11-17T06:30:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.972+0000 7f6329676700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6304066510 0x7f63040689d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.976+0000 7f6329676700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f632415d4b0 0x7f63240b7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.976+0000 7f6329676700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f63240ce430 0x7f63240b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.976+0000 7f6329676700 1 --2- 172.21.15.69:0/691137048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63240b8b20 0x7f63241515f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:05.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.976+0000 7f6329676700 1 -- 172.21.15.69:0/691137048 >> 172.21.15.69:0/691137048 conn(0x7f632406ac60 msgr2=0x7f63240b7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:05.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.980+0000 7f6329676700 1 -- 172.21.15.69:0/691137048 shutdown_connections 2023-11-17T06:30:05.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:05.980+0000 7f6329676700 1 -- 172.21.15.69:0/691137048 wait complete. 2023-11-17T06:30:05.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2023-11-17T06:30:05.984 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:05.988 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2023-11-17T06:30:05.988 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:05.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2023-11-17T06:30:05.989 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:05.995 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2023-11-17T06:30:05.995 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:05.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.5 2023-11-17T06:30:05.999 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:06.000 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2023-11-17T06:30:06.001 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:06.002 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2023-11-17T06:30:06.002 DEBUG:teuthology.parallel:result is None 2023-11-17T06:30:06.002 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-17T06:30:06.002 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:30:06.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.208+0000 7fc4bfc87700 1 Processor -- start 2023-11-17T06:30:06.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bfc87700 1 -- start start 2023-11-17T06:30:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bfc87700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc4b81617a0 0x7fc4b80cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bfc87700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc4b80cbfc0 0x7fc4b80ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bfc87700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b8166040 con 0x7fc4b80ce5d0 2023-11-17T06:30:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bfc87700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b80cc450 con 0x7fc4b81617a0 2023-11-17T06:30:06.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bfc87700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b8165430 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bda23700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc4b81617a0 0x7fc4b80cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bda23700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc4b81617a0 0x7fc4b80cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48062/0 (socket says 172.21.15.69:48062) 2023-11-17T06:30:06.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bda23700 1 -- 172.21.15.69:0/535017190 learned_addr learned my addr 172.21.15.69:0/535017190 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:06.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bd222700 1 --2- 172.21.15.69:0/535017190 >> v2:172.21.15.93:3300/0 conn(0x7fc4b80cbfc0 0x7fc4b80ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bda23700 1 -- 172.21.15.69:0/535017190 >> v2:172.21.15.93:3300/0 conn(0x7fc4b80cbfc0 msgr2=0x7fc4b80ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:06.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bda23700 1 --2- 172.21.15.69:0/535017190 >> v2:172.21.15.93:3300/0 conn(0x7fc4b80cbfc0 0x7fc4b80ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bda23700 1 -- 172.21.15.69:0/535017190 >> v1:172.21.15.69:6789/0 conn(0x7fc4b80ce5d0 legacy=0x7fc4b80b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bda23700 1 -- 172.21.15.69:0/535017190 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b8165710 con 0x7fc4b81617a0 2023-11-17T06:30:06.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.212+0000 7fc4bca21700 1 -- 172.21.15.69:0/535017190 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474912940 0 0) 0x7fc4b8166040 con 0x7fc4b80ce5d0 2023-11-17T06:30:06.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bda23700 1 --2- 172.21.15.69:0/535017190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b81617a0 0x7fc4b80cba80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc4b81664b0 tx=0x7fc4b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a6ca7333d11b10 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bca21700 1 -- 172.21.15.69:0/535017190 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400e070 con 0x7fc4b81617a0 2023-11-17T06:30:06.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bca21700 1 -- 172.21.15.69:0/535017190 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400b910 con 0x7fc4b81617a0 2023-11-17T06:30:06.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bca21700 1 -- 172.21.15.69:0/535017190 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400bcc0 con 0x7fc4b81617a0 2023-11-17T06:30:06.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bfc87700 1 -- 172.21.15.69:0/535017190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b81617a0 msgr2=0x7fc4b80cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bfc87700 1 --2- 172.21.15.69:0/535017190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b81617a0 0x7fc4b80cba80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc4b81664b0 tx=0x7fc4b400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bfc87700 1 -- 172.21.15.69:0/535017190 shutdown_connections 2023-11-17T06:30:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bfc87700 1 --2- 172.21.15.69:0/535017190 >> v2:172.21.15.93:3300/0 conn(0x7fc4b80cbfc0 0x7fc4b80ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bfc87700 1 --2- 172.21.15.69:0/535017190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b81617a0 0x7fc4b80cba80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bfc87700 1 -- 172.21.15.69:0/535017190 >> 172.21.15.69:0/535017190 conn(0x7fc4b806a480 msgr2=0x7fc4b806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bfc87700 1 -- 172.21.15.69:0/535017190 shutdown_connections 2023-11-17T06:30:06.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.216+0000 7fc4bfc87700 1 -- 172.21.15.69:0/535017190 wait complete. 2023-11-17T06:30:06.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bfc87700 1 Processor -- start 2023-11-17T06:30:06.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bfc87700 1 -- start start 2023-11-17T06:30:06.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bfc87700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b80cbfc0 0x7fc4b815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bfc87700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4b80ce5d0 0x7fc4b80b2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bfc87700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc4b81617a0 0x7fc4b80c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bfc87700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80b1d00 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bfc87700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80b1fe0 con 0x7fc4b80ce5d0 2023-11-17T06:30:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bfc87700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80b22c0 con 0x7fc4b81617a0 2023-11-17T06:30:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bda23700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b80cbfc0 0x7fc4b815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bda23700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b80cbfc0 0x7fc4b815f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48076/0 (socket says 172.21.15.69:48076) 2023-11-17T06:30:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bda23700 1 -- 172.21.15.69:0/1051013956 learned_addr learned my addr 172.21.15.69:0/1051013956 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:06.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bd222700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4b80ce5d0 0x7fc4b80b2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4be224700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc4b81617a0 0x7fc4b80c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bda23700 1 -- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc4b81617a0 msgr2=0x7fc4b80c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bda23700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc4b81617a0 0x7fc4b80c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bda23700 1 -- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4b80ce5d0 msgr2=0x7fc4b80b2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bda23700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4b80ce5d0 0x7fc4b80b2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bda23700 1 -- 172.21.15.69:0/1051013956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b4009b30 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.220+0000 7fc4bd222700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4b80ce5d0 0x7fc4b80b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.224+0000 7fc4bda23700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b80cbfc0 0x7fc4b815f4a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80cc8d0 tx=0x7fc4b4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.224+0000 7fc4ae7fc700 1 -- 172.21.15.69:0/1051013956 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b40092e0 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.224+0000 7fc4ae7fc700 1 -- 172.21.15.69:0/1051013956 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b40099b0 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.224+0000 7fc4ae7fc700 1 -- 172.21.15.69:0/1051013956 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b401b670 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.224+0000 7fc4bfc87700 1 -- 172.21.15.69:0/1051013956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b80b25a0 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.224+0000 7fc4bfc87700 1 -- 172.21.15.69:0/1051013956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b815f9e0 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.224+0000 7fc4bfc87700 1 -- 172.21.15.69:0/1051013956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b8073f00 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.228+0000 7fc4ae7fc700 1 -- 172.21.15.69:0/1051013956 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc4b401b7d0 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.228+0000 7fc4ae7fc700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc49c066510 0x7fc49c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.228+0000 7fc4ae7fc700 1 -- 172.21.15.69:0/1051013956 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4b4085470 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.228+0000 7fc4bd222700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc49c066510 0x7fc49c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.228+0000 7fc4bd222700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc49c066510 0x7fc49c0689d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80c4be0 tx=0x7fc4a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.236+0000 7fc4ae7fc700 1 -- 172.21.15.69:0/1051013956 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc4b4052980 con 0x7fc4b80cbfc0 2023-11-17T06:30:06.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.392+0000 7fc4bfc87700 1 -- 172.21.15.69:0/1051013956 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4b81659f0 con 0x7fc49c066510 2023-11-17T06:30:06.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.408+0000 7fc4ae7fc700 1 -- 172.21.15.69:0/1051013956 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264387 (secure 0 0 0) 0x7fc4a8004030 con 0x7fc49c066510 2023-11-17T06:30:06.419 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:06.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 -- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc49c066510 msgr2=0x7fc49c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc49c066510 0x7fc49c0689d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80c4be0 tx=0x7fc4a8008040 comp rx=0 tx=0).stop 2023-11-17T06:30:06.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 -- 172.21.15.69:0/1051013956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b80cbfc0 msgr2=0x7fc4b815f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b80cbfc0 0x7fc4b815f4a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80cc8d0 tx=0x7fc4b4004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 -- 172.21.15.69:0/1051013956 shutdown_connections 2023-11-17T06:30:06.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc49c066510 0x7fc49c0689d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc4b81617a0 0x7fc4b80c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc4b80ce5d0 0x7fc4b80b2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 --2- 172.21.15.69:0/1051013956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4b80cbfc0 0x7fc4b815f4a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 -- 172.21.15.69:0/1051013956 >> 172.21.15.69:0/1051013956 conn(0x7fc4b806a480 msgr2=0x7fc4b815bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 -- 172.21.15.69:0/1051013956 shutdown_connections 2023-11-17T06:30:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.416+0000 7fc4bfc87700 1 -- 172.21.15.69:0/1051013956 wait complete. 2023-11-17T06:30:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:30:06.442 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-11-17T06:30:06.365761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219244,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755476,"statfs":{"total":773094113280,"available":772869607424,"internally_reserved":0,"allocated":3121152,"data_stored":1832844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.356989"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566813+0000","last_change":"2023-11-17T06:29:57.048765+0000","last_active":"2023-11-17T06:29:58.566813+0000","last_peered":"2023-11-17T06:29:58.566813+0000","last_clean":"2023-11-17T06:29:58.566813+0000","last_became_active":"2023-11-17T06:29:57.048355+0000","last_became_peered":"2023-11-17T06:29:57.048355+0000","last_unstale":"2023-11-17T06:29:58.566813+0000","last_undegraded":"2023-11-17T06:29:58.566813+0000","last_fullsized":"2023-11-17T06:29:58.566813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:56:31.946595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017546+0000","last_change":"2023-11-17T06:29:57.026689+0000","last_active":"2023-11-17T06:29:58.017546+0000","last_peered":"2023-11-17T06:29:58.017546+0000","last_clean":"2023-11-17T06:29:58.017546+0000","last_became_active":"2023-11-17T06:29:57.026110+0000","last_became_peered":"2023-11-17T06:29:57.026110+0000","last_unstale":"2023-11-17T06:29:58.017546+0000","last_undegraded":"2023-11-17T06:29:58.017546+0000","last_fullsized":"2023-11-17T06:29:58.017546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:13:19.132028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017185+0000","last_change":"2023-11-17T06:29:57.035489+0000","last_active":"2023-11-17T06:29:58.017185+0000","last_peered":"2023-11-17T06:29:58.017185+0000","last_clean":"2023-11-17T06:29:58.017185+0000","last_became_active":"2023-11-17T06:29:57.035039+0000","last_became_peered":"2023-11-17T06:29:57.035039+0000","last_unstale":"2023-11-17T06:29:58.017185+0000","last_undegraded":"2023-11-17T06:29:58.017185+0000","last_fullsized":"2023-11-17T06:29:58.017185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:33:15.530438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013600+0000","last_change":"2023-11-17T06:29:57.037868+0000","last_active":"2023-11-17T06:29:58.013600+0000","last_peered":"2023-11-17T06:29:58.013600+0000","last_clean":"2023-11-17T06:29:58.013600+0000","last_became_active":"2023-11-17T06:29:57.036721+0000","last_became_peered":"2023-11-17T06:29:57.036721+0000","last_unstale":"2023-11-17T06:29:58.013600+0000","last_undegraded":"2023-11-17T06:29:58.013600+0000","last_fullsized":"2023-11-17T06:29:58.013600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566412+0000","last_change":"2023-11-17T06:29:57.050034+0000","last_active":"2023-11-17T06:29:58.566412+0000","last_peered":"2023-11-17T06:29:58.566412+0000","last_clean":"2023-11-17T06:29:58.566412+0000","last_became_active":"2023-11-17T06:29:57.048335+0000","last_became_peered":"2023-11-17T06:29:57.048335+0000","last_unstale":"2023-11-17T06:29:58.566412+0000","last_undegraded":"2023-11-17T06:29:58.566412+0000","last_fullsized":"2023-11-17T06:29:58.566412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:00:33.615466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013438+0000","last_change":"2023-11-17T06:29:57.035919+0000","last_active":"2023-11-17T06:29:58.013438+0000","last_peered":"2023-11-17T06:29:58.013438+0000","last_clean":"2023-11-17T06:29:58.013438+0000","last_became_active":"2023-11-17T06:29:57.035533+0000","last_became_peered":"2023-11-17T06:29:57.035533+0000","last_unstale":"2023-11-17T06:29:58.013438+0000","last_undegraded":"2023-11-17T06:29:58.013438+0000","last_fullsized":"2023-11-17T06:29:58.013438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565360+0000","last_change":"2023-11-17T06:29:57.044538+0000","last_active":"2023-11-17T06:29:58.565360+0000","last_peered":"2023-11-17T06:29:58.565360+0000","last_clean":"2023-11-17T06:29:58.565360+0000","last_became_active":"2023-11-17T06:29:57.044209+0000","last_became_peered":"2023-11-17T06:29:57.044209+0000","last_unstale":"2023-11-17T06:29:58.565360+0000","last_undegraded":"2023-11-17T06:29:58.565360+0000","last_fullsized":"2023-11-17T06:29:58.565360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:36:15.068137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016567+0000","last_change":"2023-11-17T06:29:57.050415+0000","last_active":"2023-11-17T06:29:58.016567+0000","last_peered":"2023-11-17T06:29:58.016567+0000","last_clean":"2023-11-17T06:29:58.016567+0000","last_became_active":"2023-11-17T06:29:57.050130+0000","last_became_peered":"2023-11-17T06:29:57.050130+0000","last_unstale":"2023-11-17T06:29:58.016567+0000","last_undegraded":"2023-11-17T06:29:58.016567+0000","last_fullsized":"2023-11-17T06:29:58.016567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:10:40.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567762+0000","last_change":"2023-11-17T06:29:57.021824+0000","last_active":"2023-11-17T06:29:58.567762+0000","last_peered":"2023-11-17T06:29:58.567762+0000","last_clean":"2023-11-17T06:29:58.567762+0000","last_became_active":"2023-11-17T06:29:57.021520+0000","last_became_peered":"2023-11-17T06:29:57.021520+0000","last_unstale":"2023-11-17T06:29:58.567762+0000","last_undegraded":"2023-11-17T06:29:58.567762+0000","last_fullsized":"2023-11-17T06:29:58.567762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566326+0000","last_change":"2023-11-17T06:29:57.049308+0000","last_active":"2023-11-17T06:29:58.566326+0000","last_peered":"2023-11-17T06:29:58.566326+0000","last_clean":"2023-11-17T06:29:58.566326+0000","last_became_active":"2023-11-17T06:29:57.048874+0000","last_became_peered":"2023-11-17T06:29:57.048874+0000","last_unstale":"2023-11-17T06:29:58.566326+0000","last_undegraded":"2023-11-17T06:29:58.566326+0000","last_fullsized":"2023-11-17T06:29:58.566326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:53:02.810684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567455+0000","last_change":"2023-11-17T06:29:57.049230+0000","last_active":"2023-11-17T06:29:58.567455+0000","last_peered":"2023-11-17T06:29:58.567455+0000","last_clean":"2023-11-17T06:29:58.567455+0000","last_became_active":"2023-11-17T06:29:57.048585+0000","last_became_peered":"2023-11-17T06:29:57.048585+0000","last_unstale":"2023-11-17T06:29:58.567455+0000","last_undegraded":"2023-11-17T06:29:58.567455+0000","last_fullsized":"2023-11-17T06:29:58.567455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:24:12.818384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566673+0000","last_change":"2023-11-17T06:29:57.040860+0000","last_active":"2023-11-17T06:29:58.566673+0000","last_peered":"2023-11-17T06:29:58.566673+0000","last_clean":"2023-11-17T06:29:58.566673+0000","last_became_active":"2023-11-17T06:29:57.040400+0000","last_became_peered":"2023-11-17T06:29:57.040400+0000","last_unstale":"2023-11-17T06:29:58.566673+0000","last_undegraded":"2023-11-17T06:29:58.566673+0000","last_fullsized":"2023-11-17T06:29:58.566673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:38:04.919402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063054+0000","last_change":"2023-11-17T06:29:57.051422+0000","last_active":"2023-11-17T06:29:58.063054+0000","last_peered":"2023-11-17T06:29:58.063054+0000","last_clean":"2023-11-17T06:29:58.063054+0000","last_became_active":"2023-11-17T06:29:57.051220+0000","last_became_peered":"2023-11-17T06:29:57.051220+0000","last_unstale":"2023-11-17T06:29:58.063054+0000","last_undegraded":"2023-11-17T06:29:58.063054+0000","last_fullsized":"2023-11-17T06:29:58.063054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:25.572533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062869+0000","last_change":"2023-11-17T06:29:57.027124+0000","last_active":"2023-11-17T06:29:58.062869+0000","last_peered":"2023-11-17T06:29:58.062869+0000","last_clean":"2023-11-17T06:29:58.062869+0000","last_became_active":"2023-11-17T06:29:57.025556+0000","last_became_peered":"2023-11-17T06:29:57.025556+0000","last_unstale":"2023-11-17T06:29:58.062869+0000","last_undegraded":"2023-11-17T06:29:58.062869+0000","last_fullsized":"2023-11-17T06:29:58.062869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:46.928281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016155+0000","last_change":"2023-11-17T06:29:57.051705+0000","last_active":"2023-11-17T06:29:58.016155+0000","last_peered":"2023-11-17T06:29:58.016155+0000","last_clean":"2023-11-17T06:29:58.016155+0000","last_became_active":"2023-11-17T06:29:57.051139+0000","last_became_peered":"2023-11-17T06:29:57.051139+0000","last_unstale":"2023-11-17T06:29:58.016155+0000","last_undegraded":"2023-11-17T06:29:58.016155+0000","last_fullsized":"2023-11-17T06:29:58.016155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:43:38.839375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199207+0000","last_change":"2023-11-17T06:29:57.040316+0000","last_active":"2023-11-17T06:29:58.199207+0000","last_peered":"2023-11-17T06:29:58.199207+0000","last_clean":"2023-11-17T06:29:58.199207+0000","last_became_active":"2023-11-17T06:29:57.039952+0000","last_became_peered":"2023-11-17T06:29:57.039952+0000","last_unstale":"2023-11-17T06:29:58.199207+0000","last_undegraded":"2023-11-17T06:29:58.199207+0000","last_fullsized":"2023-11-17T06:29:58.199207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:08:15.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200121+0000","last_change":"2023-11-17T06:29:57.053274+0000","last_active":"2023-11-17T06:29:58.200121+0000","last_peered":"2023-11-17T06:29:58.200121+0000","last_clean":"2023-11-17T06:29:58.200121+0000","last_became_active":"2023-11-17T06:29:57.050580+0000","last_became_peered":"2023-11-17T06:29:57.050580+0000","last_unstale":"2023-11-17T06:29:58.200121+0000","last_undegraded":"2023-11-17T06:29:58.200121+0000","last_fullsized":"2023-11-17T06:29:58.200121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:40:22.670143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565972+0000","last_change":"2023-11-17T06:29:57.039046+0000","last_active":"2023-11-17T06:29:58.565972+0000","last_peered":"2023-11-17T06:29:58.565972+0000","last_clean":"2023-11-17T06:29:58.565972+0000","last_became_active":"2023-11-17T06:29:57.038686+0000","last_became_peered":"2023-11-17T06:29:57.038686+0000","last_unstale":"2023-11-17T06:29:58.565972+0000","last_undegraded":"2023-11-17T06:29:58.565972+0000","last_fullsized":"2023-11-17T06:29:58.565972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200277+0000","last_change":"2023-11-17T06:29:57.038796+0000","last_active":"2023-11-17T06:29:58.200277+0000","last_peered":"2023-11-17T06:29:58.200277+0000","last_clean":"2023-11-17T06:29:58.200277+0000","last_became_active":"2023-11-17T06:29:57.038343+0000","last_became_peered":"2023-11-17T06:29:57.038343+0000","last_unstale":"2023-11-17T06:29:58.200277+0000","last_undegraded":"2023-11-17T06:29:58.200277+0000","last_fullsized":"2023-11-17T06:29:58.200277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:31.062867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567003+0000","last_change":"2023-11-17T06:29:57.039524+0000","last_active":"2023-11-17T06:29:58.567003+0000","last_peered":"2023-11-17T06:29:58.567003+0000","last_clean":"2023-11-17T06:29:58.567003+0000","last_became_active":"2023-11-17T06:29:57.039223+0000","last_became_peered":"2023-11-17T06:29:57.039223+0000","last_unstale":"2023-11-17T06:29:58.567003+0000","last_undegraded":"2023-11-17T06:29:58.567003+0000","last_fullsized":"2023-11-17T06:29:58.567003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:42:16.411887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014811+0000","last_change":"2023-11-17T06:29:57.035054+0000","last_active":"2023-11-17T06:29:58.014811+0000","last_peered":"2023-11-17T06:29:58.014811+0000","last_clean":"2023-11-17T06:29:58.014811+0000","last_became_active":"2023-11-17T06:29:57.034678+0000","last_became_peered":"2023-11-17T06:29:57.034678+0000","last_unstale":"2023-11-17T06:29:58.014811+0000","last_undegraded":"2023-11-17T06:29:58.014811+0000","last_fullsized":"2023-11-17T06:29:58.014811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:56.074236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566287+0000","last_change":"2023-11-17T06:29:57.049846+0000","last_active":"2023-11-17T06:29:58.566287+0000","last_peered":"2023-11-17T06:29:58.566287+0000","last_clean":"2023-11-17T06:29:58.566287+0000","last_became_active":"2023-11-17T06:29:57.049537+0000","last_became_peered":"2023-11-17T06:29:57.049537+0000","last_unstale":"2023-11-17T06:29:58.566287+0000","last_undegraded":"2023-11-17T06:29:58.566287+0000","last_fullsized":"2023-11-17T06:29:58.566287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016429+0000","last_change":"2023-11-17T06:29:57.039185+0000","last_active":"2023-11-17T06:29:58.016429+0000","last_peered":"2023-11-17T06:29:58.016429+0000","last_clean":"2023-11-17T06:29:58.016429+0000","last_became_active":"2023-11-17T06:29:57.038833+0000","last_became_peered":"2023-11-17T06:29:57.038833+0000","last_unstale":"2023-11-17T06:29:58.016429+0000","last_undegraded":"2023-11-17T06:29:58.016429+0000","last_fullsized":"2023-11-17T06:29:58.016429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:35:36.870837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199139+0000","last_change":"2023-11-17T06:29:57.028933+0000","last_active":"2023-11-17T06:29:58.199139+0000","last_peered":"2023-11-17T06:29:58.199139+0000","last_clean":"2023-11-17T06:29:58.199139+0000","last_became_active":"2023-11-17T06:29:57.028654+0000","last_became_peered":"2023-11-17T06:29:57.028654+0000","last_unstale":"2023-11-17T06:29:58.199139+0000","last_undegraded":"2023-11-17T06:29:58.199139+0000","last_fullsized":"2023-11-17T06:29:58.199139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:44:58.041380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017531+0000","last_change":"2023-11-17T06:29:57.028712+0000","last_active":"2023-11-17T06:29:58.017531+0000","last_peered":"2023-11-17T06:29:58.017531+0000","last_clean":"2023-11-17T06:29:58.017531+0000","last_became_active":"2023-11-17T06:29:57.027965+0000","last_became_peered":"2023-11-17T06:29:57.027965+0000","last_unstale":"2023-11-17T06:29:58.017531+0000","last_undegraded":"2023-11-17T06:29:58.017531+0000","last_fullsized":"2023-11-17T06:29:58.017531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:15:20.965141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013827+0000","last_change":"2023-11-17T06:29:57.037004+0000","last_active":"2023-11-17T06:29:58.013827+0000","last_peered":"2023-11-17T06:29:58.013827+0000","last_clean":"2023-11-17T06:29:58.013827+0000","last_became_active":"2023-11-17T06:29:57.036152+0000","last_became_peered":"2023-11-17T06:29:57.036152+0000","last_unstale":"2023-11-17T06:29:58.013827+0000","last_undegraded":"2023-11-17T06:29:58.013827+0000","last_fullsized":"2023-11-17T06:29:58.013827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:28.425909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063473+0000","last_change":"2023-11-17T06:29:57.030368+0000","last_active":"2023-11-17T06:29:58.063473+0000","last_peered":"2023-11-17T06:29:58.063473+0000","last_clean":"2023-11-17T06:29:58.063473+0000","last_became_active":"2023-11-17T06:29:57.028975+0000","last_became_peered":"2023-11-17T06:29:57.028975+0000","last_unstale":"2023-11-17T06:29:58.063473+0000","last_undegraded":"2023-11-17T06:29:58.063473+0000","last_fullsized":"2023-11-17T06:29:58.063473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:53.263320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063141+0000","last_change":"2023-11-17T06:29:57.049939+0000","last_active":"2023-11-17T06:29:58.063141+0000","last_peered":"2023-11-17T06:29:58.063141+0000","last_clean":"2023-11-17T06:29:58.063141+0000","last_became_active":"2023-11-17T06:29:57.049684+0000","last_became_peered":"2023-11-17T06:29:57.049684+0000","last_unstale":"2023-11-17T06:29:58.063141+0000","last_undegraded":"2023-11-17T06:29:58.063141+0000","last_fullsized":"2023-11-17T06:29:58.063141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:56.074236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017151+0000","last_change":"2023-11-17T06:29:57.024239+0000","last_active":"2023-11-17T06:29:58.017151+0000","last_peered":"2023-11-17T06:29:58.017151+0000","last_clean":"2023-11-17T06:29:58.017151+0000","last_became_active":"2023-11-17T06:29:57.023966+0000","last_became_peered":"2023-11-17T06:29:57.023966+0000","last_unstale":"2023-11-17T06:29:58.017151+0000","last_undegraded":"2023-11-17T06:29:58.017151+0000","last_fullsized":"2023-11-17T06:29:58.017151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:53:17.880921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199372+0000","last_change":"2023-11-17T06:29:57.027928+0000","last_active":"2023-11-17T06:29:58.199372+0000","last_peered":"2023-11-17T06:29:58.199372+0000","last_clean":"2023-11-17T06:29:58.199372+0000","last_became_active":"2023-11-17T06:29:57.027636+0000","last_became_peered":"2023-11-17T06:29:57.027636+0000","last_unstale":"2023-11-17T06:29:58.199372+0000","last_undegraded":"2023-11-17T06:29:58.199372+0000","last_fullsized":"2023-11-17T06:29:58.199372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:24:12.818384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565276+0000","last_change":"2023-11-17T06:29:57.031701+0000","last_active":"2023-11-17T06:29:58.565276+0000","last_peered":"2023-11-17T06:29:58.565276+0000","last_clean":"2023-11-17T06:29:58.565276+0000","last_became_active":"2023-11-17T06:29:57.031397+0000","last_became_peered":"2023-11-17T06:29:57.031397+0000","last_unstale":"2023-11-17T06:29:58.565276+0000","last_undegraded":"2023-11-17T06:29:58.565276+0000","last_fullsized":"2023-11-17T06:29:58.565276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013173+0000","last_change":"2023-11-17T06:29:57.037976+0000","last_active":"2023-11-17T06:29:58.013173+0000","last_peered":"2023-11-17T06:29:58.013173+0000","last_clean":"2023-11-17T06:29:58.013173+0000","last_became_active":"2023-11-17T06:29:57.036999+0000","last_became_peered":"2023-11-17T06:29:57.036999+0000","last_unstale":"2023-11-17T06:29:58.013173+0000","last_undegraded":"2023-11-17T06:29:58.013173+0000","last_fullsized":"2023-11-17T06:29:58.013173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:54.949043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566569+0000","last_change":"2023-11-17T06:29:57.028161+0000","last_active":"2023-11-17T06:29:58.566569+0000","last_peered":"2023-11-17T06:29:58.566569+0000","last_clean":"2023-11-17T06:29:58.566569+0000","last_became_active":"2023-11-17T06:29:57.027719+0000","last_became_peered":"2023-11-17T06:29:57.027719+0000","last_unstale":"2023-11-17T06:29:58.566569+0000","last_undegraded":"2023-11-17T06:29:58.566569+0000","last_fullsized":"2023-11-17T06:29:58.566569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017219+0000","last_change":"2023-11-17T06:29:56.148518+0000","last_active":"2023-11-17T06:29:58.017219+0000","last_peered":"2023-11-17T06:29:58.017219+0000","last_clean":"2023-11-17T06:29:58.017219+0000","last_became_active":"2023-11-17T06:29:56.148230+0000","last_became_peered":"2023-11-17T06:29:56.148230+0000","last_unstale":"2023-11-17T06:29:58.017219+0000","last_undegraded":"2023-11-17T06:29:58.017219+0000","last_fullsized":"2023-11-17T06:29:58.017219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:41:17.136054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015028+0000","last_change":"2023-11-17T06:29:57.052500+0000","last_active":"2023-11-17T06:29:58.015028+0000","last_peered":"2023-11-17T06:29:58.015028+0000","last_clean":"2023-11-17T06:29:58.015028+0000","last_became_active":"2023-11-17T06:29:57.052003+0000","last_became_peered":"2023-11-17T06:29:57.052003+0000","last_unstale":"2023-11-17T06:29:58.015028+0000","last_undegraded":"2023-11-17T06:29:58.015028+0000","last_fullsized":"2023-11-17T06:29:58.015028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:18.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199730+0000","last_change":"2023-11-17T06:29:56.155235+0000","last_active":"2023-11-17T06:29:58.199730+0000","last_peered":"2023-11-17T06:29:58.199730+0000","last_clean":"2023-11-17T06:29:58.199730+0000","last_became_active":"2023-11-17T06:29:56.154957+0000","last_became_peered":"2023-11-17T06:29:56.154957+0000","last_unstale":"2023-11-17T06:29:58.199730+0000","last_undegraded":"2023-11-17T06:29:58.199730+0000","last_fullsized":"2023-11-17T06:29:58.199730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:16.431952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062637+0000","last_change":"2023-11-17T06:29:56.156231+0000","last_active":"2023-11-17T06:29:58.062637+0000","last_peered":"2023-11-17T06:29:58.062637+0000","last_clean":"2023-11-17T06:29:58.062637+0000","last_became_active":"2023-11-17T06:29:56.155931+0000","last_became_peered":"2023-11-17T06:29:56.155931+0000","last_unstale":"2023-11-17T06:29:58.062637+0000","last_undegraded":"2023-11-17T06:29:58.062637+0000","last_fullsized":"2023-11-17T06:29:58.062637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:38.948788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016874+0000","last_change":"2023-11-17T06:29:57.033651+0000","last_active":"2023-11-17T06:29:58.016874+0000","last_peered":"2023-11-17T06:29:58.016874+0000","last_clean":"2023-11-17T06:29:58.016874+0000","last_became_active":"2023-11-17T06:29:57.030915+0000","last_became_peered":"2023-11-17T06:29:57.030915+0000","last_unstale":"2023-11-17T06:29:58.016874+0000","last_undegraded":"2023-11-17T06:29:58.016874+0000","last_fullsized":"2023-11-17T06:29:58.016874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:04:42.619958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199317+0000","last_change":"2023-11-17T06:29:56.137466+0000","last_active":"2023-11-17T06:29:58.199317+0000","last_peered":"2023-11-17T06:29:58.199317+0000","last_clean":"2023-11-17T06:29:58.199317+0000","last_became_active":"2023-11-17T06:29:56.137116+0000","last_became_peered":"2023-11-17T06:29:56.137116+0000","last_unstale":"2023-11-17T06:29:58.199317+0000","last_undegraded":"2023-11-17T06:29:58.199317+0000","last_fullsized":"2023-11-17T06:29:58.199317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:45.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016060+0000","last_change":"2023-11-17T06:29:57.029054+0000","last_active":"2023-11-17T06:29:58.016060+0000","last_peered":"2023-11-17T06:29:58.016060+0000","last_clean":"2023-11-17T06:29:58.016060+0000","last_became_active":"2023-11-17T06:29:57.028739+0000","last_became_peered":"2023-11-17T06:29:57.028739+0000","last_unstale":"2023-11-17T06:29:58.016060+0000","last_undegraded":"2023-11-17T06:29:58.016060+0000","last_fullsized":"2023-11-17T06:29:58.016060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:17.448030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567805+0000","last_change":"2023-11-17T06:29:56.145242+0000","last_active":"2023-11-17T06:29:58.567805+0000","last_peered":"2023-11-17T06:29:58.567805+0000","last_clean":"2023-11-17T06:29:58.567805+0000","last_became_active":"2023-11-17T06:29:56.144329+0000","last_became_peered":"2023-11-17T06:29:56.144329+0000","last_unstale":"2023-11-17T06:29:58.567805+0000","last_undegraded":"2023-11-17T06:29:58.567805+0000","last_fullsized":"2023-11-17T06:29:58.567805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:53.932965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014039+0000","last_change":"2023-11-17T06:29:57.036204+0000","last_active":"2023-11-17T06:29:58.014039+0000","last_peered":"2023-11-17T06:29:58.014039+0000","last_clean":"2023-11-17T06:29:58.014039+0000","last_became_active":"2023-11-17T06:29:57.035669+0000","last_became_peered":"2023-11-17T06:29:57.035669+0000","last_unstale":"2023-11-17T06:29:58.014039+0000","last_undegraded":"2023-11-17T06:29:58.014039+0000","last_fullsized":"2023-11-17T06:29:58.014039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566699+0000","last_change":"2023-11-17T06:29:56.155411+0000","last_active":"2023-11-17T06:29:58.566699+0000","last_peered":"2023-11-17T06:29:58.566699+0000","last_clean":"2023-11-17T06:29:58.566699+0000","last_became_active":"2023-11-17T06:29:56.154619+0000","last_became_peered":"2023-11-17T06:29:56.154619+0000","last_unstale":"2023-11-17T06:29:58.566699+0000","last_undegraded":"2023-11-17T06:29:58.566699+0000","last_fullsized":"2023-11-17T06:29:58.566699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:52.247242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017631+0000","last_change":"2023-11-17T06:29:57.025598+0000","last_active":"2023-11-17T06:29:58.017631+0000","last_peered":"2023-11-17T06:29:58.017631+0000","last_clean":"2023-11-17T06:29:58.017631+0000","last_became_active":"2023-11-17T06:29:57.025303+0000","last_became_peered":"2023-11-17T06:29:57.025303+0000","last_unstale":"2023-11-17T06:29:58.017631+0000","last_undegraded":"2023-11-17T06:29:58.017631+0000","last_fullsized":"2023-11-17T06:29:58.017631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:36:40.100721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565504+0000","last_change":"2023-11-17T06:29:56.149115+0000","last_active":"2023-11-17T06:29:58.565504+0000","last_peered":"2023-11-17T06:29:58.565504+0000","last_clean":"2023-11-17T06:29:58.565504+0000","last_became_active":"2023-11-17T06:29:56.147653+0000","last_became_peered":"2023-11-17T06:29:56.147653+0000","last_unstale":"2023-11-17T06:29:58.565504+0000","last_undegraded":"2023-11-17T06:29:58.565504+0000","last_fullsized":"2023-11-17T06:29:58.565504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:38:11.759914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199421+0000","last_change":"2023-11-17T06:29:57.034094+0000","last_active":"2023-11-17T06:29:58.199421+0000","last_peered":"2023-11-17T06:29:58.199421+0000","last_clean":"2023-11-17T06:29:58.199421+0000","last_became_active":"2023-11-17T06:29:57.033817+0000","last_became_peered":"2023-11-17T06:29:57.033817+0000","last_unstale":"2023-11-17T06:29:58.199421+0000","last_undegraded":"2023-11-17T06:29:58.199421+0000","last_fullsized":"2023-11-17T06:29:58.199421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:30:22.132748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013489+0000","last_change":"2023-11-17T06:29:56.143656+0000","last_active":"2023-11-17T06:29:58.013489+0000","last_peered":"2023-11-17T06:29:58.013489+0000","last_clean":"2023-11-17T06:29:58.013489+0000","last_became_active":"2023-11-17T06:29:56.140088+0000","last_became_peered":"2023-11-17T06:29:56.140088+0000","last_unstale":"2023-11-17T06:29:58.013489+0000","last_undegraded":"2023-11-17T06:29:58.013489+0000","last_fullsized":"2023-11-17T06:29:58.013489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:38:11.759914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567240+0000","last_change":"2023-11-17T06:29:57.051158+0000","last_active":"2023-11-17T06:29:58.567240+0000","last_peered":"2023-11-17T06:29:58.567240+0000","last_clean":"2023-11-17T06:29:58.567240+0000","last_became_active":"2023-11-17T06:29:57.049255+0000","last_became_peered":"2023-11-17T06:29:57.049255+0000","last_unstale":"2023-11-17T06:29:58.567240+0000","last_undegraded":"2023-11-17T06:29:58.567240+0000","last_fullsized":"2023-11-17T06:29:58.567240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:08:15.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565414+0000","last_change":"2023-11-17T06:29:56.154434+0000","last_active":"2023-11-17T06:29:58.565414+0000","last_peered":"2023-11-17T06:29:58.565414+0000","last_clean":"2023-11-17T06:29:58.565414+0000","last_became_active":"2023-11-17T06:29:56.154071+0000","last_became_peered":"2023-11-17T06:29:56.154071+0000","last_unstale":"2023-11-17T06:29:58.565414+0000","last_undegraded":"2023-11-17T06:29:58.565414+0000","last_fullsized":"2023-11-17T06:29:58.565414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:35:22.859890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062922+0000","last_change":"2023-11-17T06:29:57.028693+0000","last_active":"2023-11-17T06:29:58.062922+0000","last_peered":"2023-11-17T06:29:58.062922+0000","last_clean":"2023-11-17T06:29:58.062922+0000","last_became_active":"2023-11-17T06:29:57.027326+0000","last_became_peered":"2023-11-17T06:29:57.027326+0000","last_unstale":"2023-11-17T06:29:58.062922+0000","last_undegraded":"2023-11-17T06:29:58.062922+0000","last_fullsized":"2023-11-17T06:29:58.062922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:33.609630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199813+0000","last_change":"2023-11-17T06:29:56.145651+0000","last_active":"2023-11-17T06:29:58.199813+0000","last_peered":"2023-11-17T06:29:58.199813+0000","last_clean":"2023-11-17T06:29:58.199813+0000","last_became_active":"2023-11-17T06:29:56.145385+0000","last_became_peered":"2023-11-17T06:29:56.145385+0000","last_unstale":"2023-11-17T06:29:58.199813+0000","last_undegraded":"2023-11-17T06:29:58.199813+0000","last_fullsized":"2023-11-17T06:29:58.199813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:36:14.052058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200161+0000","last_change":"2023-11-17T06:29:57.053050+0000","last_active":"2023-11-17T06:29:58.200161+0000","last_peered":"2023-11-17T06:29:58.200161+0000","last_clean":"2023-11-17T06:29:58.200161+0000","last_became_active":"2023-11-17T06:29:57.052675+0000","last_became_peered":"2023-11-17T06:29:57.052675+0000","last_unstale":"2023-11-17T06:29:58.200161+0000","last_undegraded":"2023-11-17T06:29:58.200161+0000","last_fullsized":"2023-11-17T06:29:58.200161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:38:38.807009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565388+0000","last_change":"2023-11-17T06:29:56.153805+0000","last_active":"2023-11-17T06:29:58.565388+0000","last_peered":"2023-11-17T06:29:58.565388+0000","last_clean":"2023-11-17T06:29:58.565388+0000","last_became_active":"2023-11-17T06:29:56.153075+0000","last_became_peered":"2023-11-17T06:29:56.153075+0000","last_unstale":"2023-11-17T06:29:58.565388+0000","last_undegraded":"2023-11-17T06:29:58.565388+0000","last_fullsized":"2023-11-17T06:29:58.565388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:27.409831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565490+0000","last_change":"2023-11-17T06:29:57.035110+0000","last_active":"2023-11-17T06:29:58.565490+0000","last_peered":"2023-11-17T06:29:58.565490+0000","last_clean":"2023-11-17T06:29:58.565490+0000","last_became_active":"2023-11-17T06:29:57.034811+0000","last_became_peered":"2023-11-17T06:29:57.034811+0000","last_unstale":"2023-11-17T06:29:58.565490+0000","last_undegraded":"2023-11-17T06:29:58.565490+0000","last_fullsized":"2023-11-17T06:29:58.565490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014497+0000","last_change":"2023-11-17T06:29:56.144056+0000","last_active":"2023-11-17T06:29:58.014497+0000","last_peered":"2023-11-17T06:29:58.014497+0000","last_clean":"2023-11-17T06:29:58.014497+0000","last_became_active":"2023-11-17T06:29:56.143742+0000","last_became_peered":"2023-11-17T06:29:56.143742+0000","last_unstale":"2023-11-17T06:29:58.014497+0000","last_undegraded":"2023-11-17T06:29:58.014497+0000","last_fullsized":"2023-11-17T06:29:58.014497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:35.694108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199521+0000","last_change":"2023-11-17T06:29:57.036273+0000","last_active":"2023-11-17T06:29:58.199521+0000","last_peered":"2023-11-17T06:29:58.199521+0000","last_clean":"2023-11-17T06:29:58.199521+0000","last_became_active":"2023-11-17T06:29:57.036003+0000","last_became_peered":"2023-11-17T06:29:57.036003+0000","last_unstale":"2023-11-17T06:29:58.199521+0000","last_undegraded":"2023-11-17T06:29:58.199521+0000","last_fullsized":"2023-11-17T06:29:58.199521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:01:56.186044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567381+0000","last_change":"2023-11-17T06:29:56.153641+0000","last_active":"2023-11-17T06:29:58.567381+0000","last_peered":"2023-11-17T06:29:58.567381+0000","last_clean":"2023-11-17T06:29:58.567381+0000","last_became_active":"2023-11-17T06:29:56.153177+0000","last_became_peered":"2023-11-17T06:29:56.153177+0000","last_unstale":"2023-11-17T06:29:58.567381+0000","last_undegraded":"2023-11-17T06:29:58.567381+0000","last_fullsized":"2023-11-17T06:29:58.567381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:55.058158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014195+0000","last_change":"2023-11-17T06:29:57.053038+0000","last_active":"2023-11-17T06:29:58.014195+0000","last_peered":"2023-11-17T06:29:58.014195+0000","last_clean":"2023-11-17T06:29:58.014195+0000","last_became_active":"2023-11-17T06:29:57.052719+0000","last_became_peered":"2023-11-17T06:29:57.052719+0000","last_unstale":"2023-11-17T06:29:58.014195+0000","last_undegraded":"2023-11-17T06:29:58.014195+0000","last_fullsized":"2023-11-17T06:29:58.014195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:46.928281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015589+0000","last_change":"2023-11-17T06:29:56.151539+0000","last_active":"2023-11-17T06:29:58.015589+0000","last_peered":"2023-11-17T06:29:58.015589+0000","last_clean":"2023-11-17T06:29:58.015589+0000","last_became_active":"2023-11-17T06:29:56.151254+0000","last_became_peered":"2023-11-17T06:29:56.151254+0000","last_unstale":"2023-11-17T06:29:58.015589+0000","last_undegraded":"2023-11-17T06:29:58.015589+0000","last_fullsized":"2023-11-17T06:29:58.015589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:10.132222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567142+0000","last_change":"2023-11-17T06:29:57.050538+0000","last_active":"2023-11-17T06:29:58.567142+0000","last_peered":"2023-11-17T06:29:58.567142+0000","last_clean":"2023-11-17T06:29:58.567142+0000","last_became_active":"2023-11-17T06:29:57.048902+0000","last_became_peered":"2023-11-17T06:29:57.048902+0000","last_unstale":"2023-11-17T06:29:58.567142+0000","last_undegraded":"2023-11-17T06:29:58.567142+0000","last_fullsized":"2023-11-17T06:29:58.567142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:24:54.358531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017259+0000","last_change":"2023-11-17T06:29:56.149833+0000","last_active":"2023-11-17T06:29:58.017259+0000","last_peered":"2023-11-17T06:29:58.017259+0000","last_clean":"2023-11-17T06:29:58.017259+0000","last_became_active":"2023-11-17T06:29:56.149492+0000","last_became_peered":"2023-11-17T06:29:56.149492+0000","last_unstale":"2023-11-17T06:29:58.017259+0000","last_undegraded":"2023-11-17T06:29:58.017259+0000","last_fullsized":"2023-11-17T06:29:58.017259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:14:19.896244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567068+0000","last_change":"2023-11-17T06:29:57.040669+0000","last_active":"2023-11-17T06:29:58.567068+0000","last_peered":"2023-11-17T06:29:58.567068+0000","last_clean":"2023-11-17T06:29:58.567068+0000","last_became_active":"2023-11-17T06:29:57.040042+0000","last_became_peered":"2023-11-17T06:29:57.040042+0000","last_unstale":"2023-11-17T06:29:58.567068+0000","last_undegraded":"2023-11-17T06:29:58.567068+0000","last_fullsized":"2023-11-17T06:29:58.567068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:44:58.041380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063361+0000","last_change":"2023-11-17T06:29:56.157174+0000","last_active":"2023-11-17T06:29:58.063361+0000","last_peered":"2023-11-17T06:29:58.063361+0000","last_clean":"2023-11-17T06:29:58.063361+0000","last_became_active":"2023-11-17T06:29:56.156944+0000","last_became_peered":"2023-11-17T06:29:56.156944+0000","last_unstale":"2023-11-17T06:29:58.063361+0000","last_undegraded":"2023-11-17T06:29:58.063361+0000","last_fullsized":"2023-11-17T06:29:58.063361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:35.694108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200093+0000","last_change":"2023-11-17T06:29:57.020240+0000","last_active":"2023-11-17T06:29:58.200093+0000","last_peered":"2023-11-17T06:29:58.200093+0000","last_clean":"2023-11-17T06:29:58.200093+0000","last_became_active":"2023-11-17T06:29:57.019851+0000","last_became_peered":"2023-11-17T06:29:57.019851+0000","last_unstale":"2023-11-17T06:29:58.200093+0000","last_undegraded":"2023-11-17T06:29:58.200093+0000","last_fullsized":"2023-11-17T06:29:58.200093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:08:16.650719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:57.021221+0000","last_change":"2023-11-17T06:29:48.031659+0000","last_active":"2023-11-17T06:29:57.021221+0000","last_peered":"2023-11-17T06:29:57.021221+0000","last_clean":"2023-11-17T06:29:57.021221+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:29:57.021221+0000","last_undegraded":"2023-11-17T06:29:57.021221+0000","last_fullsized":"2023-11-17T06:29:57.021221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_clean_scrub_stamp":"2023-11-17T06:29:47.005420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:11:29.801860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200114+0000","last_change":"2023-11-17T06:29:56.148120+0000","last_active":"2023-11-17T06:29:58.200114+0000","last_peered":"2023-11-17T06:29:58.200114+0000","last_clean":"2023-11-17T06:29:58.200114+0000","last_became_active":"2023-11-17T06:29:56.147781+0000","last_became_peered":"2023-11-17T06:29:56.147781+0000","last_unstale":"2023-11-17T06:29:58.200114+0000","last_undegraded":"2023-11-17T06:29:58.200114+0000","last_fullsized":"2023-11-17T06:29:58.200114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:24.556455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015195+0000","last_change":"2023-11-17T06:29:57.037133+0000","last_active":"2023-11-17T06:29:58.015195+0000","last_peered":"2023-11-17T06:29:58.015195+0000","last_clean":"2023-11-17T06:29:58.015195+0000","last_became_active":"2023-11-17T06:29:57.036216+0000","last_became_peered":"2023-11-17T06:29:57.036216+0000","last_unstale":"2023-11-17T06:29:58.015195+0000","last_undegraded":"2023-11-17T06:29:58.015195+0000","last_fullsized":"2023-11-17T06:29:58.015195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:53.263320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199454+0000","last_change":"2023-11-17T06:29:56.147063+0000","last_active":"2023-11-17T06:29:58.199454+0000","last_peered":"2023-11-17T06:29:58.199454+0000","last_clean":"2023-11-17T06:29:58.199454+0000","last_became_active":"2023-11-17T06:29:56.146762+0000","last_became_peered":"2023-11-17T06:29:56.146762+0000","last_unstale":"2023-11-17T06:29:58.199454+0000","last_undegraded":"2023-11-17T06:29:58.199454+0000","last_fullsized":"2023-11-17T06:29:58.199454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:32.593552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062691+0000","last_change":"2023-11-17T06:29:57.037884+0000","last_active":"2023-11-17T06:29:58.062691+0000","last_peered":"2023-11-17T06:29:58.062691+0000","last_clean":"2023-11-17T06:29:58.062691+0000","last_became_active":"2023-11-17T06:29:57.037620+0000","last_became_peered":"2023-11-17T06:29:57.037620+0000","last_unstale":"2023-11-17T06:29:58.062691+0000","last_undegraded":"2023-11-17T06:29:58.062691+0000","last_fullsized":"2023-11-17T06:29:58.062691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565109+0000","last_change":"2023-11-17T06:29:56.147310+0000","last_active":"2023-11-17T06:29:58.565109+0000","last_peered":"2023-11-17T06:29:58.565109+0000","last_clean":"2023-11-17T06:29:58.565109+0000","last_became_active":"2023-11-17T06:29:56.146894+0000","last_became_peered":"2023-11-17T06:29:56.146894+0000","last_unstale":"2023-11-17T06:29:58.565109+0000","last_undegraded":"2023-11-17T06:29:58.565109+0000","last_fullsized":"2023-11-17T06:29:58.565109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:09:09.862678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016713+0000","last_change":"2023-11-17T06:29:57.024088+0000","last_active":"2023-11-17T06:29:58.016713+0000","last_peered":"2023-11-17T06:29:58.016713+0000","last_clean":"2023-11-17T06:29:58.016713+0000","last_became_active":"2023-11-17T06:29:57.023805+0000","last_became_peered":"2023-11-17T06:29:57.023805+0000","last_unstale":"2023-11-17T06:29:58.016713+0000","last_undegraded":"2023-11-17T06:29:58.016713+0000","last_fullsized":"2023-11-17T06:29:58.016713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:25:07.897379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200019+0000","last_change":"2023-11-17T06:29:56.143041+0000","last_active":"2023-11-17T06:29:58.200019+0000","last_peered":"2023-11-17T06:29:58.200019+0000","last_clean":"2023-11-17T06:29:58.200019+0000","last_became_active":"2023-11-17T06:29:56.142647+0000","last_became_peered":"2023-11-17T06:29:56.142647+0000","last_unstale":"2023-11-17T06:29:58.200019+0000","last_undegraded":"2023-11-17T06:29:58.200019+0000","last_fullsized":"2023-11-17T06:29:58.200019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:56:51.565071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566104+0000","last_change":"2023-11-17T06:29:57.049541+0000","last_active":"2023-11-17T06:29:58.566104+0000","last_peered":"2023-11-17T06:29:58.566104+0000","last_clean":"2023-11-17T06:29:58.566104+0000","last_became_active":"2023-11-17T06:29:57.049268+0000","last_became_peered":"2023-11-17T06:29:57.049268+0000","last_unstale":"2023-11-17T06:29:58.566104+0000","last_undegraded":"2023-11-17T06:29:58.566104+0000","last_fullsized":"2023-11-17T06:29:58.566104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:56:52.581149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017143+0000","last_change":"2023-11-17T06:29:56.147186+0000","last_active":"2023-11-17T06:29:58.017143+0000","last_peered":"2023-11-17T06:29:58.017143+0000","last_clean":"2023-11-17T06:29:58.017143+0000","last_became_active":"2023-11-17T06:29:56.146837+0000","last_became_peered":"2023-11-17T06:29:56.146837+0000","last_unstale":"2023-11-17T06:29:58.017143+0000","last_undegraded":"2023-11-17T06:29:58.017143+0000","last_fullsized":"2023-11-17T06:29:58.017143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:52:20.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013443+0000","last_change":"2023-11-17T06:29:57.041411+0000","last_active":"2023-11-17T06:29:58.013443+0000","last_peered":"2023-11-17T06:29:58.013443+0000","last_clean":"2023-11-17T06:29:58.013443+0000","last_became_active":"2023-11-17T06:29:57.041080+0000","last_became_peered":"2023-11-17T06:29:57.041080+0000","last_unstale":"2023-11-17T06:29:58.013443+0000","last_undegraded":"2023-11-17T06:29:58.013443+0000","last_fullsized":"2023-11-17T06:29:58.013443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200289+0000","last_change":"2023-11-17T06:29:56.143922+0000","last_active":"2023-11-17T06:29:58.200289+0000","last_peered":"2023-11-17T06:29:58.200289+0000","last_clean":"2023-11-17T06:29:58.200289+0000","last_became_active":"2023-11-17T06:29:56.143475+0000","last_became_peered":"2023-11-17T06:29:56.143475+0000","last_unstale":"2023-11-17T06:29:58.200289+0000","last_undegraded":"2023-11-17T06:29:58.200289+0000","last_fullsized":"2023-11-17T06:29:58.200289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:00:32.599388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063284+0000","last_change":"2023-11-17T06:29:57.029861+0000","last_active":"2023-11-17T06:29:58.063284+0000","last_peered":"2023-11-17T06:29:58.063284+0000","last_clean":"2023-11-17T06:29:58.063284+0000","last_became_active":"2023-11-17T06:29:57.029360+0000","last_became_peered":"2023-11-17T06:29:57.029360+0000","last_unstale":"2023-11-17T06:29:58.063284+0000","last_undegraded":"2023-11-17T06:29:58.063284+0000","last_fullsized":"2023-11-17T06:29:58.063284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:18.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:30:00.062658+0000","last_change":"2023-11-17T06:29:56.152922+0000","last_active":"2023-11-17T06:30:00.062658+0000","last_peered":"2023-11-17T06:30:00.062658+0000","last_clean":"2023-11-17T06:30:00.062658+0000","last_became_active":"2023-11-17T06:29:56.152632+0000","last_became_peered":"2023-11-17T06:29:56.152632+0000","last_unstale":"2023-11-17T06:30:00.062658+0000","last_undegraded":"2023-11-17T06:30:00.062658+0000","last_fullsized":"2023-11-17T06:30:00.062658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:32.593552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015562+0000","last_change":"2023-11-17T06:29:57.036541+0000","last_active":"2023-11-17T06:29:58.015562+0000","last_peered":"2023-11-17T06:29:58.015562+0000","last_clean":"2023-11-17T06:29:58.015562+0000","last_became_active":"2023-11-17T06:29:57.034954+0000","last_became_peered":"2023-11-17T06:29:57.034954+0000","last_unstale":"2023-11-17T06:29:58.015562+0000","last_undegraded":"2023-11-17T06:29:58.015562+0000","last_fullsized":"2023-11-17T06:29:58.015562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:13:22.110656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200289+0000","last_change":"2023-11-17T06:29:56.156668+0000","last_active":"2023-11-17T06:29:58.200289+0000","last_peered":"2023-11-17T06:29:58.200289+0000","last_clean":"2023-11-17T06:29:58.200289+0000","last_became_active":"2023-11-17T06:29:56.155662+0000","last_became_peered":"2023-11-17T06:29:56.155662+0000","last_unstale":"2023-11-17T06:29:58.200289+0000","last_undegraded":"2023-11-17T06:29:58.200289+0000","last_fullsized":"2023-11-17T06:29:58.200289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:56:30.930517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015394+0000","last_change":"2023-11-17T06:29:57.034365+0000","last_active":"2023-11-17T06:29:58.015394+0000","last_peered":"2023-11-17T06:29:58.015394+0000","last_clean":"2023-11-17T06:29:58.015394+0000","last_became_active":"2023-11-17T06:29:57.034154+0000","last_became_peered":"2023-11-17T06:29:57.034154+0000","last_unstale":"2023-11-17T06:29:58.015394+0000","last_undegraded":"2023-11-17T06:29:58.015394+0000","last_fullsized":"2023-11-17T06:29:58.015394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:31:15.968761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565274+0000","last_change":"2023-11-17T06:29:56.153356+0000","last_active":"2023-11-17T06:29:58.565274+0000","last_peered":"2023-11-17T06:29:58.565274+0000","last_clean":"2023-11-17T06:29:58.565274+0000","last_became_active":"2023-11-17T06:29:56.153004+0000","last_became_peered":"2023-11-17T06:29:56.153004+0000","last_unstale":"2023-11-17T06:29:58.565274+0000","last_undegraded":"2023-11-17T06:29:58.565274+0000","last_fullsized":"2023-11-17T06:29:58.565274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:17.338010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199179+0000","last_change":"2023-11-17T06:29:57.029538+0000","last_active":"2023-11-17T06:29:58.199179+0000","last_peered":"2023-11-17T06:29:58.199179+0000","last_clean":"2023-11-17T06:29:58.199179+0000","last_became_active":"2023-11-17T06:29:57.029210+0000","last_became_peered":"2023-11-17T06:29:57.029210+0000","last_unstale":"2023-11-17T06:29:58.199179+0000","last_undegraded":"2023-11-17T06:29:58.199179+0000","last_fullsized":"2023-11-17T06:29:58.199179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:24:54.358531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014921+0000","last_change":"2023-11-17T06:29:56.154270+0000","last_active":"2023-11-17T06:29:58.014921+0000","last_peered":"2023-11-17T06:29:58.014921+0000","last_clean":"2023-11-17T06:29:58.014921+0000","last_became_active":"2023-11-17T06:29:56.153931+0000","last_became_peered":"2023-11-17T06:29:56.153931+0000","last_unstale":"2023-11-17T06:29:58.014921+0000","last_undegraded":"2023-11-17T06:29:58.014921+0000","last_fullsized":"2023-11-17T06:29:58.014921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:27.409831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014523+0000","last_change":"2023-11-17T06:29:57.023492+0000","last_active":"2023-11-17T06:29:58.014523+0000","last_peered":"2023-11-17T06:29:58.014523+0000","last_clean":"2023-11-17T06:29:58.014523+0000","last_became_active":"2023-11-17T06:29:57.023199+0000","last_became_peered":"2023-11-17T06:29:57.023199+0000","last_unstale":"2023-11-17T06:29:58.014523+0000","last_undegraded":"2023-11-17T06:29:58.014523+0000","last_fullsized":"2023-11-17T06:29:58.014523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:25.572533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063127+0000","last_change":"2023-11-17T06:29:56.151644+0000","last_active":"2023-11-17T06:29:58.063127+0000","last_peered":"2023-11-17T06:29:58.063127+0000","last_clean":"2023-11-17T06:29:58.063127+0000","last_became_active":"2023-11-17T06:29:56.151334+0000","last_became_peered":"2023-11-17T06:29:56.151334+0000","last_unstale":"2023-11-17T06:29:58.063127+0000","last_undegraded":"2023-11-17T06:29:58.063127+0000","last_fullsized":"2023-11-17T06:29:58.063127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:50.793814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565539+0000","last_change":"2023-11-17T06:29:57.030102+0000","last_active":"2023-11-17T06:29:58.565539+0000","last_peered":"2023-11-17T06:29:58.565539+0000","last_clean":"2023-11-17T06:29:58.565539+0000","last_became_active":"2023-11-17T06:29:57.028292+0000","last_became_peered":"2023-11-17T06:29:57.028292+0000","last_unstale":"2023-11-17T06:29:58.565539+0000","last_undegraded":"2023-11-17T06:29:58.565539+0000","last_fullsized":"2023-11-17T06:29:58.565539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199917+0000","last_change":"2023-11-17T06:29:56.147463+0000","last_active":"2023-11-17T06:29:58.199917+0000","last_peered":"2023-11-17T06:29:58.199917+0000","last_clean":"2023-11-17T06:29:58.199917+0000","last_became_active":"2023-11-17T06:29:56.147172+0000","last_became_peered":"2023-11-17T06:29:56.147172+0000","last_unstale":"2023-11-17T06:29:58.199917+0000","last_undegraded":"2023-11-17T06:29:58.199917+0000","last_fullsized":"2023-11-17T06:29:58.199917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:31:14.952683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199574+0000","last_change":"2023-11-17T06:29:57.030874+0000","last_active":"2023-11-17T06:29:58.199574+0000","last_peered":"2023-11-17T06:29:58.199574+0000","last_clean":"2023-11-17T06:29:58.199574+0000","last_became_active":"2023-11-17T06:29:57.030602+0000","last_became_peered":"2023-11-17T06:29:57.030602+0000","last_unstale":"2023-11-17T06:29:58.199574+0000","last_undegraded":"2023-11-17T06:29:58.199574+0000","last_fullsized":"2023-11-17T06:29:58.199574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:40:17.803427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199948+0000","last_change":"2023-11-17T06:29:57.050840+0000","last_active":"2023-11-17T06:29:58.199948+0000","last_peered":"2023-11-17T06:29:58.199948+0000","last_clean":"2023-11-17T06:29:58.199948+0000","last_became_active":"2023-11-17T06:29:57.050346+0000","last_became_peered":"2023-11-17T06:29:57.050346+0000","last_unstale":"2023-11-17T06:29:58.199948+0000","last_undegraded":"2023-11-17T06:29:58.199948+0000","last_fullsized":"2023-11-17T06:29:58.199948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:25:35.354706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567223+0000","last_change":"2023-11-17T06:29:56.153913+0000","last_active":"2023-11-17T06:29:58.567223+0000","last_peered":"2023-11-17T06:29:58.567223+0000","last_clean":"2023-11-17T06:29:58.567223+0000","last_became_active":"2023-11-17T06:29:56.153474+0000","last_became_peered":"2023-11-17T06:29:56.153474+0000","last_unstale":"2023-11-17T06:29:58.567223+0000","last_undegraded":"2023-11-17T06:29:58.567223+0000","last_fullsized":"2023-11-17T06:29:58.567223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:53.932965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567084+0000","last_change":"2023-11-17T06:29:57.041986+0000","last_active":"2023-11-17T06:29:58.567084+0000","last_peered":"2023-11-17T06:29:58.567084+0000","last_clean":"2023-11-17T06:29:58.567084+0000","last_became_active":"2023-11-17T06:29:57.041251+0000","last_became_peered":"2023-11-17T06:29:57.041251+0000","last_unstale":"2023-11-17T06:29:58.567084+0000","last_undegraded":"2023-11-17T06:29:58.567084+0000","last_fullsized":"2023-11-17T06:29:58.567084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:28.425909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567460+0000","last_change":"2023-11-17T06:29:56.155103+0000","last_active":"2023-11-17T06:29:58.567460+0000","last_peered":"2023-11-17T06:29:58.567460+0000","last_clean":"2023-11-17T06:29:58.567460+0000","last_became_active":"2023-11-17T06:29:56.154824+0000","last_became_peered":"2023-11-17T06:29:56.154824+0000","last_unstale":"2023-11-17T06:29:58.567460+0000","last_undegraded":"2023-11-17T06:29:58.567460+0000","last_fullsized":"2023-11-17T06:29:58.567460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:13:21.094578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017560+0000","last_change":"2023-11-17T06:29:57.028924+0000","last_active":"2023-11-17T06:29:58.017560+0000","last_peered":"2023-11-17T06:29:58.017560+0000","last_clean":"2023-11-17T06:29:58.017560+0000","last_became_active":"2023-11-17T06:29:57.028381+0000","last_became_peered":"2023-11-17T06:29:57.028381+0000","last_unstale":"2023-11-17T06:29:58.017560+0000","last_undegraded":"2023-11-17T06:29:58.017560+0000","last_fullsized":"2023-11-17T06:29:58.017560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:16:29.542871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017697+0000","last_change":"2023-11-17T06:29:56.147117+0000","last_active":"2023-11-17T06:29:58.017697+0000","last_peered":"2023-11-17T06:29:58.017697+0000","last_clean":"2023-11-17T06:29:58.017697+0000","last_became_active":"2023-11-17T06:29:56.146805+0000","last_became_peered":"2023-11-17T06:29:56.146805+0000","last_unstale":"2023-11-17T06:29:58.017697+0000","last_undegraded":"2023-11-17T06:29:58.017697+0000","last_fullsized":"2023-11-17T06:29:58.017697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:24:37.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017661+0000","last_change":"2023-11-17T06:29:57.046219+0000","last_active":"2023-11-17T06:29:58.017661+0000","last_peered":"2023-11-17T06:29:58.017661+0000","last_clean":"2023-11-17T06:29:58.017661+0000","last_became_active":"2023-11-17T06:29:57.045949+0000","last_became_peered":"2023-11-17T06:29:57.045949+0000","last_unstale":"2023-11-17T06:29:58.017661+0000","last_undegraded":"2023-11-17T06:29:58.017661+0000","last_fullsized":"2023-11-17T06:29:58.017661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:31:49.682905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015780+0000","last_change":"2023-11-17T06:29:56.141229+0000","last_active":"2023-11-17T06:29:58.015780+0000","last_peered":"2023-11-17T06:29:58.015780+0000","last_clean":"2023-11-17T06:29:58.015780+0000","last_became_active":"2023-11-17T06:29:56.140850+0000","last_became_peered":"2023-11-17T06:29:56.140850+0000","last_unstale":"2023-11-17T06:29:58.015780+0000","last_undegraded":"2023-11-17T06:29:58.015780+0000","last_fullsized":"2023-11-17T06:29:58.015780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:45.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5349999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":80911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.726}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":83195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2990000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.696}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7330000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1789999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4480000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.593}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2530000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4180000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.149}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6849999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":80967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":671371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:30:06.446 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:30:06.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.644+0000 7ff0cf08f700 1 Processor -- start 2023-11-17T06:30:06.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.644+0000 7ff0cf08f700 1 -- start start 2023-11-17T06:30:06.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0cf08f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0c80cb020 0x7ff0c815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0cf08f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c80b09e0 con 0x7ff0c80cb400 2023-11-17T06:30:06.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0cf08f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c80b0cc0 con 0x7ff0c80cba80 2023-11-17T06:30:06.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0cf08f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c815fd90 con 0x7ff0c80cb020 2023-11-17T06:30:06.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c7fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ff0c80cb400 0x7ff0c806fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59164/0 (socket says 172.21.15.69:59164) 2023-11-17T06:30:06.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c7fff700 1 -- 172.21.15.69:0/3764073498 learned_addr learned my addr 172.21.15.69:0/3764073498 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:06.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0cce2b700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0c80cb020 0x7ff0c815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633479246 0 0) 0x7ff0c80b09e0 con 0x7ff0c80cb400 2023-11-17T06:30:06.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0b80035d0 con 0x7ff0c80cb400 2023-11-17T06:30:06.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 60560613 0 0) 0x7ff0b80035d0 con 0x7ff0c80cb400 2023-11-17T06:30:06.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0c80cb020 msgr2=0x7ff0c815ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:06.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c77fe700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0c80cb020 0x7ff0c815ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 >> v1:172.21.15.93:6789/0 conn(0x7ff0c80cba80 legacy=0x7ff0c81519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c80b0fa0 con 0x7ff0c80cb400 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7ff0b4001670 con 0x7ff0c80cb400 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.648+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 >> v1:172.21.15.69:6789/0 conn(0x7ff0c80cb400 legacy=0x7ff0c806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c77fe700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0c80cb020 0x7ff0b8003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c77fe700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0b8003f90 0x7ff0b8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c77fe700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0b8004db0 0x7ff0b8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c815fd90 con 0x7ff0b8004db0 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b800bb70 con 0x7ff0b8003f90 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b800bd30 con 0x7ff0c80cb020 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cd62c700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0b8004db0 0x7ff0b8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cce2b700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0c80cb020 0x7ff0b8003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c7fff700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0b8003f90 0x7ff0b8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cd62c700 1 -- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0c80cb020 msgr2=0x7ff0b8003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:06.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cd62c700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0c80cb020 0x7ff0b8003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cd62c700 1 -- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0b8003f90 msgr2=0x7ff0b8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:06.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cd62c700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0b8003f90 0x7ff0b8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cd62c700 1 -- 172.21.15.69:0/3764073498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0b80035d0 con 0x7ff0b8004db0 2023-11-17T06:30:06.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c7fff700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0b8003f90 0x7ff0b8004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:06.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cd62c700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0b8004db0 0x7ff0b8005230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000c290 tx=0x7ff0b80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82747d32d1bf5974 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0001e70 con 0x7ff0b8004db0 2023-11-17T06:30:06.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c000ce50 con 0x7ff0b8004db0 2023-11-17T06:30:06.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0c77fe700 1 -- 172.21.15.69:0/3764073498 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0012660 con 0x7ff0b8004db0 2023-11-17T06:30:06.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cf08f700 1 -- 172.21.15.69:0/3764073498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0b8004db0 msgr2=0x7ff0b8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cf08f700 1 --2- 172.21.15.69:0/3764073498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0b8004db0 0x7ff0b8005230 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff0c000c290 tx=0x7ff0b80058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cd62c700 1 -- 172.21.15.69:0/3764073498 reap_dead start 2023-11-17T06:30:06.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cf08f700 1 -- 172.21.15.69:0/3764073498 shutdown_connections 2023-11-17T06:30:06.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cf08f700 1 -- 172.21.15.69:0/3764073498 >> 172.21.15.69:0/3764073498 conn(0x7ff0c806a480 msgr2=0x7ff0c806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:06.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cf08f700 1 -- 172.21.15.69:0/3764073498 shutdown_connections 2023-11-17T06:30:06.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.652+0000 7ff0cf08f700 1 -- 172.21.15.69:0/3764073498 wait complete. 2023-11-17T06:30:06.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.656+0000 7ff0cf08f700 1 Processor -- start 2023-11-17T06:30:06.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.656+0000 7ff0cf08f700 1 -- start start 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.656+0000 7ff0cf08f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0b8004db0 0x7ff0c81583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.656+0000 7ff0cf08f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0c8155e50 0x7ff0c81f2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cf08f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0c80b18c0 0x7ff0c80cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cf08f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c80b1660 con 0x7ff0c80b18c0 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cf08f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c814fb30 con 0x7ff0c8155e50 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cf08f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c8159640 con 0x7ff0b8004db0 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cd62c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0c80b18c0 0x7ff0c80cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cd62c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0c80b18c0 0x7ff0c80cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48094/0 (socket says 172.21.15.69:48094) 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cd62c700 1 -- 172.21.15.69:0/2612305635 learned_addr learned my addr 172.21.15.69:0/2612305635 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cd62c700 1 -- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0b8004db0 msgr2=0x7ff0c81583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cce2b700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0b8004db0 0x7ff0c81583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0c7fff700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0c8155e50 0x7ff0c81f2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cd62c700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0b8004db0 0x7ff0c81583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cd62c700 1 -- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0c8155e50 msgr2=0x7ff0c81f2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cd62c700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0c8155e50 0x7ff0c81f2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cd62c700 1 -- 172.21.15.69:0/2612305635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c80b1d40 con 0x7ff0c80b18c0 2023-11-17T06:30:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cce2b700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0b8004db0 0x7ff0c81583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cd62c700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0c80b18c0 0x7ff0c80cd9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0013000 tx=0x7ff0c00015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0c57fa700 1 -- 172.21.15.69:0/2612305635 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00052c0 con 0x7ff0c80b18c0 2023-11-17T06:30:06.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0c57fa700 1 -- 172.21.15.69:0/2612305635 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c0005420 con 0x7ff0c80b18c0 2023-11-17T06:30:06.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cf08f700 1 -- 172.21.15.69:0/2612305635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c8158a30 con 0x7ff0c80b18c0 2023-11-17T06:30:06.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0c57fa700 1 -- 172.21.15.69:0/2612305635 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c00057d0 con 0x7ff0c80b18c0 2023-11-17T06:30:06.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cf08f700 1 -- 172.21.15.69:0/2612305635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c8158ff0 con 0x7ff0c80b18c0 2023-11-17T06:30:06.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.660+0000 7ff0cf08f700 1 -- 172.21.15.69:0/2612305635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c8073f00 con 0x7ff0c80b18c0 2023-11-17T06:30:06.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.664+0000 7ff0c57fa700 1 -- 172.21.15.69:0/2612305635 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff0c0023070 con 0x7ff0c80b18c0 2023-11-17T06:30:06.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.664+0000 7ff0c57fa700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff0ac066540 0x7ff0ac068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:06.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.664+0000 7ff0c57fa700 1 -- 172.21.15.69:0/2612305635 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0c0085790 con 0x7ff0c80b18c0 2023-11-17T06:30:06.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.664+0000 7ff0cce2b700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff0ac066540 0x7ff0ac068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:06.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.668+0000 7ff0cce2b700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff0ac066540 0x7ff0ac068a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009ab0 tx=0x7ff0bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:06.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.672+0000 7ff0c57fa700 1 -- 172.21.15.69:0/2612305635 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff0c0052c00 con 0x7ff0c80b18c0 2023-11-17T06:30:06.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.828+0000 7ff0cf08f700 1 -- 172.21.15.69:0/2612305635 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0c80704b0 con 0x7ff0ac066540 2023-11-17T06:30:06.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.844+0000 7ff0c57fa700 1 -- 172.21.15.69:0/2612305635 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264387 (secure 0 0 0) 0x7ff0bc0127c0 con 0x7ff0ac066540 2023-11-17T06:30:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:06.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 -- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff0ac066540 msgr2=0x7ff0ac068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff0ac066540 0x7ff0ac068a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff0bc009ab0 tx=0x7ff0bc008040 comp rx=0 tx=0).stop 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 -- 172.21.15.69:0/2612305635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0c80b18c0 msgr2=0x7ff0c80cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0c80b18c0 0x7ff0c80cd9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0013000 tx=0x7ff0c00015b0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 -- 172.21.15.69:0/2612305635 shutdown_connections 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff0ac066540 0x7ff0ac068a00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0c80b18c0 0x7ff0c80cd9a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff0c8155e50 0x7ff0c81f2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 --2- 172.21.15.69:0/2612305635 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff0b8004db0 0x7ff0c81583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 -- 172.21.15.69:0/2612305635 >> 172.21.15.69:0/2612305635 conn(0x7ff0c806a480 msgr2=0x7ff0c80aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 -- 172.21.15.69:0/2612305635 shutdown_connections 2023-11-17T06:30:06.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:06.852+0000 7ff0cf08f700 1 -- 172.21.15.69:0/2612305635 wait complete. 2023-11-17T06:30:06.860 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:30:06.879 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-11-17T06:30:06.365761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219244,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755476,"statfs":{"total":773094113280,"available":772869607424,"internally_reserved":0,"allocated":3121152,"data_stored":1832844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.356989"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566813+0000","last_change":"2023-11-17T06:29:57.048765+0000","last_active":"2023-11-17T06:29:58.566813+0000","last_peered":"2023-11-17T06:29:58.566813+0000","last_clean":"2023-11-17T06:29:58.566813+0000","last_became_active":"2023-11-17T06:29:57.048355+0000","last_became_peered":"2023-11-17T06:29:57.048355+0000","last_unstale":"2023-11-17T06:29:58.566813+0000","last_undegraded":"2023-11-17T06:29:58.566813+0000","last_fullsized":"2023-11-17T06:29:58.566813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:56:31.946595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017546+0000","last_change":"2023-11-17T06:29:57.026689+0000","last_active":"2023-11-17T06:29:58.017546+0000","last_peered":"2023-11-17T06:29:58.017546+0000","last_clean":"2023-11-17T06:29:58.017546+0000","last_became_active":"2023-11-17T06:29:57.026110+0000","last_became_peered":"2023-11-17T06:29:57.026110+0000","last_unstale":"2023-11-17T06:29:58.017546+0000","last_undegraded":"2023-11-17T06:29:58.017546+0000","last_fullsized":"2023-11-17T06:29:58.017546+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:13:19.132028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017185+0000","last_change":"2023-11-17T06:29:57.035489+0000","last_active":"2023-11-17T06:29:58.017185+0000","last_peered":"2023-11-17T06:29:58.017185+0000","last_clean":"2023-11-17T06:29:58.017185+0000","last_became_active":"2023-11-17T06:29:57.035039+0000","last_became_peered":"2023-11-17T06:29:57.035039+0000","last_unstale":"2023-11-17T06:29:58.017185+0000","last_undegraded":"2023-11-17T06:29:58.017185+0000","last_fullsized":"2023-11-17T06:29:58.017185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:33:15.530438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013600+0000","last_change":"2023-11-17T06:29:57.037868+0000","last_active":"2023-11-17T06:29:58.013600+0000","last_peered":"2023-11-17T06:29:58.013600+0000","last_clean":"2023-11-17T06:29:58.013600+0000","last_became_active":"2023-11-17T06:29:57.036721+0000","last_became_peered":"2023-11-17T06:29:57.036721+0000","last_unstale":"2023-11-17T06:29:58.013600+0000","last_undegraded":"2023-11-17T06:29:58.013600+0000","last_fullsized":"2023-11-17T06:29:58.013600+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566412+0000","last_change":"2023-11-17T06:29:57.050034+0000","last_active":"2023-11-17T06:29:58.566412+0000","last_peered":"2023-11-17T06:29:58.566412+0000","last_clean":"2023-11-17T06:29:58.566412+0000","last_became_active":"2023-11-17T06:29:57.048335+0000","last_became_peered":"2023-11-17T06:29:57.048335+0000","last_unstale":"2023-11-17T06:29:58.566412+0000","last_undegraded":"2023-11-17T06:29:58.566412+0000","last_fullsized":"2023-11-17T06:29:58.566412+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:00:33.615466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013438+0000","last_change":"2023-11-17T06:29:57.035919+0000","last_active":"2023-11-17T06:29:58.013438+0000","last_peered":"2023-11-17T06:29:58.013438+0000","last_clean":"2023-11-17T06:29:58.013438+0000","last_became_active":"2023-11-17T06:29:57.035533+0000","last_became_peered":"2023-11-17T06:29:57.035533+0000","last_unstale":"2023-11-17T06:29:58.013438+0000","last_undegraded":"2023-11-17T06:29:58.013438+0000","last_fullsized":"2023-11-17T06:29:58.013438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565360+0000","last_change":"2023-11-17T06:29:57.044538+0000","last_active":"2023-11-17T06:29:58.565360+0000","last_peered":"2023-11-17T06:29:58.565360+0000","last_clean":"2023-11-17T06:29:58.565360+0000","last_became_active":"2023-11-17T06:29:57.044209+0000","last_became_peered":"2023-11-17T06:29:57.044209+0000","last_unstale":"2023-11-17T06:29:58.565360+0000","last_undegraded":"2023-11-17T06:29:58.565360+0000","last_fullsized":"2023-11-17T06:29:58.565360+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:36:15.068137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016567+0000","last_change":"2023-11-17T06:29:57.050415+0000","last_active":"2023-11-17T06:29:58.016567+0000","last_peered":"2023-11-17T06:29:58.016567+0000","last_clean":"2023-11-17T06:29:58.016567+0000","last_became_active":"2023-11-17T06:29:57.050130+0000","last_became_peered":"2023-11-17T06:29:57.050130+0000","last_unstale":"2023-11-17T06:29:58.016567+0000","last_undegraded":"2023-11-17T06:29:58.016567+0000","last_fullsized":"2023-11-17T06:29:58.016567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:10:40.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567762+0000","last_change":"2023-11-17T06:29:57.021824+0000","last_active":"2023-11-17T06:29:58.567762+0000","last_peered":"2023-11-17T06:29:58.567762+0000","last_clean":"2023-11-17T06:29:58.567762+0000","last_became_active":"2023-11-17T06:29:57.021520+0000","last_became_peered":"2023-11-17T06:29:57.021520+0000","last_unstale":"2023-11-17T06:29:58.567762+0000","last_undegraded":"2023-11-17T06:29:58.567762+0000","last_fullsized":"2023-11-17T06:29:58.567762+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566326+0000","last_change":"2023-11-17T06:29:57.049308+0000","last_active":"2023-11-17T06:29:58.566326+0000","last_peered":"2023-11-17T06:29:58.566326+0000","last_clean":"2023-11-17T06:29:58.566326+0000","last_became_active":"2023-11-17T06:29:57.048874+0000","last_became_peered":"2023-11-17T06:29:57.048874+0000","last_unstale":"2023-11-17T06:29:58.566326+0000","last_undegraded":"2023-11-17T06:29:58.566326+0000","last_fullsized":"2023-11-17T06:29:58.566326+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:53:02.810684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567455+0000","last_change":"2023-11-17T06:29:57.049230+0000","last_active":"2023-11-17T06:29:58.567455+0000","last_peered":"2023-11-17T06:29:58.567455+0000","last_clean":"2023-11-17T06:29:58.567455+0000","last_became_active":"2023-11-17T06:29:57.048585+0000","last_became_peered":"2023-11-17T06:29:57.048585+0000","last_unstale":"2023-11-17T06:29:58.567455+0000","last_undegraded":"2023-11-17T06:29:58.567455+0000","last_fullsized":"2023-11-17T06:29:58.567455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:24:12.818384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566673+0000","last_change":"2023-11-17T06:29:57.040860+0000","last_active":"2023-11-17T06:29:58.566673+0000","last_peered":"2023-11-17T06:29:58.566673+0000","last_clean":"2023-11-17T06:29:58.566673+0000","last_became_active":"2023-11-17T06:29:57.040400+0000","last_became_peered":"2023-11-17T06:29:57.040400+0000","last_unstale":"2023-11-17T06:29:58.566673+0000","last_undegraded":"2023-11-17T06:29:58.566673+0000","last_fullsized":"2023-11-17T06:29:58.566673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:38:04.919402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063054+0000","last_change":"2023-11-17T06:29:57.051422+0000","last_active":"2023-11-17T06:29:58.063054+0000","last_peered":"2023-11-17T06:29:58.063054+0000","last_clean":"2023-11-17T06:29:58.063054+0000","last_became_active":"2023-11-17T06:29:57.051220+0000","last_became_peered":"2023-11-17T06:29:57.051220+0000","last_unstale":"2023-11-17T06:29:58.063054+0000","last_undegraded":"2023-11-17T06:29:58.063054+0000","last_fullsized":"2023-11-17T06:29:58.063054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:25.572533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062869+0000","last_change":"2023-11-17T06:29:57.027124+0000","last_active":"2023-11-17T06:29:58.062869+0000","last_peered":"2023-11-17T06:29:58.062869+0000","last_clean":"2023-11-17T06:29:58.062869+0000","last_became_active":"2023-11-17T06:29:57.025556+0000","last_became_peered":"2023-11-17T06:29:57.025556+0000","last_unstale":"2023-11-17T06:29:58.062869+0000","last_undegraded":"2023-11-17T06:29:58.062869+0000","last_fullsized":"2023-11-17T06:29:58.062869+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:46.928281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016155+0000","last_change":"2023-11-17T06:29:57.051705+0000","last_active":"2023-11-17T06:29:58.016155+0000","last_peered":"2023-11-17T06:29:58.016155+0000","last_clean":"2023-11-17T06:29:58.016155+0000","last_became_active":"2023-11-17T06:29:57.051139+0000","last_became_peered":"2023-11-17T06:29:57.051139+0000","last_unstale":"2023-11-17T06:29:58.016155+0000","last_undegraded":"2023-11-17T06:29:58.016155+0000","last_fullsized":"2023-11-17T06:29:58.016155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:43:38.839375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199207+0000","last_change":"2023-11-17T06:29:57.040316+0000","last_active":"2023-11-17T06:29:58.199207+0000","last_peered":"2023-11-17T06:29:58.199207+0000","last_clean":"2023-11-17T06:29:58.199207+0000","last_became_active":"2023-11-17T06:29:57.039952+0000","last_became_peered":"2023-11-17T06:29:57.039952+0000","last_unstale":"2023-11-17T06:29:58.199207+0000","last_undegraded":"2023-11-17T06:29:58.199207+0000","last_fullsized":"2023-11-17T06:29:58.199207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:08:15.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200121+0000","last_change":"2023-11-17T06:29:57.053274+0000","last_active":"2023-11-17T06:29:58.200121+0000","last_peered":"2023-11-17T06:29:58.200121+0000","last_clean":"2023-11-17T06:29:58.200121+0000","last_became_active":"2023-11-17T06:29:57.050580+0000","last_became_peered":"2023-11-17T06:29:57.050580+0000","last_unstale":"2023-11-17T06:29:58.200121+0000","last_undegraded":"2023-11-17T06:29:58.200121+0000","last_fullsized":"2023-11-17T06:29:58.200121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:40:22.670143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565972+0000","last_change":"2023-11-17T06:29:57.039046+0000","last_active":"2023-11-17T06:29:58.565972+0000","last_peered":"2023-11-17T06:29:58.565972+0000","last_clean":"2023-11-17T06:29:58.565972+0000","last_became_active":"2023-11-17T06:29:57.038686+0000","last_became_peered":"2023-11-17T06:29:57.038686+0000","last_unstale":"2023-11-17T06:29:58.565972+0000","last_undegraded":"2023-11-17T06:29:58.565972+0000","last_fullsized":"2023-11-17T06:29:58.565972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200277+0000","last_change":"2023-11-17T06:29:57.038796+0000","last_active":"2023-11-17T06:29:58.200277+0000","last_peered":"2023-11-17T06:29:58.200277+0000","last_clean":"2023-11-17T06:29:58.200277+0000","last_became_active":"2023-11-17T06:29:57.038343+0000","last_became_peered":"2023-11-17T06:29:57.038343+0000","last_unstale":"2023-11-17T06:29:58.200277+0000","last_undegraded":"2023-11-17T06:29:58.200277+0000","last_fullsized":"2023-11-17T06:29:58.200277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:08:31.062867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567003+0000","last_change":"2023-11-17T06:29:57.039524+0000","last_active":"2023-11-17T06:29:58.567003+0000","last_peered":"2023-11-17T06:29:58.567003+0000","last_clean":"2023-11-17T06:29:58.567003+0000","last_became_active":"2023-11-17T06:29:57.039223+0000","last_became_peered":"2023-11-17T06:29:57.039223+0000","last_unstale":"2023-11-17T06:29:58.567003+0000","last_undegraded":"2023-11-17T06:29:58.567003+0000","last_fullsized":"2023-11-17T06:29:58.567003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:42:16.411887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014811+0000","last_change":"2023-11-17T06:29:57.035054+0000","last_active":"2023-11-17T06:29:58.014811+0000","last_peered":"2023-11-17T06:29:58.014811+0000","last_clean":"2023-11-17T06:29:58.014811+0000","last_became_active":"2023-11-17T06:29:57.034678+0000","last_became_peered":"2023-11-17T06:29:57.034678+0000","last_unstale":"2023-11-17T06:29:58.014811+0000","last_undegraded":"2023-11-17T06:29:58.014811+0000","last_fullsized":"2023-11-17T06:29:58.014811+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:56.074236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566287+0000","last_change":"2023-11-17T06:29:57.049846+0000","last_active":"2023-11-17T06:29:58.566287+0000","last_peered":"2023-11-17T06:29:58.566287+0000","last_clean":"2023-11-17T06:29:58.566287+0000","last_became_active":"2023-11-17T06:29:57.049537+0000","last_became_peered":"2023-11-17T06:29:57.049537+0000","last_unstale":"2023-11-17T06:29:58.566287+0000","last_undegraded":"2023-11-17T06:29:58.566287+0000","last_fullsized":"2023-11-17T06:29:58.566287+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016429+0000","last_change":"2023-11-17T06:29:57.039185+0000","last_active":"2023-11-17T06:29:58.016429+0000","last_peered":"2023-11-17T06:29:58.016429+0000","last_clean":"2023-11-17T06:29:58.016429+0000","last_became_active":"2023-11-17T06:29:57.038833+0000","last_became_peered":"2023-11-17T06:29:57.038833+0000","last_unstale":"2023-11-17T06:29:58.016429+0000","last_undegraded":"2023-11-17T06:29:58.016429+0000","last_fullsized":"2023-11-17T06:29:58.016429+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:35:36.870837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199139+0000","last_change":"2023-11-17T06:29:57.028933+0000","last_active":"2023-11-17T06:29:58.199139+0000","last_peered":"2023-11-17T06:29:58.199139+0000","last_clean":"2023-11-17T06:29:58.199139+0000","last_became_active":"2023-11-17T06:29:57.028654+0000","last_became_peered":"2023-11-17T06:29:57.028654+0000","last_unstale":"2023-11-17T06:29:58.199139+0000","last_undegraded":"2023-11-17T06:29:58.199139+0000","last_fullsized":"2023-11-17T06:29:58.199139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:44:58.041380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017531+0000","last_change":"2023-11-17T06:29:57.028712+0000","last_active":"2023-11-17T06:29:58.017531+0000","last_peered":"2023-11-17T06:29:58.017531+0000","last_clean":"2023-11-17T06:29:58.017531+0000","last_became_active":"2023-11-17T06:29:57.027965+0000","last_became_peered":"2023-11-17T06:29:57.027965+0000","last_unstale":"2023-11-17T06:29:58.017531+0000","last_undegraded":"2023-11-17T06:29:58.017531+0000","last_fullsized":"2023-11-17T06:29:58.017531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:15:20.965141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013827+0000","last_change":"2023-11-17T06:29:57.037004+0000","last_active":"2023-11-17T06:29:58.013827+0000","last_peered":"2023-11-17T06:29:58.013827+0000","last_clean":"2023-11-17T06:29:58.013827+0000","last_became_active":"2023-11-17T06:29:57.036152+0000","last_became_peered":"2023-11-17T06:29:57.036152+0000","last_unstale":"2023-11-17T06:29:58.013827+0000","last_undegraded":"2023-11-17T06:29:58.013827+0000","last_fullsized":"2023-11-17T06:29:58.013827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:28.425909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063473+0000","last_change":"2023-11-17T06:29:57.030368+0000","last_active":"2023-11-17T06:29:58.063473+0000","last_peered":"2023-11-17T06:29:58.063473+0000","last_clean":"2023-11-17T06:29:58.063473+0000","last_became_active":"2023-11-17T06:29:57.028975+0000","last_became_peered":"2023-11-17T06:29:57.028975+0000","last_unstale":"2023-11-17T06:29:58.063473+0000","last_undegraded":"2023-11-17T06:29:58.063473+0000","last_fullsized":"2023-11-17T06:29:58.063473+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:53.263320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063141+0000","last_change":"2023-11-17T06:29:57.049939+0000","last_active":"2023-11-17T06:29:58.063141+0000","last_peered":"2023-11-17T06:29:58.063141+0000","last_clean":"2023-11-17T06:29:58.063141+0000","last_became_active":"2023-11-17T06:29:57.049684+0000","last_became_peered":"2023-11-17T06:29:57.049684+0000","last_unstale":"2023-11-17T06:29:58.063141+0000","last_undegraded":"2023-11-17T06:29:58.063141+0000","last_fullsized":"2023-11-17T06:29:58.063141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:56.074236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017151+0000","last_change":"2023-11-17T06:29:57.024239+0000","last_active":"2023-11-17T06:29:58.017151+0000","last_peered":"2023-11-17T06:29:58.017151+0000","last_clean":"2023-11-17T06:29:58.017151+0000","last_became_active":"2023-11-17T06:29:57.023966+0000","last_became_peered":"2023-11-17T06:29:57.023966+0000","last_unstale":"2023-11-17T06:29:58.017151+0000","last_undegraded":"2023-11-17T06:29:58.017151+0000","last_fullsized":"2023-11-17T06:29:58.017151+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:53:17.880921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199372+0000","last_change":"2023-11-17T06:29:57.027928+0000","last_active":"2023-11-17T06:29:58.199372+0000","last_peered":"2023-11-17T06:29:58.199372+0000","last_clean":"2023-11-17T06:29:58.199372+0000","last_became_active":"2023-11-17T06:29:57.027636+0000","last_became_peered":"2023-11-17T06:29:57.027636+0000","last_unstale":"2023-11-17T06:29:58.199372+0000","last_undegraded":"2023-11-17T06:29:58.199372+0000","last_fullsized":"2023-11-17T06:29:58.199372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:24:12.818384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565276+0000","last_change":"2023-11-17T06:29:57.031701+0000","last_active":"2023-11-17T06:29:58.565276+0000","last_peered":"2023-11-17T06:29:58.565276+0000","last_clean":"2023-11-17T06:29:58.565276+0000","last_became_active":"2023-11-17T06:29:57.031397+0000","last_became_peered":"2023-11-17T06:29:57.031397+0000","last_unstale":"2023-11-17T06:29:58.565276+0000","last_undegraded":"2023-11-17T06:29:58.565276+0000","last_fullsized":"2023-11-17T06:29:58.565276+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013173+0000","last_change":"2023-11-17T06:29:57.037976+0000","last_active":"2023-11-17T06:29:58.013173+0000","last_peered":"2023-11-17T06:29:58.013173+0000","last_clean":"2023-11-17T06:29:58.013173+0000","last_became_active":"2023-11-17T06:29:57.036999+0000","last_became_peered":"2023-11-17T06:29:57.036999+0000","last_unstale":"2023-11-17T06:29:58.013173+0000","last_undegraded":"2023-11-17T06:29:58.013173+0000","last_fullsized":"2023-11-17T06:29:58.013173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:54.949043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566569+0000","last_change":"2023-11-17T06:29:57.028161+0000","last_active":"2023-11-17T06:29:58.566569+0000","last_peered":"2023-11-17T06:29:58.566569+0000","last_clean":"2023-11-17T06:29:58.566569+0000","last_became_active":"2023-11-17T06:29:57.027719+0000","last_became_peered":"2023-11-17T06:29:57.027719+0000","last_unstale":"2023-11-17T06:29:58.566569+0000","last_undegraded":"2023-11-17T06:29:58.566569+0000","last_fullsized":"2023-11-17T06:29:58.566569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:36.710187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017219+0000","last_change":"2023-11-17T06:29:56.148518+0000","last_active":"2023-11-17T06:29:58.017219+0000","last_peered":"2023-11-17T06:29:58.017219+0000","last_clean":"2023-11-17T06:29:58.017219+0000","last_became_active":"2023-11-17T06:29:56.148230+0000","last_became_peered":"2023-11-17T06:29:56.148230+0000","last_unstale":"2023-11-17T06:29:58.017219+0000","last_undegraded":"2023-11-17T06:29:58.017219+0000","last_fullsized":"2023-11-17T06:29:58.017219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:41:17.136054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015028+0000","last_change":"2023-11-17T06:29:57.052500+0000","last_active":"2023-11-17T06:29:58.015028+0000","last_peered":"2023-11-17T06:29:58.015028+0000","last_clean":"2023-11-17T06:29:58.015028+0000","last_became_active":"2023-11-17T06:29:57.052003+0000","last_became_peered":"2023-11-17T06:29:57.052003+0000","last_unstale":"2023-11-17T06:29:58.015028+0000","last_undegraded":"2023-11-17T06:29:58.015028+0000","last_fullsized":"2023-11-17T06:29:58.015028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:18.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199730+0000","last_change":"2023-11-17T06:29:56.155235+0000","last_active":"2023-11-17T06:29:58.199730+0000","last_peered":"2023-11-17T06:29:58.199730+0000","last_clean":"2023-11-17T06:29:58.199730+0000","last_became_active":"2023-11-17T06:29:56.154957+0000","last_became_peered":"2023-11-17T06:29:56.154957+0000","last_unstale":"2023-11-17T06:29:58.199730+0000","last_undegraded":"2023-11-17T06:29:58.199730+0000","last_fullsized":"2023-11-17T06:29:58.199730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:16.431952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062637+0000","last_change":"2023-11-17T06:29:56.156231+0000","last_active":"2023-11-17T06:29:58.062637+0000","last_peered":"2023-11-17T06:29:58.062637+0000","last_clean":"2023-11-17T06:29:58.062637+0000","last_became_active":"2023-11-17T06:29:56.155931+0000","last_became_peered":"2023-11-17T06:29:56.155931+0000","last_unstale":"2023-11-17T06:29:58.062637+0000","last_undegraded":"2023-11-17T06:29:58.062637+0000","last_fullsized":"2023-11-17T06:29:58.062637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:38.948788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016874+0000","last_change":"2023-11-17T06:29:57.033651+0000","last_active":"2023-11-17T06:29:58.016874+0000","last_peered":"2023-11-17T06:29:58.016874+0000","last_clean":"2023-11-17T06:29:58.016874+0000","last_became_active":"2023-11-17T06:29:57.030915+0000","last_became_peered":"2023-11-17T06:29:57.030915+0000","last_unstale":"2023-11-17T06:29:58.016874+0000","last_undegraded":"2023-11-17T06:29:58.016874+0000","last_fullsized":"2023-11-17T06:29:58.016874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:04:42.619958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199317+0000","last_change":"2023-11-17T06:29:56.137466+0000","last_active":"2023-11-17T06:29:58.199317+0000","last_peered":"2023-11-17T06:29:58.199317+0000","last_clean":"2023-11-17T06:29:58.199317+0000","last_became_active":"2023-11-17T06:29:56.137116+0000","last_became_peered":"2023-11-17T06:29:56.137116+0000","last_unstale":"2023-11-17T06:29:58.199317+0000","last_undegraded":"2023-11-17T06:29:58.199317+0000","last_fullsized":"2023-11-17T06:29:58.199317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:45.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016060+0000","last_change":"2023-11-17T06:29:57.029054+0000","last_active":"2023-11-17T06:29:58.016060+0000","last_peered":"2023-11-17T06:29:58.016060+0000","last_clean":"2023-11-17T06:29:58.016060+0000","last_became_active":"2023-11-17T06:29:57.028739+0000","last_became_peered":"2023-11-17T06:29:57.028739+0000","last_unstale":"2023-11-17T06:29:58.016060+0000","last_undegraded":"2023-11-17T06:29:58.016060+0000","last_fullsized":"2023-11-17T06:29:58.016060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:17.448030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567805+0000","last_change":"2023-11-17T06:29:56.145242+0000","last_active":"2023-11-17T06:29:58.567805+0000","last_peered":"2023-11-17T06:29:58.567805+0000","last_clean":"2023-11-17T06:29:58.567805+0000","last_became_active":"2023-11-17T06:29:56.144329+0000","last_became_peered":"2023-11-17T06:29:56.144329+0000","last_unstale":"2023-11-17T06:29:58.567805+0000","last_undegraded":"2023-11-17T06:29:58.567805+0000","last_fullsized":"2023-11-17T06:29:58.567805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:53.932965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014039+0000","last_change":"2023-11-17T06:29:57.036204+0000","last_active":"2023-11-17T06:29:58.014039+0000","last_peered":"2023-11-17T06:29:58.014039+0000","last_clean":"2023-11-17T06:29:58.014039+0000","last_became_active":"2023-11-17T06:29:57.035669+0000","last_became_peered":"2023-11-17T06:29:57.035669+0000","last_unstale":"2023-11-17T06:29:58.014039+0000","last_undegraded":"2023-11-17T06:29:58.014039+0000","last_fullsized":"2023-11-17T06:29:58.014039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566699+0000","last_change":"2023-11-17T06:29:56.155411+0000","last_active":"2023-11-17T06:29:58.566699+0000","last_peered":"2023-11-17T06:29:58.566699+0000","last_clean":"2023-11-17T06:29:58.566699+0000","last_became_active":"2023-11-17T06:29:56.154619+0000","last_became_peered":"2023-11-17T06:29:56.154619+0000","last_unstale":"2023-11-17T06:29:58.566699+0000","last_undegraded":"2023-11-17T06:29:58.566699+0000","last_fullsized":"2023-11-17T06:29:58.566699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:52.247242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017631+0000","last_change":"2023-11-17T06:29:57.025598+0000","last_active":"2023-11-17T06:29:58.017631+0000","last_peered":"2023-11-17T06:29:58.017631+0000","last_clean":"2023-11-17T06:29:58.017631+0000","last_became_active":"2023-11-17T06:29:57.025303+0000","last_became_peered":"2023-11-17T06:29:57.025303+0000","last_unstale":"2023-11-17T06:29:58.017631+0000","last_undegraded":"2023-11-17T06:29:58.017631+0000","last_fullsized":"2023-11-17T06:29:58.017631+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:36:40.100721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565504+0000","last_change":"2023-11-17T06:29:56.149115+0000","last_active":"2023-11-17T06:29:58.565504+0000","last_peered":"2023-11-17T06:29:58.565504+0000","last_clean":"2023-11-17T06:29:58.565504+0000","last_became_active":"2023-11-17T06:29:56.147653+0000","last_became_peered":"2023-11-17T06:29:56.147653+0000","last_unstale":"2023-11-17T06:29:58.565504+0000","last_undegraded":"2023-11-17T06:29:58.565504+0000","last_fullsized":"2023-11-17T06:29:58.565504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:38:11.759914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199421+0000","last_change":"2023-11-17T06:29:57.034094+0000","last_active":"2023-11-17T06:29:58.199421+0000","last_peered":"2023-11-17T06:29:58.199421+0000","last_clean":"2023-11-17T06:29:58.199421+0000","last_became_active":"2023-11-17T06:29:57.033817+0000","last_became_peered":"2023-11-17T06:29:57.033817+0000","last_unstale":"2023-11-17T06:29:58.199421+0000","last_undegraded":"2023-11-17T06:29:58.199421+0000","last_fullsized":"2023-11-17T06:29:58.199421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:30:22.132748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013489+0000","last_change":"2023-11-17T06:29:56.143656+0000","last_active":"2023-11-17T06:29:58.013489+0000","last_peered":"2023-11-17T06:29:58.013489+0000","last_clean":"2023-11-17T06:29:58.013489+0000","last_became_active":"2023-11-17T06:29:56.140088+0000","last_became_peered":"2023-11-17T06:29:56.140088+0000","last_unstale":"2023-11-17T06:29:58.013489+0000","last_undegraded":"2023-11-17T06:29:58.013489+0000","last_fullsized":"2023-11-17T06:29:58.013489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:38:11.759914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567240+0000","last_change":"2023-11-17T06:29:57.051158+0000","last_active":"2023-11-17T06:29:58.567240+0000","last_peered":"2023-11-17T06:29:58.567240+0000","last_clean":"2023-11-17T06:29:58.567240+0000","last_became_active":"2023-11-17T06:29:57.049255+0000","last_became_peered":"2023-11-17T06:29:57.049255+0000","last_unstale":"2023-11-17T06:29:58.567240+0000","last_undegraded":"2023-11-17T06:29:58.567240+0000","last_fullsized":"2023-11-17T06:29:58.567240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:08:15.360810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565414+0000","last_change":"2023-11-17T06:29:56.154434+0000","last_active":"2023-11-17T06:29:58.565414+0000","last_peered":"2023-11-17T06:29:58.565414+0000","last_clean":"2023-11-17T06:29:58.565414+0000","last_became_active":"2023-11-17T06:29:56.154071+0000","last_became_peered":"2023-11-17T06:29:56.154071+0000","last_unstale":"2023-11-17T06:29:58.565414+0000","last_undegraded":"2023-11-17T06:29:58.565414+0000","last_fullsized":"2023-11-17T06:29:58.565414+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:35:22.859890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062922+0000","last_change":"2023-11-17T06:29:57.028693+0000","last_active":"2023-11-17T06:29:58.062922+0000","last_peered":"2023-11-17T06:29:58.062922+0000","last_clean":"2023-11-17T06:29:58.062922+0000","last_became_active":"2023-11-17T06:29:57.027326+0000","last_became_peered":"2023-11-17T06:29:57.027326+0000","last_unstale":"2023-11-17T06:29:58.062922+0000","last_undegraded":"2023-11-17T06:29:58.062922+0000","last_fullsized":"2023-11-17T06:29:58.062922+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:33.609630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199813+0000","last_change":"2023-11-17T06:29:56.145651+0000","last_active":"2023-11-17T06:29:58.199813+0000","last_peered":"2023-11-17T06:29:58.199813+0000","last_clean":"2023-11-17T06:29:58.199813+0000","last_became_active":"2023-11-17T06:29:56.145385+0000","last_became_peered":"2023-11-17T06:29:56.145385+0000","last_unstale":"2023-11-17T06:29:58.199813+0000","last_undegraded":"2023-11-17T06:29:58.199813+0000","last_fullsized":"2023-11-17T06:29:58.199813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:36:14.052058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200161+0000","last_change":"2023-11-17T06:29:57.053050+0000","last_active":"2023-11-17T06:29:58.200161+0000","last_peered":"2023-11-17T06:29:58.200161+0000","last_clean":"2023-11-17T06:29:58.200161+0000","last_became_active":"2023-11-17T06:29:57.052675+0000","last_became_peered":"2023-11-17T06:29:57.052675+0000","last_unstale":"2023-11-17T06:29:58.200161+0000","last_undegraded":"2023-11-17T06:29:58.200161+0000","last_fullsized":"2023-11-17T06:29:58.200161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:38:38.807009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565388+0000","last_change":"2023-11-17T06:29:56.153805+0000","last_active":"2023-11-17T06:29:58.565388+0000","last_peered":"2023-11-17T06:29:58.565388+0000","last_clean":"2023-11-17T06:29:58.565388+0000","last_became_active":"2023-11-17T06:29:56.153075+0000","last_became_peered":"2023-11-17T06:29:56.153075+0000","last_unstale":"2023-11-17T06:29:58.565388+0000","last_undegraded":"2023-11-17T06:29:58.565388+0000","last_fullsized":"2023-11-17T06:29:58.565388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:27.409831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565490+0000","last_change":"2023-11-17T06:29:57.035110+0000","last_active":"2023-11-17T06:29:58.565490+0000","last_peered":"2023-11-17T06:29:58.565490+0000","last_clean":"2023-11-17T06:29:58.565490+0000","last_became_active":"2023-11-17T06:29:57.034811+0000","last_became_peered":"2023-11-17T06:29:57.034811+0000","last_unstale":"2023-11-17T06:29:58.565490+0000","last_undegraded":"2023-11-17T06:29:58.565490+0000","last_fullsized":"2023-11-17T06:29:58.565490+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:31:39.964866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":20,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014497+0000","last_change":"2023-11-17T06:29:56.144056+0000","last_active":"2023-11-17T06:29:58.014497+0000","last_peered":"2023-11-17T06:29:58.014497+0000","last_clean":"2023-11-17T06:29:58.014497+0000","last_became_active":"2023-11-17T06:29:56.143742+0000","last_became_peered":"2023-11-17T06:29:56.143742+0000","last_unstale":"2023-11-17T06:29:58.014497+0000","last_undegraded":"2023-11-17T06:29:58.014497+0000","last_fullsized":"2023-11-17T06:29:58.014497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:35.694108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199521+0000","last_change":"2023-11-17T06:29:57.036273+0000","last_active":"2023-11-17T06:29:58.199521+0000","last_peered":"2023-11-17T06:29:58.199521+0000","last_clean":"2023-11-17T06:29:58.199521+0000","last_became_active":"2023-11-17T06:29:57.036003+0000","last_became_peered":"2023-11-17T06:29:57.036003+0000","last_unstale":"2023-11-17T06:29:58.199521+0000","last_undegraded":"2023-11-17T06:29:58.199521+0000","last_fullsized":"2023-11-17T06:29:58.199521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:01:56.186044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567381+0000","last_change":"2023-11-17T06:29:56.153641+0000","last_active":"2023-11-17T06:29:58.567381+0000","last_peered":"2023-11-17T06:29:58.567381+0000","last_clean":"2023-11-17T06:29:58.567381+0000","last_became_active":"2023-11-17T06:29:56.153177+0000","last_became_peered":"2023-11-17T06:29:56.153177+0000","last_unstale":"2023-11-17T06:29:58.567381+0000","last_undegraded":"2023-11-17T06:29:58.567381+0000","last_fullsized":"2023-11-17T06:29:58.567381+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:07:55.058158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014195+0000","last_change":"2023-11-17T06:29:57.053038+0000","last_active":"2023-11-17T06:29:58.014195+0000","last_peered":"2023-11-17T06:29:58.014195+0000","last_clean":"2023-11-17T06:29:58.014195+0000","last_became_active":"2023-11-17T06:29:57.052719+0000","last_became_peered":"2023-11-17T06:29:57.052719+0000","last_unstale":"2023-11-17T06:29:58.014195+0000","last_undegraded":"2023-11-17T06:29:58.014195+0000","last_fullsized":"2023-11-17T06:29:58.014195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:46.928281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015589+0000","last_change":"2023-11-17T06:29:56.151539+0000","last_active":"2023-11-17T06:29:58.015589+0000","last_peered":"2023-11-17T06:29:58.015589+0000","last_clean":"2023-11-17T06:29:58.015589+0000","last_became_active":"2023-11-17T06:29:56.151254+0000","last_became_peered":"2023-11-17T06:29:56.151254+0000","last_unstale":"2023-11-17T06:29:58.015589+0000","last_undegraded":"2023-11-17T06:29:58.015589+0000","last_fullsized":"2023-11-17T06:29:58.015589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:10.132222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567142+0000","last_change":"2023-11-17T06:29:57.050538+0000","last_active":"2023-11-17T06:29:58.567142+0000","last_peered":"2023-11-17T06:29:58.567142+0000","last_clean":"2023-11-17T06:29:58.567142+0000","last_became_active":"2023-11-17T06:29:57.048902+0000","last_became_peered":"2023-11-17T06:29:57.048902+0000","last_unstale":"2023-11-17T06:29:58.567142+0000","last_undegraded":"2023-11-17T06:29:58.567142+0000","last_fullsized":"2023-11-17T06:29:58.567142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:24:54.358531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017259+0000","last_change":"2023-11-17T06:29:56.149833+0000","last_active":"2023-11-17T06:29:58.017259+0000","last_peered":"2023-11-17T06:29:58.017259+0000","last_clean":"2023-11-17T06:29:58.017259+0000","last_became_active":"2023-11-17T06:29:56.149492+0000","last_became_peered":"2023-11-17T06:29:56.149492+0000","last_unstale":"2023-11-17T06:29:58.017259+0000","last_undegraded":"2023-11-17T06:29:58.017259+0000","last_fullsized":"2023-11-17T06:29:58.017259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:14:19.896244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567068+0000","last_change":"2023-11-17T06:29:57.040669+0000","last_active":"2023-11-17T06:29:58.567068+0000","last_peered":"2023-11-17T06:29:58.567068+0000","last_clean":"2023-11-17T06:29:58.567068+0000","last_became_active":"2023-11-17T06:29:57.040042+0000","last_became_peered":"2023-11-17T06:29:57.040042+0000","last_unstale":"2023-11-17T06:29:58.567068+0000","last_undegraded":"2023-11-17T06:29:58.567068+0000","last_fullsized":"2023-11-17T06:29:58.567068+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:44:58.041380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063361+0000","last_change":"2023-11-17T06:29:56.157174+0000","last_active":"2023-11-17T06:29:58.063361+0000","last_peered":"2023-11-17T06:29:58.063361+0000","last_clean":"2023-11-17T06:29:58.063361+0000","last_became_active":"2023-11-17T06:29:56.156944+0000","last_became_peered":"2023-11-17T06:29:56.156944+0000","last_unstale":"2023-11-17T06:29:58.063361+0000","last_undegraded":"2023-11-17T06:29:58.063361+0000","last_fullsized":"2023-11-17T06:29:58.063361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:47:35.694108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200093+0000","last_change":"2023-11-17T06:29:57.020240+0000","last_active":"2023-11-17T06:29:58.200093+0000","last_peered":"2023-11-17T06:29:58.200093+0000","last_clean":"2023-11-17T06:29:58.200093+0000","last_became_active":"2023-11-17T06:29:57.019851+0000","last_became_peered":"2023-11-17T06:29:57.019851+0000","last_unstale":"2023-11-17T06:29:58.200093+0000","last_undegraded":"2023-11-17T06:29:58.200093+0000","last_fullsized":"2023-11-17T06:29:58.200093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:08:16.650719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":165,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-17T06:29:57.021221+0000","last_change":"2023-11-17T06:29:48.031659+0000","last_active":"2023-11-17T06:29:57.021221+0000","last_peered":"2023-11-17T06:29:57.021221+0000","last_clean":"2023-11-17T06:29:57.021221+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:29:57.021221+0000","last_undegraded":"2023-11-17T06:29:57.021221+0000","last_fullsized":"2023-11-17T06:29:57.021221+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_clean_scrub_stamp":"2023-11-17T06:29:47.005420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:11:29.801860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200114+0000","last_change":"2023-11-17T06:29:56.148120+0000","last_active":"2023-11-17T06:29:58.200114+0000","last_peered":"2023-11-17T06:29:58.200114+0000","last_clean":"2023-11-17T06:29:58.200114+0000","last_became_active":"2023-11-17T06:29:56.147781+0000","last_became_peered":"2023-11-17T06:29:56.147781+0000","last_unstale":"2023-11-17T06:29:58.200114+0000","last_undegraded":"2023-11-17T06:29:58.200114+0000","last_fullsized":"2023-11-17T06:29:58.200114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:24.556455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015195+0000","last_change":"2023-11-17T06:29:57.037133+0000","last_active":"2023-11-17T06:29:58.015195+0000","last_peered":"2023-11-17T06:29:58.015195+0000","last_clean":"2023-11-17T06:29:58.015195+0000","last_became_active":"2023-11-17T06:29:57.036216+0000","last_became_peered":"2023-11-17T06:29:57.036216+0000","last_unstale":"2023-11-17T06:29:58.015195+0000","last_undegraded":"2023-11-17T06:29:58.015195+0000","last_fullsized":"2023-11-17T06:29:58.015195+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:14:53.263320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199454+0000","last_change":"2023-11-17T06:29:56.147063+0000","last_active":"2023-11-17T06:29:58.199454+0000","last_peered":"2023-11-17T06:29:58.199454+0000","last_clean":"2023-11-17T06:29:58.199454+0000","last_became_active":"2023-11-17T06:29:56.146762+0000","last_became_peered":"2023-11-17T06:29:56.146762+0000","last_unstale":"2023-11-17T06:29:58.199454+0000","last_undegraded":"2023-11-17T06:29:58.199454+0000","last_fullsized":"2023-11-17T06:29:58.199454+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:32.593552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.062691+0000","last_change":"2023-11-17T06:29:57.037884+0000","last_active":"2023-11-17T06:29:58.062691+0000","last_peered":"2023-11-17T06:29:58.062691+0000","last_clean":"2023-11-17T06:29:58.062691+0000","last_became_active":"2023-11-17T06:29:57.037620+0000","last_became_peered":"2023-11-17T06:29:57.037620+0000","last_unstale":"2023-11-17T06:29:58.062691+0000","last_undegraded":"2023-11-17T06:29:58.062691+0000","last_fullsized":"2023-11-17T06:29:58.062691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:11.148301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565109+0000","last_change":"2023-11-17T06:29:56.147310+0000","last_active":"2023-11-17T06:29:58.565109+0000","last_peered":"2023-11-17T06:29:58.565109+0000","last_clean":"2023-11-17T06:29:58.565109+0000","last_became_active":"2023-11-17T06:29:56.146894+0000","last_became_peered":"2023-11-17T06:29:56.146894+0000","last_unstale":"2023-11-17T06:29:58.565109+0000","last_undegraded":"2023-11-17T06:29:58.565109+0000","last_fullsized":"2023-11-17T06:29:58.565109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:09:09.862678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.016713+0000","last_change":"2023-11-17T06:29:57.024088+0000","last_active":"2023-11-17T06:29:58.016713+0000","last_peered":"2023-11-17T06:29:58.016713+0000","last_clean":"2023-11-17T06:29:58.016713+0000","last_became_active":"2023-11-17T06:29:57.023805+0000","last_became_peered":"2023-11-17T06:29:57.023805+0000","last_unstale":"2023-11-17T06:29:58.016713+0000","last_undegraded":"2023-11-17T06:29:58.016713+0000","last_fullsized":"2023-11-17T06:29:58.016713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:25:07.897379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200019+0000","last_change":"2023-11-17T06:29:56.143041+0000","last_active":"2023-11-17T06:29:58.200019+0000","last_peered":"2023-11-17T06:29:58.200019+0000","last_clean":"2023-11-17T06:29:58.200019+0000","last_became_active":"2023-11-17T06:29:56.142647+0000","last_became_peered":"2023-11-17T06:29:56.142647+0000","last_unstale":"2023-11-17T06:29:58.200019+0000","last_undegraded":"2023-11-17T06:29:58.200019+0000","last_fullsized":"2023-11-17T06:29:58.200019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:56:51.565071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.566104+0000","last_change":"2023-11-17T06:29:57.049541+0000","last_active":"2023-11-17T06:29:58.566104+0000","last_peered":"2023-11-17T06:29:58.566104+0000","last_clean":"2023-11-17T06:29:58.566104+0000","last_became_active":"2023-11-17T06:29:57.049268+0000","last_became_peered":"2023-11-17T06:29:57.049268+0000","last_unstale":"2023-11-17T06:29:58.566104+0000","last_undegraded":"2023-11-17T06:29:58.566104+0000","last_fullsized":"2023-11-17T06:29:58.566104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:56:52.581149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017143+0000","last_change":"2023-11-17T06:29:56.147186+0000","last_active":"2023-11-17T06:29:58.017143+0000","last_peered":"2023-11-17T06:29:58.017143+0000","last_clean":"2023-11-17T06:29:58.017143+0000","last_became_active":"2023-11-17T06:29:56.146837+0000","last_became_peered":"2023-11-17T06:29:56.146837+0000","last_unstale":"2023-11-17T06:29:58.017143+0000","last_undegraded":"2023-11-17T06:29:58.017143+0000","last_fullsized":"2023-11-17T06:29:58.017143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:52:20.072163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.013443+0000","last_change":"2023-11-17T06:29:57.041411+0000","last_active":"2023-11-17T06:29:58.013443+0000","last_peered":"2023-11-17T06:29:58.013443+0000","last_clean":"2023-11-17T06:29:58.013443+0000","last_became_active":"2023-11-17T06:29:57.041080+0000","last_became_peered":"2023-11-17T06:29:57.041080+0000","last_unstale":"2023-11-17T06:29:58.013443+0000","last_undegraded":"2023-11-17T06:29:58.013443+0000","last_fullsized":"2023-11-17T06:29:58.013443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200289+0000","last_change":"2023-11-17T06:29:56.143922+0000","last_active":"2023-11-17T06:29:58.200289+0000","last_peered":"2023-11-17T06:29:58.200289+0000","last_clean":"2023-11-17T06:29:58.200289+0000","last_became_active":"2023-11-17T06:29:56.143475+0000","last_became_peered":"2023-11-17T06:29:56.143475+0000","last_unstale":"2023-11-17T06:29:58.200289+0000","last_undegraded":"2023-11-17T06:29:58.200289+0000","last_fullsized":"2023-11-17T06:29:58.200289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:00:32.599388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063284+0000","last_change":"2023-11-17T06:29:57.029861+0000","last_active":"2023-11-17T06:29:58.063284+0000","last_peered":"2023-11-17T06:29:58.063284+0000","last_clean":"2023-11-17T06:29:58.063284+0000","last_became_active":"2023-11-17T06:29:57.029360+0000","last_became_peered":"2023-11-17T06:29:57.029360+0000","last_unstale":"2023-11-17T06:29:58.063284+0000","last_undegraded":"2023-11-17T06:29:58.063284+0000","last_fullsized":"2023-11-17T06:29:58.063284+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:18.354088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:30:00.062658+0000","last_change":"2023-11-17T06:29:56.152922+0000","last_active":"2023-11-17T06:30:00.062658+0000","last_peered":"2023-11-17T06:30:00.062658+0000","last_clean":"2023-11-17T06:30:00.062658+0000","last_became_active":"2023-11-17T06:29:56.152632+0000","last_became_peered":"2023-11-17T06:29:56.152632+0000","last_unstale":"2023-11-17T06:30:00.062658+0000","last_undegraded":"2023-11-17T06:30:00.062658+0000","last_fullsized":"2023-11-17T06:30:00.062658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T18:20:32.593552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015562+0000","last_change":"2023-11-17T06:29:57.036541+0000","last_active":"2023-11-17T06:29:58.015562+0000","last_peered":"2023-11-17T06:29:58.015562+0000","last_clean":"2023-11-17T06:29:58.015562+0000","last_became_active":"2023-11-17T06:29:57.034954+0000","last_became_peered":"2023-11-17T06:29:57.034954+0000","last_unstale":"2023-11-17T06:29:58.015562+0000","last_undegraded":"2023-11-17T06:29:58.015562+0000","last_fullsized":"2023-11-17T06:29:58.015562+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:13:22.110656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.200289+0000","last_change":"2023-11-17T06:29:56.156668+0000","last_active":"2023-11-17T06:29:58.200289+0000","last_peered":"2023-11-17T06:29:58.200289+0000","last_clean":"2023-11-17T06:29:58.200289+0000","last_became_active":"2023-11-17T06:29:56.155662+0000","last_became_peered":"2023-11-17T06:29:56.155662+0000","last_unstale":"2023-11-17T06:29:58.200289+0000","last_undegraded":"2023-11-17T06:29:58.200289+0000","last_fullsized":"2023-11-17T06:29:58.200289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:56:30.930517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015394+0000","last_change":"2023-11-17T06:29:57.034365+0000","last_active":"2023-11-17T06:29:58.015394+0000","last_peered":"2023-11-17T06:29:58.015394+0000","last_clean":"2023-11-17T06:29:58.015394+0000","last_became_active":"2023-11-17T06:29:57.034154+0000","last_became_peered":"2023-11-17T06:29:57.034154+0000","last_unstale":"2023-11-17T06:29:58.015394+0000","last_undegraded":"2023-11-17T06:29:58.015394+0000","last_fullsized":"2023-11-17T06:29:58.015394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:31:15.968761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565274+0000","last_change":"2023-11-17T06:29:56.153356+0000","last_active":"2023-11-17T06:29:58.565274+0000","last_peered":"2023-11-17T06:29:58.565274+0000","last_clean":"2023-11-17T06:29:58.565274+0000","last_became_active":"2023-11-17T06:29:56.153004+0000","last_became_peered":"2023-11-17T06:29:56.153004+0000","last_unstale":"2023-11-17T06:29:58.565274+0000","last_undegraded":"2023-11-17T06:29:58.565274+0000","last_fullsized":"2023-11-17T06:29:58.565274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:57:17.338010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199179+0000","last_change":"2023-11-17T06:29:57.029538+0000","last_active":"2023-11-17T06:29:58.199179+0000","last_peered":"2023-11-17T06:29:58.199179+0000","last_clean":"2023-11-17T06:29:58.199179+0000","last_became_active":"2023-11-17T06:29:57.029210+0000","last_became_peered":"2023-11-17T06:29:57.029210+0000","last_unstale":"2023-11-17T06:29:58.199179+0000","last_undegraded":"2023-11-17T06:29:58.199179+0000","last_fullsized":"2023-11-17T06:29:58.199179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:24:54.358531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014921+0000","last_change":"2023-11-17T06:29:56.154270+0000","last_active":"2023-11-17T06:29:58.014921+0000","last_peered":"2023-11-17T06:29:58.014921+0000","last_clean":"2023-11-17T06:29:58.014921+0000","last_became_active":"2023-11-17T06:29:56.153931+0000","last_became_peered":"2023-11-17T06:29:56.153931+0000","last_unstale":"2023-11-17T06:29:58.014921+0000","last_undegraded":"2023-11-17T06:29:58.014921+0000","last_fullsized":"2023-11-17T06:29:58.014921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:27.409831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.014523+0000","last_change":"2023-11-17T06:29:57.023492+0000","last_active":"2023-11-17T06:29:58.014523+0000","last_peered":"2023-11-17T06:29:58.014523+0000","last_clean":"2023-11-17T06:29:58.014523+0000","last_became_active":"2023-11-17T06:29:57.023199+0000","last_became_peered":"2023-11-17T06:29:57.023199+0000","last_unstale":"2023-11-17T06:29:58.014523+0000","last_undegraded":"2023-11-17T06:29:58.014523+0000","last_fullsized":"2023-11-17T06:29:58.014523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:31:25.572533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.063127+0000","last_change":"2023-11-17T06:29:56.151644+0000","last_active":"2023-11-17T06:29:58.063127+0000","last_peered":"2023-11-17T06:29:58.063127+0000","last_clean":"2023-11-17T06:29:58.063127+0000","last_became_active":"2023-11-17T06:29:56.151334+0000","last_became_peered":"2023-11-17T06:29:56.151334+0000","last_unstale":"2023-11-17T06:29:58.063127+0000","last_undegraded":"2023-11-17T06:29:58.063127+0000","last_fullsized":"2023-11-17T06:29:58.063127+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:50.793814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.565539+0000","last_change":"2023-11-17T06:29:57.030102+0000","last_active":"2023-11-17T06:29:58.565539+0000","last_peered":"2023-11-17T06:29:58.565539+0000","last_clean":"2023-11-17T06:29:58.565539+0000","last_became_active":"2023-11-17T06:29:57.028292+0000","last_became_peered":"2023-11-17T06:29:57.028292+0000","last_unstale":"2023-11-17T06:29:58.565539+0000","last_undegraded":"2023-11-17T06:29:58.565539+0000","last_fullsized":"2023-11-17T06:29:58.565539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:12:51.809892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199917+0000","last_change":"2023-11-17T06:29:56.147463+0000","last_active":"2023-11-17T06:29:58.199917+0000","last_peered":"2023-11-17T06:29:58.199917+0000","last_clean":"2023-11-17T06:29:58.199917+0000","last_became_active":"2023-11-17T06:29:56.147172+0000","last_became_peered":"2023-11-17T06:29:56.147172+0000","last_unstale":"2023-11-17T06:29:58.199917+0000","last_undegraded":"2023-11-17T06:29:58.199917+0000","last_fullsized":"2023-11-17T06:29:58.199917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:31:14.952683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199574+0000","last_change":"2023-11-17T06:29:57.030874+0000","last_active":"2023-11-17T06:29:58.199574+0000","last_peered":"2023-11-17T06:29:58.199574+0000","last_clean":"2023-11-17T06:29:58.199574+0000","last_became_active":"2023-11-17T06:29:57.030602+0000","last_became_peered":"2023-11-17T06:29:57.030602+0000","last_unstale":"2023-11-17T06:29:58.199574+0000","last_undegraded":"2023-11-17T06:29:58.199574+0000","last_fullsized":"2023-11-17T06:29:58.199574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:40:17.803427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.199948+0000","last_change":"2023-11-17T06:29:57.050840+0000","last_active":"2023-11-17T06:29:58.199948+0000","last_peered":"2023-11-17T06:29:58.199948+0000","last_clean":"2023-11-17T06:29:58.199948+0000","last_became_active":"2023-11-17T06:29:57.050346+0000","last_became_peered":"2023-11-17T06:29:57.050346+0000","last_unstale":"2023-11-17T06:29:58.199948+0000","last_undegraded":"2023-11-17T06:29:58.199948+0000","last_fullsized":"2023-11-17T06:29:58.199948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:25:35.354706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567223+0000","last_change":"2023-11-17T06:29:56.153913+0000","last_active":"2023-11-17T06:29:58.567223+0000","last_peered":"2023-11-17T06:29:58.567223+0000","last_clean":"2023-11-17T06:29:58.567223+0000","last_became_active":"2023-11-17T06:29:56.153474+0000","last_became_peered":"2023-11-17T06:29:56.153474+0000","last_unstale":"2023-11-17T06:29:58.567223+0000","last_undegraded":"2023-11-17T06:29:58.567223+0000","last_fullsized":"2023-11-17T06:29:58.567223+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:53.932965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567084+0000","last_change":"2023-11-17T06:29:57.041986+0000","last_active":"2023-11-17T06:29:58.567084+0000","last_peered":"2023-11-17T06:29:58.567084+0000","last_clean":"2023-11-17T06:29:58.567084+0000","last_became_active":"2023-11-17T06:29:57.041251+0000","last_became_peered":"2023-11-17T06:29:57.041251+0000","last_unstale":"2023-11-17T06:29:58.567084+0000","last_undegraded":"2023-11-17T06:29:58.567084+0000","last_fullsized":"2023-11-17T06:29:58.567084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:30:28.425909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.567460+0000","last_change":"2023-11-17T06:29:56.155103+0000","last_active":"2023-11-17T06:29:58.567460+0000","last_peered":"2023-11-17T06:29:58.567460+0000","last_clean":"2023-11-17T06:29:58.567460+0000","last_became_active":"2023-11-17T06:29:56.154824+0000","last_became_peered":"2023-11-17T06:29:56.154824+0000","last_unstale":"2023-11-17T06:29:58.567460+0000","last_undegraded":"2023-11-17T06:29:58.567460+0000","last_fullsized":"2023-11-17T06:29:58.567460+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:13:21.094578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017560+0000","last_change":"2023-11-17T06:29:57.028924+0000","last_active":"2023-11-17T06:29:58.017560+0000","last_peered":"2023-11-17T06:29:58.017560+0000","last_clean":"2023-11-17T06:29:58.017560+0000","last_became_active":"2023-11-17T06:29:57.028381+0000","last_became_peered":"2023-11-17T06:29:57.028381+0000","last_unstale":"2023-11-17T06:29:58.017560+0000","last_undegraded":"2023-11-17T06:29:58.017560+0000","last_fullsized":"2023-11-17T06:29:58.017560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:16:29.542871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017697+0000","last_change":"2023-11-17T06:29:56.147117+0000","last_active":"2023-11-17T06:29:58.017697+0000","last_peered":"2023-11-17T06:29:58.017697+0000","last_clean":"2023-11-17T06:29:58.017697+0000","last_became_active":"2023-11-17T06:29:56.146805+0000","last_became_peered":"2023-11-17T06:29:56.146805+0000","last_unstale":"2023-11-17T06:29:58.017697+0000","last_undegraded":"2023-11-17T06:29:58.017697+0000","last_fullsized":"2023-11-17T06:29:58.017697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:24:37.170131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.017661+0000","last_change":"2023-11-17T06:29:57.046219+0000","last_active":"2023-11-17T06:29:58.017661+0000","last_peered":"2023-11-17T06:29:58.017661+0000","last_clean":"2023-11-17T06:29:58.017661+0000","last_became_active":"2023-11-17T06:29:57.045949+0000","last_became_peered":"2023-11-17T06:29:57.045949+0000","last_unstale":"2023-11-17T06:29:58.017661+0000","last_undegraded":"2023-11-17T06:29:58.017661+0000","last_fullsized":"2023-11-17T06:29:58.017661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:56.101732+0000","last_clean_scrub_stamp":"2023-11-17T06:29:56.101732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:31:49.682905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-11-17T06:29:58.015780+0000","last_change":"2023-11-17T06:29:56.141229+0000","last_active":"2023-11-17T06:29:58.015780+0000","last_peered":"2023-11-17T06:29:58.015780+0000","last_clean":"2023-11-17T06:29:58.015780+0000","last_became_active":"2023-11-17T06:29:56.140850+0000","last_became_peered":"2023-11-17T06:29:56.140850+0000","last_unstale":"2023-11-17T06:29:58.015780+0000","last_undegraded":"2023-11-17T06:29:58.015780+0000","last_fullsized":"2023-11-17T06:29:58.015780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:55.085653+0000","last_clean_scrub_stamp":"2023-11-17T06:29:55.085653+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:41:45.912203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":81035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3959999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5349999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":80911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.726}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.712}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":253952,"data_stored":83195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5589999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.083}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.401}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8120000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":237568,"data_stored":81493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2990000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3919999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3260000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.696}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7330000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1789999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9350000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":831488,"data_stored":671349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4480000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.593}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2530000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.4180000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.149}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.6849999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":241664,"data_stored":80967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":835584,"data_stored":671371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1040000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3540000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:30:06.883 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-17T06:30:06.883 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-17T06:30:06.883 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-17T06:30:06.883 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-17T06:30:07.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.076+0000 7f3dfa1d7700 1 Processor -- start 2023-11-17T06:30:07.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.076+0000 7f3dfa1d7700 1 -- start start 2023-11-17T06:30:07.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.080+0000 7f3dfa1d7700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3df40cbc30 0x7f3df40ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.080+0000 7f3dfa1d7700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df406c060 con 0x7f3df40c9420 2023-11-17T06:30:07.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.080+0000 7f3df89d4700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f3df40c9420 0x7f3df40cb520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59178/0 (socket says 172.21.15.69:59178) 2023-11-17T06:30:07.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.080+0000 7f3dfa1d7700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df406c340 con 0x7f3df415d3e0 2023-11-17T06:30:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.080+0000 7f3df89d4700 1 -- 172.21.15.69:0/2233660479 learned_addr learned my addr 172.21.15.69:0/2233660479 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.080+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/2233660479 --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df406c620 con 0x7f3df40cbc30 2023-11-17T06:30:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.080+0000 7f3df99d6700 1 --2- 172.21.15.69:0/2233660479 >> v2:172.21.15.69:3300/0 conn(0x7f3df40cbc30 0x7f3df40ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.080+0000 7f3debfff700 1 -- 172.21.15.69:0/2233660479 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840356380 0 0) 0x7f3df406c060 con 0x7f3df40c9420 2023-11-17T06:30:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.080+0000 7f3debfff700 1 -- 172.21.15.69:0/2233660479 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3de00035d0 con 0x7f3df40c9420 2023-11-17T06:30:07.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3debfff700 1 -- 172.21.15.69:0/2233660479 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633577005 0 0) 0x7f3df406c340 con 0x7f3df415d3e0 2023-11-17T06:30:07.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3debfff700 1 -- 172.21.15.69:0/2233660479 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3df406c060 con 0x7f3df415d3e0 2023-11-17T06:30:07.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3debfff700 1 -- 172.21.15.69:0/2233660479 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2390299262 0 0) 0x7f3de00035d0 con 0x7f3df40c9420 2023-11-17T06:30:07.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3df99d6700 1 -- 172.21.15.69:0/2233660479 >> v1:172.21.15.93:6789/0 conn(0x7f3df415d3e0 legacy=0x7f3df4161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3df99d6700 1 -- 172.21.15.69:0/2233660479 >> v1:172.21.15.69:6789/0 conn(0x7f3df40c9420 legacy=0x7f3df40cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3df99d6700 1 -- 172.21.15.69:0/2233660479 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df406c900 con 0x7f3df40cbc30 2023-11-17T06:30:07.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3df99d6700 1 --2- 172.21.15.69:0/2233660479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40cbc30 0x7f3df40ad0e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009d90 tx=0x7f3dec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd1405f886e2b60 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3debfff700 1 -- 172.21.15.69:0/2233660479 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec00e070 con 0x7f3df40cbc30 2023-11-17T06:30:07.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3debfff700 1 -- 172.21.15.69:0/2233660479 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec003a40 con 0x7f3df40cbc30 2023-11-17T06:30:07.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3debfff700 1 -- 172.21.15.69:0/2233660479 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4001670 con 0x7f3df40cbc30 2023-11-17T06:30:07.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/2233660479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40cbc30 msgr2=0x7f3df40ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3dfa1d7700 1 --2- 172.21.15.69:0/2233660479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40cbc30 0x7f3df40ad0e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3dec009d90 tx=0x7f3dec00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:07.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/2233660479 shutdown_connections 2023-11-17T06:30:07.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3dfa1d7700 1 --2- 172.21.15.69:0/2233660479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40cbc30 0x7f3df40ad0e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/2233660479 >> 172.21.15.69:0/2233660479 conn(0x7f3df40b0900 msgr2=0x7f3df40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:07.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/2233660479 shutdown_connections 2023-11-17T06:30:07.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.084+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/2233660479 wait complete. 2023-11-17T06:30:07.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3dfa1d7700 1 Processor -- start 2023-11-17T06:30:07.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3dfa1d7700 1 -- start start 2023-11-17T06:30:07.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3dfa1d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40c9420 0x7f3df415f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3dfa1d7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3df40cbc30 0x7f3df415e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3dfa1d7700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3df415d3e0 0x7f3df40c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3dfa1d7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df415d940 con 0x7f3df40c9420 2023-11-17T06:30:07.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3dfa1d7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df415df00 con 0x7f3df40cbc30 2023-11-17T06:30:07.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3dfa1d7700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40c7150 con 0x7f3df415d3e0 2023-11-17T06:30:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3df91d5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40c9420 0x7f3df415f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3df91d5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40c9420 0x7f3df415f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48118/0 (socket says 172.21.15.69:48118) 2023-11-17T06:30:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3df91d5700 1 -- 172.21.15.69:0/3382345625 learned_addr learned my addr 172.21.15.69:0/3382345625 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3df89d4700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3df40cbc30 0x7f3df415e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3df99d6700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3df415d3e0 0x7f3df40c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3df91d5700 1 -- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3df415d3e0 msgr2=0x7f3df40c66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3df91d5700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3df415d3e0 0x7f3df40c66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3df91d5700 1 -- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3df40cbc30 msgr2=0x7f3df415e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.088+0000 7f3df91d5700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3df40cbc30 0x7f3df415e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.092+0000 7f3df91d5700 1 -- 172.21.15.69:0/3382345625 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec009a70 con 0x7f3df40c9420 2023-11-17T06:30:07.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.092+0000 7f3df91d5700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40c9420 0x7f3df415f760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3df000c490 tx=0x7f3df000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.092+0000 7f3de9ffb700 1 -- 172.21.15.69:0/3382345625 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00052d0 con 0x7f3df40c9420 2023-11-17T06:30:07.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.092+0000 7f3de9ffb700 1 -- 172.21.15.69:0/3382345625 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df0005450 con 0x7f3df40c9420 2023-11-17T06:30:07.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.092+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/3382345625 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df40b3800 con 0x7f3df40c9420 2023-11-17T06:30:07.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.092+0000 7f3de9ffb700 1 -- 172.21.15.69:0/3382345625 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df00038e0 con 0x7f3df40c9420 2023-11-17T06:30:07.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.092+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/3382345625 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df415db90 con 0x7f3df40c9420 2023-11-17T06:30:07.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.092+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/3382345625 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df40c9820 con 0x7f3df40c9420 2023-11-17T06:30:07.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.092+0000 7f3de9ffb700 1 -- 172.21.15.69:0/3382345625 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3df0003a40 con 0x7f3df40c9420 2023-11-17T06:30:07.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.096+0000 7f3de9ffb700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3dd8066510 0x7f3dd80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.096+0000 7f3de9ffb700 1 -- 172.21.15.69:0/3382345625 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3df00832f0 con 0x7f3df40c9420 2023-11-17T06:30:07.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.096+0000 7f3df89d4700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3dd8066510 0x7f3dd80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.096+0000 7f3df89d4700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3dd8066510 0x7f3dd80689d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3df41f5c80 tx=0x7f3de4001b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.100+0000 7f3de9ffb700 1 -- 172.21.15.69:0/3382345625 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3df0050760 con 0x7f3df40c9420 2023-11-17T06:30:07.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.312+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/3382345625 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3df4073f00 con 0x7f3df40c9420 2023-11-17T06:30:07.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.312+0000 7f3de9ffb700 1 -- 172.21.15.69:0/3382345625 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3df0053d80 con 0x7f3df40c9420 2023-11-17T06:30:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:07.316 INFO:teuthology.orchestra.run.smithi069.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-17T06:30:07.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.312+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3dd8066510 msgr2=0x7f3dd80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.312+0000 7f3dfa1d7700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3dd8066510 0x7f3dd80689d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3df41f5c80 tx=0x7f3de4001b80 comp rx=0 tx=0).stop 2023-11-17T06:30:07.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.312+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/3382345625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40c9420 msgr2=0x7f3df415f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.312+0000 7f3dfa1d7700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40c9420 0x7f3df415f760 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3df000c490 tx=0x7f3df000c850 comp rx=0 tx=0).stop 2023-11-17T06:30:07.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.316+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/3382345625 shutdown_connections 2023-11-17T06:30:07.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.316+0000 7f3dfa1d7700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3dd8066510 0x7f3dd80689d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.316+0000 7f3dfa1d7700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3df415d3e0 0x7f3df40c66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.316+0000 7f3dfa1d7700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3df40cbc30 0x7f3df415e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.316+0000 7f3dfa1d7700 1 --2- 172.21.15.69:0/3382345625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3df40c9420 0x7f3df415f760 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.316+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/3382345625 >> 172.21.15.69:0/3382345625 conn(0x7f3df40b0900 msgr2=0x7f3df40cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:07.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.316+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/3382345625 shutdown_connections 2023-11-17T06:30:07.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.316+0000 7f3dfa1d7700 1 -- 172.21.15.69:0/3382345625 wait complete. 2023-11-17T06:30:07.339 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-17T06:30:07.339 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:07.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.508+0000 7fdc2c60f700 1 Processor -- start 2023-11-17T06:30:07.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.508+0000 7fdc2c60f700 1 -- start start 2023-11-17T06:30:07.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc2c60f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 0x7fdc240cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc2c60f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdc240cbfc0 0x7fdc240ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc2c60f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc24166040 con 0x7fdc240ce5d0 2023-11-17T06:30:07.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc2c60f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc24165430 con 0x7fdc240cbfc0 2023-11-17T06:30:07.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc2c60f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc24165710 con 0x7fdc241617a0 2023-11-17T06:30:07.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc29baa700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdc240cbfc0 0x7fdc240ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc29baa700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdc240cbfc0 0x7fdc240ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48126/0 (socket says 172.21.15.69:48126) 2023-11-17T06:30:07.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc29baa700 1 -- 172.21.15.69:0/1599624393 learned_addr learned my addr 172.21.15.69:0/1599624393 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:07.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc2a3ab700 1 --2- 172.21.15.69:0/1599624393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 0x7fdc240cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc29baa700 1 -- 172.21.15.69:0/1599624393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 msgr2=0x7fdc240cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:07.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc29baa700 1 --2- 172.21.15.69:0/1599624393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 0x7fdc240cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc29baa700 1 -- 172.21.15.69:0/1599624393 >> v1:172.21.15.69:6789/0 conn(0x7fdc240ce5d0 legacy=0x7fdc240b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc29baa700 1 -- 172.21.15.69:0/1599624393 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240cc420 con 0x7fdc240cbfc0 2023-11-17T06:30:07.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.512+0000 7fdc293a9700 1 -- 172.21.15.69:0/1599624393 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531275909 0 0) 0x7fdc24166040 con 0x7fdc240ce5d0 2023-11-17T06:30:07.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc29baa700 1 --2- 172.21.15.69:0/1599624393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 0x7fdc240ce090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009910 tx=0x7fdc14009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ccee62993ca63a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc293a9700 1 -- 172.21.15.69:0/1599624393 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1400ba60 con 0x7fdc240cbfc0 2023-11-17T06:30:07.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc293a9700 1 -- 172.21.15.69:0/1599624393 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1400bbc0 con 0x7fdc240cbfc0 2023-11-17T06:30:07.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc293a9700 1 -- 172.21.15.69:0/1599624393 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14009e60 con 0x7fdc240cbfc0 2023-11-17T06:30:07.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc2c60f700 1 -- 172.21.15.69:0/1599624393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 msgr2=0x7fdc240ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc2c60f700 1 --2- 172.21.15.69:0/1599624393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 0x7fdc240ce090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdc14009910 tx=0x7fdc14009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:07.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc2c60f700 1 -- 172.21.15.69:0/1599624393 shutdown_connections 2023-11-17T06:30:07.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc2c60f700 1 --2- 172.21.15.69:0/1599624393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 0x7fdc240ce090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc2c60f700 1 --2- 172.21.15.69:0/1599624393 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 0x7fdc240cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc2c60f700 1 -- 172.21.15.69:0/1599624393 >> 172.21.15.69:0/1599624393 conn(0x7fdc2406a480 msgr2=0x7fdc2406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:07.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc2c60f700 1 -- 172.21.15.69:0/1599624393 shutdown_connections 2023-11-17T06:30:07.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.516+0000 7fdc2c60f700 1 -- 172.21.15.69:0/1599624393 wait complete. 2023-11-17T06:30:07.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2c60f700 1 Processor -- start 2023-11-17T06:30:07.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2c60f700 1 -- start start 2023-11-17T06:30:07.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2c60f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 0x7fdc241f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2c60f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc240ce5d0 0x7fdc240c4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2c60f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 0x7fdc240c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2c60f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240af870 con 0x7fdc240cbfc0 2023-11-17T06:30:07.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2c60f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240c5090 con 0x7fdc240ce5d0 2023-11-17T06:30:07.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2c60f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc240c5370 con 0x7fdc241617a0 2023-11-17T06:30:07.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2a3ab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 0x7fdc241f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2a3ab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 0x7fdc241f68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48130/0 (socket says 172.21.15.69:48130) 2023-11-17T06:30:07.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2a3ab700 1 -- 172.21.15.69:0/4210835213 learned_addr learned my addr 172.21.15.69:0/4210835213 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:07.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2abac700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 0x7fdc240c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc29baa700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc240ce5d0 0x7fdc240c4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2a3ab700 1 -- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 msgr2=0x7fdc240c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2a3ab700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 0x7fdc240c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2a3ab700 1 -- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc240ce5d0 msgr2=0x7fdc240c4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2a3ab700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc240ce5d0 0x7fdc240c4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2a3ab700 1 -- 172.21.15.69:0/4210835213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc14009570 con 0x7fdc240cbfc0 2023-11-17T06:30:07.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2abac700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 0x7fdc240c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:07.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.520+0000 7fdc2a3ab700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 0x7fdc241f68a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000d800 tx=0x7fdc2000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.524+0000 7fdc1affd700 1 -- 172.21.15.69:0/4210835213 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc200125f0 con 0x7fdc240cbfc0 2023-11-17T06:30:07.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.524+0000 7fdc1affd700 1 -- 172.21.15.69:0/4210835213 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc20012750 con 0x7fdc240cbfc0 2023-11-17T06:30:07.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.524+0000 7fdc1affd700 1 -- 172.21.15.69:0/4210835213 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc20012ac0 con 0x7fdc240cbfc0 2023-11-17T06:30:07.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.524+0000 7fdc2c60f700 1 -- 172.21.15.69:0/4210835213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc240c5650 con 0x7fdc240cbfc0 2023-11-17T06:30:07.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.524+0000 7fdc2c60f700 1 -- 172.21.15.69:0/4210835213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc241f6de0 con 0x7fdc240cbfc0 2023-11-17T06:30:07.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.524+0000 7fdc2c60f700 1 -- 172.21.15.69:0/4210835213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc240c5c50 con 0x7fdc240cbfc0 2023-11-17T06:30:07.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.528+0000 7fdc1affd700 1 -- 172.21.15.69:0/4210835213 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdc20012c20 con 0x7fdc240cbfc0 2023-11-17T06:30:07.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.528+0000 7fdc1affd700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdc08066510 0x7fdc080689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.528+0000 7fdc1affd700 1 -- 172.21.15.69:0/4210835213 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc20084220 con 0x7fdc240cbfc0 2023-11-17T06:30:07.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.528+0000 7fdc29baa700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdc08066510 0x7fdc080689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.528+0000 7fdc29baa700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdc08066510 0x7fdc080689d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdc14000c00 tx=0x7fdc14008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.536+0000 7fdc1affd700 1 -- 172.21.15.69:0/4210835213 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdc20051690 con 0x7fdc240cbfc0 2023-11-17T06:30:07.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.708+0000 7fdc2c60f700 1 -- 172.21.15.69:0/4210835213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc24073f00 con 0x7fdc240cbfc0 2023-11-17T06:30:07.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.712+0000 7fdc1affd700 1 -- 172.21.15.69:0/4210835213 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fdc20012ed0 con 0x7fdc240cbfc0 2023-11-17T06:30:07.717 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:07.717 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:58.004301+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:07.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 -- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdc08066510 msgr2=0x7fdc080689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdc08066510 0x7fdc080689d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdc14000c00 tx=0x7fdc14008030 comp rx=0 tx=0).stop 2023-11-17T06:30:07.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 -- 172.21.15.69:0/4210835213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 msgr2=0x7fdc241f68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 0x7fdc241f68a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000d800 tx=0x7fdc2000dbc0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 -- 172.21.15.69:0/4210835213 shutdown_connections 2023-11-17T06:30:07.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdc08066510 0x7fdc080689d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdc241617a0 0x7fdc240c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdc240ce5d0 0x7fdc240c4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 --2- 172.21.15.69:0/4210835213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdc240cbfc0 0x7fdc241f68a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 -- 172.21.15.69:0/4210835213 >> 172.21.15.69:0/4210835213 conn(0x7fdc2406a480 msgr2=0x7fdc2415c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:07.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 -- 172.21.15.69:0/4210835213 shutdown_connections 2023-11-17T06:30:07.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.716+0000 7fdc2c60f700 1 -- 172.21.15.69:0/4210835213 wait complete. 2023-11-17T06:30:07.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:07.740 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:07.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.912+0000 7fdf918f9700 1 Processor -- start 2023-11-17T06:30:07.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.912+0000 7fdf918f9700 1 -- start start 2023-11-17T06:30:07.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf918f9700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdf8c0c21a0 0x7fdf8c06c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf918f9700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c06c200 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf918f9700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c165d00 con 0x7fdf8c1652b0 2023-11-17T06:30:07.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf918f9700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c1662c0 con 0x7fdf8c0c21a0 2023-11-17T06:30:07.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf908f7700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdf8c0c21a0 0x7fdf8c06c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf910f8700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fdf8c0cbef0 0x7fdf8c0cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59194/0 (socket says 172.21.15.69:59194) 2023-11-17T06:30:07.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf910f8700 1 -- 172.21.15.69:0/252730754 learned_addr learned my addr 172.21.15.69:0/252730754 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:07.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf837fe700 1 -- 172.21.15.69:0/252730754 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547946949 0 0) 0x7fdf8c06c200 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf837fe700 1 -- 172.21.15.69:0/252730754 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf740035d0 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf837fe700 1 -- 172.21.15.69:0/252730754 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345384492 0 0) 0x7fdf8c165d00 con 0x7fdf8c1652b0 2023-11-17T06:30:07.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf908f7700 1 -- 172.21.15.69:0/252730754 >> v1:172.21.15.93:6789/0 conn(0x7fdf8c1652b0 legacy=0x7fdf8c0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf908f7700 1 -- 172.21.15.69:0/252730754 >> v1:172.21.15.69:6789/0 conn(0x7fdf8c0cbef0 legacy=0x7fdf8c0cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.916+0000 7fdf908f7700 1 -- 172.21.15.69:0/252730754 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c165fe0 con 0x7fdf8c0c21a0 2023-11-17T06:30:07.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf908f7700 1 --2- 172.21.15.69:0/252730754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0c21a0 0x7fdf8c06c690 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009dc0 tx=0x7fdf8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718612fbec7a2d89 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf837fe700 1 -- 172.21.15.69:0/252730754 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8800e070 con 0x7fdf8c0c21a0 2023-11-17T06:30:07.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf837fe700 1 -- 172.21.15.69:0/252730754 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf8800bae0 con 0x7fdf8c0c21a0 2023-11-17T06:30:07.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf837fe700 1 -- 172.21.15.69:0/252730754 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8800be90 con 0x7fdf8c0c21a0 2023-11-17T06:30:07.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf918f9700 1 -- 172.21.15.69:0/252730754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0c21a0 msgr2=0x7fdf8c06c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf918f9700 1 --2- 172.21.15.69:0/252730754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0c21a0 0x7fdf8c06c690 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009dc0 tx=0x7fdf8800b330 comp rx=0 tx=0).stop 2023-11-17T06:30:07.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf918f9700 1 -- 172.21.15.69:0/252730754 shutdown_connections 2023-11-17T06:30:07.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf918f9700 1 --2- 172.21.15.69:0/252730754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0c21a0 0x7fdf8c06c690 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf918f9700 1 -- 172.21.15.69:0/252730754 >> 172.21.15.69:0/252730754 conn(0x7fdf8c0b0900 msgr2=0x7fdf8c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:07.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf918f9700 1 -- 172.21.15.69:0/252730754 shutdown_connections 2023-11-17T06:30:07.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf918f9700 1 -- 172.21.15.69:0/252730754 wait complete. 2023-11-17T06:30:07.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf918f9700 1 Processor -- start 2023-11-17T06:30:07.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.920+0000 7fdf918f9700 1 -- start start 2023-11-17T06:30:07.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf918f9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf8c0c21a0 0x7fdf8c0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf918f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0cbef0 0x7fdf8c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf918f9700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdf8c1652b0 0x7fdf8c1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf918f9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c152a70 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf918f9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c150050 con 0x7fdf8c0c21a0 2023-11-17T06:30:07.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf918f9700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c150330 con 0x7fdf8c1652b0 2023-11-17T06:30:07.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf83fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0cbef0 0x7fdf8c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf83fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0cbef0 0x7fdf8c152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48146/0 (socket says 172.21.15.69:48146) 2023-11-17T06:30:07.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf83fff700 1 -- 172.21.15.69:0/9268082 learned_addr learned my addr 172.21.15.69:0/9268082 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:07.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf908f7700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf8c0c21a0 0x7fdf8c0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf910f8700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdf8c1652b0 0x7fdf8c1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf83fff700 1 -- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdf8c1652b0 msgr2=0x7fdf8c1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf83fff700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdf8c1652b0 0x7fdf8c1510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf83fff700 1 -- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf8c0c21a0 msgr2=0x7fdf8c0b47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf83fff700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf8c0c21a0 0x7fdf8c0b47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf83fff700 1 -- 172.21.15.69:0/9268082 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88009a70 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf83fff700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0cbef0 0x7fdf8c152530 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00c520 tx=0x7fdf7c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf817fa700 1 -- 172.21.15.69:0/9268082 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0054e0 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf817fa700 1 -- 172.21.15.69:0/9268082 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0036a0 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf918f9700 1 -- 172.21.15.69:0/9268082 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c150610 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf817fa700 1 -- 172.21.15.69:0/9268082 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c003a50 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.924+0000 7fdf918f9700 1 -- 172.21.15.69:0/9268082 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c150bd0 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.928+0000 7fdf918f9700 1 -- 172.21.15.69:0/9268082 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c073f00 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.928+0000 7fdf817fa700 1 -- 172.21.15.69:0/9268082 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdf7c003bb0 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.932+0000 7fdf817fa700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdf78066510 0x7fdf780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:07.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.932+0000 7fdf817fa700 1 -- 172.21.15.69:0/9268082 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf7c083210 con 0x7fdf8c0cbef0 2023-11-17T06:30:07.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.932+0000 7fdf908f7700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdf78066510 0x7fdf780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:07.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.932+0000 7fdf908f7700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdf78066510 0x7fdf780689d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdf88014040 tx=0x7fdf8801e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:07.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:07.936+0000 7fdf817fa700 1 -- 172.21.15.69:0/9268082 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdf7c050690 con 0x7fdf8c0cbef0 2023-11-17T06:30:08.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.112+0000 7fdf918f9700 1 -- 172.21.15.69:0/9268082 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf8c0c6150 con 0x7fdf8c0cbef0 2023-11-17T06:30:08.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.112+0000 7fdf817fa700 1 -- 172.21.15.69:0/9268082 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf7c017020 con 0x7fdf8c0cbef0 2023-11-17T06:30:08.117 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:08.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 -- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdf78066510 msgr2=0x7fdf780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdf78066510 0x7fdf780689d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdf88014040 tx=0x7fdf8801e040 comp rx=0 tx=0).stop 2023-11-17T06:30:08.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 -- 172.21.15.69:0/9268082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0cbef0 msgr2=0x7fdf8c152530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0cbef0 0x7fdf8c152530 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00c520 tx=0x7fdf7c00c830 comp rx=0 tx=0).stop 2023-11-17T06:30:08.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 -- 172.21.15.69:0/9268082 shutdown_connections 2023-11-17T06:30:08.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdf78066510 0x7fdf780689d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdf8c1652b0 0x7fdf8c1510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0cbef0 0x7fdf8c152530 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 --2- 172.21.15.69:0/9268082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdf8c0c21a0 0x7fdf8c0b47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 -- 172.21.15.69:0/9268082 >> 172.21.15.69:0/9268082 conn(0x7fdf8c0b0900 msgr2=0x7fdf8c0ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:08.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 -- 172.21.15.69:0/9268082 shutdown_connections 2023-11-17T06:30:08.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.116+0000 7fdf918f9700 1 -- 172.21.15.69:0/9268082 wait complete. 2023-11-17T06:30:08.146 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:08.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.328+0000 7f37995de700 1 Processor -- start 2023-11-17T06:30:08.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.328+0000 7f37995de700 1 -- start start 2023-11-17T06:30:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37995de700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f37940b8bc0 0x7f37940cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37995de700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f37940ce310 0x7f37940b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37995de700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37940b9000 con 0x7f379415d490 2023-11-17T06:30:08.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37995de700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37940ce7c0 con 0x7f37940ce310 2023-11-17T06:30:08.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37995de700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37940d1bb0 con 0x7f37940b8bc0 2023-11-17T06:30:08.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37937fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f37940ce310 0x7f37940b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37937fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f37940ce310 0x7f37940b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48162/0 (socket says 172.21.15.69:48162) 2023-11-17T06:30:08.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37937fe700 1 -- 172.21.15.69:0/2341135029 learned_addr learned my addr 172.21.15.69:0/2341135029 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:08.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37927fc700 1 --2- 172.21.15.69:0/2341135029 >> v2:172.21.15.93:3300/0 conn(0x7f37940b8bc0 0x7f37940cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37937fe700 1 -- 172.21.15.69:0/2341135029 >> v2:172.21.15.93:3300/0 conn(0x7f37940b8bc0 msgr2=0x7f37940cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:08.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37937fe700 1 --2- 172.21.15.69:0/2341135029 >> v2:172.21.15.93:3300/0 conn(0x7f37940b8bc0 0x7f37940cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37937fe700 1 -- 172.21.15.69:0/2341135029 >> v1:172.21.15.93:6789/0 conn(0x7f379415d490 legacy=0x7f37940d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:08.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37937fe700 1 -- 172.21.15.69:0/2341135029 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940d1e90 con 0x7f37940ce310 2023-11-17T06:30:08.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f37937fe700 1 --2- 172.21.15.69:0/2341135029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940ce310 0x7f37940b6130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f379406bbc0 tx=0x7f378c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27461e98bbed8d2a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f3791ffb700 1 -- 172.21.15.69:0/2341135029 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c00e070 con 0x7f37940ce310 2023-11-17T06:30:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f3791ffb700 1 -- 172.21.15.69:0/2341135029 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c00b9c0 con 0x7f37940ce310 2023-11-17T06:30:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.332+0000 7f3791ffb700 1 -- 172.21.15.69:0/2341135029 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c00bd70 con 0x7f37940ce310 2023-11-17T06:30:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.336+0000 7f37995de700 1 -- 172.21.15.69:0/2341135029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940ce310 msgr2=0x7f37940b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.336+0000 7f37995de700 1 --2- 172.21.15.69:0/2341135029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940ce310 0x7f37940b6130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f379406bbc0 tx=0x7f378c00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.336+0000 7f37995de700 1 -- 172.21.15.69:0/2341135029 shutdown_connections 2023-11-17T06:30:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.336+0000 7f37995de700 1 --2- 172.21.15.69:0/2341135029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940ce310 0x7f37940b6130 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.336+0000 7f37995de700 1 --2- 172.21.15.69:0/2341135029 >> v2:172.21.15.93:3300/0 conn(0x7f37940b8bc0 0x7f37940cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.336+0000 7f37995de700 1 -- 172.21.15.69:0/2341135029 >> 172.21.15.69:0/2341135029 conn(0x7f379406ab40 msgr2=0x7f379406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.336+0000 7f37995de700 1 -- 172.21.15.69:0/2341135029 shutdown_connections 2023-11-17T06:30:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.336+0000 7f37995de700 1 -- 172.21.15.69:0/2341135029 wait complete. 2023-11-17T06:30:08.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.336+0000 7f37995de700 1 Processor -- start 2023-11-17T06:30:08.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37995de700 1 -- start start 2023-11-17T06:30:08.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37995de700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940b8bc0 0x7f3794155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37995de700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f37940ce310 0x7f37941460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37995de700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f379415d490 0x7f37940c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37995de700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3794145600 con 0x7f37940b8bc0 2023-11-17T06:30:08.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37995de700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37940cdd30 con 0x7f379415d490 2023-11-17T06:30:08.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37995de700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37940ce010 con 0x7f37940ce310 2023-11-17T06:30:08.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f3792ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940b8bc0 0x7f3794155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f3792ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940b8bc0 0x7f3794155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48174/0 (socket says 172.21.15.69:48174) 2023-11-17T06:30:08.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f3792ffd700 1 -- 172.21.15.69:0/3167857691 learned_addr learned my addr 172.21.15.69:0/3167857691 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:08.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37927fc700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f37940ce310 0x7f37941460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f3792ffd700 1 -- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f37940ce310 msgr2=0x7f37941460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37937fe700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f379415d490 0x7f37940c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f3792ffd700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f37940ce310 0x7f37941460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f3792ffd700 1 -- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f379415d490 msgr2=0x7f37940c8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f3792ffd700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f379415d490 0x7f37940c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f3792ffd700 1 -- 172.21.15.69:0/3167857691 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c009b30 con 0x7f37940b8bc0 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37927fc700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f37940ce310 0x7f37941460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f3792ffd700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940b8bc0 0x7f3794155070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f378400c500 tx=0x7f378400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f377b7fe700 1 -- 172.21.15.69:0/3167857691 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37840052d0 con 0x7f37940b8bc0 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f377b7fe700 1 -- 172.21.15.69:0/3167857691 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3784005430 con 0x7f37940b8bc0 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37995de700 1 -- 172.21.15.69:0/3167857691 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37941458c0 con 0x7f37940b8bc0 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f377b7fe700 1 -- 172.21.15.69:0/3167857691 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37840055a0 con 0x7f37940b8bc0 2023-11-17T06:30:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.340+0000 7f37995de700 1 -- 172.21.15.69:0/3167857691 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37940c88a0 con 0x7f37940b8bc0 2023-11-17T06:30:08.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.344+0000 7f37995de700 1 -- 172.21.15.69:0/3167857691 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3794145de0 con 0x7f37940b8bc0 2023-11-17T06:30:08.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.344+0000 7f377b7fe700 1 -- 172.21.15.69:0/3167857691 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f37840038e0 con 0x7f37940b8bc0 2023-11-17T06:30:08.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.344+0000 7f377b7fe700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3780066510 0x7f37800689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.348+0000 7f377b7fe700 1 -- 172.21.15.69:0/3167857691 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3784083190 con 0x7f37940b8bc0 2023-11-17T06:30:08.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.348+0000 7f37927fc700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3780066510 0x7f37800689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.348+0000 7f37927fc700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3780066510 0x7f37800689d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f379415a2e0 tx=0x7f3788008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.352+0000 7f377b7fe700 1 -- 172.21.15.69:0/3167857691 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3794145de0 con 0x7f37940b8bc0 2023-11-17T06:30:08.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.524+0000 7f37995de700 1 -- 172.21.15.69:0/3167857691 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37940b9000 con 0x7f37940b8bc0 2023-11-17T06:30:08.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.524+0000 7f377b7fe700 1 -- 172.21.15.69:0/3167857691 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37940b9000 con 0x7f37940b8bc0 2023-11-17T06:30:08.529 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:08.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 -- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3780066510 msgr2=0x7f37800689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3780066510 0x7f37800689d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f379415a2e0 tx=0x7f3788008040 comp rx=0 tx=0).stop 2023-11-17T06:30:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 -- 172.21.15.69:0/3167857691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940b8bc0 msgr2=0x7f3794155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940b8bc0 0x7f3794155070 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f378400c500 tx=0x7f378400c8c0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 -- 172.21.15.69:0/3167857691 shutdown_connections 2023-11-17T06:30:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3780066510 0x7f37800689d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f379415d490 0x7f37940c8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f37940ce310 0x7f37941460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 --2- 172.21.15.69:0/3167857691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37940b8bc0 0x7f3794155070 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 -- 172.21.15.69:0/3167857691 >> 172.21.15.69:0/3167857691 conn(0x7f379406ab40 msgr2=0x7f379415a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 -- 172.21.15.69:0/3167857691 shutdown_connections 2023-11-17T06:30:08.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.528+0000 7f37995de700 1 -- 172.21.15.69:0/3167857691 wait complete. 2023-11-17T06:30:08.553 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:08.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.728+0000 7fafa5f5d700 1 Processor -- start 2023-11-17T06:30:08.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.728+0000 7fafa5f5d700 1 -- start start 2023-11-17T06:30:08.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa5f5d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafa00b3000 0x7fafa00cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa5f5d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fafa015c0c0 0x7fafa00cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa5f5d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa00d0cd0 con 0x7fafa00b6280 2023-11-17T06:30:08.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa5f5d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa015c610 con 0x7fafa015c0c0 2023-11-17T06:30:08.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa5f5d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00d0560 con 0x7fafa00b3000 2023-11-17T06:30:08.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa575c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fafa015c0c0 0x7fafa00cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa575c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fafa015c0c0 0x7fafa00cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48182/0 (socket says 172.21.15.69:48182) 2023-11-17T06:30:08.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa575c700 1 -- 172.21.15.69:0/3487798165 learned_addr learned my addr 172.21.15.69:0/3487798165 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:08.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7faf9ffff700 1 --2- 172.21.15.69:0/3487798165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafa00b3000 0x7fafa00cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa575c700 1 -- 172.21.15.69:0/3487798165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafa00b3000 msgr2=0x7fafa00cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:08.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa575c700 1 --2- 172.21.15.69:0/3487798165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafa00b3000 0x7fafa00cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa575c700 1 -- 172.21.15.69:0/3487798165 >> v1:172.21.15.69:6789/0 conn(0x7fafa00b6280 legacy=0x7fafa00b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa575c700 1 -- 172.21.15.69:0/3487798165 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00cff00 con 0x7fafa015c0c0 2023-11-17T06:30:08.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.732+0000 7fafa575c700 1 --2- 172.21.15.69:0/3487798165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa015c0c0 0x7fafa00cea40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faf98009e50 tx=0x7faf9800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f290353feb89d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7faf9f7fe700 1 -- 172.21.15.69:0/3487798165 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9800e070 con 0x7fafa015c0c0 2023-11-17T06:30:08.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7faf9f7fe700 1 -- 172.21.15.69:0/3487798165 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9800b9c0 con 0x7fafa015c0c0 2023-11-17T06:30:08.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7faf9f7fe700 1 -- 172.21.15.69:0/3487798165 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9800bd70 con 0x7fafa015c0c0 2023-11-17T06:30:08.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7fafa5f5d700 1 -- 172.21.15.69:0/3487798165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa015c0c0 msgr2=0x7fafa00cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7fafa5f5d700 1 --2- 172.21.15.69:0/3487798165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa015c0c0 0x7fafa00cea40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faf98009e50 tx=0x7faf9800b330 comp rx=0 tx=0).stop 2023-11-17T06:30:08.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7fafa5f5d700 1 -- 172.21.15.69:0/3487798165 shutdown_connections 2023-11-17T06:30:08.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7fafa5f5d700 1 --2- 172.21.15.69:0/3487798165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa015c0c0 0x7fafa00cea40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7fafa5f5d700 1 --2- 172.21.15.69:0/3487798165 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafa00b3000 0x7fafa00cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7fafa5f5d700 1 -- 172.21.15.69:0/3487798165 >> 172.21.15.69:0/3487798165 conn(0x7fafa006dfa0 msgr2=0x7fafa006e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:08.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7fafa5f5d700 1 -- 172.21.15.69:0/3487798165 shutdown_connections 2023-11-17T06:30:08.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.736+0000 7fafa5f5d700 1 -- 172.21.15.69:0/3487798165 wait complete. 2023-11-17T06:30:08.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa5f5d700 1 Processor -- start 2023-11-17T06:30:08.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa5f5d700 1 -- start start 2023-11-17T06:30:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa5f5d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa00b3000 0x7fafa0150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa5f5d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafa00b6280 0x7fafa014c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa5f5d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafa015c0c0 0x7fafa0147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa5f5d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa0150ee0 con 0x7fafa00b3000 2023-11-17T06:30:08.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa5f5d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa0150920 con 0x7fafa00b6280 2023-11-17T06:30:08.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa5f5d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa0150c00 con 0x7fafa015c0c0 2023-11-17T06:30:08.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa4f5b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa00b3000 0x7fafa0150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa4f5b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa00b3000 0x7fafa0150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48186/0 (socket says 172.21.15.69:48186) 2023-11-17T06:30:08.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa4f5b700 1 -- 172.21.15.69:0/1894060884 learned_addr learned my addr 172.21.15.69:0/1894060884 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:08.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa575c700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafa015c0c0 0x7fafa0147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7faf9ffff700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafa00b6280 0x7fafa014c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa4f5b700 1 -- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafa015c0c0 msgr2=0x7fafa0147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa4f5b700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafa015c0c0 0x7fafa0147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa4f5b700 1 -- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafa00b6280 msgr2=0x7fafa014c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa4f5b700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafa00b6280 0x7fafa014c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa4f5b700 1 -- 172.21.15.69:0/1894060884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf98009b30 con 0x7fafa00b3000 2023-11-17T06:30:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa4f5b700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa00b3000 0x7fafa0150240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c500 tx=0x7faf9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7faf9d7fa700 1 -- 172.21.15.69:0/1894060884 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940052d0 con 0x7fafa00b3000 2023-11-17T06:30:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7faf9d7fa700 1 -- 172.21.15.69:0/1894060884 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf94005430 con 0x7fafa00b3000 2023-11-17T06:30:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa5f5d700 1 -- 172.21.15.69:0/1894060884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa014cf60 con 0x7fafa00b3000 2023-11-17T06:30:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7faf9d7fa700 1 -- 172.21.15.69:0/1894060884 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940055a0 con 0x7fafa00b3000 2023-11-17T06:30:08.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.740+0000 7fafa5f5d700 1 -- 172.21.15.69:0/1894060884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa014c590 con 0x7fafa00b3000 2023-11-17T06:30:08.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.744+0000 7fafa5f5d700 1 -- 172.21.15.69:0/1894060884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa014cdc0 con 0x7fafa00b3000 2023-11-17T06:30:08.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.744+0000 7faf9d7fa700 1 -- 172.21.15.69:0/1894060884 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faf940038e0 con 0x7fafa00b3000 2023-11-17T06:30:08.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.744+0000 7faf9d7fa700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faf8c066510 0x7faf8c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:08.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.744+0000 7faf9d7fa700 1 -- 172.21.15.69:0/1894060884 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf94083260 con 0x7fafa00b3000 2023-11-17T06:30:08.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.748+0000 7faf9ffff700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faf8c066510 0x7faf8c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:08.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.748+0000 7faf9ffff700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faf8c066510 0x7faf8c0689d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fafa00b3e00 tx=0x7faf90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:08.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.752+0000 7faf9d7fa700 1 -- 172.21.15.69:0/1894060884 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fafa014cdc0 con 0x7fafa00b3000 2023-11-17T06:30:08.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.924+0000 7fafa5f5d700 1 -- 172.21.15.69:0/1894060884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafa00d0cd0 con 0x7fafa00b3000 2023-11-17T06:30:08.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.924+0000 7faf9d7fa700 1 -- 172.21.15.69:0/1894060884 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafa00d0cd0 con 0x7fafa00b3000 2023-11-17T06:30:08.930 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:08.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 -- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faf8c066510 msgr2=0x7faf8c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faf8c066510 0x7faf8c0689d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fafa00b3e00 tx=0x7faf90008040 comp rx=0 tx=0).stop 2023-11-17T06:30:08.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 -- 172.21.15.69:0/1894060884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa00b3000 msgr2=0x7fafa0150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:08.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa00b3000 0x7fafa0150240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c500 tx=0x7faf9400c8c0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 -- 172.21.15.69:0/1894060884 shutdown_connections 2023-11-17T06:30:08.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faf8c066510 0x7faf8c0689d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafa015c0c0 0x7fafa0147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafa00b6280 0x7fafa014c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 --2- 172.21.15.69:0/1894060884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafa00b3000 0x7fafa0150240 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:08.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 -- 172.21.15.69:0/1894060884 >> 172.21.15.69:0/1894060884 conn(0x7fafa006dfa0 msgr2=0x7fafa006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:08.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 -- 172.21.15.69:0/1894060884 shutdown_connections 2023-11-17T06:30:08.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:08.928+0000 7fafa5f5d700 1 -- 172.21.15.69:0/1894060884 wait complete. 2023-11-17T06:30:08.953 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:30:09.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.112+0000 7feddd4ff700 1 Processor -- start 2023-11-17T06:30:09.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.112+0000 7feddd4ff700 1 -- start start 2023-11-17T06:30:09.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7feddd4ff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 0x7fedd80cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7feddd4ff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fedd80ce430 0x7fedd80d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7feddd4ff700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd80d1620 con 0x7fedd815d4b0 2023-11-17T06:30:09.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7feddd4ff700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd80ce8e0 con 0x7fedd80ce430 2023-11-17T06:30:09.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7feddd4ff700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd80d1320 con 0x7fedd80b8b20 2023-11-17T06:30:09.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd6ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fedd815d4b0 0x7fedd8161110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59216/0 (socket says 172.21.15.69:59216) 2023-11-17T06:30:09.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd6ffd700 1 -- 172.21.15.69:0/3969941451 learned_addr learned my addr 172.21.15.69:0/3969941451 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:09.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd77fe700 1 --2- 172.21.15.69:0/3969941451 >> v2:172.21.15.69:3300/0 conn(0x7fedd80ce430 0x7fedd80d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd67fc700 1 --2- 172.21.15.69:0/3969941451 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 0x7fedd80cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd5ffb700 1 -- 172.21.15.69:0/3969941451 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296228904 0 0) 0x7fedd80d1620 con 0x7fedd815d4b0 2023-11-17T06:30:09.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd5ffb700 1 -- 172.21.15.69:0/3969941451 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc00035d0 con 0x7fedd815d4b0 2023-11-17T06:30:09.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd67fc700 1 -- 172.21.15.69:0/3969941451 >> v2:172.21.15.69:3300/0 conn(0x7fedd80ce430 msgr2=0x7fedd80d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:09.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd67fc700 1 --2- 172.21.15.69:0/3969941451 >> v2:172.21.15.69:3300/0 conn(0x7fedd80ce430 0x7fedd80d1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd67fc700 1 -- 172.21.15.69:0/3969941451 >> v1:172.21.15.69:6789/0 conn(0x7fedd815d4b0 legacy=0x7fedd8161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd67fc700 1 -- 172.21.15.69:0/3969941451 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd81619f0 con 0x7fedd80b8b20 2023-11-17T06:30:09.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd77fe700 1 --2- 172.21.15.69:0/3969941451 >> v2:172.21.15.69:3300/0 conn(0x7fedd80ce430 0x7fedd80d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:09.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.116+0000 7fedd67fc700 1 --2- 172.21.15.69:0/3969941451 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 0x7fedd80cdef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009850 tx=0x7fedcc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af52cba40c268a6f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:09.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7fedd5ffb700 1 -- 172.21.15.69:0/3969941451 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc011830 con 0x7fedd80b8b20 2023-11-17T06:30:09.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7fedd5ffb700 1 -- 172.21.15.69:0/3969941451 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc011990 con 0x7fedd80b8b20 2023-11-17T06:30:09.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7fedd5ffb700 1 -- 172.21.15.69:0/3969941451 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc011d40 con 0x7fedd80b8b20 2023-11-17T06:30:09.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7feddd4ff700 1 -- 172.21.15.69:0/3969941451 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 msgr2=0x7fedd80cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7feddd4ff700 1 --2- 172.21.15.69:0/3969941451 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 0x7fedd80cdef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fedcc009850 tx=0x7fedcc009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:09.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7feddd4ff700 1 -- 172.21.15.69:0/3969941451 shutdown_connections 2023-11-17T06:30:09.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7feddd4ff700 1 --2- 172.21.15.69:0/3969941451 >> v2:172.21.15.69:3300/0 conn(0x7fedd80ce430 0x7fedd80d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7feddd4ff700 1 --2- 172.21.15.69:0/3969941451 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 0x7fedd80cdef0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7feddd4ff700 1 -- 172.21.15.69:0/3969941451 >> 172.21.15.69:0/3969941451 conn(0x7fedd806ac60 msgr2=0x7fedd806b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:09.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7feddd4ff700 1 -- 172.21.15.69:0/3969941451 shutdown_connections 2023-11-17T06:30:09.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.120+0000 7feddd4ff700 1 -- 172.21.15.69:0/3969941451 wait complete. 2023-11-17T06:30:09.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7feddd4ff700 1 Processor -- start 2023-11-17T06:30:09.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7feddd4ff700 1 -- start start 2023-11-17T06:30:09.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7feddd4ff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 0x7fedd8151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7feddd4ff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedd80ce430 0x7fedd815f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7feddd4ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedd815d4b0 0x7fedd815f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7feddd4ff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd80ccdb0 con 0x7fedd80ce430 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7feddd4ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd80cc130 con 0x7fedd815d4b0 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7feddd4ff700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd80cc410 con 0x7fedd80b8b20 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd67fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedd80ce430 0x7fedd815f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd67fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedd80ce430 0x7fedd815f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48210/0 (socket says 172.21.15.69:48210) 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd67fc700 1 -- 172.21.15.69:0/1453607956 learned_addr learned my addr 172.21.15.69:0/1453607956 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd77fe700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedd815d4b0 0x7fedd815f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd6ffd700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 0x7fedd8151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd67fc700 1 -- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 msgr2=0x7fedd8151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd67fc700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 0x7fedd8151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd67fc700 1 -- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedd815d4b0 msgr2=0x7fedd815f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd67fc700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedd815d4b0 0x7fedd815f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd67fc700 1 -- 172.21.15.69:0/1453607956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd0009a70 con 0x7fedd80ce430 2023-11-17T06:30:09.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd77fe700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedd815d4b0 0x7fedd815f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:09.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd6ffd700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 0x7fedd8151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:09.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.124+0000 7fedd67fc700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedd80ce430 0x7fedd815f190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0090b0 tx=0x7fedcc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:09.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.128+0000 7fedbf7fe700 1 -- 172.21.15.69:0/1453607956 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc004610 con 0x7fedd80ce430 2023-11-17T06:30:09.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.128+0000 7fedbf7fe700 1 -- 172.21.15.69:0/1453607956 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc01e070 con 0x7fedd80ce430 2023-11-17T06:30:09.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.128+0000 7feddd4ff700 1 -- 172.21.15.69:0/1453607956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc0094b0 con 0x7fedd80ce430 2023-11-17T06:30:09.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.128+0000 7fedbf7fe700 1 -- 172.21.15.69:0/1453607956 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0038c0 con 0x7fedd80ce430 2023-11-17T06:30:09.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.128+0000 7feddd4ff700 1 -- 172.21.15.69:0/1453607956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd80cc9d0 con 0x7fedd80ce430 2023-11-17T06:30:09.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.128+0000 7feddd4ff700 1 -- 172.21.15.69:0/1453607956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd80ccef0 con 0x7fedd80ce430 2023-11-17T06:30:09.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.128+0000 7fedbf7fe700 1 -- 172.21.15.69:0/1453607956 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fedcc003a20 con 0x7fedd80ce430 2023-11-17T06:30:09.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.132+0000 7fedbf7fe700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fedc4066510 0x7fedc40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:09.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.132+0000 7fedbf7fe700 1 -- 172.21.15.69:0/1453607956 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedcc020070 con 0x7fedd80ce430 2023-11-17T06:30:09.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.132+0000 7fedd6ffd700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fedc4066510 0x7fedc40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:09.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.132+0000 7fedd6ffd700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fedc4066510 0x7fedc40689d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fedc80011e0 tx=0x7fedc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:09.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.136+0000 7fedbf7fe700 1 -- 172.21.15.69:0/1453607956 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fedcc0527c0 con 0x7fedd80ce430 2023-11-17T06:30:09.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.348+0000 7feddd4ff700 1 -- 172.21.15.69:0/1453607956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedd80686a0 con 0x7fedd80ce430 2023-11-17T06:30:09.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.348+0000 7fedbf7fe700 1 -- 172.21.15.69:0/1453607956 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fedcc055de0 con 0x7fedd80ce430 2023-11-17T06:30:09.354 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:09.354 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/1178370379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1178370379},{"type":"v1","addr":"172.21.15.93:6835","nonce":1178370379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/2342979080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":2342979080},{"type":"v1","addr":"172.21.15.93:6837","nonce":2342979080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/1839590536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1839590536},{"type":"v1","addr":"172.21.15.69:6833","nonce":1839590536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:56.576603+0000","modified":"2023-11-17T06:29:59.616825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2440982410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2440982410},{"type":"v1","addr":"172.21.15.69:6835","nonce":2440982410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:30:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 -- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fedc4066510 msgr2=0x7fedc40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fedc4066510 0x7fedc40689d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fedc80011e0 tx=0x7fedc8009040 comp rx=0 tx=0).stop 2023-11-17T06:30:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 -- 172.21.15.69:0/1453607956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedd80ce430 msgr2=0x7fedd815f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedd80ce430 0x7fedd815f190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0090b0 tx=0x7fedcc004770 comp rx=0 tx=0).stop 2023-11-17T06:30:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 -- 172.21.15.69:0/1453607956 shutdown_connections 2023-11-17T06:30:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fedc4066510 0x7fedc40689d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedd815d4b0 0x7fedd815f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fedd80ce430 0x7fedd815f190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 --2- 172.21.15.69:0/1453607956 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fedd80b8b20 0x7fedd8151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:09.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 -- 172.21.15.69:0/1453607956 >> 172.21.15.69:0/1453607956 conn(0x7fedd806ac60 msgr2=0x7fedd80b1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:09.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 -- 172.21.15.69:0/1453607956 shutdown_connections 2023-11-17T06:30:09.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.352+0000 7feddd4ff700 1 -- 172.21.15.69:0/1453607956 wait complete. 2023-11-17T06:30:09.359 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-11-17T06:30:09.381 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:09.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.560+0000 7f19f669d700 1 Processor -- start 2023-11-17T06:30:14.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.564+0000 7f19f669d700 1 -- start start 2023-11-17T06:30:14.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.564+0000 7f19f669d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f19f00719e0 0x7f19f00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.564+0000 7f19f669d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 0x7f19f015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.564+0000 7f19f669d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f006fc20 con 0x7f19f015b980 2023-11-17T06:30:14.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.564+0000 7f19f669d700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f0070430 con 0x7f19f00719e0 2023-11-17T06:30:14.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.564+0000 7f19f669d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f015ed70 con 0x7f19f00c9960 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.564+0000 7f19f5e9c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 0x7f19f015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.564+0000 7f19f4e9a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f19f00719e0 0x7f19f00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.564+0000 7f19f569b700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f19f015b980 0x7f19f015f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:48702/0 (socket says 172.21.15.69:48702) 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.564+0000 7f19f569b700 1 -- 172.21.15.69:0/3055332359 learned_addr learned my addr 172.21.15.69:0/3055332359 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f5e9c700 1 -- 172.21.15.69:0/3055332359 >> v2:172.21.15.93:3300/0 conn(0x7f19f00719e0 msgr2=0x7f19f00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f5e9c700 1 --2- 172.21.15.69:0/3055332359 >> v2:172.21.15.93:3300/0 conn(0x7f19f00719e0 0x7f19f00c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f5e9c700 1 -- 172.21.15.69:0/3055332359 >> v1:172.21.15.93:6789/0 conn(0x7f19f015b980 legacy=0x7f19f015f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19e7fff700 1 -- 172.21.15.69:0/3055332359 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324650063 0 0) 0x7f19f006fc20 con 0x7f19f015b980 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f5e9c700 1 -- 172.21.15.69:0/3055332359 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f006fe70 con 0x7f19f00c9960 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f5e9c700 1 --2- 172.21.15.69:0/3055332359 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 0x7f19f015bd60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f19f015eeb0 tx=0x7f19e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a90131ba76ea00f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19e7fff700 1 -- 172.21.15.69:0/3055332359 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8016070 con 0x7f19f00c9960 2023-11-17T06:30:14.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19e7fff700 1 -- 172.21.15.69:0/3055332359 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e800bb20 con 0x7f19f00c9960 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19e7fff700 1 -- 172.21.15.69:0/3055332359 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e800e070 con 0x7f19f00c9960 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f669d700 1 -- 172.21.15.69:0/3055332359 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 msgr2=0x7f19f015bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f669d700 1 --2- 172.21.15.69:0/3055332359 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 0x7f19f015bd60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f19f015eeb0 tx=0x7f19e800b330 comp rx=0 tx=0).stop 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f669d700 1 -- 172.21.15.69:0/3055332359 shutdown_connections 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f669d700 1 --2- 172.21.15.69:0/3055332359 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 0x7f19f015bd60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f669d700 1 --2- 172.21.15.69:0/3055332359 >> v2:172.21.15.93:3300/0 conn(0x7f19f00719e0 0x7f19f00c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f669d700 1 -- 172.21.15.69:0/3055332359 >> 172.21.15.69:0/3055332359 conn(0x7f19f00b0900 msgr2=0x7f19f00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f669d700 1 -- 172.21.15.69:0/3055332359 shutdown_connections 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.568+0000 7f19f669d700 1 -- 172.21.15.69:0/3055332359 wait complete. 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.572+0000 7f19f669d700 1 Processor -- start 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.572+0000 7f19f669d700 1 -- start start 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.572+0000 7f19f669d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f00719e0 0x7f19f01f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.572+0000 7f19f669d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 0x7f19f01533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.572+0000 7f19f669d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f015b980 0x7f19f00b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.572+0000 7f19f669d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00b2e30 con 0x7f19f015b980 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.572+0000 7f19f669d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00b29a0 con 0x7f19f00719e0 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.572+0000 7f19f669d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f01f12b0 con 0x7f19f00c9960 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f5e9c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f015b980 0x7f19f00b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f5e9c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f015b980 0x7f19f00b2fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48212/0 (socket says 172.21.15.69:48212) 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f5e9c700 1 -- 172.21.15.69:0/2579183910 learned_addr learned my addr 172.21.15.69:0/2579183910 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f569b700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f00719e0 0x7f19f01f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f4e9a700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 0x7f19f01533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f5e9c700 1 -- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 msgr2=0x7f19f01533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f5e9c700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 0x7f19f01533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f5e9c700 1 -- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f00719e0 msgr2=0x7f19f01f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f5e9c700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f00719e0 0x7f19f01f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f5e9c700 1 -- 172.21.15.69:0/2579183910 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e8009a70 con 0x7f19f015b980 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f5e9c700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f015b980 0x7f19f00b2fd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f19e8014040 tx=0x7f19e8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19e5ffb700 1 -- 172.21.15.69:0/2579183910 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8016040 con 0x7f19f015b980 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19e5ffb700 1 -- 172.21.15.69:0/2579183910 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e801b440 con 0x7f19f015b980 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f669d700 1 -- 172.21.15.69:0/2579183910 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f00b1d90 con 0x7f19f015b980 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19e5ffb700 1 -- 172.21.15.69:0/2579183910 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e801b7f0 con 0x7f19f015b980 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f669d700 1 -- 172.21.15.69:0/2579183910 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f00b2350 con 0x7f19f015b980 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.576+0000 7f19f669d700 1 -- 172.21.15.69:0/2579183910 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f00b2b50 con 0x7f19f015b980 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.580+0000 7f19e5ffb700 1 -- 172.21.15.69:0/2579183910 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f19e801b950 con 0x7f19f015b980 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.580+0000 7f19e5ffb700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19d4066510 0x7f19d40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.580+0000 7f19e5ffb700 1 -- 172.21.15.69:0/2579183910 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19e8085be0 con 0x7f19f015b980 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.584+0000 7f19f569b700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19d4066510 0x7f19d40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.584+0000 7f19f569b700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19d4066510 0x7f19d40689d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f19ec000f60 tx=0x7f19ec007cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:14.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.588+0000 7f19e5ffb700 1 -- 172.21.15.69:0/2579183910 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f19f00b2b50 con 0x7f19f015b980 2023-11-17T06:30:14.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.772+0000 7f19f669d700 1 -- 172.21.15.69:0/2579183910 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19f00b2b10 con 0x7f19f015b980 2023-11-17T06:30:14.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.776+0000 7f19e5ffb700 1 -- 172.21.15.69:0/2579183910 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f19e80531a0 con 0x7f19f015b980 2023-11-17T06:30:14.468 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:14.468 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:58.004301+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:14.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 -- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19d4066510 msgr2=0x7f19d40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19d4066510 0x7f19d40689d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f19ec000f60 tx=0x7f19ec007cb0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 -- 172.21.15.69:0/2579183910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f015b980 msgr2=0x7f19f00b2fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f015b980 0x7f19f00b2fd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f19e8014040 tx=0x7f19e8004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 -- 172.21.15.69:0/2579183910 shutdown_connections 2023-11-17T06:30:14.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19d4066510 0x7f19d40689d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19f015b980 0x7f19f00b2fd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19f00c9960 0x7f19f01533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 --2- 172.21.15.69:0/2579183910 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f19f00719e0 0x7f19f01f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 -- 172.21.15.69:0/2579183910 >> 172.21.15.69:0/2579183910 conn(0x7f19f00b0900 msgr2=0x7f19f015a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:14.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 -- 172.21.15.69:0/2579183910 shutdown_connections 2023-11-17T06:30:14.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:09.780+0000 7f19f669d700 1 -- 172.21.15.69:0/2579183910 wait complete. 2023-11-17T06:30:14.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:14.476 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:14.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.660+0000 7f744de43700 1 Processor -- start 2023-11-17T06:30:14.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.660+0000 7f744de43700 1 -- start start 2023-11-17T06:30:14.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f744de43700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f744815d980 0x7f74480b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f744de43700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480b6750 con 0x7f74480b5270 2023-11-17T06:30:14.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f744de43700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74480b56d0 con 0x7f74480d1e70 2023-11-17T06:30:14.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f744de43700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480d2a30 con 0x7f744815d980 2023-11-17T06:30:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f7446ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f74480b5270 0x7f74480d1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:34688/0 (socket says 172.21.15.69:34688) 2023-11-17T06:30:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f7446ffd700 1 -- 172.21.15.69:0/696940215 learned_addr learned my addr 172.21.15.69:0/696940215 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f74477fe700 1 --2- 172.21.15.69:0/696940215 >> v2:172.21.15.93:3300/0 conn(0x7f744815d980 0x7f74480b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f74467fc700 1 -- 172.21.15.69:0/696940215 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985374868 0 0) 0x7f74480b6750 con 0x7f74480b5270 2023-11-17T06:30:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f74467fc700 1 -- 172.21.15.69:0/696940215 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74300035d0 con 0x7f74480b5270 2023-11-17T06:30:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f74477fe700 1 -- 172.21.15.69:0/696940215 >> v1:172.21.15.93:6789/0 conn(0x7f74480d1e70 legacy=0x7f74480b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f74467fc700 1 -- 172.21.15.69:0/696940215 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2264634599 0 0) 0x7f74480b56d0 con 0x7f74480d1e70 2023-11-17T06:30:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f74477fe700 1 -- 172.21.15.69:0/696940215 >> v1:172.21.15.69:6789/0 conn(0x7f74480b5270 legacy=0x7f74480d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.664+0000 7f74477fe700 1 -- 172.21.15.69:0/696940215 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480b6980 con 0x7f744815d980 2023-11-17T06:30:14.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f74477fe700 1 --2- 172.21.15.69:0/696940215 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f744815d980 0x7f74480b4d30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7438009850 tx=0x7f7438009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e175a2045dec9a8e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:14.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f74467fc700 1 -- 172.21.15.69:0/696940215 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438011830 con 0x7f744815d980 2023-11-17T06:30:14.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f74467fc700 1 -- 172.21.15.69:0/696940215 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7438011990 con 0x7f744815d980 2023-11-17T06:30:14.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f74467fc700 1 -- 172.21.15.69:0/696940215 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7438011d40 con 0x7f744815d980 2023-11-17T06:30:14.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f744de43700 1 -- 172.21.15.69:0/696940215 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f744815d980 msgr2=0x7f74480b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f744de43700 1 --2- 172.21.15.69:0/696940215 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f744815d980 0x7f74480b4d30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7438009850 tx=0x7f7438009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f744de43700 1 -- 172.21.15.69:0/696940215 shutdown_connections 2023-11-17T06:30:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f744de43700 1 --2- 172.21.15.69:0/696940215 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f744815d980 0x7f74480b4d30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f744de43700 1 -- 172.21.15.69:0/696940215 >> 172.21.15.69:0/696940215 conn(0x7f74480cfd30 msgr2=0x7f74480d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f744de43700 1 -- 172.21.15.69:0/696940215 shutdown_connections 2023-11-17T06:30:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.668+0000 7f744de43700 1 -- 172.21.15.69:0/696940215 wait complete. 2023-11-17T06:30:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.672+0000 7f744de43700 1 Processor -- start 2023-11-17T06:30:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.672+0000 7f744de43700 1 -- start start 2023-11-17T06:30:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.672+0000 7f744de43700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480b5270 0x7f744815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f744de43700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480d1e70 0x7f74481f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f744de43700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74481f84c0 0x7f744806f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f744de43700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744815c130 con 0x7f74480b5270 2023-11-17T06:30:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f744de43700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74481f7da0 con 0x7f74480d1e70 2023-11-17T06:30:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f744de43700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744806e6d0 con 0x7f74481f84c0 2023-11-17T06:30:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f74477fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480b5270 0x7f744815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f74477fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480b5270 0x7f744815bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49944/0 (socket says 172.21.15.69:49944) 2023-11-17T06:30:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f74477fe700 1 -- 172.21.15.69:0/417771662 learned_addr learned my addr 172.21.15.69:0/417771662 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f7446ffd700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480d1e70 0x7f74481f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f7447fff700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74481f84c0 0x7f744806f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f74477fe700 1 -- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74481f84c0 msgr2=0x7f744806f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f74477fe700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74481f84c0 0x7f744806f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f74477fe700 1 -- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480d1e70 msgr2=0x7f74481f7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f74477fe700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480d1e70 0x7f74481f7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f74477fe700 1 -- 172.21.15.69:0/417771662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380094b0 con 0x7f74480b5270 2023-11-17T06:30:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f74477fe700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480b5270 0x7f744815bbf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74480b59c0 tx=0x7f7438004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f742ffff700 1 -- 172.21.15.69:0/417771662 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743801aac0 con 0x7f74480b5270 2023-11-17T06:30:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f744de43700 1 -- 172.21.15.69:0/417771662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744806e9b0 con 0x7f74480b5270 2023-11-17T06:30:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f742ffff700 1 -- 172.21.15.69:0/417771662 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743801f070 con 0x7f74480b5270 2023-11-17T06:30:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f742ffff700 1 -- 172.21.15.69:0/417771662 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743801ae60 con 0x7f74480b5270 2023-11-17T06:30:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.676+0000 7f744de43700 1 -- 172.21.15.69:0/417771662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744806ef70 con 0x7f74480b5270 2023-11-17T06:30:14.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.680+0000 7f744de43700 1 -- 172.21.15.69:0/417771662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74480b49a0 con 0x7f74480b5270 2023-11-17T06:30:14.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.680+0000 7f742ffff700 1 -- 172.21.15.69:0/417771662 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f743801b430 con 0x7f74480b5270 2023-11-17T06:30:14.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.684+0000 7f742ffff700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7434066540 0x7f7434068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:14.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.684+0000 7f742ffff700 1 -- 172.21.15.69:0/417771662 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7438084fb0 con 0x7f74480b5270 2023-11-17T06:30:14.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.684+0000 7f7446ffd700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7434066540 0x7f7434068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:14.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.684+0000 7f7446ffd700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7434066540 0x7f7434068a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f74480701a0 tx=0x7f743c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:14.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.688+0000 7f742ffff700 1 -- 172.21.15.69:0/417771662 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f74380523a0 con 0x7f74480b5270 2023-11-17T06:30:14.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.864+0000 7f744de43700 1 -- 172.21.15.69:0/417771662 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7448073f00 con 0x7f74480b5270 2023-11-17T06:30:14.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.864+0000 7f742ffff700 1 -- 172.21.15.69:0/417771662 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74380559c0 con 0x7f74480b5270 2023-11-17T06:30:14.868 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 -- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7434066540 msgr2=0x7f7434068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7434066540 0x7f7434068a00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f74480701a0 tx=0x7f743c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 -- 172.21.15.69:0/417771662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480b5270 msgr2=0x7f744815bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480b5270 0x7f744815bbf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f74480b59c0 tx=0x7f7438004770 comp rx=0 tx=0).stop 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 -- 172.21.15.69:0/417771662 shutdown_connections 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7434066540 0x7f7434068a00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74481f84c0 0x7f744806f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480d1e70 0x7f74481f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 --2- 172.21.15.69:0/417771662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480b5270 0x7f744815bbf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 -- 172.21.15.69:0/417771662 >> 172.21.15.69:0/417771662 conn(0x7f74480cfd30 msgr2=0x7f74480d2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:14.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 -- 172.21.15.69:0/417771662 shutdown_connections 2023-11-17T06:30:14.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:14.868+0000 7f744de43700 1 -- 172.21.15.69:0/417771662 wait complete. 2023-11-17T06:30:14.895 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:15.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.080+0000 7fe3079a5700 1 Processor -- start 2023-11-17T06:30:15.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.084+0000 7fe3079a5700 1 -- start start 2023-11-17T06:30:15.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.084+0000 7fe3079a5700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 0x7fe300065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.084+0000 7fe3079a5700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe3000cf0f0 0x7fe3000c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.084+0000 7fe3079a5700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30006a7a0 con 0x7fe30006a2a0 2023-11-17T06:30:15.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.084+0000 7fe3079a5700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30006aa80 con 0x7fe3000cf0f0 2023-11-17T06:30:15.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.084+0000 7fe3079a5700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30006ad60 con 0x7fe3000cecd0 2023-11-17T06:30:15.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe304f40700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 0x7fe300065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe305741700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fe30006a2a0 0x7fe30006b840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:35826/0 (socket says 172.21.15.69:35826) 2023-11-17T06:30:15.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe305f42700 1 --2- 172.21.15.69:0/605196931 >> v2:172.21.15.93:3300/0 conn(0x7fe3000cf0f0 0x7fe3000c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe305741700 1 -- 172.21.15.69:0/605196931 learned_addr learned my addr 172.21.15.69:0/605196931 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:15.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe304f40700 1 -- 172.21.15.69:0/605196931 >> v2:172.21.15.93:3300/0 conn(0x7fe3000cf0f0 msgr2=0x7fe3000c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:15.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe304f40700 1 --2- 172.21.15.69:0/605196931 >> v2:172.21.15.93:3300/0 conn(0x7fe3000cf0f0 0x7fe3000c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe304f40700 1 -- 172.21.15.69:0/605196931 >> v1:172.21.15.93:6789/0 conn(0x7fe30006a2a0 legacy=0x7fe30006b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe304f40700 1 -- 172.21.15.69:0/605196931 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30006b040 con 0x7fe3000cecd0 2023-11-17T06:30:15.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe304f40700 1 --2- 172.21.15.69:0/605196931 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 0x7fe300065e90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009850 tx=0x7fe2f0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81df8d63effb1a05 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe2f7fff700 1 -- 172.21.15.69:0/605196931 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0011830 con 0x7fe3000cecd0 2023-11-17T06:30:15.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe2f7fff700 1 -- 172.21.15.69:0/605196931 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f0011990 con 0x7fe3000cecd0 2023-11-17T06:30:15.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe2f7fff700 1 -- 172.21.15.69:0/605196931 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0011d40 con 0x7fe3000cecd0 2023-11-17T06:30:15.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe3079a5700 1 -- 172.21.15.69:0/605196931 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 msgr2=0x7fe300065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe3079a5700 1 --2- 172.21.15.69:0/605196931 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 0x7fe300065e90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009850 tx=0x7fe2f0009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:15.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe3079a5700 1 -- 172.21.15.69:0/605196931 shutdown_connections 2023-11-17T06:30:15.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe3079a5700 1 --2- 172.21.15.69:0/605196931 >> v2:172.21.15.93:3300/0 conn(0x7fe3000cf0f0 0x7fe3000c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe3079a5700 1 --2- 172.21.15.69:0/605196931 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 0x7fe300065e90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.088+0000 7fe3079a5700 1 -- 172.21.15.69:0/605196931 >> 172.21.15.69:0/605196931 conn(0x7fe3000cc0d0 msgr2=0x7fe3000cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:15.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.092+0000 7fe3079a5700 1 -- 172.21.15.69:0/605196931 shutdown_connections 2023-11-17T06:30:15.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.092+0000 7fe3079a5700 1 -- 172.21.15.69:0/605196931 wait complete. 2023-11-17T06:30:15.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.092+0000 7fe3079a5700 1 Processor -- start 2023-11-17T06:30:15.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.092+0000 7fe3079a5700 1 -- start start 2023-11-17T06:30:15.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.092+0000 7fe3079a5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe30006a2a0 0x7fe30014e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.092+0000 7fe3079a5700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 0x7fe300148c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.092+0000 7fe3079a5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3000cf0f0 0x7fe30015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.092+0000 7fe3079a5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30015c770 con 0x7fe3000cf0f0 2023-11-17T06:30:15.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.092+0000 7fe3079a5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30015c490 con 0x7fe30006a2a0 2023-11-17T06:30:15.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.092+0000 7fe3079a5700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30014d7d0 con 0x7fe3000cecd0 2023-11-17T06:30:15.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe305f42700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3000cf0f0 0x7fe30015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe305f42700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3000cf0f0 0x7fe30015bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49954/0 (socket says 172.21.15.69:49954) 2023-11-17T06:30:15.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe305f42700 1 -- 172.21.15.69:0/990474835 learned_addr learned my addr 172.21.15.69:0/990474835 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:15.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe304f40700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 0x7fe300148c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe305741700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe30006a2a0 0x7fe30014e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe305f42700 1 -- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 msgr2=0x7fe300148c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe305f42700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 0x7fe300148c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe305f42700 1 -- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe30006a2a0 msgr2=0x7fe30014e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe305f42700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe30006a2a0 0x7fe30014e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe305f42700 1 -- 172.21.15.69:0/990474835 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f00094b0 con 0x7fe3000cf0f0 2023-11-17T06:30:15.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe305f42700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3000cf0f0 0x7fe30015bab0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800ef90 tx=0x7fe2f8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe2f5ffb700 1 -- 172.21.15.69:0/990474835 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8009b20 con 0x7fe3000cf0f0 2023-11-17T06:30:15.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe2f5ffb700 1 -- 172.21.15.69:0/990474835 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f800f040 con 0x7fe3000cf0f0 2023-11-17T06:30:15.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe3079a5700 1 -- 172.21.15.69:0/990474835 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30014dab0 con 0x7fe3000cf0f0 2023-11-17T06:30:15.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe2f5ffb700 1 -- 172.21.15.69:0/990474835 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800cc70 con 0x7fe3000cf0f0 2023-11-17T06:30:15.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe3079a5700 1 -- 172.21.15.69:0/990474835 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe300149150 con 0x7fe3000cf0f0 2023-11-17T06:30:15.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.096+0000 7fe3079a5700 1 -- 172.21.15.69:0/990474835 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3000674c0 con 0x7fe3000cf0f0 2023-11-17T06:30:15.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.100+0000 7fe2f5ffb700 1 -- 172.21.15.69:0/990474835 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe2f8014480 con 0x7fe3000cf0f0 2023-11-17T06:30:15.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.100+0000 7fe2f5ffb700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe2e4066510 0x7fe2e40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.104+0000 7fe2f5ffb700 1 -- 172.21.15.69:0/990474835 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2f8084880 con 0x7fe3000cf0f0 2023-11-17T06:30:15.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.104+0000 7fe305741700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe2e4066510 0x7fe2e40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.104+0000 7fe305741700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe2e4066510 0x7fe2e40689d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc005930 tx=0x7fe2fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.108+0000 7fe2f5ffb700 1 -- 172.21.15.69:0/990474835 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe2f8051cf0 con 0x7fe3000cf0f0 2023-11-17T06:30:15.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.284+0000 7fe3079a5700 1 -- 172.21.15.69:0/990474835 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe30014dfd0 con 0x7fe3000cf0f0 2023-11-17T06:30:15.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.284+0000 7fe2f5ffb700 1 -- 172.21.15.69:0/990474835 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe30014dfd0 con 0x7fe3000cf0f0 2023-11-17T06:30:15.288 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:15.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 -- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe2e4066510 msgr2=0x7fe2e40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe2e4066510 0x7fe2e40689d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc005930 tx=0x7fe2fc009040 comp rx=0 tx=0).stop 2023-11-17T06:30:15.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 -- 172.21.15.69:0/990474835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3000cf0f0 msgr2=0x7fe30015bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3000cf0f0 0x7fe30015bab0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800ef90 tx=0x7fe2f8009f60 comp rx=0 tx=0).stop 2023-11-17T06:30:15.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 -- 172.21.15.69:0/990474835 shutdown_connections 2023-11-17T06:30:15.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe2e4066510 0x7fe2e40689d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3000cf0f0 0x7fe30015bab0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe3000cecd0 0x7fe300148c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 --2- 172.21.15.69:0/990474835 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe30006a2a0 0x7fe30014e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 -- 172.21.15.69:0/990474835 >> 172.21.15.69:0/990474835 conn(0x7fe3000cc0d0 msgr2=0x7fe300153770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:15.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 -- 172.21.15.69:0/990474835 shutdown_connections 2023-11-17T06:30:15.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.288+0000 7fe3079a5700 1 -- 172.21.15.69:0/990474835 wait complete. 2023-11-17T06:30:15.313 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:15.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f880d3da700 1 Processor -- start 2023-11-17T06:30:15.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f880d3da700 1 -- start start 2023-11-17T06:30:15.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f880d3da700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f88080719e0 0x7f88080c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f880d3da700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880806fc20 con 0x7f88080c9960 2023-11-17T06:30:15.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f880d3da700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880806fe70 con 0x7f880815b980 2023-11-17T06:30:15.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f880d3da700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8808070430 con 0x7f88080719e0 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f880cbd9700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f88080c9960 0x7f880815bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:34702/0 (socket says 172.21.15.69:34702) 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f880cbd9700 1 -- 172.21.15.69:0/3833083492 learned_addr learned my addr 172.21.15.69:0/3833083492 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f88077fe700 1 --2- 172.21.15.69:0/3833083492 >> v2:172.21.15.93:3300/0 conn(0x7f88080719e0 0x7f88080c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f8806ffd700 1 -- 172.21.15.69:0/3833083492 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200853005 0 0) 0x7f880806fc20 con 0x7f88080c9960 2023-11-17T06:30:15.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f8806ffd700 1 -- 172.21.15.69:0/3833083492 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f00035d0 con 0x7f88080c9960 2023-11-17T06:30:15.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f88077fe700 1 -- 172.21.15.69:0/3833083492 >> v1:172.21.15.93:6789/0 conn(0x7f880815b980 legacy=0x7f880815f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f88077fe700 1 -- 172.21.15.69:0/3833083492 >> v1:172.21.15.69:6789/0 conn(0x7f88080c9960 legacy=0x7f880815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f8806ffd700 1 -- 172.21.15.69:0/3833083492 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1094788873 0 0) 0x7f87f00035d0 con 0x7f88080c9960 2023-11-17T06:30:15.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.480+0000 7f88077fe700 1 -- 172.21.15.69:0/3833083492 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8808070150 con 0x7f88080719e0 2023-11-17T06:30:15.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f88077fe700 1 --2- 172.21.15.69:0/3833083492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88080719e0 0x7f88080c9420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009850 tx=0x7f87fc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ced99b7b25858fc server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f8806ffd700 1 -- 172.21.15.69:0/3833083492 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000019f0 con 0x7f88080719e0 2023-11-17T06:30:15.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f8806ffd700 1 -- 172.21.15.69:0/3833083492 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc004030 con 0x7f88080719e0 2023-11-17T06:30:15.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f8806ffd700 1 -- 172.21.15.69:0/3833083492 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc0043c0 con 0x7f88080719e0 2023-11-17T06:30:15.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f880d3da700 1 -- 172.21.15.69:0/3833083492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88080719e0 msgr2=0x7f88080c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f880d3da700 1 --2- 172.21.15.69:0/3833083492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88080719e0 0x7f88080c9420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009850 tx=0x7f87fc009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:15.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f880d3da700 1 -- 172.21.15.69:0/3833083492 shutdown_connections 2023-11-17T06:30:15.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f880d3da700 1 --2- 172.21.15.69:0/3833083492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88080719e0 0x7f88080c9420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f880d3da700 1 -- 172.21.15.69:0/3833083492 >> 172.21.15.69:0/3833083492 conn(0x7f88080b0900 msgr2=0x7f88080b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:15.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f880d3da700 1 -- 172.21.15.69:0/3833083492 shutdown_connections 2023-11-17T06:30:15.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.484+0000 7f880d3da700 1 -- 172.21.15.69:0/3833083492 wait complete. 2023-11-17T06:30:15.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880d3da700 1 Processor -- start 2023-11-17T06:30:15.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880d3da700 1 -- start start 2023-11-17T06:30:15.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880d3da700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f88080719e0 0x7f880814efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880d3da700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88080c9960 0x7f88080c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880d3da700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f880815b980 0x7f88080c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880d3da700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88080b20f0 con 0x7f880815b980 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880d3da700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8808151930 con 0x7f88080c9960 2023-11-17T06:30:15.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880d3da700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f880814f510 con 0x7f88080719e0 2023-11-17T06:30:15.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880cbd9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f880815b980 0x7f88080c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880cbd9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f880815b980 0x7f88080c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49970/0 (socket says 172.21.15.69:49970) 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880cbd9700 1 -- 172.21.15.69:0/1945317832 learned_addr learned my addr 172.21.15.69:0/1945317832 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f88077fe700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88080c9960 0x7f88080c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f8807fff700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f88080719e0 0x7f880814efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880cbd9700 1 -- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f88080719e0 msgr2=0x7f880814efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880cbd9700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f88080719e0 0x7f880814efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880cbd9700 1 -- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88080c9960 msgr2=0x7f88080c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880cbd9700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88080c9960 0x7f88080c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880cbd9700 1 -- 172.21.15.69:0/1945317832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0094b0 con 0x7f880815b980 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f8807fff700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f88080719e0 0x7f880814efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:15.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880cbd9700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f880815b980 0x7f88080c7a50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f880000cc90 tx=0x7f880000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f8804ff9700 1 -- 172.21.15.69:0/1945317832 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880000ab80 con 0x7f880815b980 2023-11-17T06:30:15.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f8804ff9700 1 -- 172.21.15.69:0/1945317832 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880000ace0 con 0x7f880815b980 2023-11-17T06:30:15.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f880d3da700 1 -- 172.21.15.69:0/1945317832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8808150db0 con 0x7f880815b980 2023-11-17T06:30:15.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.488+0000 7f8804ff9700 1 -- 172.21.15.69:0/1945317832 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800007310 con 0x7f880815b980 2023-11-17T06:30:15.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.492+0000 7f880d3da700 1 -- 172.21.15.69:0/1945317832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8808151370 con 0x7f880815b980 2023-11-17T06:30:15.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.492+0000 7f880d3da700 1 -- 172.21.15.69:0/1945317832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88080b2260 con 0x7f880815b980 2023-11-17T06:30:15.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.492+0000 7f8804ff9700 1 -- 172.21.15.69:0/1945317832 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8800007470 con 0x7f880815b980 2023-11-17T06:30:15.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.496+0000 7f8804ff9700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f87f4066510 0x7f87f40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.496+0000 7f8804ff9700 1 -- 172.21.15.69:0/1945317832 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8800083dc0 con 0x7f880815b980 2023-11-17T06:30:15.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.496+0000 7f8807fff700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f87f4066510 0x7f87f40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.496+0000 7f8807fff700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f87f4066510 0x7f87f40689d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f87f8000f60 tx=0x7f87f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.500+0000 7f8804ff9700 1 -- 172.21.15.69:0/1945317832 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f88000511a0 con 0x7f880815b980 2023-11-17T06:30:15.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.676+0000 7f880d3da700 1 -- 172.21.15.69:0/1945317832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8808073f00 con 0x7f880815b980 2023-11-17T06:30:15.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.676+0000 7f8804ff9700 1 -- 172.21.15.69:0/1945317832 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88000180a0 con 0x7f880815b980 2023-11-17T06:30:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:15.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 -- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f87f4066510 msgr2=0x7f87f40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f87f4066510 0x7f87f40689d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f87f8000f60 tx=0x7f87f8009040 comp rx=0 tx=0).stop 2023-11-17T06:30:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 -- 172.21.15.69:0/1945317832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f880815b980 msgr2=0x7f88080c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f880815b980 0x7f88080c7a50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f880000cc90 tx=0x7f880000a060 comp rx=0 tx=0).stop 2023-11-17T06:30:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 -- 172.21.15.69:0/1945317832 shutdown_connections 2023-11-17T06:30:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f87f4066510 0x7f87f40689d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f880815b980 0x7f88080c7a50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f88080c9960 0x7f88080c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 --2- 172.21.15.69:0/1945317832 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f88080719e0 0x7f880814efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 -- 172.21.15.69:0/1945317832 >> 172.21.15.69:0/1945317832 conn(0x7f88080b0900 msgr2=0x7f88080cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:15.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 -- 172.21.15.69:0/1945317832 shutdown_connections 2023-11-17T06:30:15.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.680+0000 7f880d3da700 1 -- 172.21.15.69:0/1945317832 wait complete. 2023-11-17T06:30:15.705 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:30:15.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.884+0000 7fbee2d67700 1 Processor -- start 2023-11-17T06:30:15.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.884+0000 7fbee2d67700 1 -- start start 2023-11-17T06:30:15.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.884+0000 7fbee2d67700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbedc0b5440 0x7fbedc0d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.884+0000 7fbee2d67700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc0d1ca0 0x7fbedc0b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.884+0000 7fbee2d67700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc0b6750 con 0x7fbedc15d980 2023-11-17T06:30:15.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.884+0000 7fbee2d67700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc0d2a30 con 0x7fbedc0b5440 2023-11-17T06:30:15.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.884+0000 7fbee2d67700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0b6980 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbee1304700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc0d1ca0 0x7fbedc0b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbedbfff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbedc0b5440 0x7fbedc0d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbedbfff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbedc0b5440 0x7fbedc0d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:45038/0 (socket says 172.21.15.69:45038) 2023-11-17T06:30:15.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbedbfff700 1 -- 172.21.15.69:0/3101945966 learned_addr learned my addr 172.21.15.69:0/3101945966 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:15.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbee1304700 1 -- 172.21.15.69:0/3101945966 >> v2:172.21.15.93:3300/0 conn(0x7fbedc0b5440 msgr2=0x7fbedc0d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:15.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbee1304700 1 --2- 172.21.15.69:0/3101945966 >> v2:172.21.15.93:3300/0 conn(0x7fbedc0b5440 0x7fbedc0d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbee1304700 1 -- 172.21.15.69:0/3101945966 >> v1:172.21.15.93:6789/0 conn(0x7fbedc15d980 legacy=0x7fbedc0b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbee1304700 1 -- 172.21.15.69:0/3101945966 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0d2470 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbedbfff700 1 --2- 172.21.15.69:0/3101945966 >> v2:172.21.15.93:3300/0 conn(0x7fbedc0b5440 0x7fbedc0d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:15.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbee1304700 1 --2- 172.21.15.69:0/3101945966 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc0d1ca0 0x7fbedc0b7140 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009d90 tx=0x7fbed400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b9643a5de0dddef server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbedb7fe700 1 -- 172.21.15.69:0/3101945966 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed400e070 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbedb7fe700 1 -- 172.21.15.69:0/3101945966 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed400bb20 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.888+0000 7fbedb7fe700 1 -- 172.21.15.69:0/3101945966 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4012430 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.892+0000 7fbee2d67700 1 -- 172.21.15.69:0/3101945966 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc0d1ca0 msgr2=0x7fbedc0b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.892+0000 7fbee2d67700 1 --2- 172.21.15.69:0/3101945966 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc0d1ca0 0x7fbedc0b7140 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009d90 tx=0x7fbed400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.892+0000 7fbee2d67700 1 -- 172.21.15.69:0/3101945966 shutdown_connections 2023-11-17T06:30:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.892+0000 7fbee2d67700 1 --2- 172.21.15.69:0/3101945966 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc0d1ca0 0x7fbedc0b7140 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.892+0000 7fbee2d67700 1 --2- 172.21.15.69:0/3101945966 >> v2:172.21.15.93:3300/0 conn(0x7fbedc0b5440 0x7fbedc0d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.892+0000 7fbee2d67700 1 -- 172.21.15.69:0/3101945966 >> 172.21.15.69:0/3101945966 conn(0x7fbedc0cfd30 msgr2=0x7fbedc0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.892+0000 7fbee2d67700 1 -- 172.21.15.69:0/3101945966 shutdown_connections 2023-11-17T06:30:15.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.892+0000 7fbee2d67700 1 -- 172.21.15.69:0/3101945966 wait complete. 2023-11-17T06:30:15.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.892+0000 7fbee2d67700 1 Processor -- start 2023-11-17T06:30:15.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbee2d67700 1 -- start start 2023-11-17T06:30:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbee2d67700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbedc0b5440 0x7fbedc155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbee2d67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbedc0d1ca0 0x7fbedc0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbee2d67700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc146120 0x7fbedc145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbee2d67700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc154080 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbee2d67700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc154320 con 0x7fbedc0b5440 2023-11-17T06:30:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbee2d67700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc154600 con 0x7fbedc146120 2023-11-17T06:30:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbedbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbedc0d1ca0 0x7fbedc0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbedbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbedc0d1ca0 0x7fbedc0c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49974/0 (socket says 172.21.15.69:49974) 2023-11-17T06:30:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbedbfff700 1 -- 172.21.15.69:0/3349651309 learned_addr learned my addr 172.21.15.69:0/3349651309 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbee1304700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc146120 0x7fbedc145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbee0b03700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbedc0b5440 0x7fbedc155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbedbfff700 1 -- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc146120 msgr2=0x7fbedc145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbedbfff700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc146120 0x7fbedc145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbedbfff700 1 -- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbedc0b5440 msgr2=0x7fbedc155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:15.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbedbfff700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbedc0b5440 0x7fbedc155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:15.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbedbfff700 1 -- 172.21.15.69:0/3349651309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec8009570 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.896+0000 7fbedbfff700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbedc0d1ca0 0x7fbedc0c9160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbec800e9d0 tx=0x7fbec800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.900+0000 7fbed97fa700 1 -- 172.21.15.69:0/3349651309 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800ee70 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.900+0000 7fbee2d67700 1 -- 172.21.15.69:0/3349651309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed4009a70 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.900+0000 7fbed97fa700 1 -- 172.21.15.69:0/3349651309 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec800c850 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.900+0000 7fbed97fa700 1 -- 172.21.15.69:0/3349651309 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec800cbc0 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.900+0000 7fbee2d67700 1 -- 172.21.15.69:0/3349651309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc154bc0 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.900+0000 7fbee2d67700 1 -- 172.21.15.69:0/3349651309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc073f00 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.904+0000 7fbed97fa700 1 -- 172.21.15.69:0/3349651309 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbec800cd20 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.904+0000 7fbed97fa700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbec0066540 0x7fbec0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:15.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.904+0000 7fbed97fa700 1 -- 172.21.15.69:0/3349651309 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbec8083eb0 con 0x7fbedc0d1ca0 2023-11-17T06:30:15.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.904+0000 7fbee0b03700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbec0066540 0x7fbec0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:15.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.904+0000 7fbee0b03700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbec0066540 0x7fbec0068a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbed0000f60 tx=0x7fbed0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:15.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:15.912+0000 7fbed97fa700 1 -- 172.21.15.69:0/3349651309 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbec80512a0 con 0x7fbedc0d1ca0 2023-11-17T06:30:16.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.128+0000 7fbee2d67700 1 -- 172.21.15.69:0/3349651309 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbedc0cf7c0 con 0x7fbedc0d1ca0 2023-11-17T06:30:16.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.128+0000 7fbed97fa700 1 -- 172.21.15.69:0/3349651309 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fbec80548c0 con 0x7fbedc0d1ca0 2023-11-17T06:30:16.132 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:16.132 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/1178370379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1178370379},{"type":"v1","addr":"172.21.15.93:6835","nonce":1178370379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/2342979080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":2342979080},{"type":"v1","addr":"172.21.15.93:6837","nonce":2342979080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/1839590536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1839590536},{"type":"v1","addr":"172.21.15.69:6833","nonce":1839590536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:56.576603+0000","modified":"2023-11-17T06:29:59.616825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2440982410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2440982410},{"type":"v1","addr":"172.21.15.69:6835","nonce":2440982410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:30:16.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.128+0000 7fbee2d67700 1 -- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbec0066540 msgr2=0x7fbec0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbec0066540 0x7fbec0068a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbed0000f60 tx=0x7fbed0009040 comp rx=0 tx=0).stop 2023-11-17T06:30:16.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 -- 172.21.15.69:0/3349651309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbedc0d1ca0 msgr2=0x7fbedc0c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbedc0d1ca0 0x7fbedc0c9160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbec800e9d0 tx=0x7fbec800ece0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 -- 172.21.15.69:0/3349651309 shutdown_connections 2023-11-17T06:30:16.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbec0066540 0x7fbec0068a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbedc146120 0x7fbedc145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbedc0d1ca0 0x7fbedc0c9160 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 --2- 172.21.15.69:0/3349651309 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbedc0b5440 0x7fbedc155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 -- 172.21.15.69:0/3349651309 >> 172.21.15.69:0/3349651309 conn(0x7fbedc0cfd30 msgr2=0x7fbedc0b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:16.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 -- 172.21.15.69:0/3349651309 shutdown_connections 2023-11-17T06:30:16.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.132+0000 7fbee2d67700 1 -- 172.21.15.69:0/3349651309 wait complete. 2023-11-17T06:30:16.138 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-11-17T06:30:16.155 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:16.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.328+0000 7f310b6dd700 1 Processor -- start 2023-11-17T06:30:16.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.332+0000 7f310b6dd700 1 -- start start 2023-11-17T06:30:16.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.332+0000 7f310b6dd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f310415d6d0 0x7f31040716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.332+0000 7f310b6dd700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3104071c10 con 0x7f310415e420 2023-11-17T06:30:16.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.332+0000 7f310b6dd700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3104070980 con 0x7f31040cba80 2023-11-17T06:30:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.332+0000 7f310b6dd700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31040cb490 con 0x7f310415d6d0 2023-11-17T06:30:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.332+0000 7f3109479700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f310415d6d0 0x7f31040716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.332+0000 7f3109c7a700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f310415e420 0x7f31040cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:34706/0 (socket says 172.21.15.69:34706) 2023-11-17T06:30:16.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.332+0000 7f3109c7a700 1 -- 172.21.15.69:0/2400915825 learned_addr learned my addr 172.21.15.69:0/2400915825 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:16.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f3109479700 1 -- 172.21.15.69:0/2400915825 >> v1:172.21.15.93:6789/0 conn(0x7f31040cba80 legacy=0x7f310415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f3109479700 1 -- 172.21.15.69:0/2400915825 >> v1:172.21.15.69:6789/0 conn(0x7f310415e420 legacy=0x7f31040cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f3109479700 1 -- 172.21.15.69:0/2400915825 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3104070bf0 con 0x7f310415d6d0 2023-11-17T06:30:16.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f30fbfff700 1 -- 172.21.15.69:0/2400915825 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078766671 0 0) 0x7f3104070980 con 0x7f31040cba80 2023-11-17T06:30:16.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f3109479700 1 --2- 172.21.15.69:0/2400915825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 0x7f31040716d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3100009850 tx=0x7f3100009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5206532a72642485 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f30fbfff700 1 -- 172.21.15.69:0/2400915825 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100004230 con 0x7f310415d6d0 2023-11-17T06:30:16.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f30fbfff700 1 -- 172.21.15.69:0/2400915825 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3100004390 con 0x7f310415d6d0 2023-11-17T06:30:16.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f30fbfff700 1 -- 172.21.15.69:0/2400915825 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31000036c0 con 0x7f310415d6d0 2023-11-17T06:30:16.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f310b6dd700 1 -- 172.21.15.69:0/2400915825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 msgr2=0x7f31040716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f310b6dd700 1 --2- 172.21.15.69:0/2400915825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 0x7f31040716d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3100009850 tx=0x7f3100009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:16.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f310b6dd700 1 -- 172.21.15.69:0/2400915825 shutdown_connections 2023-11-17T06:30:16.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f310b6dd700 1 --2- 172.21.15.69:0/2400915825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 0x7f31040716d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f310b6dd700 1 -- 172.21.15.69:0/2400915825 >> 172.21.15.69:0/2400915825 conn(0x7f310406a480 msgr2=0x7f310406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:16.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f310b6dd700 1 -- 172.21.15.69:0/2400915825 shutdown_connections 2023-11-17T06:30:16.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.336+0000 7f310b6dd700 1 -- 172.21.15.69:0/2400915825 wait complete. 2023-11-17T06:30:16.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f310b6dd700 1 Processor -- start 2023-11-17T06:30:16.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f310b6dd700 1 -- start start 2023-11-17T06:30:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f310b6dd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31040cba80 0x7f31041548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f310b6dd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 0x7f31040cd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f310b6dd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f310415e420 0x7f31040cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f310b6dd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31041e3ba0 con 0x7f310415d6d0 2023-11-17T06:30:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f310b6dd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31041e3e80 con 0x7f31040cba80 2023-11-17T06:30:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f310b6dd700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31041e4160 con 0x7f310415e420 2023-11-17T06:30:16.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f3108c78700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 0x7f31040cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f3108c78700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 0x7f31040cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49978/0 (socket says 172.21.15.69:49978) 2023-11-17T06:30:16.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f3108c78700 1 -- 172.21.15.69:0/4200962900 learned_addr learned my addr 172.21.15.69:0/4200962900 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:16.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f3109479700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31040cba80 0x7f31041548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f3109c7a700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f310415e420 0x7f31040cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.340+0000 7f3108c78700 1 -- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f310415e420 msgr2=0x7f31040cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f3108c78700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f310415e420 0x7f31040cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f3108c78700 1 -- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31040cba80 msgr2=0x7f31041548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f3108c78700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31040cba80 0x7f31041548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f3108c78700 1 -- 172.21.15.69:0/4200962900 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000094b0 con 0x7f310415d6d0 2023-11-17T06:30:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f3108c78700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 0x7f31040cd500 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f30f400c450 tx=0x7f30f400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f30f9ffb700 1 -- 172.21.15.69:0/4200962900 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f40054e0 con 0x7f310415d6d0 2023-11-17T06:30:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f30f9ffb700 1 -- 172.21.15.69:0/4200962900 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f40036a0 con 0x7f310415d6d0 2023-11-17T06:30:16.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f30f9ffb700 1 -- 172.21.15.69:0/4200962900 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f4003a50 con 0x7f310415d6d0 2023-11-17T06:30:16.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f310b6dd700 1 -- 172.21.15.69:0/4200962900 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31041e4440 con 0x7f310415d6d0 2023-11-17T06:30:16.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f310b6dd700 1 -- 172.21.15.69:0/4200962900 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3104154e20 con 0x7f310415d6d0 2023-11-17T06:30:16.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.344+0000 7f310b6dd700 1 -- 172.21.15.69:0/4200962900 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3104073f00 con 0x7f310415d6d0 2023-11-17T06:30:16.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.348+0000 7f30f9ffb700 1 -- 172.21.15.69:0/4200962900 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f30f4003bb0 con 0x7f310415d6d0 2023-11-17T06:30:16.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.348+0000 7f30f9ffb700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f30e8066540 0x7f30e8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.348+0000 7f30f9ffb700 1 -- 172.21.15.69:0/4200962900 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30f40832d0 con 0x7f310415d6d0 2023-11-17T06:30:16.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.348+0000 7f3109479700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f30e8066540 0x7f30e8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.352+0000 7f3109479700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f30e8066540 0x7f30e8068a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3100009850 tx=0x7f3100010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.356+0000 7f30f9ffb700 1 -- 172.21.15.69:0/4200962900 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f30f40506b0 con 0x7f310415d6d0 2023-11-17T06:30:16.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.528+0000 7f310b6dd700 1 -- 172.21.15.69:0/4200962900 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f310406aa70 con 0x7f310415d6d0 2023-11-17T06:30:16.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.532+0000 7f30f9ffb700 1 -- 172.21.15.69:0/4200962900 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f30f4001160 con 0x7f310415d6d0 2023-11-17T06:30:16.536 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:16.536 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:58.004301+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:16.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 -- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f30e8066540 msgr2=0x7f30e8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f30e8066540 0x7f30e8068a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3100009850 tx=0x7f3100010000 comp rx=0 tx=0).stop 2023-11-17T06:30:16.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 -- 172.21.15.69:0/4200962900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 msgr2=0x7f31040cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 0x7f31040cd500 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f30f400c450 tx=0x7f30f400c760 comp rx=0 tx=0).stop 2023-11-17T06:30:16.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 -- 172.21.15.69:0/4200962900 shutdown_connections 2023-11-17T06:30:16.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f30e8066540 0x7f30e8068a00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f310415e420 0x7f31040cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f310415d6d0 0x7f31040cd500 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 --2- 172.21.15.69:0/4200962900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31040cba80 0x7f31041548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 -- 172.21.15.69:0/4200962900 >> 172.21.15.69:0/4200962900 conn(0x7f310406a480 msgr2=0x7f31040c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:16.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 -- 172.21.15.69:0/4200962900 shutdown_connections 2023-11-17T06:30:16.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.536+0000 7f310b6dd700 1 -- 172.21.15.69:0/4200962900 wait complete. 2023-11-17T06:30:16.562 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:30:16.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.740+0000 7f40c46db700 1 Processor -- start 2023-11-17T06:30:16.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.740+0000 7f40c46db700 1 -- start start 2023-11-17T06:30:16.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.740+0000 7f40c46db700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f40bc0cb020 0x7f40bc15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.740+0000 7f40c46db700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb400 0x7f40bc06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c46db700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc0b09e0 con 0x7f40bc0702e0 2023-11-17T06:30:16.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c46db700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc15fd90 con 0x7f40bc0cb020 2023-11-17T06:30:16.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c46db700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0b1660 con 0x7f40bc0cb400 2023-11-17T06:30:16.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1c76700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb400 0x7f40bc06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c2477700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f40bc0cb020 0x7f40bc15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c2c78700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f40bc0702e0 0x7f40bc0cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:35860/0 (socket says 172.21.15.69:35860) 2023-11-17T06:30:16.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c2c78700 1 -- 172.21.15.69:0/3535790475 learned_addr learned my addr 172.21.15.69:0/3535790475 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:16.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1475700 1 -- 172.21.15.69:0/3535790475 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233746363 0 0) 0x7f40bc0b09e0 con 0x7f40bc0702e0 2023-11-17T06:30:16.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1475700 1 -- 172.21.15.69:0/3535790475 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40a80035d0 con 0x7f40bc0702e0 2023-11-17T06:30:16.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1c76700 1 -- 172.21.15.69:0/3535790475 >> v2:172.21.15.93:3300/0 conn(0x7f40bc0cb020 msgr2=0x7f40bc15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:16.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1c76700 1 --2- 172.21.15.69:0/3535790475 >> v2:172.21.15.93:3300/0 conn(0x7f40bc0cb020 0x7f40bc15ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1c76700 1 -- 172.21.15.69:0/3535790475 >> v1:172.21.15.93:6789/0 conn(0x7f40bc0702e0 legacy=0x7f40bc0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1c76700 1 -- 172.21.15.69:0/3535790475 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc0b0cc0 con 0x7f40bc0cb400 2023-11-17T06:30:16.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c2477700 1 --2- 172.21.15.69:0/3535790475 >> v2:172.21.15.93:3300/0 conn(0x7f40bc0cb020 0x7f40bc15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:16.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1c76700 1 --2- 172.21.15.69:0/3535790475 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb400 0x7f40bc06fda0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009850 tx=0x7f40ac009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e348ecab8433e759 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1475700 1 -- 172.21.15.69:0/3535790475 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac011830 con 0x7f40bc0cb400 2023-11-17T06:30:16.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1475700 1 -- 172.21.15.69:0/3535790475 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac011990 con 0x7f40bc0cb400 2023-11-17T06:30:16.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.744+0000 7f40c1475700 1 -- 172.21.15.69:0/3535790475 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac011d40 con 0x7f40bc0cb400 2023-11-17T06:30:16.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.748+0000 7f40c46db700 1 -- 172.21.15.69:0/3535790475 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb400 msgr2=0x7f40bc06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.748+0000 7f40c46db700 1 --2- 172.21.15.69:0/3535790475 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb400 0x7f40bc06fda0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f40ac009850 tx=0x7f40ac009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:16.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.748+0000 7f40c46db700 1 -- 172.21.15.69:0/3535790475 shutdown_connections 2023-11-17T06:30:16.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.748+0000 7f40c46db700 1 --2- 172.21.15.69:0/3535790475 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb400 0x7f40bc06fda0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.748+0000 7f40c46db700 1 --2- 172.21.15.69:0/3535790475 >> v2:172.21.15.93:3300/0 conn(0x7f40bc0cb020 0x7f40bc15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.748+0000 7f40c46db700 1 -- 172.21.15.69:0/3535790475 >> 172.21.15.69:0/3535790475 conn(0x7f40bc06a480 msgr2=0x7f40bc06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:16.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.748+0000 7f40c46db700 1 -- 172.21.15.69:0/3535790475 shutdown_connections 2023-11-17T06:30:16.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.748+0000 7f40c46db700 1 -- 172.21.15.69:0/3535790475 wait complete. 2023-11-17T06:30:16.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c46db700 1 Processor -- start 2023-11-17T06:30:16.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c46db700 1 -- start start 2023-11-17T06:30:16.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c46db700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40bc0702e0 0x7f40bc153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c46db700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb020 0x7f40bc0c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c46db700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40bc0cb400 0x7f40bc0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c46db700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc153690 con 0x7f40bc0702e0 2023-11-17T06:30:16.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c46db700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0b22b0 con 0x7f40bc0cb400 2023-11-17T06:30:16.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c46db700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0b19c0 con 0x7f40bc0cb020 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c2477700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40bc0702e0 0x7f40bc153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c2477700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40bc0702e0 0x7f40bc153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49994/0 (socket says 172.21.15.69:49994) 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c2477700 1 -- 172.21.15.69:0/3741828652 learned_addr learned my addr 172.21.15.69:0/3741828652 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c1c76700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb020 0x7f40bc0c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c2c78700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40bc0cb400 0x7f40bc0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c2477700 1 -- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb020 msgr2=0x7f40bc0c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c2477700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb020 0x7f40bc0c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c2477700 1 -- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40bc0cb400 msgr2=0x7f40bc0c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c2477700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40bc0cb400 0x7f40bc0c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.752+0000 7f40c2477700 1 -- 172.21.15.69:0/3741828652 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b80094b0 con 0x7f40bc0702e0 2023-11-17T06:30:16.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.756+0000 7f40c2477700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40bc0702e0 0x7f40bc153150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f40b800ebe0 tx=0x7f40b8009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.756+0000 7f40b2ffd700 1 -- 172.21.15.69:0/3741828652 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b800c910 con 0x7f40bc0702e0 2023-11-17T06:30:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.756+0000 7f40b2ffd700 1 -- 172.21.15.69:0/3741828652 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b800ca70 con 0x7f40bc0702e0 2023-11-17T06:30:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.756+0000 7f40b2ffd700 1 -- 172.21.15.69:0/3741828652 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b800ce00 con 0x7f40bc0702e0 2023-11-17T06:30:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.756+0000 7f40c46db700 1 -- 172.21.15.69:0/3741828652 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ac0094b0 con 0x7f40bc0702e0 2023-11-17T06:30:16.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.756+0000 7f40c46db700 1 -- 172.21.15.69:0/3741828652 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc0b1f40 con 0x7f40bc0702e0 2023-11-17T06:30:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.756+0000 7f40c46db700 1 -- 172.21.15.69:0/3741828652 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc071fd0 con 0x7f40bc0702e0 2023-11-17T06:30:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.760+0000 7f40b2ffd700 1 -- 172.21.15.69:0/3741828652 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f40b8013470 con 0x7f40bc0702e0 2023-11-17T06:30:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.760+0000 7f40b2ffd700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f40a0066510 0x7f40a00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.760+0000 7f40b2ffd700 1 -- 172.21.15.69:0/3741828652 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40b8084100 con 0x7f40bc0702e0 2023-11-17T06:30:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.760+0000 7f40c1c76700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f40a0066510 0x7f40a00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:16.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.764+0000 7f40c1c76700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f40a0066510 0x7f40a00689d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0090b0 tx=0x7f40ac008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.764+0000 7f40b2ffd700 1 -- 172.21.15.69:0/3741828652 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f40bc071fd0 con 0x7f40bc0702e0 2023-11-17T06:30:16.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.968+0000 7f40c46db700 1 -- 172.21.15.69:0/3741828652 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40bc071fd0 con 0x7f40bc0702e0 2023-11-17T06:30:16.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.968+0000 7f40b2ffd700 1 -- 172.21.15.69:0/3741828652 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f40bc071fd0 con 0x7f40bc0702e0 2023-11-17T06:30:16.974 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:16.974 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/1178370379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1178370379},{"type":"v1","addr":"172.21.15.93:6835","nonce":1178370379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/2342979080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":2342979080},{"type":"v1","addr":"172.21.15.93:6837","nonce":2342979080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/1839590536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1839590536},{"type":"v1","addr":"172.21.15.69:6833","nonce":1839590536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:56.576603+0000","modified":"2023-11-17T06:29:59.616825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2440982410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2440982410},{"type":"v1","addr":"172.21.15.69:6835","nonce":2440982410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:30:16.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 -- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f40a0066510 msgr2=0x7f40a00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f40a0066510 0x7f40a00689d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f40ac0090b0 tx=0x7f40ac008030 comp rx=0 tx=0).stop 2023-11-17T06:30:16.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 -- 172.21.15.69:0/3741828652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40bc0702e0 msgr2=0x7f40bc153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:16.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40bc0702e0 0x7f40bc153150 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f40b800ebe0 tx=0x7f40b8009ed0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 -- 172.21.15.69:0/3741828652 shutdown_connections 2023-11-17T06:30:16.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f40a0066510 0x7f40a00689d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40bc0cb400 0x7f40bc0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f40bc0cb020 0x7f40bc0c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 --2- 172.21.15.69:0/3741828652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40bc0702e0 0x7f40bc153150 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:16.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 -- 172.21.15.69:0/3741828652 >> 172.21.15.69:0/3741828652 conn(0x7f40bc06a480 msgr2=0x7f40bc15d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:16.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 -- 172.21.15.69:0/3741828652 shutdown_connections 2023-11-17T06:30:16.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:16.972+0000 7f40c46db700 1 -- 172.21.15.69:0/3741828652 wait complete. 2023-11-17T06:30:16.978 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-11-17T06:30:17.399 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:29:56.576603+0000', 'modified': '2023-11-17T06:29:59.616825+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.69:6835/2440982410', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6834', 'nonce': 2440982410}, {'type': 'v1', 'addr': '172.21.15.69:6835', 'nonce': 2440982410}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:30:17.399 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-17T06:30:17.399 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-17T06:30:17.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.580+0000 7fb7a01cb700 1 Processor -- start 2023-11-17T06:30:17.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.580+0000 7fb7a01cb700 1 -- start start 2023-11-17T06:30:17.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb7a01cb700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb7981617a0 0x7fb7980cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb7a01cb700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb7980ce7a0 0x7fb7980cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb7a01cb700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb798166040 con 0x7fb7980cbfc0 2023-11-17T06:30:17.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb7a01cb700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7980cc450 con 0x7fb7981617a0 2023-11-17T06:30:17.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb7a01cb700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7980cebd0 con 0x7fb7980ce7a0 2023-11-17T06:30:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79df67700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb7981617a0 0x7fb7980cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79df67700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb7981617a0 0x7fb7980cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50008/0 (socket says 172.21.15.69:50008) 2023-11-17T06:30:17.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79df67700 1 -- 172.21.15.69:0/3460126325 learned_addr learned my addr 172.21.15.69:0/3460126325 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:17.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79e768700 1 --2- 172.21.15.69:0/3460126325 >> v2:172.21.15.93:3300/0 conn(0x7fb7980ce7a0 0x7fb7980cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79df67700 1 -- 172.21.15.69:0/3460126325 >> v2:172.21.15.93:3300/0 conn(0x7fb7980ce7a0 msgr2=0x7fb7980cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:17.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79df67700 1 --2- 172.21.15.69:0/3460126325 >> v2:172.21.15.93:3300/0 conn(0x7fb7980ce7a0 0x7fb7980cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79df67700 1 -- 172.21.15.69:0/3460126325 >> v1:172.21.15.93:6789/0 conn(0x7fb7980cbfc0 legacy=0x7fb7980ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79df67700 1 -- 172.21.15.69:0/3460126325 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb798165430 con 0x7fb7981617a0 2023-11-17T06:30:17.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79e768700 1 --2- 172.21.15.69:0/3460126325 >> v2:172.21.15.93:3300/0 conn(0x7fb7980ce7a0 0x7fb7980cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79df67700 1 --2- 172.21.15.69:0/3460126325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7981617a0 0x7fb7980cba80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb7980b4cf0 tx=0x7fb79400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158681460d0887f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79cf65700 1 -- 172.21.15.69:0/3460126325 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79400e070 con 0x7fb7981617a0 2023-11-17T06:30:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79cf65700 1 -- 172.21.15.69:0/3460126325 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79400b9c0 con 0x7fb7981617a0 2023-11-17T06:30:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.584+0000 7fb79cf65700 1 -- 172.21.15.69:0/3460126325 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79400bd70 con 0x7fb7981617a0 2023-11-17T06:30:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.588+0000 7fb7a01cb700 1 -- 172.21.15.69:0/3460126325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7981617a0 msgr2=0x7fb7980cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.588+0000 7fb7a01cb700 1 --2- 172.21.15.69:0/3460126325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7981617a0 0x7fb7980cba80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb7980b4cf0 tx=0x7fb79400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:17.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.588+0000 7fb7a01cb700 1 -- 172.21.15.69:0/3460126325 shutdown_connections 2023-11-17T06:30:17.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.588+0000 7fb7a01cb700 1 --2- 172.21.15.69:0/3460126325 >> v2:172.21.15.93:3300/0 conn(0x7fb7980ce7a0 0x7fb7980cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.588+0000 7fb7a01cb700 1 --2- 172.21.15.69:0/3460126325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7981617a0 0x7fb7980cba80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.588+0000 7fb7a01cb700 1 -- 172.21.15.69:0/3460126325 >> 172.21.15.69:0/3460126325 conn(0x7fb79806a480 msgr2=0x7fb79806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.588+0000 7fb7a01cb700 1 -- 172.21.15.69:0/3460126325 shutdown_connections 2023-11-17T06:30:17.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.588+0000 7fb7a01cb700 1 -- 172.21.15.69:0/3460126325 wait complete. 2023-11-17T06:30:17.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.588+0000 7fb7a01cb700 1 Processor -- start 2023-11-17T06:30:17.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.588+0000 7fb7a01cb700 1 -- start start 2023-11-17T06:30:17.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb7a01cb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7980cbfc0 0x7fb7980b43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb7a01cb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7980ce7a0 0x7fb7980cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb7a01cb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7981617a0 0x7fb7980cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb7a01cb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7981fb2e0 con 0x7fb7980cbfc0 2023-11-17T06:30:17.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb7a01cb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb798157fa0 con 0x7fb7980ce7a0 2023-11-17T06:30:17.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb7a01cb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7981fa6f0 con 0x7fb7981617a0 2023-11-17T06:30:17.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79df67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7980cbfc0 0x7fb7980b43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79df67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7980cbfc0 0x7fb7980b43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50014/0 (socket says 172.21.15.69:50014) 2023-11-17T06:30:17.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79df67700 1 -- 172.21.15.69:0/174135236 learned_addr learned my addr 172.21.15.69:0/174135236 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:17.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79e768700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7981617a0 0x7fb7980cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79d766700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7980ce7a0 0x7fb7980cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79df67700 1 -- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7981617a0 msgr2=0x7fb7980cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79df67700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7981617a0 0x7fb7980cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79df67700 1 -- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7980ce7a0 msgr2=0x7fb7980cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79df67700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7980ce7a0 0x7fb7980cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79df67700 1 -- 172.21.15.69:0/174135236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794009b30 con 0x7fb7980cbfc0 2023-11-17T06:30:17.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79e768700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7981617a0 0x7fb7980cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:17.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79d766700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7980ce7a0 0x7fb7980cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:17.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb79df67700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7980cbfc0 0x7fb7980b43e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb79400b730 tx=0x7fb794004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb78e7fc700 1 -- 172.21.15.69:0/174135236 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7940099b0 con 0x7fb7980cbfc0 2023-11-17T06:30:17.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb78e7fc700 1 -- 172.21.15.69:0/174135236 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7940092e0 con 0x7fb7980cbfc0 2023-11-17T06:30:17.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb7a01cb700 1 -- 172.21.15.69:0/174135236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7980c6200 con 0x7fb7980cbfc0 2023-11-17T06:30:17.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb78e7fc700 1 -- 172.21.15.69:0/174135236 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79401b650 con 0x7fb7980cbfc0 2023-11-17T06:30:17.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.592+0000 7fb7a01cb700 1 -- 172.21.15.69:0/174135236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7981fac20 con 0x7fb7980cbfc0 2023-11-17T06:30:17.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.596+0000 7fb78e7fc700 1 -- 172.21.15.69:0/174135236 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb79401b7b0 con 0x7fb7980cbfc0 2023-11-17T06:30:17.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb78e7fc700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb77c066510 0x7fb77c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb78e7fc700 1 -- 172.21.15.69:0/174135236 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb794085510 con 0x7fb7980cbfc0 2023-11-17T06:30:17.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb7a349b740 1 Processor -- start 2023-11-17T06:30:17.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79d766700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb77c066510 0x7fb77c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb7a349b740 1 -- start start 2023-11-17T06:30:17.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8c530 0xe8c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8a750 0xe8ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xe8d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb7a349b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0xdbc620 con 0xe8d390 2023-11-17T06:30:17.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb7a349b740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0xdb9d10 con 0xe8a750 2023-11-17T06:30:17.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb7a349b740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0xdb5600 con 0xe8c530 2023-11-17T06:30:17.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79d766700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb77c066510 0x7fb77c0689d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb79815fe70 tx=0x7fb788009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79e768700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xe8d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79e768700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xe8d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50028/0 (socket says 172.21.15.69:50028) 2023-11-17T06:30:17.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79e768700 1 -- 172.21.15.69:0/3670938879 learned_addr learned my addr 172.21.15.69:0/3670938879 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:17.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79df67700 1 --2- 172.21.15.69:0/3670938879 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8c530 0xe8c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79d766700 1 --2- 172.21.15.69:0/3670938879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8a750 0xe8ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79e768700 1 -- 172.21.15.69:0/3670938879 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8c530 msgr2=0xe8c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:17.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79e768700 1 --2- 172.21.15.69:0/3670938879 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8c530 0xe8c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79e768700 1 -- 172.21.15.69:0/3670938879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8a750 msgr2=0xe8ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:17.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79e768700 1 --2- 172.21.15.69:0/3670938879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8a750 0xe8ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.600+0000 7fb79e768700 1 -- 172.21.15.69:0/3670938879 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xdda850 con 0xe8d390 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb79e768700 1 --2- 172.21.15.69:0/3670938879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xe8d770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb790009c10 tx=0x7fb790009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347d613bd500887c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb77b7fe700 1 -- 172.21.15.69:0/3670938879 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790010bb0 con 0xe8d390 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb77b7fe700 1 -- 172.21.15.69:0/3670938879 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79000c050 con 0xe8d390 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb77b7fe700 1 -- 172.21.15.69:0/3670938879 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb790015470 con 0xe8d390 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 -- 172.21.15.69:0/3670938879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 msgr2=0xe8d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 --2- 172.21.15.69:0/3670938879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xe8d770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb790009c10 tx=0x7fb790009f20 comp rx=0 tx=0).stop 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 -- 172.21.15.69:0/3670938879 shutdown_connections 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 --2- 172.21.15.69:0/3670938879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xe8d770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 --2- 172.21.15.69:0/3670938879 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8a750 0xe8ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 --2- 172.21.15.69:0/3670938879 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8c530 0xe8c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 -- 172.21.15.69:0/3670938879 >> 172.21.15.69:0/3670938879 conn(0xbda4d0 msgr2=0xe75160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 -- 172.21.15.69:0/3670938879 shutdown_connections 2023-11-17T06:30:17.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 -- 172.21.15.69:0/3670938879 wait complete. 2023-11-17T06:30:17.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 -- start start 2023-11-17T06:30:17.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.604+0000 7fb7a349b740 1 Processor -- start 2023-11-17T06:30:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8a750 0xe4c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8c530 0xe9a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8d390 0xe9a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0xd736e0 con 0xe8c530 2023-11-17T06:30:17.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0xd73380 con 0xe8a750 2023-11-17T06:30:17.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0xc5eaa0 con 0xe8d390 2023-11-17T06:30:17.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 10 client.0 _ll_register_callbacks cb 0xd62a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:30:17.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79d766700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8c530 0xe9a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79d766700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8c530 0xe9a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50032/0 (socket says 172.21.15.69:50032) 2023-11-17T06:30:17.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79d766700 1 -- 172.21.15.69:0/339846017 learned_addr learned my addr 172.21.15.69:0/339846017 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:17.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79e768700 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8d390 0xe9a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79df67700 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8a750 0xe4c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79d766700 1 -- 172.21.15.69:0/339846017 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8d390 msgr2=0xe9a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:17.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79d766700 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8d390 0xe9a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79d766700 1 -- 172.21.15.69:0/339846017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8a750 msgr2=0xe4c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:17.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79d766700 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8a750 0xe4c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79d766700 1 -- 172.21.15.69:0/339846017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7900097e0 con 0xe8c530 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79d766700 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8c530 0xe9a1f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb788003950 tx=0x7fb788001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb660a4f42f2f82 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb778ff9700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb778ff9700 1 -- 172.21.15.69:0/339846017 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78800e8b0 con 0xe8c530 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb778ff9700 1 -- 172.21.15.69:0/339846017 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb788022aa0 con 0xe8c530 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 1 -- 172.21.15.69:0/339846017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xdae5e0 con 0xe8c530 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb778ff9700 1 -- 172.21.15.69:0/339846017 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb788022ca0 con 0xe8c530 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 10 client.4632 fetch_fsmap learned FSMap version 8 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 1 -- 172.21.15.69:0/339846017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0xc25960 con 0xe8c530 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb778ff9700 1 -- 172.21.15.69:0/339846017 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xdae5e0 con 0xe8c530 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb778ff9700 1 -- 172.21.15.69:0/339846017 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb788020070 con 0xe8c530 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 10 client.4632 fetch_fsmap finished waiting for FSMap version 8 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 10 client.4632 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-17T06:30:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 20 client.4632 populate_metadata read hostname 'smithi069' 2023-11-17T06:30:17.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.69:6834/2440982410,v1:172.21.15.69:6835/2440982410] conn(0xe9e2c0 0xe4b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 4 client.4632 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-17T06:30:17.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb7a349b740 1 -- 172.21.15.69:0/339846017 --> [v2:172.21.15.69:6834/2440982410,v1:172.21.15.69:6835/2440982410] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd6e470 con 0xe9e2c0 2023-11-17T06:30:17.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.608+0000 7fb79df67700 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.69:6834/2440982410,v1:172.21.15.69:6835/2440982410] conn(0xe9e2c0 0xe4b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb778ff9700 10 client.4632 ms_handle_connect on v2:172.21.15.69:6834/2440982410 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb79df67700 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.69:6834/2440982410,v1:172.21.15.69:6835/2440982410] conn(0xe9e2c0 0xe4b120 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e26f6a67f7abb477 server_cookie=53e2453688d441e5 in_seq=0 out_seq=0 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb778ff9700 1 -- 172.21.15.69:0/339846017 <== mds.0 v2:172.21.15.69:6834/2440982410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0xd6e470 con 0xe9e2c0 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb778ff9700 10 client.4632 handle_command_reply: tid=0 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 client.4632 shutdown 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 -- 172.21.15.69:0/339846017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8c530 msgr2=0xe9a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8c530 0xe9a1f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb788003950 tx=0x7fb788001120 comp rx=0 tx=0).stop 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 -- 172.21.15.69:0/339846017 shutdown_connections 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.69:6834/2440982410,v1:172.21.15.69:6835/2440982410] conn(0xe9e2c0 0xe4b120 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8d390 0xe9a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8c530 0xe9a1f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb778ff9700 0 client.4632 ms_handle_reset on v2:172.21.15.69:6834/2440982410 2023-11-17T06:30:17.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 --2- 172.21.15.69:0/339846017 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8a750 0xe4c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 -- 172.21.15.69:0/339846017 >> 172.21.15.69:0/339846017 conn(0xbda4d0 msgr2=0xe8d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 -- 172.21.15.69:0/339846017 shutdown_connections 2023-11-17T06:30:17.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 1 -- 172.21.15.69:0/339846017 wait complete. 2023-11-17T06:30:17.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.612+0000 7fb7a349b740 20 client.4632 trim_cache size 0 max 16384 2023-11-17T06:30:17.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.632+0000 7fb7a349b740 1 Processor -- start 2023-11-17T06:30:17.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.632+0000 7fb7a349b740 1 -- start start 2023-11-17T06:30:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 0xe8b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 0xe8ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xe4cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0xe77170 con 0xe8d390 2023-11-17T06:30:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0xdb2a00 con 0xe8c530 2023-11-17T06:30:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0xd804f0 con 0xe8a750 2023-11-17T06:30:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79df67700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 0xe8b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79e768700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xe4cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79df67700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 0xe8b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:60464/0 (socket says 172.21.15.69:60464) 2023-11-17T06:30:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79df67700 1 -- 172.21.15.69:0/2897201452 learned_addr learned my addr 172.21.15.69:0/2897201452 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79d766700 1 --2- 172.21.15.69:0/2897201452 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 0xe8ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79df67700 1 -- 172.21.15.69:0/2897201452 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 msgr2=0xe8ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79df67700 1 --2- 172.21.15.69:0/2897201452 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 0xe8ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79df67700 1 -- 172.21.15.69:0/2897201452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 msgr2=0xe4cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79df67700 1 --2- 172.21.15.69:0/2897201452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xe4cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79df67700 1 -- 172.21.15.69:0/2897201452 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xe8ae00 con 0xe8a750 2023-11-17T06:30:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb79df67700 1 --2- 172.21.15.69:0/2897201452 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 0xe8b520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7940565d0 tx=0x7fb794026040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71d1e4114e629e8e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb77bfff700 1 -- 172.21.15.69:0/2897201452 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794056640 con 0xe8a750 2023-11-17T06:30:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb77bfff700 1 -- 172.21.15.69:0/2897201452 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79405a790 con 0xe8a750 2023-11-17T06:30:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb77bfff700 1 -- 172.21.15.69:0/2897201452 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79405e940 con 0xe8a750 2023-11-17T06:30:17.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 -- 172.21.15.69:0/2897201452 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 msgr2=0xe8b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 --2- 172.21.15.69:0/2897201452 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 0xe8b520 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb7940565d0 tx=0x7fb794026040 comp rx=0 tx=0).stop 2023-11-17T06:30:17.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 -- 172.21.15.69:0/2897201452 shutdown_connections 2023-11-17T06:30:17.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 --2- 172.21.15.69:0/2897201452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xe4cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 --2- 172.21.15.69:0/2897201452 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 0xe8ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 --2- 172.21.15.69:0/2897201452 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 0xe8b520 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 -- 172.21.15.69:0/2897201452 >> 172.21.15.69:0/2897201452 conn(0xbda4d0 msgr2=0xe8c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 -- 172.21.15.69:0/2897201452 shutdown_connections 2023-11-17T06:30:17.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.636+0000 7fb7a349b740 1 -- 172.21.15.69:0/2897201452 wait complete. 2023-11-17T06:30:17.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb7a349b740 1 -- start start 2023-11-17T06:30:17.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb7a349b740 1 Processor -- start 2023-11-17T06:30:17.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 0xea3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 0xef2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb7a349b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xef3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb7a349b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0xd7ad90 con 0xe8d390 2023-11-17T06:30:17.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb7a349b740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0xdb4490 con 0xe8c530 2023-11-17T06:30:17.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb7a349b740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0xd79560 con 0xe8a750 2023-11-17T06:30:17.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb7a349b740 10 client.0 _ll_register_callbacks cb 0xd7a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:30:17.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79e768700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xef3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79e768700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xef3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50048/0 (socket says 172.21.15.69:50048) 2023-11-17T06:30:17.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79e768700 1 -- 172.21.15.69:0/2757990899 learned_addr learned my addr 172.21.15.69:0/2757990899 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:17.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79d766700 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 0xef2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79df67700 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 0xea3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79d766700 1 -- 172.21.15.69:0/2757990899 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 msgr2=0xea3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:17.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79d766700 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 0xea3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79d766700 1 -- 172.21.15.69:0/2757990899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 msgr2=0xef3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:17.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79d766700 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xef3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79d766700 1 -- 172.21.15.69:0/2757990899 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7981fac20 con 0xe8c530 2023-11-17T06:30:17.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79e768700 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xef3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:17.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb79d766700 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 0xef2400 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb788009010 tx=0x7fb788013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad7230ce91fe864b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:17.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.640+0000 7fb778ff9700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-11-17T06:30:17.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb778ff9700 1 -- 172.21.15.69:0/2757990899 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb788001500 con 0xe8c530 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 -- 172.21.15.69:0/2757990899 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb79000c050 con 0xe8c530 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb778ff9700 1 -- 172.21.15.69:0/2757990899 <== mon.1 v2:172.21.15.93:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb78800e8b0 con 0xe8c530 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb778ff9700 1 -- 172.21.15.69:0/2757990899 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb78800ee50 con 0xe8c530 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 10 client.4702 fetch_fsmap learned FSMap version 8 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 -- 172.21.15.69:0/2757990899 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0xd784f0 con 0xe8c530 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb778ff9700 1 -- 172.21.15.69:0/2757990899 <== mon.1 v2:172.21.15.93:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79000c050 con 0xe8c530 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb778ff9700 1 -- 172.21.15.69:0/2757990899 <== mon.1 v2:172.21.15.93:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb78803f070 con 0xe8c530 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 10 client.4702 fetch_fsmap finished waiting for FSMap version 8 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 10 client.4702 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 20 client.4702 populate_metadata read hostname 'smithi069' 2023-11-17T06:30:17.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.69:6834/2440982410,v1:172.21.15.69:6835/2440982410] conn(0xea1750 0xea1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:17.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 4 client.4702 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-17T06:30:17.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 -- 172.21.15.69:0/2757990899 --> [v2:172.21.15.69:6834/2440982410,v1:172.21.15.69:6835/2440982410] -- command(tid 0: {"prefix": "status"}) v1 -- 0xc31460 con 0xea1750 2023-11-17T06:30:17.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb79df67700 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.69:6834/2440982410,v1:172.21.15.69:6835/2440982410] conn(0xea1750 0xea1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:17.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb778ff9700 10 client.4702 ms_handle_connect on v2:172.21.15.69:6834/2440982410 2023-11-17T06:30:17.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb79df67700 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.69:6834/2440982410,v1:172.21.15.69:6835/2440982410] conn(0xea1750 0xea1b30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99739e62857b9f9 server_cookie=cc14358dd54286df in_seq=0 out_seq=0 2023-11-17T06:30:17.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb778ff9700 1 -- 172.21.15.69:0/2757990899 <== mds.0 v2:172.21.15.69:6834/2440982410 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0xc31460 con 0xea1750 2023-11-17T06:30:17.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb778ff9700 10 client.4702 handle_command_reply: tid=0 2023-11-17T06:30:17.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 client.4702 shutdown 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 -- 172.21.15.69:0/2757990899 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 msgr2=0xef2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 0xef2400 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb788009010 tx=0x7fb788013000 comp rx=0 tx=0).stop 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 -- 172.21.15.69:0/2757990899 shutdown_connections 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.69:6834/2440982410,v1:172.21.15.69:6835/2440982410] conn(0xea1750 0xea1b30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0xe8d390 0xef3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0xe8c530 0xef2400 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 --2- 172.21.15.69:0/2757990899 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0xe8a750 0xea3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb7a349b740 1 -- 172.21.15.69:0/2757990899 >> 172.21.15.69:0/2757990899 conn(0xbda4d0 msgr2=0xe8b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.644+0000 7fb778ff9700 0 client.4702 ms_handle_reset on v2:172.21.15.69:6834/2440982410 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a349b740 1 -- 172.21.15.69:0/2757990899 shutdown_connections 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a349b740 1 -- 172.21.15.69:0/2757990899 wait complete. 2023-11-17T06:30:17.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a349b740 20 client.4702 trim_cache size 0 max 16384 2023-11-17T06:30:17.653 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:30:17.653 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "473113af-218f-4c66-9eb3-2c30c3150d71", 2023-11-17T06:30:17.653 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2023-11-17T06:30:17.653 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4260, 2023-11-17T06:30:17.653 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-11-17T06:30:17.653 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-11-17T06:30:17.653 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-11-17T06:30:17.653 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 20.519912728000001, 2023-11-17T06:30:17.653 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 8, 2023-11-17T06:30:17.653 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 23, 2023-11-17T06:30:17.654 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 23, 2023-11-17T06:30:17.654 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 25.921459820999999 2023-11-17T06:30:17.654 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:30:17.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 -- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb77c066510 msgr2=0x7fb77c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb77c066510 0x7fb77c0689d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb79815fe70 tx=0x7fb788009040 comp rx=0 tx=0).stop 2023-11-17T06:30:17.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 -- 172.21.15.69:0/174135236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7980cbfc0 msgr2=0x7fb7980b43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:17.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7980cbfc0 0x7fb7980b43e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb79400b730 tx=0x7fb794004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 -- 172.21.15.69:0/174135236 shutdown_connections 2023-11-17T06:30:17.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb77c066510 0x7fb77c0689d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7981617a0 0x7fb7980cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7980ce7a0 0x7fb7980cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 --2- 172.21.15.69:0/174135236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7980cbfc0 0x7fb7980b43e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:17.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 -- 172.21.15.69:0/174135236 >> 172.21.15.69:0/174135236 conn(0x7fb79806a480 msgr2=0x7fb79815bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:17.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 -- 172.21.15.69:0/174135236 shutdown_connections 2023-11-17T06:30:17.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:17.648+0000 7fb7a01cb700 1 -- 172.21.15.69:0/174135236 wait complete. 2023-11-17T06:30:17.677 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-17T06:30:17.701 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-17T06:30:17.702 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-17T06:30:17.702 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-17T06:30:17.702 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-17T06:30:17.702 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:17.702 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-17T06:30:17.702 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-17T06:30:17.702 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:17.702 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-17T06:30:17.702 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-17T06:30:17.702 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:17.703 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-17T06:30:17.703 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-17T06:30:17.703 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:17.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:17.703 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-11-17T06:30:17.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:17.722 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2023-11-17T06:30:17.804 INFO:teuthology.orchestra.run.smithi069.stderr:Cannot find device "ceph-brx" 2023-11-17T06:30:17.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:30:17.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:17.808 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-17T06:30:17.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:17.831 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link delete ceph-brx 2023-11-17T06:30:17.920 INFO:teuthology.orchestra.run.smithi093.stderr:Cannot find device "ceph-brx" 2023-11-17T06:30:17.923 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:30:17.924 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-17T06:30:17.924 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:30:18.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.104+0000 7ffbbae08700 1 Processor -- start 2023-11-17T06:30:18.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.104+0000 7ffbbae08700 1 -- start start 2023-11-17T06:30:18.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbbae08700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbb415d450 0x7ffbb406d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbbae08700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ffbb415d830 0x7ffbb40b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbbae08700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb40cef80 con 0x7ffbb40b1f50 2023-11-17T06:30:18.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbbae08700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb40cae10 con 0x7ffbb415d830 2023-11-17T06:30:18.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbbae08700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb40b23c0 con 0x7ffbb415d450 2023-11-17T06:30:18.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbb93a5700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ffbb40b1f50 0x7ffbb40ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:34708/0 (socket says 172.21.15.69:34708) 2023-11-17T06:30:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbb93a5700 1 -- 172.21.15.69:0/1783677957 learned_addr learned my addr 172.21.15.69:0/1783677957 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbb8ba4700 1 --2- 172.21.15.69:0/1783677957 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbb415d450 0x7ffbb406d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbabfff700 1 --2- 172.21.15.69:0/1783677957 >> v2:172.21.15.93:3300/0 conn(0x7ffbb415d830 0x7ffbb40b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbab7fe700 1 -- 172.21.15.69:0/1783677957 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1169007964 0 0) 0x7ffbb40cef80 con 0x7ffbb40b1f50 2023-11-17T06:30:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbab7fe700 1 -- 172.21.15.69:0/1783677957 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb9c0035d0 con 0x7ffbb40b1f50 2023-11-17T06:30:18.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbabfff700 1 -- 172.21.15.69:0/1783677957 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbb415d450 msgr2=0x7ffbb406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:18.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbabfff700 1 --2- 172.21.15.69:0/1783677957 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbb415d450 0x7ffbb406d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbabfff700 1 -- 172.21.15.69:0/1783677957 >> v1:172.21.15.69:6789/0 conn(0x7ffbb40b1f50 legacy=0x7ffbb40ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbabfff700 1 -- 172.21.15.69:0/1783677957 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb40cb020 con 0x7ffbb415d830 2023-11-17T06:30:18.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbabfff700 1 --2- 172.21.15.69:0/1783677957 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb415d830 0x7ffbb40b1a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009850 tx=0x7ffba4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0f7ef6747309142 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:18.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbab7fe700 1 -- 172.21.15.69:0/1783677957 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4011830 con 0x7ffbb415d830 2023-11-17T06:30:18.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbab7fe700 1 -- 172.21.15.69:0/1783677957 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba4011990 con 0x7ffbb415d830 2023-11-17T06:30:18.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.108+0000 7ffbab7fe700 1 -- 172.21.15.69:0/1783677957 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba4011d40 con 0x7ffbb415d830 2023-11-17T06:30:18.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.112+0000 7ffbbae08700 1 -- 172.21.15.69:0/1783677957 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb415d830 msgr2=0x7ffbb40b1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.112+0000 7ffbbae08700 1 --2- 172.21.15.69:0/1783677957 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb415d830 0x7ffbb40b1a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009850 tx=0x7ffba4009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:18.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.112+0000 7ffbbae08700 1 -- 172.21.15.69:0/1783677957 shutdown_connections 2023-11-17T06:30:18.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.112+0000 7ffbbae08700 1 --2- 172.21.15.69:0/1783677957 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb415d830 0x7ffbb40b1a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.112+0000 7ffbbae08700 1 --2- 172.21.15.69:0/1783677957 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbb415d450 0x7ffbb406d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.112+0000 7ffbbae08700 1 -- 172.21.15.69:0/1783677957 >> 172.21.15.69:0/1783677957 conn(0x7ffbb40cff90 msgr2=0x7ffbb40d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:18.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.112+0000 7ffbbae08700 1 -- 172.21.15.69:0/1783677957 shutdown_connections 2023-11-17T06:30:18.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.112+0000 7ffbbae08700 1 -- 172.21.15.69:0/1783677957 wait complete. 2023-11-17T06:30:18.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.112+0000 7ffbbae08700 1 Processor -- start 2023-11-17T06:30:18.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.112+0000 7ffbbae08700 1 -- start start 2023-11-17T06:30:18.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbbae08700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb40b1f50 0x7ffbb414b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbbae08700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbb415d450 0x7ffbb4143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbbae08700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb415d830 0x7ffbb414e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbbae08700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb415bb40 con 0x7ffbb415d830 2023-11-17T06:30:18.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbbae08700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb414b790 con 0x7ffbb40b1f50 2023-11-17T06:30:18.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbbae08700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb4149ce0 con 0x7ffbb415d450 2023-11-17T06:30:18.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbb93a5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb415d830 0x7ffbb414e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbb93a5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb415d830 0x7ffbb414e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50050/0 (socket says 172.21.15.69:50050) 2023-11-17T06:30:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbb93a5700 1 -- 172.21.15.69:0/267034559 learned_addr learned my addr 172.21.15.69:0/267034559 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbb8ba4700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb40b1f50 0x7ffbb414b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbabfff700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbb415d450 0x7ffbb4143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbb93a5700 1 -- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbb415d450 msgr2=0x7ffbb4143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbb93a5700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbb415d450 0x7ffbb4143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbb93a5700 1 -- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb40b1f50 msgr2=0x7ffbb414b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbb93a5700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb40b1f50 0x7ffbb414b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbb93a5700 1 -- 172.21.15.69:0/267034559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba40094b0 con 0x7ffbb415d830 2023-11-17T06:30:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbb93a5700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb415d830 0x7ffbb414e220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00cb40 tx=0x7ffbac00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffba97fa700 1 -- 172.21.15.69:0/267034559 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac007500 con 0x7ffbb415d830 2023-11-17T06:30:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffba97fa700 1 -- 172.21.15.69:0/267034559 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac007660 con 0x7ffbb415d830 2023-11-17T06:30:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbbae08700 1 -- 172.21.15.69:0/267034559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb4149a00 con 0x7ffbb415d830 2023-11-17T06:30:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffba97fa700 1 -- 172.21.15.69:0/267034559 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbac0079f0 con 0x7ffbb415d830 2023-11-17T06:30:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.116+0000 7ffbbae08700 1 -- 172.21.15.69:0/267034559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb415b7d0 con 0x7ffbb415d830 2023-11-17T06:30:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.120+0000 7ffbbae08700 1 -- 172.21.15.69:0/267034559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb40cf6b0 con 0x7ffbb415d830 2023-11-17T06:30:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.120+0000 7ffba97fa700 1 -- 172.21.15.69:0/267034559 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffbac01b3b0 con 0x7ffbb415d830 2023-11-17T06:30:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.124+0000 7ffba97fa700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffba0066510 0x7ffba00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.124+0000 7ffba97fa700 1 -- 172.21.15.69:0/267034559 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbac083890 con 0x7ffbb415d830 2023-11-17T06:30:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.124+0000 7ffbb8ba4700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffba0066510 0x7ffba00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.124+0000 7ffbb8ba4700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffba0066510 0x7ffba00689d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009bf0 tx=0x7ffbb0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.128+0000 7ffba97fa700 1 -- 172.21.15.69:0/267034559 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffbac050d10 con 0x7ffbb415d830 2023-11-17T06:30:18.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.344+0000 7ffbbae08700 1 -- 172.21.15.69:0/267034559 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffbb40cbd40 con 0x7ffbb415d830 2023-11-17T06:30:18.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.344+0000 7ffba97fa700 1 -- 172.21.15.69:0/267034559 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffbac017060 con 0x7ffbb415d830 2023-11-17T06:30:18.348 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:30:18.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.344+0000 7ffbbae08700 1 -- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffba0066510 msgr2=0x7ffba00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.344+0000 7ffbbae08700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffba0066510 0x7ffba00689d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009bf0 tx=0x7ffbb0009240 comp rx=0 tx=0).stop 2023-11-17T06:30:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.344+0000 7ffbbae08700 1 -- 172.21.15.69:0/267034559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb415d830 msgr2=0x7ffbb414e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.344+0000 7ffbbae08700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb415d830 0x7ffbb414e220 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffbac00cb40 tx=0x7ffbac00cb70 comp rx=0 tx=0).stop 2023-11-17T06:30:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.344+0000 7ffbbae08700 1 -- 172.21.15.69:0/267034559 shutdown_connections 2023-11-17T06:30:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.344+0000 7ffbbae08700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffba0066510 0x7ffba00689d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.344+0000 7ffbbae08700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb415d830 0x7ffbb414e220 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.348+0000 7ffbbae08700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbb415d450 0x7ffbb4143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.348+0000 7ffbbae08700 1 --2- 172.21.15.69:0/267034559 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbb40b1f50 0x7ffbb414b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.348+0000 7ffbbae08700 1 -- 172.21.15.69:0/267034559 >> 172.21.15.69:0/267034559 conn(0x7ffbb40cff90 msgr2=0x7ffbb40cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:18.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.348+0000 7ffbbae08700 1 -- 172.21.15.69:0/267034559 shutdown_connections 2023-11-17T06:30:18.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:18.348+0000 7ffbbae08700 1 -- 172.21.15.69:0/267034559 wait complete. 2023-11-17T06:30:18.371 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:30:18.372 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:30:18.372 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2023-11-17T06:30:18.372 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-17T06:30:18.372 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:18.372 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:30:18.372 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:30:18.372 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:30:18.372 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:30:18.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:18.372 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2023-11-17T06:30:18.391 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:18.391 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:18.392 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:18.392 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:18.392 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:18.392 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:18.392 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:18.392 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:18.392 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2023-11-17T06:30:18.392 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:18.392 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:18.392 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42225sec preferred_lft 42225sec 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 02:42:2e:aa:f1:0b brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:18.393 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:30:18.394 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:18.395 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-17T06:30:18.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:18.395 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:30:18.395 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:30:18.395 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add name ceph-brx type bridge 2023-11-17T06:30:18.395 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr flush dev ceph-brx 2023-11-17T06:30:18.395 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set ceph-brx up 2023-11-17T06:30:18.395 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-17T06:30:18.396 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:30:18.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:18.560 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:30:18.590 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-11-17T06:30:18.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:18.593 DEBUG:teuthology.orchestra.run.smithi069:> route 2023-11-17T06:30:18.672 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2023-11-17T06:30:18.672 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:30:18.672 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:30:18.672 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:30:18.673 INFO:teuthology.orchestra.run.smithi069.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:30:18.673 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:30:18.673 INFO:teuthology.orchestra.run.smithi069.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:30:18.673 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:30:18.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:18.673 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:30:18.673 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:30:18.674 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:30:18.674 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:30:18.674 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:30:18.674 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:30:18.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:18.804 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-11-17T06:30:18.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:18.820 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2023-11-17T06:30:18.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:18.884 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:30:18.884 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:30:18.885 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:18.885 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-17T06:30:18.885 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:30:18.998 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-17T06:30:18.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:18.998 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:30:18.998 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:30:18.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-17T06:30:18.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-17T06:30:18.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-17T06:30:18.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-17T06:30:18.999 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-17T06:30:18.999 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:30:19.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:19.180 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:30:19.180 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:30:19.180 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2023-11-17T06:30:19.180 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.0 master ceph-brx 2023-11-17T06:30:19.180 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:30:19.251 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-17T06:30:19.251 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:19.252 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:19.266 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:30:19.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:19.266 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:19.330 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:30:19.407 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:19.474 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:19.475 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:19.476 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:30:19.477 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:30:19.478 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:30:19.478 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:30:19.478 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:30:19.478 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:19.478 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:19.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:19.479 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:30:19.541 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-17T06:30:19.541 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-17T06:30:19.589 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:30:19.630 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:30:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:30:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:30:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:30:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:30:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:30:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:30:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:30:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:19.698 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:19.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:19.699 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:30:19.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:2023-11-17T06:30:19.728+0000 7f9164bb3640 -1 init, newargv = 0x559b92c00a70 newargc=15 2023-11-17T06:30:19.733 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[43447]: starting ceph client 2023-11-17T06:30:19.746 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[43447]: starting fuse 2023-11-17T06:30:19.746 INFO:teuthology.orchestra.run.smithi069.stdout:49 2023-11-17T06:30:19.747 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-17T06:30:19.747 DEBUG:teuthology.orchestra.run.smithi069:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:30:19.747 DEBUG:teuthology.orchestra.run.smithi069:> import glob 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> import re 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> import os 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> import subprocess 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> def _find_admin_socket(client_name): 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> files = glob.glob(asok_path) 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> # Given a non-glob path, it better be there 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> if "*" not in asok_path: 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> assert(len(files) == 1) 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> return files[0] 2023-11-17T06:30:19.748 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> for f in files: 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> contents = proc_f.read() 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> if mountpoint in contents: 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> return f 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> print(_find_admin_socket("client.0")) 2023-11-17T06:30:19.749 DEBUG:teuthology.orchestra.run.smithi069:> ' 2023-11-17T06:30:19.913 INFO:teuthology.orchestra.run.smithi069.stdout:/var/run/ceph/ceph-client.0.43447.asok 2023-11-17T06:30:19.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:30:19.933 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43447.asok 2023-11-17T06:30:19.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:19.934 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43447.asok status 2023-11-17T06:30:20.123 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:30:20.123 INFO:teuthology.orchestra.run.smithi069.stdout: "metadata": { 2023-11-17T06:30:20.123 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:30:20.123 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:30:20.123 INFO:teuthology.orchestra.run.smithi069.stdout: "entity_id": "0", 2023-11-17T06:30:20.123 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": "smithi069", 2023-11-17T06:30:20.123 INFO:teuthology.orchestra.run.smithi069.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "pid": "43447", 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "root": "/" 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_count": 0, 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_pinned_count": 0, 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4650, 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "inst": { 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "name": { 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "client", 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "num": 4650 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-11-17T06:30:20.124 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 1903577103 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 1903577103 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: "inst_str": "client.4650 192.168.0.1:0/1903577103", 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: "addr_str": "192.168.0.1:0/1903577103", 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: "inode_count": 1, 2023-11-17T06:30:20.125 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_epoch": 8, 2023-11-17T06:30:20.126 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch": 23, 2023-11-17T06:30:20.126 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:30:20.126 INFO:teuthology.orchestra.run.smithi069.stdout: "blocklisted": false, 2023-11-17T06:30:20.126 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs" 2023-11-17T06:30:20.126 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:30:20.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:30:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb0815f4700 1 Processor -- start 2023-11-17T06:30:20.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb0815f4700 1 -- start start 2023-11-17T06:30:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb0815f4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb07c0b8bc0 0x7fb07c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb0815f4700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb07c0ce310 0x7fb07c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb0815f4700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c0b9000 con 0x7fb07c15d490 2023-11-17T06:30:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb0815f4700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c0ce7c0 con 0x7fb07c0ce310 2023-11-17T06:30:20.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb0815f4700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c0d1bb0 con 0x7fb07c0b8bc0 2023-11-17T06:30:20.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb07bfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb07c15d490 0x7fb07c0d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:34716/0 (socket says 172.21.15.69:34716) 2023-11-17T06:30:20.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb07bfff700 1 -- 172.21.15.69:0/1369176798 learned_addr learned my addr 172.21.15.69:0/1369176798 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:20.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb080df3700 1 --2- 172.21.15.69:0/1369176798 >> v2:172.21.15.69:3300/0 conn(0x7fb07c0ce310 0x7fb07c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.304+0000 7fb07b7fe700 1 --2- 172.21.15.69:0/1369176798 >> v2:172.21.15.93:3300/0 conn(0x7fb07c0b8bc0 0x7fb07c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb080df3700 1 -- 172.21.15.69:0/1369176798 >> v2:172.21.15.93:3300/0 conn(0x7fb07c0b8bc0 msgr2=0x7fb07c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb080df3700 1 --2- 172.21.15.69:0/1369176798 >> v2:172.21.15.93:3300/0 conn(0x7fb07c0b8bc0 0x7fb07c0cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb080df3700 1 -- 172.21.15.69:0/1369176798 >> v1:172.21.15.69:6789/0 conn(0x7fb07c15d490 legacy=0x7fb07c0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb080df3700 1 -- 172.21.15.69:0/1369176798 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0d1e90 con 0x7fb07c0ce310 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb080df3700 1 --2- 172.21.15.69:0/1369176798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c0ce310 0x7fb07c0b6130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb07c06bbc0 tx=0x7fb07400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8d511ec75db478 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb07affd700 1 -- 172.21.15.69:0/1369176798 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400e070 con 0x7fb07c0ce310 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb07affd700 1 -- 172.21.15.69:0/1369176798 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07400bb20 con 0x7fb07c0ce310 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb07affd700 1 -- 172.21.15.69:0/1369176798 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074012430 con 0x7fb07c0ce310 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb0815f4700 1 -- 172.21.15.69:0/1369176798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c0ce310 msgr2=0x7fb07c0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb0815f4700 1 --2- 172.21.15.69:0/1369176798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c0ce310 0x7fb07c0b6130 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb07c06bbc0 tx=0x7fb07400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:20.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb0815f4700 1 -- 172.21.15.69:0/1369176798 shutdown_connections 2023-11-17T06:30:20.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb0815f4700 1 --2- 172.21.15.69:0/1369176798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c0ce310 0x7fb07c0b6130 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb0815f4700 1 --2- 172.21.15.69:0/1369176798 >> v2:172.21.15.93:3300/0 conn(0x7fb07c0b8bc0 0x7fb07c0cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb0815f4700 1 -- 172.21.15.69:0/1369176798 >> 172.21.15.69:0/1369176798 conn(0x7fb07c06ab40 msgr2=0x7fb07c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:20.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb0815f4700 1 -- 172.21.15.69:0/1369176798 shutdown_connections 2023-11-17T06:30:20.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.308+0000 7fb0815f4700 1 -- 172.21.15.69:0/1369176798 wait complete. 2023-11-17T06:30:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb0815f4700 1 Processor -- start 2023-11-17T06:30:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb0815f4700 1 -- start start 2023-11-17T06:30:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb0815f4700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb07c0b8bc0 0x7fb07c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb0815f4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c0ce310 0x7fb07c1460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb0815f4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c15d490 0x7fb07c0c8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb0815f4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c145600 con 0x7fb07c15d490 2023-11-17T06:30:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb0815f4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0cdd30 con 0x7fb07c0ce310 2023-11-17T06:30:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb0815f4700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0ce010 con 0x7fb07c0b8bc0 2023-11-17T06:30:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb080df3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c15d490 0x7fb07c0c8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb080df3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c15d490 0x7fb07c0c8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50064/0 (socket says 172.21.15.69:50064) 2023-11-17T06:30:20.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb080df3700 1 -- 172.21.15.69:0/3156648497 learned_addr learned my addr 172.21.15.69:0/3156648497 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:20.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb07b7fe700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c0ce310 0x7fb07c1460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb07bfff700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb07c0b8bc0 0x7fb07c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb080df3700 1 -- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb07c0b8bc0 msgr2=0x7fb07c155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb080df3700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb07c0b8bc0 0x7fb07c155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb080df3700 1 -- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c0ce310 msgr2=0x7fb07c1460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb080df3700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c0ce310 0x7fb07c1460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.312+0000 7fb080df3700 1 -- 172.21.15.69:0/3156648497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb074009a70 con 0x7fb07c15d490 2023-11-17T06:30:20.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.316+0000 7fb080df3700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c15d490 0x7fb07c0c8360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb074014040 tx=0x7fb074004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:20.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.316+0000 7fb078ff9700 1 -- 172.21.15.69:0/3156648497 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074012430 con 0x7fb07c15d490 2023-11-17T06:30:20.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.316+0000 7fb078ff9700 1 -- 172.21.15.69:0/3156648497 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb074020070 con 0x7fb07c15d490 2023-11-17T06:30:20.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.316+0000 7fb078ff9700 1 -- 172.21.15.69:0/3156648497 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740098f0 con 0x7fb07c15d490 2023-11-17T06:30:20.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.316+0000 7fb0815f4700 1 -- 172.21.15.69:0/3156648497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c1458c0 con 0x7fb07c15d490 2023-11-17T06:30:20.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.316+0000 7fb0815f4700 1 -- 172.21.15.69:0/3156648497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c0c88a0 con 0x7fb07c15d490 2023-11-17T06:30:20.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.316+0000 7fb0815f4700 1 -- 172.21.15.69:0/3156648497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c145de0 con 0x7fb07c15d490 2023-11-17T06:30:20.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.316+0000 7fb078ff9700 1 -- 172.21.15.69:0/3156648497 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb074004040 con 0x7fb07c15d490 2023-11-17T06:30:20.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.320+0000 7fb078ff9700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb068066510 0x7fb0680689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:20.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.320+0000 7fb078ff9700 1 -- 172.21.15.69:0/3156648497 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb074022070 con 0x7fb07c15d490 2023-11-17T06:30:20.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.320+0000 7fb07bfff700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb068066510 0x7fb0680689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:20.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.320+0000 7fb07bfff700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb068066510 0x7fb0680689d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb06c005930 tx=0x7fb06c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:20.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.324+0000 7fb078ff9700 1 -- 172.21.15.69:0/3156648497 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb07c145de0 con 0x7fb07c15d490 2023-11-17T06:30:20.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 -- 172.21.15.69:0/3156648497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb07c145de0 con 0x7fb07c15d490 2023-11-17T06:30:20.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb078ff9700 1 -- 172.21.15.69:0/3156648497 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb07c145de0 con 0x7fb07c15d490 2023-11-17T06:30:20.548 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:30:20.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 -- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb068066510 msgr2=0x7fb0680689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb068066510 0x7fb0680689d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb06c005930 tx=0x7fb06c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:20.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 -- 172.21.15.69:0/3156648497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c15d490 msgr2=0x7fb07c0c8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:20.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c15d490 0x7fb07c0c8360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb074014040 tx=0x7fb074004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 -- 172.21.15.69:0/3156648497 shutdown_connections 2023-11-17T06:30:20.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb068066510 0x7fb0680689d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb07c15d490 0x7fb07c0c8360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c0ce310 0x7fb07c1460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 --2- 172.21.15.69:0/3156648497 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb07c0b8bc0 0x7fb07c155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:20.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 -- 172.21.15.69:0/3156648497 >> 172.21.15.69:0/3156648497 conn(0x7fb07c06ab40 msgr2=0x7fb07c15a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:20.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 -- 172.21.15.69:0/3156648497 shutdown_connections 2023-11-17T06:30:20.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:20.544+0000 7fb0815f4700 1 -- 172.21.15.69:0/3156648497 wait complete. 2023-11-17T06:30:20.571 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:30:20.571 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:30:20.572 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2023-11-17T06:30:20.572 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-17T06:30:20.572 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:20.572 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:30:20.572 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:30:20.572 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:30:20.572 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-17T06:30:20.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:20.572 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2023-11-17T06:30:20.589 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:20.589 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:20.589 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:20.589 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:20.589 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:20.589 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:20.589 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:20.589 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:20.589 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42223sec preferred_lft 42223sec 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:20.590 INFO:teuthology.orchestra.run.smithi069.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 02:42:2e:aa:f1:0b brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 62:b7:9e:10:0f:21 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::3479:73ff:fe34:bc0f/64 scope link 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 62:b7:9e:10:0f:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:20.591 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::60b7:9eff:fe10:f21/64 scope link tentative 2023-11-17T06:30:20.592 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:20.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:20.593 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:30:20.672 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-11-17T06:30:20.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:20.675 DEBUG:teuthology.orchestra.run.smithi069:> route 2023-11-17T06:30:20.741 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2023-11-17T06:30:20.741 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:30:20.741 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:30:20.742 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:30:20.742 INFO:teuthology.orchestra.run.smithi069.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:30:20.742 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:30:20.742 INFO:teuthology.orchestra.run.smithi069.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:30:20.742 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:30:20.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:20.743 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:30:20.743 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:30:20.743 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:30:20.743 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:30:20.743 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:30:20.743 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:30:20.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:20.878 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-11-17T06:30:20.896 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-17T06:30:20.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:20.897 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2023-11-17T06:30:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-17T06:30:20.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:20.958 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:30:20.958 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:30:20.958 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:30:20.958 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-17T06:30:20.958 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:30:21.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:21.067 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-17T06:30:21.099 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:21.099 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:21.099 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:21.099 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:21.099 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:21.099 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:21.100 INFO:teuthology.orchestra.run.smithi069.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:30:21.100 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether d2:e6:0e:a5:51:04 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-17T06:30:21.100 INFO:teuthology.orchestra.run.smithi069.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-17T06:30:21.100 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:21.100 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::d0e6:eff:fea5:5104/64 scope link 2023-11-17T06:30:21.100 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:21.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:21.103 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-17T06:30:21.185 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:21.185 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:21.185 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:21.185 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:21.185 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:21.185 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:21.186 INFO:teuthology.orchestra.run.smithi069.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:30:21.186 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether d2:e6:0e:a5:51:04 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-17T06:30:21.186 INFO:teuthology.orchestra.run.smithi069.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-17T06:30:21.186 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:21.186 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::d0e6:eff:fea5:5104/64 scope link 2023-11-17T06:30:21.186 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:21.190 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-17T06:30:21.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:21.190 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:30:21.190 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:30:21.190 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-17T06:30:21.190 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-17T06:30:21.190 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-17T06:30:21.190 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-17T06:30:21.190 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-17T06:30:21.190 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:30:21.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:21.478 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:30:21.478 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:30:21.478 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.1 up 2023-11-17T06:30:21.478 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.1 master ceph-brx 2023-11-17T06:30:21.478 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:30:21.552 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-17T06:30:21.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:21.553 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:21.568 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-17T06:30:21.568 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:21.569 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:21.629 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:30:21.706 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:21.767 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:30:21.767 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:30:21.767 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:30:21.767 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:30:21.767 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:30:21.767 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:30:21.767 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:30:21.767 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:30:21.767 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:30:21.767 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:30:21.769 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:30:21.770 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:30:21.770 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:30:21.770 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:30:21.770 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:30:21.770 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:30:21.770 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:21.770 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:21.770 INFO:teuthology.orchestra.run.smithi069.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:21.770 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:30:21.770 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:30:21.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:21.771 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:30:21.831 INFO:teuthology.orchestra.run.smithi069.stdout:49 2023-11-17T06:30:21.831 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-11-17T06:30:21.832 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-17T06:30:21.881 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:30:21.914 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:21.977 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:30:21.978 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:30:21.978 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:30:21.978 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:30:21.978 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:30:21.978 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:30:21.978 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:30:21.978 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:30:21.978 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:30:21.979 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:30:21.979 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:21.979 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:21.979 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:30:21.979 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:30:21.979 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:21.980 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:21.980 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:21.980 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:21.980 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:21.980 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:21.980 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:21.980 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:21.980 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:21.981 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:21.981 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:21.981 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:30:21.981 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:30:21.981 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:30:21.981 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:30:21.981 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:30:21.982 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:21.983 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:30:21.983 INFO:teuthology.orchestra.run.smithi069.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:21.983 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:30:21.983 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:30:21.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:21.984 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:30:22.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi069.stderr:2023-11-17T06:30:22.016+0000 7f4d84eae640 -1 init, newargv = 0x56048295c8c0 newargc=15 2023-11-17T06:30:22.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi069.stderr:ceph-fuse[43586]: starting ceph client 2023-11-17T06:30:22.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi069.stderr:ceph-fuse[43586]: starting fuse 2023-11-17T06:30:22.034 INFO:teuthology.orchestra.run.smithi069.stdout:49 2023-11-17T06:30:22.034 INFO:teuthology.orchestra.run.smithi069.stdout:50 2023-11-17T06:30:22.035 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-11-17T06:30:22.035 DEBUG:teuthology.orchestra.run.smithi069:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:30:22.035 DEBUG:teuthology.orchestra.run.smithi069:> import glob 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> import re 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> import os 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> import subprocess 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> def _find_admin_socket(client_name): 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> files = glob.glob(asok_path) 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> # Given a non-glob path, it better be there 2023-11-17T06:30:22.036 DEBUG:teuthology.orchestra.run.smithi069:> if "*" not in asok_path: 2023-11-17T06:30:22.037 DEBUG:teuthology.orchestra.run.smithi069:> assert(len(files) == 1) 2023-11-17T06:30:22.037 DEBUG:teuthology.orchestra.run.smithi069:> return files[0] 2023-11-17T06:30:22.037 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:30:22.037 DEBUG:teuthology.orchestra.run.smithi069:> for f in files: 2023-11-17T06:30:22.037 DEBUG:teuthology.orchestra.run.smithi069:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:30:22.037 DEBUG:teuthology.orchestra.run.smithi069:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:30:22.037 DEBUG:teuthology.orchestra.run.smithi069:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:30:22.037 DEBUG:teuthology.orchestra.run.smithi069:> contents = proc_f.read() 2023-11-17T06:30:22.037 DEBUG:teuthology.orchestra.run.smithi069:> if mountpoint in contents: 2023-11-17T06:30:22.037 DEBUG:teuthology.orchestra.run.smithi069:> return f 2023-11-17T06:30:22.038 DEBUG:teuthology.orchestra.run.smithi069:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:30:22.038 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:30:22.038 DEBUG:teuthology.orchestra.run.smithi069:> print(_find_admin_socket("client.2")) 2023-11-17T06:30:22.038 DEBUG:teuthology.orchestra.run.smithi069:> ' 2023-11-17T06:30:22.197 INFO:teuthology.orchestra.run.smithi069.stdout:/var/run/ceph/ceph-client.2.43586.asok 2023-11-17T06:30:22.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:30:22.219 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.43586.asok 2023-11-17T06:30:22.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:22.220 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.43586.asok status 2023-11-17T06:30:22.412 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:30:22.412 INFO:teuthology.orchestra.run.smithi069.stdout: "metadata": { 2023-11-17T06:30:22.412 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:30:22.412 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:30:22.412 INFO:teuthology.orchestra.run.smithi069.stdout: "entity_id": "2", 2023-11-17T06:30:22.412 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": "smithi069", 2023-11-17T06:30:22.412 INFO:teuthology.orchestra.run.smithi069.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-17T06:30:22.412 INFO:teuthology.orchestra.run.smithi069.stdout: "pid": "43586", 2023-11-17T06:30:22.412 INFO:teuthology.orchestra.run.smithi069.stdout: "root": "/" 2023-11-17T06:30:22.412 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_count": 0, 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_pinned_count": 0, 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4723, 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "inst": { 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "name": { 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "client", 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "num": 4723 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3213170788 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:30:22.413 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3213170788 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "inst_str": "client.4723 172.21.15.69:0/3213170788", 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "addr_str": "172.21.15.69:0/3213170788", 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "inode_count": 1, 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_epoch": 8, 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch": 23, 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "blocklisted": false, 2023-11-17T06:30:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs" 2023-11-17T06:30:22.415 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:30:22.426 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:30:22.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.592+0000 7fa08f39f700 1 Processor -- start 2023-11-17T06:30:22.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.592+0000 7fa08f39f700 1 -- start start 2023-11-17T06:30:22.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08f39f700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa088159ed0 0x7fa0880ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08f39f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa08815a2b0 0x7fa0880c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08f39f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0880cca40 con 0x7fa0880706f0 2023-11-17T06:30:22.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08f39f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0880ccdb0 con 0x7fa08815a2b0 2023-11-17T06:30:22.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08db9c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa08815a2b0 0x7fa0880c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08f39f700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0880caef0 con 0x7fa088159ed0 2023-11-17T06:30:22.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08db9c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa08815a2b0 0x7fa0880c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50072/0 (socket says 172.21.15.69:50072) 2023-11-17T06:30:22.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08db9c700 1 -- 172.21.15.69:0/1549527566 learned_addr learned my addr 172.21.15.69:0/1549527566 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:22.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08e39d700 1 --2- 172.21.15.69:0/1549527566 >> v2:172.21.15.93:3300/0 conn(0x7fa088159ed0 0x7fa0880ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08db9c700 1 -- 172.21.15.69:0/1549527566 >> v2:172.21.15.93:3300/0 conn(0x7fa088159ed0 msgr2=0x7fa0880ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:22.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08db9c700 1 --2- 172.21.15.69:0/1549527566 >> v2:172.21.15.93:3300/0 conn(0x7fa088159ed0 0x7fa0880ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08db9c700 1 -- 172.21.15.69:0/1549527566 >> v1:172.21.15.93:6789/0 conn(0x7fa0880706f0 legacy=0x7fa0880cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:22.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08db9c700 1 -- 172.21.15.69:0/1549527566 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0880cdf60 con 0x7fa08815a2b0 2023-11-17T06:30:22.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.596+0000 7fa08e39d700 1 --2- 172.21.15.69:0/1549527566 >> v2:172.21.15.93:3300/0 conn(0x7fa088159ed0 0x7fa0880ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:22.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08db9c700 1 --2- 172.21.15.69:0/1549527566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 0x7fa0880c98c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa0880685d0 tx=0x7fa07800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8b10dce9d66300 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08d39b700 1 -- 172.21.15.69:0/1549527566 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07800dd50 con 0x7fa08815a2b0 2023-11-17T06:30:22.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08d39b700 1 -- 172.21.15.69:0/1549527566 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa078004030 con 0x7fa08815a2b0 2023-11-17T06:30:22.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08d39b700 1 -- 172.21.15.69:0/1549527566 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0780043c0 con 0x7fa08815a2b0 2023-11-17T06:30:22.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08f39f700 1 -- 172.21.15.69:0/1549527566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 msgr2=0x7fa0880c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08f39f700 1 --2- 172.21.15.69:0/1549527566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 0x7fa0880c98c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa0880685d0 tx=0x7fa07800be90 comp rx=0 tx=0).stop 2023-11-17T06:30:22.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08f39f700 1 -- 172.21.15.69:0/1549527566 shutdown_connections 2023-11-17T06:30:22.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08f39f700 1 --2- 172.21.15.69:0/1549527566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 0x7fa0880c98c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08f39f700 1 --2- 172.21.15.69:0/1549527566 >> v2:172.21.15.93:3300/0 conn(0x7fa088159ed0 0x7fa0880ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08f39f700 1 -- 172.21.15.69:0/1549527566 >> 172.21.15.69:0/1549527566 conn(0x7fa0880b0900 msgr2=0x7fa0880b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:22.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08f39f700 1 -- 172.21.15.69:0/1549527566 shutdown_connections 2023-11-17T06:30:22.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.600+0000 7fa08f39f700 1 -- 172.21.15.69:0/1549527566 wait complete. 2023-11-17T06:30:22.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.604+0000 7fa08f39f700 1 Processor -- start 2023-11-17T06:30:22.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.604+0000 7fa08f39f700 1 -- start start 2023-11-17T06:30:22.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08f39f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0880706f0 0x7fa088159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08f39f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa088159ed0 0x7fa0880afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08f39f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 0x7fa0880c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08f39f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0880b0780 con 0x7fa08815a2b0 2023-11-17T06:30:22.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08f39f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0880c2770 con 0x7fa0880706f0 2023-11-17T06:30:22.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08f39f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0881595b0 con 0x7fa088159ed0 2023-11-17T06:30:22.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08eb9e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 0x7fa0880c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08eb9e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 0x7fa0880c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50074/0 (socket says 172.21.15.69:50074) 2023-11-17T06:30:22.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08eb9e700 1 -- 172.21.15.69:0/934626314 learned_addr learned my addr 172.21.15.69:0/934626314 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:22.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08db9c700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa088159ed0 0x7fa0880afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08e39d700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0880706f0 0x7fa088159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08eb9e700 1 -- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa088159ed0 msgr2=0x7fa0880afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08eb9e700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa088159ed0 0x7fa0880afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08eb9e700 1 -- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0880706f0 msgr2=0x7fa088159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08eb9e700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0880706f0 0x7fa088159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08eb9e700 1 -- 172.21.15.69:0/934626314 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07800b810 con 0x7fa08815a2b0 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08e39d700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0880706f0 0x7fa088159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08eb9e700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 0x7fa0880c8f60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa08000c7c0 tx=0x7fa08000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa07effd700 1 -- 172.21.15.69:0/934626314 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080003e30 con 0x7fa08815a2b0 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa07effd700 1 -- 172.21.15.69:0/934626314 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa080005070 con 0x7fa08815a2b0 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08f39f700 1 -- 172.21.15.69:0/934626314 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0880c2a10 con 0x7fa08815a2b0 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa07effd700 1 -- 172.21.15.69:0/934626314 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080005420 con 0x7fa08815a2b0 2023-11-17T06:30:22.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.608+0000 7fa08f39f700 1 -- 172.21.15.69:0/934626314 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0880b47e0 con 0x7fa08815a2b0 2023-11-17T06:30:22.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.612+0000 7fa08f39f700 1 -- 172.21.15.69:0/934626314 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0880c9db0 con 0x7fa08815a2b0 2023-11-17T06:30:22.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.612+0000 7fa07effd700 1 -- 172.21.15.69:0/934626314 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa080005580 con 0x7fa08815a2b0 2023-11-17T06:30:22.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.616+0000 7fa07effd700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa06c066540 0x7fa06c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:22.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.616+0000 7fa07effd700 1 -- 172.21.15.69:0/934626314 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa080083190 con 0x7fa08815a2b0 2023-11-17T06:30:22.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.616+0000 7fa08e39d700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa06c066540 0x7fa06c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:22.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.616+0000 7fa08e39d700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa06c066540 0x7fa06c068a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa0840089d0 tx=0x7fa084008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:22.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.620+0000 7fa07effd700 1 -- 172.21.15.69:0/934626314 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa080050600 con 0x7fa08815a2b0 2023-11-17T06:30:22.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 -- 172.21.15.69:0/934626314 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa0880cbcb0 con 0x7fa08815a2b0 2023-11-17T06:30:22.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa07effd700 1 -- 172.21.15.69:0/934626314 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa080053c20 con 0x7fa08815a2b0 2023-11-17T06:30:22.836 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:30:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 -- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa06c066540 msgr2=0x7fa06c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa06c066540 0x7fa06c068a00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa0840089d0 tx=0x7fa084008040 comp rx=0 tx=0).stop 2023-11-17T06:30:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 -- 172.21.15.69:0/934626314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 msgr2=0x7fa0880c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 0x7fa0880c8f60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa08000c7c0 tx=0x7fa08000cb80 comp rx=0 tx=0).stop 2023-11-17T06:30:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 -- 172.21.15.69:0/934626314 shutdown_connections 2023-11-17T06:30:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa06c066540 0x7fa06c068a00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa08815a2b0 0x7fa0880c8f60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa088159ed0 0x7fa0880afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 --2- 172.21.15.69:0/934626314 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0880706f0 0x7fa088159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:22.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.832+0000 7fa08f39f700 1 -- 172.21.15.69:0/934626314 >> 172.21.15.69:0/934626314 conn(0x7fa0880b0900 msgr2=0x7fa0880cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:22.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.836+0000 7fa08f39f700 1 -- 172.21.15.69:0/934626314 shutdown_connections 2023-11-17T06:30:22.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:22.836+0000 7fa08f39f700 1 -- 172.21.15.69:0/934626314 wait complete. 2023-11-17T06:30:22.858 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:30:22.858 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:30:22.859 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-17T06:30:22.859 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-17T06:30:22.859 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:22.859 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:30:22.859 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:30:22.859 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:30:22.859 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-17T06:30:22.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:22.860 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-17T06:30:22.882 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:22.882 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:22.882 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:22.882 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:22.882 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:22.882 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:22.882 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:22.882 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:22.882 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-17T06:30:22.883 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:22.883 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:22.883 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-17T06:30:22.883 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:22.883 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:22.883 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:30:22.883 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:22.883 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:30:22.883 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 42214sec preferred_lft 42214sec 2023-11-17T06:30:22.883 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-17T06:30:22.885 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:22.885 INFO:teuthology.orchestra.run.smithi093.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:30:22.885 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 02:42:70:2c:df:7c brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:22.885 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:30:22.885 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:22.886 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-17T06:30:22.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:22.887 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-17T06:30:22.887 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-17T06:30:22.887 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add name ceph-brx type bridge 2023-11-17T06:30:22.887 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip addr flush dev ceph-brx 2023-11-17T06:30:22.887 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set ceph-brx up 2023-11-17T06:30:22.887 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-17T06:30:22.887 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-17T06:30:23.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:23.039 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:30:23.073 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-17T06:30:23.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:23.076 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-17T06:30:23.168 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-17T06:30:23.168 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:30:23.168 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:30:23.168 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:30:23.168 INFO:teuthology.orchestra.run.smithi093.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:30:23.168 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:30:23.169 INFO:teuthology.orchestra.run.smithi093.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:30:23.169 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:30:23.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:23.170 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-17T06:30:23.170 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-17T06:30:23.170 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:30:23.170 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:30:23.170 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:30:23.170 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-17T06:30:23.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:23.306 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-17T06:30:23.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:23.322 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list-id 2023-11-17T06:30:23.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:23.377 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-17T06:30:23.377 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-17T06:30:23.377 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:23.378 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-17T06:30:23.378 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-17T06:30:23.492 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-17T06:30:23.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:23.493 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-17T06:30:23.493 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-17T06:30:23.493 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-17T06:30:23.493 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-17T06:30:23.493 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-17T06:30:23.493 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-17T06:30:23.493 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-17T06:30:23.493 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-17T06:30:23.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:23.672 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-17T06:30:23.672 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-17T06:30:23.672 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2023-11-17T06:30:23.672 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set dev brx.0 master ceph-brx 2023-11-17T06:30:23.672 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-17T06:30:23.746 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-17T06:30:23.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:23.746 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:23.761 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-17T06:30:23.761 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:23.762 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:23.824 DEBUG:teuthology.orchestra.run.smithi093:> sudo modprobe fuse 2023-11-17T06:30:23.903 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:23.966 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-17T06:30:23.966 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-17T06:30:23.966 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-17T06:30:23.966 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-17T06:30:23.966 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-17T06:30:23.966 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-17T06:30:23.966 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-17T06:30:23.966 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-17T06:30:23.966 INFO:teuthology.orchestra.run.smithi093.stdout:/run/lock 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:23.967 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/run/rpc_pipefs 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/fs/nfsd 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-17T06:30:23.968 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-17T06:30:23.969 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-17T06:30:23.969 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-4 2023-11-17T06:30:23.969 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-5 2023-11-17T06:30:23.969 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-6 2023-11-17T06:30:23.969 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-7 2023-11-17T06:30:23.969 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-17T06:30:23.969 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:23.969 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:23.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:23.970 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-17T06:30:24.028 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-17T06:30:24.028 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-17T06:30:24.079 DEBUG:teuthology.orchestra.run.smithi093:> sudo modprobe fuse 2023-11-17T06:30:24.114 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:24.175 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-17T06:30:24.175 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/run/lock 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-17T06:30:24.176 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:24.177 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/run/rpc_pipefs 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/fs/nfsd 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-4 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-5 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-6 2023-11-17T06:30:24.178 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-7 2023-11-17T06:30:24.179 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-17T06:30:24.179 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:24.179 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:24.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:24.180 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-17T06:30:24.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi093.stderr:2023-11-17T06:30:24.209+0000 7f6f7ece8640 -1 init, newargv = 0x56497e93fd90 newargc=15 2023-11-17T06:30:24.214 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi093.stderr:ceph-fuse[41190]: starting ceph client 2023-11-17T06:30:24.228 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi093.stderr:ceph-fuse[41190]: starting fuse 2023-11-17T06:30:24.229 INFO:teuthology.orchestra.run.smithi093.stdout:49 2023-11-17T06:30:24.229 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-17T06:30:24.230 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-17T06:30:24.231 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-17T06:30:24.232 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:30:24.232 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-17T06:30:24.232 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.1")) 2023-11-17T06:30:24.232 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-17T06:30:24.388 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.1.41190.asok 2023-11-17T06:30:24.393 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:30:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:30:24.412 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41190.asok 2023-11-17T06:30:24.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:24.412 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41190.asok status 2023-11-17T06:30:24.612 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "1", 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "41190", 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 4535, 2023-11-17T06:30:24.613 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 4535 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 4112856912 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-17T06:30:24.614 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:30:24.615 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 4112856912 2023-11-17T06:30:24.615 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-17T06:30:24.615 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.4535 192.168.0.1:0/4112856912", 2023-11-17T06:30:24.615 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.1:0/4112856912", 2023-11-17T06:30:24.615 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-17T06:30:24.615 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 8, 2023-11-17T06:30:24.615 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 23, 2023-11-17T06:30:24.615 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:30:24.615 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-17T06:30:24.615 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-17T06:30:24.616 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-17T06:30:24.628 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:30:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.800+0000 7f969d63e700 1 Processor -- start 2023-11-17T06:30:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.800+0000 7f969d63e700 1 -- start start 2023-11-17T06:30:24.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969d63e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f96980719e0 0x7f96980c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969d63e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f96980c9960 0x7f969815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969d63e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969806fc20 con 0x7f969815b980 2023-11-17T06:30:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969d63e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9698070430 con 0x7f96980c9960 2023-11-17T06:30:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969d63e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969815ed70 con 0x7f96980719e0 2023-11-17T06:30:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969ce3d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f96980c9960 0x7f969815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969ce3d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f96980c9960 0x7f969815bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38240/0 (socket says 172.21.15.69:38240) 2023-11-17T06:30:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969ce3d700 1 -- 172.21.15.69:0/2375741618 learned_addr learned my addr 172.21.15.69:0/2375741618 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:24.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f968f7fe700 1 --2- 172.21.15.69:0/2375741618 >> v2:172.21.15.93:3300/0 conn(0x7f96980719e0 0x7f96980c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969ce3d700 1 -- 172.21.15.69:0/2375741618 >> v2:172.21.15.93:3300/0 conn(0x7f96980719e0 msgr2=0x7f96980c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:24.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969ce3d700 1 --2- 172.21.15.69:0/2375741618 >> v2:172.21.15.93:3300/0 conn(0x7f96980719e0 0x7f96980c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969ce3d700 1 -- 172.21.15.69:0/2375741618 >> v1:172.21.15.93:6789/0 conn(0x7f969815b980 legacy=0x7f969815f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969ce3d700 1 -- 172.21.15.69:0/2375741618 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969806fe70 con 0x7f96980c9960 2023-11-17T06:30:24.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f968f7fe700 1 --2- 172.21.15.69:0/2375741618 >> v2:172.21.15.93:3300/0 conn(0x7f96980719e0 0x7f96980c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:24.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f969ce3d700 1 --2- 172.21.15.69:0/2375741618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96980c9960 0x7f969815bd60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f96980ca950 tx=0x7f969000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79bd299cfd37ea3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:24.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f96977fe700 1 -- 172.21.15.69:0/2375741618 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000e070 con 0x7f96980c9960 2023-11-17T06:30:24.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f96977fe700 1 -- 172.21.15.69:0/2375741618 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969000b9c0 con 0x7f96980c9960 2023-11-17T06:30:24.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.804+0000 7f96977fe700 1 -- 172.21.15.69:0/2375741618 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969000bd70 con 0x7f96980c9960 2023-11-17T06:30:24.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.808+0000 7f969d63e700 1 -- 172.21.15.69:0/2375741618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96980c9960 msgr2=0x7f969815bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.808+0000 7f969d63e700 1 --2- 172.21.15.69:0/2375741618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96980c9960 0x7f969815bd60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f96980ca950 tx=0x7f969000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:24.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.808+0000 7f969d63e700 1 -- 172.21.15.69:0/2375741618 shutdown_connections 2023-11-17T06:30:24.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.808+0000 7f969d63e700 1 --2- 172.21.15.69:0/2375741618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96980c9960 0x7f969815bd60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.808+0000 7f969d63e700 1 --2- 172.21.15.69:0/2375741618 >> v2:172.21.15.93:3300/0 conn(0x7f96980719e0 0x7f96980c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.808+0000 7f969d63e700 1 -- 172.21.15.69:0/2375741618 >> 172.21.15.69:0/2375741618 conn(0x7f96980b0900 msgr2=0x7f96980b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:24.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.808+0000 7f969d63e700 1 -- 172.21.15.69:0/2375741618 shutdown_connections 2023-11-17T06:30:24.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.808+0000 7f969d63e700 1 -- 172.21.15.69:0/2375741618 wait complete. 2023-11-17T06:30:24.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969d63e700 1 Processor -- start 2023-11-17T06:30:24.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969d63e700 1 -- start start 2023-11-17T06:30:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969d63e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96980719e0 0x7f96981f0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969d63e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96980c9960 0x7f96981efca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969d63e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f969815b980 0x7f96981f39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969d63e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96981f13b0 con 0x7f969815b980 2023-11-17T06:30:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969d63e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96981f4420 con 0x7f96980c9960 2023-11-17T06:30:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969d63e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96981f4700 con 0x7f96980719e0 2023-11-17T06:30:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969ce3d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f969815b980 0x7f96981f39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969ce3d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f969815b980 0x7f96981f39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38256/0 (socket says 172.21.15.69:38256) 2023-11-17T06:30:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969ce3d700 1 -- 172.21.15.69:0/2978473327 learned_addr learned my addr 172.21.15.69:0/2978473327 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f9697fff700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96980719e0 0x7f96981f0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f968f7fe700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96980c9960 0x7f96981efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969ce3d700 1 -- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96980719e0 msgr2=0x7f96981f0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969ce3d700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96980719e0 0x7f96981f0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969ce3d700 1 -- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96980c9960 msgr2=0x7f96981efca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969ce3d700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96980c9960 0x7f96981efca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f969ce3d700 1 -- 172.21.15.69:0/2978473327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690009b30 con 0x7f969815b980 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.812+0000 7f9697fff700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96980719e0 0x7f96981f0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.816+0000 7f969ce3d700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f969815b980 0x7f96981f39a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9698068700 tx=0x7f9690004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.816+0000 7f96957fa700 1 -- 172.21.15.69:0/2978473327 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96900099b0 con 0x7f969815b980 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.816+0000 7f96957fa700 1 -- 172.21.15.69:0/2978473327 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96900092e0 con 0x7f969815b980 2023-11-17T06:30:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.816+0000 7f96957fa700 1 -- 172.21.15.69:0/2978473327 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969001c640 con 0x7f969815b980 2023-11-17T06:30:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.816+0000 7f969d63e700 1 -- 172.21.15.69:0/2978473327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96981f0670 con 0x7f969815b980 2023-11-17T06:30:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.816+0000 7f969d63e700 1 -- 172.21.15.69:0/2978473327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9698158130 con 0x7f969815b980 2023-11-17T06:30:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.816+0000 7f969d63e700 1 -- 172.21.15.69:0/2978473327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96981f0b30 con 0x7f969815b980 2023-11-17T06:30:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.820+0000 7f96957fa700 1 -- 172.21.15.69:0/2978473327 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f969001c7a0 con 0x7f969815b980 2023-11-17T06:30:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.820+0000 7f96957fa700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9678066510 0x7f96780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.820+0000 7f96957fa700 1 -- 172.21.15.69:0/2978473327 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9690085830 con 0x7f969815b980 2023-11-17T06:30:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.820+0000 7f9697fff700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9678066510 0x7f96780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.820+0000 7f9697fff700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9678066510 0x7f96780689d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96980b4c20 tx=0x7f9688009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:24.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:24.828+0000 7f96957fa700 1 -- 172.21.15.69:0/2978473327 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9690052d40 con 0x7f969815b980 2023-11-17T06:30:25.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.044+0000 7f969d63e700 1 -- 172.21.15.69:0/2978473327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9698073f00 con 0x7f969815b980 2023-11-17T06:30:25.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.044+0000 7f96957fa700 1 -- 172.21.15.69:0/2978473327 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9690056360 con 0x7f969815b980 2023-11-17T06:30:25.049 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:30:25.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 -- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9678066510 msgr2=0x7f96780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9678066510 0x7f96780689d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f96980b4c20 tx=0x7f9688009040 comp rx=0 tx=0).stop 2023-11-17T06:30:25.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 -- 172.21.15.69:0/2978473327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f969815b980 msgr2=0x7f96981f39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:25.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f969815b980 0x7f96981f39a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9698068700 tx=0x7f9690004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 -- 172.21.15.69:0/2978473327 shutdown_connections 2023-11-17T06:30:25.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9678066510 0x7f96780689d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f969815b980 0x7f96981f39a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96980c9960 0x7f96981efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 --2- 172.21.15.69:0/2978473327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96980719e0 0x7f96981f0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:25.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 -- 172.21.15.69:0/2978473327 >> 172.21.15.69:0/2978473327 conn(0x7f96980b0900 msgr2=0x7f96980afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:25.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 -- 172.21.15.69:0/2978473327 shutdown_connections 2023-11-17T06:30:25.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:25.048+0000 7f969d63e700 1 -- 172.21.15.69:0/2978473327 wait complete. 2023-11-17T06:30:25.070 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:30:25.070 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:30:25.070 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2023-11-17T06:30:25.070 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-17T06:30:25.070 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:25.070 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:30:25.070 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:30:25.070 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:30:25.070 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-17T06:30:25.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.071 DEBUG:teuthology.orchestra.run.smithi093:> ip addr 2023-11-17T06:30:25.089 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:25.090 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:25.090 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:25.090 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.090 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:25.090 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.090 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:25.090 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:25.090 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f0 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout: altname enp7s0f1 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 42212sec preferred_lft 42212sec 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2023-11-17T06:30:25.091 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.092 INFO:teuthology.orchestra.run.smithi093.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:30:25.092 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 02:42:70:2c:df:7c brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:25.092 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:30:25.092 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.092 INFO:teuthology.orchestra.run.smithi093.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:30:25.092 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether ee:ff:23:bd:ea:00 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:30:25.092 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-17T06:30:25.092 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.092 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::cc3f:25ff:fee1:f7c5/64 scope link 2023-11-17T06:30:25.093 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.093 INFO:teuthology.orchestra.run.smithi093.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:30:25.093 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether ee:ff:23:bd:ea:00 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:25.093 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ecff:23ff:febd:ea00/64 scope link tentative 2023-11-17T06:30:25.093 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.094 DEBUG:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:30:25.173 INFO:teuthology.orchestra.run.smithi093.stdout:1 2023-11-17T06:30:25.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.177 DEBUG:teuthology.orchestra.run.smithi093:> route 2023-11-17T06:30:25.240 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2023-11-17T06:30:25.240 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:30:25.240 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:30:25.241 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:30:25.241 INFO:teuthology.orchestra.run.smithi093.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:30:25.241 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:30:25.241 INFO:teuthology.orchestra.run.smithi093.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:30:25.241 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:30:25.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.242 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-17T06:30:25.242 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-17T06:30:25.242 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:30:25.242 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:30:25.242 DEBUG:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:30:25.242 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-17T06:30:25.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.381 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-17T06:30:25.399 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-17T06:30:25.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.401 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list-id 2023-11-17T06:30:25.468 INFO:teuthology.orchestra.run.smithi093.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-17T06:30:25.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.469 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-17T06:30:25.469 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-17T06:30:25.469 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:30:25.469 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-17T06:30:25.469 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-17T06:30:25.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.585 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-17T06:30:25.621 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:25.621 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:25.621 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:25.621 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.622 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:25.622 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.622 INFO:teuthology.orchestra.run.smithi093.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:30:25.622 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether ba:3e:33:5d:af:d6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-17T06:30:25.622 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-17T06:30:25.622 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.622 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b83e:33ff:fe5d:afd6/64 scope link 2023-11-17T06:30:25.622 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.625 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-17T06:30:25.709 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:30:25.709 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:30:25.709 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:30:25.709 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.709 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2023-11-17T06:30:25.709 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.710 INFO:teuthology.orchestra.run.smithi093.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:30:25.710 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether ba:3e:33:5d:af:d6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-17T06:30:25.710 INFO:teuthology.orchestra.run.smithi093.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-17T06:30:25.710 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.710 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::b83e:33ff:fe5d:afd6/64 scope link 2023-11-17T06:30:25.710 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:30:25.713 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-17T06:30:25.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.714 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-17T06:30:25.714 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-17T06:30:25.714 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-17T06:30:25.714 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-17T06:30:25.714 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-17T06:30:25.714 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-17T06:30:25.714 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-17T06:30:25.714 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-17T06:30:25.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:25.914 DEBUG:teuthology.orchestra.run.smithi093:> (cd / && exec bash -c ' 2023-11-17T06:30:25.914 DEBUG:teuthology.orchestra.run.smithi093:> set -e 2023-11-17T06:30:25.914 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set brx.1 up 2023-11-17T06:30:25.914 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link set dev brx.1 master ceph-brx 2023-11-17T06:30:25.914 DEBUG:teuthology.orchestra.run.smithi093:> ') 2023-11-17T06:30:25.986 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-17T06:30:25.986 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:25.986 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:25.999 INFO:teuthology.orchestra.run.smithi093.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-17T06:30:26.000 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:30:26.000 DEBUG:teuthology.orchestra.run.smithi093:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:26.056 DEBUG:teuthology.orchestra.run.smithi093:> sudo modprobe fuse 2023-11-17T06:30:26.139 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:26.204 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-17T06:30:26.204 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-17T06:30:26.204 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-17T06:30:26.204 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/run/lock 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:26.205 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-17T06:30:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/run/rpc_pipefs 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/fs/nfsd 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-4 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-5 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-6 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-7 2023-11-17T06:30:26.207 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-17T06:30:26.209 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:26.209 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:26.209 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:26.209 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:30:26.209 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:30:26.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:26.210 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-17T06:30:26.272 INFO:teuthology.orchestra.run.smithi093.stdout:49 2023-11-17T06:30:26.272 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-11-17T06:30:26.272 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-17T06:30:26.325 DEBUG:teuthology.orchestra.run.smithi093:> sudo modprobe fuse 2023-11-17T06:30:26.358 DEBUG:teuthology.orchestra.run.smithi093:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:30:26.423 INFO:teuthology.orchestra.run.smithi093.stdout:/sys 2023-11-17T06:30:26.423 INFO:teuthology.orchestra.run.smithi093.stdout:/proc 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/dev 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/pts 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/run 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/ 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/security 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/shm 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/run/lock 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/unified 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/pstore 2023-11-17T06:30:26.424 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/bpf 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/devices 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/pids 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/memory 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:30:26.425 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/hugepages 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/mqueue 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/debug 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/tracing 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/run/rpc_pipefs 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/proc/fs/nfsd 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/fs/fuse/connections 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/sys/kernel/config 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/run/user/1000 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-4 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-5 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-6 2023-11-17T06:30:26.426 INFO:teuthology.orchestra.run.smithi093.stdout:/var/lib/ceph/osd/ceph-7 2023-11-17T06:30:26.427 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns 2023-11-17T06:30:26.427 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:26.427 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:30:26.427 INFO:teuthology.orchestra.run.smithi093.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:26.427 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:30:26.427 INFO:teuthology.orchestra.run.smithi093.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:30:26.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:26.428 DEBUG:teuthology.orchestra.run.smithi093:> ls /sys/fs/fuse/connections 2023-11-17T06:30:26.470 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi093.stderr:2023-11-17T06:30:26.465+0000 7f4c55868640 -1 init, newargv = 0x561db0d21820 newargc=15 2023-11-17T06:30:26.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi093.stderr:ceph-fuse[41301]: starting ceph client 2023-11-17T06:30:26.482 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi093.stderr:ceph-fuse[41301]: starting fuse 2023-11-17T06:30:26.484 INFO:teuthology.orchestra.run.smithi093.stdout:49 2023-11-17T06:30:26.484 INFO:teuthology.orchestra.run.smithi093.stdout:50 2023-11-17T06:30:26.485 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-11-17T06:30:26.485 DEBUG:teuthology.orchestra.run.smithi093:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:30:26.485 DEBUG:teuthology.orchestra.run.smithi093:> import glob 2023-11-17T06:30:26.485 DEBUG:teuthology.orchestra.run.smithi093:> import re 2023-11-17T06:30:26.485 DEBUG:teuthology.orchestra.run.smithi093:> import os 2023-11-17T06:30:26.485 DEBUG:teuthology.orchestra.run.smithi093:> import subprocess 2023-11-17T06:30:26.485 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-17T06:30:26.485 DEBUG:teuthology.orchestra.run.smithi093:> def _find_admin_socket(client_name): 2023-11-17T06:30:26.485 DEBUG:teuthology.orchestra.run.smithi093:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> files = glob.glob(asok_path) 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> # Given a non-glob path, it better be there 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> if "*" not in asok_path: 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> assert(len(files) == 1) 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> return files[0] 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> for f in files: 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:30:26.486 DEBUG:teuthology.orchestra.run.smithi093:> contents = proc_f.read() 2023-11-17T06:30:26.487 DEBUG:teuthology.orchestra.run.smithi093:> if mountpoint in contents: 2023-11-17T06:30:26.487 DEBUG:teuthology.orchestra.run.smithi093:> return f 2023-11-17T06:30:26.487 DEBUG:teuthology.orchestra.run.smithi093:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:30:26.487 DEBUG:teuthology.orchestra.run.smithi093:> 2023-11-17T06:30:26.487 DEBUG:teuthology.orchestra.run.smithi093:> print(_find_admin_socket("client.3")) 2023-11-17T06:30:26.487 DEBUG:teuthology.orchestra.run.smithi093:> ' 2023-11-17T06:30:26.645 INFO:teuthology.orchestra.run.smithi093.stdout:/var/run/ceph/ceph-client.3.41301.asok 2023-11-17T06:30:26.650 INFO:teuthology.orchestra.run.smithi093.stderr:2023-11-17T06:30:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:30:26.666 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.41301.asok 2023-11-17T06:30:26.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:26.666 DEBUG:teuthology.orchestra.run.smithi093:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.41301.asok status 2023-11-17T06:30:26.861 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-11-17T06:30:26.861 INFO:teuthology.orchestra.run.smithi093.stdout: "metadata": { 2023-11-17T06:30:26.861 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:30:26.861 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:30:26.861 INFO:teuthology.orchestra.run.smithi093.stdout: "entity_id": "3", 2023-11-17T06:30:26.861 INFO:teuthology.orchestra.run.smithi093.stdout: "hostname": "smithi093", 2023-11-17T06:30:26.861 INFO:teuthology.orchestra.run.smithi093.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-17T06:30:26.861 INFO:teuthology.orchestra.run.smithi093.stdout: "pid": "41301", 2023-11-17T06:30:26.861 INFO:teuthology.orchestra.run.smithi093.stdout: "root": "/" 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_count": 0, 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "dentry_pinned_count": 0, 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "id": 4541, 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "inst": { 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "name": { 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "client", 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "num": 4541 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.2:0", 2023-11-17T06:30:26.862 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 1371272342 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": { 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: "type": "v1", 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: "addr": "192.168.0.2:0", 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: "nonce": 1371272342 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: "inst_str": "client.4541 192.168.0.2:0/1371272342", 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: "addr_str": "192.168.0.2:0/1371272342", 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: "inode_count": 1, 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_epoch": 8, 2023-11-17T06:30:26.863 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch": 23, 2023-11-17T06:30:26.864 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:30:26.864 INFO:teuthology.orchestra.run.smithi093.stdout: "blocklisted": false, 2023-11-17T06:30:26.864 INFO:teuthology.orchestra.run.smithi093.stdout: "fs_name": "cephfs" 2023-11-17T06:30:26.864 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-11-17T06:30:26.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:26.875 DEBUG:teuthology.orchestra.run.smithi069:> stat --file-system '--printf=%T 2023-11-17T06:30:26.875 DEBUG:teuthology.orchestra.run.smithi069:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:26.897 INFO:teuthology.orchestra.run.smithi069.stdout:fuseblk 2023-11-17T06:30:26.898 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:26.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:26.898 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:26.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:26.983 DEBUG:teuthology.orchestra.run.smithi069:> stat --file-system '--printf=%T 2023-11-17T06:30:26.983 DEBUG:teuthology.orchestra.run.smithi069:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:27.050 INFO:teuthology.orchestra.run.smithi069.stdout:fuseblk 2023-11-17T06:30:27.051 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:27.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:27.052 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:27.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:27.141 DEBUG:teuthology.orchestra.run.smithi093:> stat --file-system '--printf=%T 2023-11-17T06:30:27.141 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:27.162 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-17T06:30:27.162 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:27.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:27.163 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:27.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:27.243 DEBUG:teuthology.orchestra.run.smithi093:> stat --file-system '--printf=%T 2023-11-17T06:30:27.243 DEBUG:teuthology.orchestra.run.smithi093:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:27.301 INFO:teuthology.orchestra.run.smithi093.stdout:fuseblk 2023-11-17T06:30:27.301 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:27.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:27.301 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-17T06:30:27.376 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-17T06:30:27.393 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:27.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.576+0000 7fbc439ce700 1 Processor -- start 2023-11-17T06:30:27.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.576+0000 7fbc439ce700 1 -- start start 2023-11-17T06:30:27.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.576+0000 7fbc439ce700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc3c0cb020 0x7fbc3c15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.576+0000 7fbc439ce700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbc3c0cb400 0x7fbc3c06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.576+0000 7fbc439ce700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c0b09e0 con 0x7fbc3c0702e0 2023-11-17T06:30:27.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.576+0000 7fbc439ce700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c15fd90 con 0x7fbc3c0cb400 2023-11-17T06:30:27.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.576+0000 7fbc439ce700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0b1660 con 0x7fbc3c0cb020 2023-11-17T06:30:27.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc40f69700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbc3c0cb400 0x7fbc3c06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc40f69700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbc3c0cb400 0x7fbc3c06fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38268/0 (socket says 172.21.15.69:38268) 2023-11-17T06:30:27.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc40f69700 1 -- 172.21.15.69:0/3520633438 learned_addr learned my addr 172.21.15.69:0/3520633438 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:27.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc4176a700 1 --2- 172.21.15.69:0/3520633438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc3c0cb020 0x7fbc3c15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc40f69700 1 -- 172.21.15.69:0/3520633438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc3c0cb020 msgr2=0x7fbc3c15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:27.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc40f69700 1 --2- 172.21.15.69:0/3520633438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc3c0cb020 0x7fbc3c15ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc40f69700 1 -- 172.21.15.69:0/3520633438 >> v1:172.21.15.69:6789/0 conn(0x7fbc3c0702e0 legacy=0x7fbc3c0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc40f69700 1 -- 172.21.15.69:0/3520633438 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0b0cc0 con 0x7fbc3c0cb400 2023-11-17T06:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc40f69700 1 --2- 172.21.15.69:0/3520633438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb400 0x7fbc3c06fda0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009910 tx=0x7fbc2c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cab679cff91a971 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc33fff700 1 -- 172.21.15.69:0/3520633438 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c011830 con 0x7fbc3c0cb400 2023-11-17T06:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc33fff700 1 -- 172.21.15.69:0/3520633438 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c011990 con 0x7fbc3c0cb400 2023-11-17T06:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc33fff700 1 -- 172.21.15.69:0/3520633438 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c011d40 con 0x7fbc3c0cb400 2023-11-17T06:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc439ce700 1 -- 172.21.15.69:0/3520633438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb400 msgr2=0x7fbc3c06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc439ce700 1 --2- 172.21.15.69:0/3520633438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb400 0x7fbc3c06fda0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c009910 tx=0x7fbc2c009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc439ce700 1 -- 172.21.15.69:0/3520633438 shutdown_connections 2023-11-17T06:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc439ce700 1 --2- 172.21.15.69:0/3520633438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb400 0x7fbc3c06fda0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc439ce700 1 --2- 172.21.15.69:0/3520633438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc3c0cb020 0x7fbc3c15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc439ce700 1 -- 172.21.15.69:0/3520633438 >> 172.21.15.69:0/3520633438 conn(0x7fbc3c06a480 msgr2=0x7fbc3c06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:27.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc439ce700 1 -- 172.21.15.69:0/3520633438 shutdown_connections 2023-11-17T06:30:27.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.580+0000 7fbc439ce700 1 -- 172.21.15.69:0/3520633438 wait complete. 2023-11-17T06:30:27.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc439ce700 1 Processor -- start 2023-11-17T06:30:27.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc439ce700 1 -- start start 2023-11-17T06:30:27.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc439ce700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc3c0702e0 0x7fbc3c0b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc439ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb020 0x7fbc3c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc439ce700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc3c0cb400 0x7fbc3c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc439ce700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c14aae0 con 0x7fbc3c0cb020 2023-11-17T06:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc439ce700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0b2130 con 0x7fbc3c0cb400 2023-11-17T06:30:27.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc439ce700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0b1e50 con 0x7fbc3c0702e0 2023-11-17T06:30:27.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc40f69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb020 0x7fbc3c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc40f69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb020 0x7fbc3c15a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38276/0 (socket says 172.21.15.69:38276) 2023-11-17T06:30:27.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc40f69700 1 -- 172.21.15.69:0/4115690437 learned_addr learned my addr 172.21.15.69:0/4115690437 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:27.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc4176a700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc3c0702e0 0x7fbc3c0b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.584+0000 7fbc41f6b700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc3c0cb400 0x7fbc3c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc40f69700 1 -- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc3c0702e0 msgr2=0x7fbc3c0b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc40f69700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc3c0702e0 0x7fbc3c0b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc40f69700 1 -- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc3c0cb400 msgr2=0x7fbc3c15a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc40f69700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc3c0cb400 0x7fbc3c15a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc40f69700 1 -- 172.21.15.69:0/4115690437 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c009570 con 0x7fbc3c0cb020 2023-11-17T06:30:27.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc40f69700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb020 0x7fbc3c15a260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0cc790 tx=0x7fbc2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:27.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc31ffb700 1 -- 172.21.15.69:0/4115690437 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c01a8f0 con 0x7fbc3c0cb020 2023-11-17T06:30:27.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc31ffb700 1 -- 172.21.15.69:0/4115690437 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c01e070 con 0x7fbc3c0cb020 2023-11-17T06:30:27.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc439ce700 1 -- 172.21.15.69:0/4115690437 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c0ccfd0 con 0x7fbc3c0cb020 2023-11-17T06:30:27.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc31ffb700 1 -- 172.21.15.69:0/4115690437 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c01ac70 con 0x7fbc3c0cb020 2023-11-17T06:30:27.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc439ce700 1 -- 172.21.15.69:0/4115690437 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c0cd590 con 0x7fbc3c0cb020 2023-11-17T06:30:27.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.588+0000 7fbc439ce700 1 -- 172.21.15.69:0/4115690437 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c071fd0 con 0x7fbc3c0cb020 2023-11-17T06:30:27.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.592+0000 7fbc31ffb700 1 -- 172.21.15.69:0/4115690437 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbc2c02d450 con 0x7fbc3c0cb020 2023-11-17T06:30:27.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.592+0000 7fbc31ffb700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc20066510 0x7fbc200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.592+0000 7fbc31ffb700 1 -- 172.21.15.69:0/4115690437 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc2c084d90 con 0x7fbc3c0cb020 2023-11-17T06:30:27.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.592+0000 7fbc4176a700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc20066510 0x7fbc200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.592+0000 7fbc4176a700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc20066510 0x7fbc200689d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009bf0 tx=0x7fbc38009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.596+0000 7fbc31ffb700 1 -- 172.21.15.69:0/4115690437 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc3c071fd0 con 0x7fbc3c0cb020 2023-11-17T06:30:27.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.780+0000 7fbc439ce700 1 -- 172.21.15.69:0/4115690437 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc3c071fd0 con 0x7fbc3c0cb020 2023-11-17T06:30:27.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.780+0000 7fbc31ffb700 1 -- 172.21.15.69:0/4115690437 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fbc3c071fd0 con 0x7fbc3c0cb020 2023-11-17T06:30:27.786 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:27.786 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:58.004301+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:27.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 -- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc20066510 msgr2=0x7fbc200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc20066510 0x7fbc200689d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009bf0 tx=0x7fbc38009240 comp rx=0 tx=0).stop 2023-11-17T06:30:27.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 -- 172.21.15.69:0/4115690437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb020 msgr2=0x7fbc3c15a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb020 0x7fbc3c15a260 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0cc790 tx=0x7fbc2c004770 comp rx=0 tx=0).stop 2023-11-17T06:30:27.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 -- 172.21.15.69:0/4115690437 shutdown_connections 2023-11-17T06:30:27.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc20066510 0x7fbc200689d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc3c0cb400 0x7fbc3c15a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc3c0cb020 0x7fbc3c15a260 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 --2- 172.21.15.69:0/4115690437 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc3c0702e0 0x7fbc3c0b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 -- 172.21.15.69:0/4115690437 >> 172.21.15.69:0/4115690437 conn(0x7fbc3c06a480 msgr2=0x7fbc3c15b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:27.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 -- 172.21.15.69:0/4115690437 shutdown_connections 2023-11-17T06:30:27.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.784+0000 7fbc439ce700 1 -- 172.21.15.69:0/4115690437 wait complete. 2023-11-17T06:30:27.810 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:27.810 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:27.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.980+0000 7fd3656db700 1 Processor -- start 2023-11-17T06:30:27.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.984+0000 7fd3656db700 1 -- start start 2023-11-17T06:30:27.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.984+0000 7fd3656db700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd3600ce050 0x7fd360166190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.984+0000 7fd3656db700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3600ccea0 con 0x7fd36015b0d0 2023-11-17T06:30:27.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.984+0000 7fd3656db700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3600701c0 con 0x7fd3600cebb0 2023-11-17T06:30:27.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.984+0000 7fd3656db700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3600cf070 con 0x7fd3600ce050 2023-11-17T06:30:27.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35effd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fd36015b0d0 0x7fd3600cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37252/0 (socket says 172.21.15.69:37252) 2023-11-17T06:30:27.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35effd700 1 -- 172.21.15.69:0/2572424165 learned_addr learned my addr 172.21.15.69:0/2572424165 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:27.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35f7fe700 1 --2- 172.21.15.69:0/2572424165 >> v2:172.21.15.69:3300/0 conn(0x7fd3600ce050 0x7fd360166190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35dffb700 1 -- 172.21.15.69:0/2572424165 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241402984 0 0) 0x7fd3600ccea0 con 0x7fd36015b0d0 2023-11-17T06:30:27.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35dffb700 1 -- 172.21.15.69:0/2572424165 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3480035d0 con 0x7fd36015b0d0 2023-11-17T06:30:27.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35dffb700 1 -- 172.21.15.69:0/2572424165 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676823190 0 0) 0x7fd3600701c0 con 0x7fd3600cebb0 2023-11-17T06:30:27.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35f7fe700 1 -- 172.21.15.69:0/2572424165 >> v1:172.21.15.93:6789/0 conn(0x7fd3600cebb0 legacy=0x7fd3600cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35f7fe700 1 -- 172.21.15.69:0/2572424165 >> v1:172.21.15.69:6789/0 conn(0x7fd36015b0d0 legacy=0x7fd3600cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35f7fe700 1 -- 172.21.15.69:0/2572424165 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3600cf350 con 0x7fd3600ce050 2023-11-17T06:30:27.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35f7fe700 1 --2- 172.21.15.69:0/2572424165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 0x7fd360166190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd358009dc0 tx=0x7fd35800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=456a508ff7f6476d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:27.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35dffb700 1 -- 172.21.15.69:0/2572424165 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800e070 con 0x7fd3600ce050 2023-11-17T06:30:27.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35dffb700 1 -- 172.21.15.69:0/2572424165 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35800bae0 con 0x7fd3600ce050 2023-11-17T06:30:27.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd35dffb700 1 -- 172.21.15.69:0/2572424165 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35800be90 con 0x7fd3600ce050 2023-11-17T06:30:27.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd3656db700 1 -- 172.21.15.69:0/2572424165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 msgr2=0x7fd360166190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:27.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd3656db700 1 --2- 172.21.15.69:0/2572424165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 0x7fd360166190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd358009dc0 tx=0x7fd35800b330 comp rx=0 tx=0).stop 2023-11-17T06:30:27.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd3656db700 1 -- 172.21.15.69:0/2572424165 shutdown_connections 2023-11-17T06:30:27.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd3656db700 1 --2- 172.21.15.69:0/2572424165 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 0x7fd360166190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:27.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd3656db700 1 -- 172.21.15.69:0/2572424165 >> 172.21.15.69:0/2572424165 conn(0x7fd36009a360 msgr2=0x7fd3600d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:27.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd3656db700 1 -- 172.21.15.69:0/2572424165 shutdown_connections 2023-11-17T06:30:27.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.988+0000 7fd3656db700 1 -- 172.21.15.69:0/2572424165 wait complete. 2023-11-17T06:30:27.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd3656db700 1 Processor -- start 2023-11-17T06:30:27.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd3656db700 1 -- start start 2023-11-17T06:30:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd3656db700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 0x7fd3600c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd3656db700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3600cebb0 0x7fd3600caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd3656db700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36015b0d0 0x7fd36015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd3656db700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36015e3a0 con 0x7fd3600ce050 2023-11-17T06:30:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd3656db700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36006f440 con 0x7fd36015b0d0 2023-11-17T06:30:27.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd3656db700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3600c8770 con 0x7fd3600cebb0 2023-11-17T06:30:27.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd35effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 0x7fd3600c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:27.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd35effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 0x7fd3600c80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38298/0 (socket says 172.21.15.69:38298) 2023-11-17T06:30:27.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd35effd700 1 -- 172.21.15.69:0/1466805395 learned_addr learned my addr 172.21.15.69:0/1466805395 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:27.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd35e7fc700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3600cebb0 0x7fd3600caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.992+0000 7fd35f7fe700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36015b0d0 0x7fd36015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd35effd700 1 -- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3600cebb0 msgr2=0x7fd3600caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd35effd700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3600cebb0 0x7fd3600caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd35effd700 1 -- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36015b0d0 msgr2=0x7fd36015de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd35effd700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36015b0d0 0x7fd36015de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd35effd700 1 -- 172.21.15.69:0/1466805395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd358009a70 con 0x7fd3600ce050 2023-11-17T06:30:28.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd35e7fc700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3600cebb0 0x7fd3600caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:28.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd35effd700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 0x7fd3600c80b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd35000c680 tx=0x7fd35000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd3477fe700 1 -- 172.21.15.69:0/1466805395 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500074e0 con 0x7fd3600ce050 2023-11-17T06:30:28.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd3477fe700 1 -- 172.21.15.69:0/1466805395 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350007660 con 0x7fd3600ce050 2023-11-17T06:30:28.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd3656db700 1 -- 172.21.15.69:0/1466805395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36006edf0 con 0x7fd3600ce050 2023-11-17T06:30:28.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd3477fe700 1 -- 172.21.15.69:0/1466805395 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd350005a90 con 0x7fd3600ce050 2023-11-17T06:30:28.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd3656db700 1 -- 172.21.15.69:0/1466805395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36006eb00 con 0x7fd3600ce050 2023-11-17T06:30:28.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:27.996+0000 7fd3656db700 1 -- 172.21.15.69:0/1466805395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3600caf90 con 0x7fd3600ce050 2023-11-17T06:30:28.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.000+0000 7fd3477fe700 1 -- 172.21.15.69:0/1466805395 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd350005bf0 con 0x7fd3600ce050 2023-11-17T06:30:28.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.000+0000 7fd3477fe700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd34c066510 0x7fd34c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.000+0000 7fd3477fe700 1 -- 172.21.15.69:0/1466805395 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd350083490 con 0x7fd3600ce050 2023-11-17T06:30:28.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.000+0000 7fd35e7fc700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd34c066510 0x7fd34c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.004+0000 7fd35e7fc700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd34c066510 0x7fd34c0689d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd36004e890 tx=0x7fd354009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.008+0000 7fd3477fe700 1 -- 172.21.15.69:0/1466805395 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd350050880 con 0x7fd3600ce050 2023-11-17T06:30:28.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.196+0000 7fd3656db700 1 -- 172.21.15.69:0/1466805395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3600cf8e0 con 0x7fd3600ce050 2023-11-17T06:30:28.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.196+0000 7fd3477fe700 1 -- 172.21.15.69:0/1466805395 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd350053ea0 con 0x7fd3600ce050 2023-11-17T06:30:28.201 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:28.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.200+0000 7fd3656db700 1 -- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd34c066510 msgr2=0x7fd34c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.200+0000 7fd3656db700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd34c066510 0x7fd34c0689d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd36004e890 tx=0x7fd354009040 comp rx=0 tx=0).stop 2023-11-17T06:30:28.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.200+0000 7fd3656db700 1 -- 172.21.15.69:0/1466805395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 msgr2=0x7fd3600c80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.200+0000 7fd3656db700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 0x7fd3600c80b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd35000c680 tx=0x7fd35000ca40 comp rx=0 tx=0).stop 2023-11-17T06:30:28.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.204+0000 7fd3656db700 1 -- 172.21.15.69:0/1466805395 shutdown_connections 2023-11-17T06:30:28.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.204+0000 7fd3656db700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd34c066510 0x7fd34c0689d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.204+0000 7fd3656db700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd36015b0d0 0x7fd36015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.204+0000 7fd3656db700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3600cebb0 0x7fd3600caa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.204+0000 7fd3656db700 1 --2- 172.21.15.69:0/1466805395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3600ce050 0x7fd3600c80b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.204+0000 7fd3656db700 1 -- 172.21.15.69:0/1466805395 >> 172.21.15.69:0/1466805395 conn(0x7fd36009a360 msgr2=0x7fd3600b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:28.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.204+0000 7fd3656db700 1 -- 172.21.15.69:0/1466805395 shutdown_connections 2023-11-17T06:30:28.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.204+0000 7fd3656db700 1 -- 172.21.15.69:0/1466805395 wait complete. 2023-11-17T06:30:28.231 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:28.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.408+0000 7f462e687700 1 Processor -- start 2023-11-17T06:30:28.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.408+0000 7f462e687700 1 -- start start 2023-11-17T06:30:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f462e687700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f46280cb340 0x7f462815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f462e687700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4628070120 con 0x7f462815b120 2023-11-17T06:30:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f462e687700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462815fb00 con 0x7f462815b500 2023-11-17T06:30:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f462e687700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f462815fd50 con 0x7f46280cb340 2023-11-17T06:30:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f4627fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f462815b120 0x7f462815eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37258/0 (socket says 172.21.15.69:37258) 2023-11-17T06:30:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f4627fff700 1 -- 172.21.15.69:0/131475351 learned_addr learned my addr 172.21.15.69:0/131475351 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f462cc24700 1 --2- 172.21.15.69:0/131475351 >> v2:172.21.15.69:3300/0 conn(0x7f46280cb340 0x7f462815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051665501 0 0) 0x7f4628070120 con 0x7f462815b120 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46080035d0 con 0x7f462815b120 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2663647472 0 0) 0x7f46080035d0 con 0x7f462815b120 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 >> v2:172.21.15.69:3300/0 conn(0x7f46280cb340 msgr2=0x7f462815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 --2- 172.21.15.69:0/131475351 >> v2:172.21.15.69:3300/0 conn(0x7f46280cb340 0x7f462815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 >> v1:172.21.15.93:6789/0 conn(0x7f462815b500 legacy=0x7f46280c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46280705b0 con 0x7f462815b120 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f4618001670 con 0x7f462815b120 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 >> v1:172.21.15.69:6789/0 conn(0x7f462815b120 legacy=0x7f462815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4608003a20 0x7f4608003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4608004870 0x7f4608004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608005280 0x7f460800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462815fd50 con 0x7f4608004870 2023-11-17T06:30:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460800c1d0 con 0x7f4608003a20 2023-11-17T06:30:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.412+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460800c390 con 0x7f4608005280 2023-11-17T06:30:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f461f7fe700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4608004870 0x7f4608004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f4627fff700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4608003a20 0x7f4608003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f462cc24700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608005280 0x7f460800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f461f7fe700 1 -- 172.21.15.69:0/131475351 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608005280 msgr2=0x7f460800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:28.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f461f7fe700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608005280 0x7f460800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f461f7fe700 1 -- 172.21.15.69:0/131475351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4608003a20 msgr2=0x7f4608003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:28.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f461f7fe700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4608003a20 0x7f4608003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f461f7fe700 1 -- 172.21.15.69:0/131475351 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080035d0 con 0x7f4608004870 2023-11-17T06:30:28.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f462cc24700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608005280 0x7f460800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:28.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f462cc24700 1 -- 172.21.15.69:0/131475351 reap_dead start 2023-11-17T06:30:28.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f461f7fe700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4608004870 0x7f4608004cf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f462806fd60 tx=0x7f46080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f275447e97f652e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610001390 con 0x7f4608004870 2023-11-17T06:30:28.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46100052f0 con 0x7f4608004870 2023-11-17T06:30:28.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f46277fe700 1 -- 172.21.15.69:0/131475351 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46100036a0 con 0x7f4608004870 2023-11-17T06:30:28.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f462e687700 1 -- 172.21.15.69:0/131475351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4608004870 msgr2=0x7f4608004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f462e687700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4608004870 0x7f4608004cf0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f462806fd60 tx=0x7f46080058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f462e687700 1 -- 172.21.15.69:0/131475351 shutdown_connections 2023-11-17T06:30:28.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f462e687700 1 --2- 172.21.15.69:0/131475351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4608004870 0x7f4608004cf0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f462e687700 1 -- 172.21.15.69:0/131475351 >> 172.21.15.69:0/131475351 conn(0x7f46280cee80 msgr2=0x7f46280cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:28.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f462e687700 1 -- 172.21.15.69:0/131475351 shutdown_connections 2023-11-17T06:30:28.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.416+0000 7f462e687700 1 -- 172.21.15.69:0/131475351 wait complete. 2023-11-17T06:30:28.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462e687700 1 Processor -- start 2023-11-17T06:30:28.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462e687700 1 -- start start 2023-11-17T06:30:28.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462e687700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608004870 0x7f46281548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462e687700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46281f4170 0x7f462815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462e687700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f462815c650 0x7f4628152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462e687700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4628151bf0 con 0x7f462815c650 2023-11-17T06:30:28.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462e687700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462815bc80 con 0x7f46281f4170 2023-11-17T06:30:28.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462e687700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46281f49a0 con 0x7f4608004870 2023-11-17T06:30:28.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462cc24700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f462815c650 0x7f4628152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462cc24700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f462815c650 0x7f4628152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38330/0 (socket says 172.21.15.69:38330) 2023-11-17T06:30:28.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f462cc24700 1 -- 172.21.15.69:0/804416399 learned_addr learned my addr 172.21.15.69:0/804416399 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:28.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f461f7fe700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46281f4170 0x7f462815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.420+0000 7f4627fff700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608004870 0x7f46281548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f462cc24700 1 -- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608004870 msgr2=0x7f46281548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f462cc24700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608004870 0x7f46281548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f462cc24700 1 -- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46281f4170 msgr2=0x7f462815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f462cc24700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46281f4170 0x7f462815c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f462cc24700 1 -- 172.21.15.69:0/804416399 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46281f4c80 con 0x7f462815c650 2023-11-17T06:30:28.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f4627fff700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608004870 0x7f46281548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:28.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f462cc24700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f462815c650 0x7f4628152d20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f46280c5ed0 tx=0x7f46200114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f46257fa700 1 -- 172.21.15.69:0/804416399 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462000e030 con 0x7f462815c650 2023-11-17T06:30:28.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f46257fa700 1 -- 172.21.15.69:0/804416399 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4620011bc0 con 0x7f462815c650 2023-11-17T06:30:28.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f462e687700 1 -- 172.21.15.69:0/804416399 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46281f4f60 con 0x7f462815c650 2023-11-17T06:30:28.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f46257fa700 1 -- 172.21.15.69:0/804416399 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620016470 con 0x7f462815c650 2023-11-17T06:30:28.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f462e687700 1 -- 172.21.15.69:0/804416399 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46281f45f0 con 0x7f462815c650 2023-11-17T06:30:28.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.424+0000 7f462e687700 1 -- 172.21.15.69:0/804416399 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4628073f00 con 0x7f462815c650 2023-11-17T06:30:28.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.428+0000 7f46257fa700 1 -- 172.21.15.69:0/804416399 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f46200165d0 con 0x7f462815c650 2023-11-17T06:30:28.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.428+0000 7f46257fa700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f460c066540 0x7f460c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.428+0000 7f46257fa700 1 -- 172.21.15.69:0/804416399 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f462000f070 con 0x7f462815c650 2023-11-17T06:30:28.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.428+0000 7f4627fff700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f460c066540 0x7f460c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.428+0000 7f4627fff700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f460c066540 0x7f460c068a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4618007c70 tx=0x7f4618009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.432+0000 7f46257fa700 1 -- 172.21.15.69:0/804416399 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4620051b10 con 0x7f462815c650 2023-11-17T06:30:28.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.608+0000 7f462e687700 1 -- 172.21.15.69:0/804416399 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4628158460 con 0x7f462815c650 2023-11-17T06:30:28.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.608+0000 7f46257fa700 1 -- 172.21.15.69:0/804416399 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4620055130 con 0x7f462815c650 2023-11-17T06:30:28.612 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:28.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.608+0000 7f462e687700 1 -- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f460c066540 msgr2=0x7f460c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.608+0000 7f462e687700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f460c066540 0x7f460c068a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4618007c70 tx=0x7f4618009040 comp rx=0 tx=0).stop 2023-11-17T06:30:28.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.608+0000 7f462e687700 1 -- 172.21.15.69:0/804416399 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f462815c650 msgr2=0x7f4628152d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.608+0000 7f462e687700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f462815c650 0x7f4628152d20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f46280c5ed0 tx=0x7f46200114b0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.612+0000 7f462e687700 1 -- 172.21.15.69:0/804416399 shutdown_connections 2023-11-17T06:30:28.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.612+0000 7f462e687700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f460c066540 0x7f460c068a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.612+0000 7f462e687700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f462815c650 0x7f4628152d20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.612+0000 7f462e687700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f46281f4170 0x7f462815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.612+0000 7f462e687700 1 --2- 172.21.15.69:0/804416399 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4608004870 0x7f46281548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.612+0000 7f462e687700 1 -- 172.21.15.69:0/804416399 >> 172.21.15.69:0/804416399 conn(0x7f46280cee80 msgr2=0x7f46280b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:28.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.612+0000 7f462e687700 1 -- 172.21.15.69:0/804416399 shutdown_connections 2023-11-17T06:30:28.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.612+0000 7f462e687700 1 -- 172.21.15.69:0/804416399 wait complete. 2023-11-17T06:30:28.635 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:28.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.812+0000 7fb3ab058700 1 Processor -- start 2023-11-17T06:30:28.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.812+0000 7fb3ab058700 1 -- start start 2023-11-17T06:30:28.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3ab058700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb3a415d5a0 0x7fb3a40cfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3ab058700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a41621b0 con 0x7fb3a415d980 2023-11-17T06:30:28.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3ab058700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a40b59b0 con 0x7fb3a40b2600 2023-11-17T06:30:28.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3ab058700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a4161630 con 0x7fb3a415d5a0 2023-11-17T06:30:28.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3aa056700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb3a415d5a0 0x7fb3a40cfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3a9855700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb3a415d980 0x7fb3a40b4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37270/0 (socket says 172.21.15.69:37270) 2023-11-17T06:30:28.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3a9855700 1 -- 172.21.15.69:0/2109293182 learned_addr learned my addr 172.21.15.69:0/2109293182 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:28.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3aa857700 1 --1- 172.21.15.69:0/2109293182 >> v1:172.21.15.93:6789/0 conn(0x7fb3a40b2600 0x7fb3a40b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:59406/0 (socket says 172.21.15.69:59406) 2023-11-17T06:30:28.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3aa056700 1 -- 172.21.15.69:0/2109293182 >> v1:172.21.15.93:6789/0 conn(0x7fb3a40b2600 legacy=0x7fb3a40b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3aa056700 1 -- 172.21.15.69:0/2109293182 >> v1:172.21.15.69:6789/0 conn(0x7fb3a415d980 legacy=0x7fb3a40b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3aa056700 1 -- 172.21.15.69:0/2109293182 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a4161910 con 0x7fb3a415d5a0 2023-11-17T06:30:28.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3aa056700 1 --2- 172.21.15.69:0/2109293182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3a415d5a0 0x7fb3a40cfb20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009850 tx=0x7fb3a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32b26afff4583c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.816+0000 7fb3a9054700 1 -- 172.21.15.69:0/2109293182 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0011830 con 0x7fb3a415d5a0 2023-11-17T06:30:28.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.820+0000 7fb3a9054700 1 -- 172.21.15.69:0/2109293182 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a0011990 con 0x7fb3a415d5a0 2023-11-17T06:30:28.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.820+0000 7fb3a9054700 1 -- 172.21.15.69:0/2109293182 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0011d20 con 0x7fb3a415d5a0 2023-11-17T06:30:28.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.820+0000 7fb3ab058700 1 -- 172.21.15.69:0/2109293182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3a415d5a0 msgr2=0x7fb3a40cfb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.820+0000 7fb3ab058700 1 --2- 172.21.15.69:0/2109293182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3a415d5a0 0x7fb3a40cfb20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009850 tx=0x7fb3a0009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:28.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.820+0000 7fb3ab058700 1 -- 172.21.15.69:0/2109293182 shutdown_connections 2023-11-17T06:30:28.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.820+0000 7fb3ab058700 1 --2- 172.21.15.69:0/2109293182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3a415d5a0 0x7fb3a40cfb20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.820+0000 7fb3ab058700 1 -- 172.21.15.69:0/2109293182 >> 172.21.15.69:0/2109293182 conn(0x7fb3a406aca0 msgr2=0x7fb3a406b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:28.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.820+0000 7fb3ab058700 1 -- 172.21.15.69:0/2109293182 shutdown_connections 2023-11-17T06:30:28.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.820+0000 7fb3ab058700 1 -- 172.21.15.69:0/2109293182 wait complete. 2023-11-17T06:30:28.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3ab058700 1 Processor -- start 2023-11-17T06:30:28.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3ab058700 1 -- start start 2023-11-17T06:30:28.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3ab058700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3a40b2600 0x7fb3a41f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3ab058700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3a415d5a0 0x7fb3a41f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3ab058700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3a41f3290 0x7fb3a40b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3ab058700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a41f7220 con 0x7fb3a40b2600 2023-11-17T06:30:28.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3ab058700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a41f37a0 con 0x7fb3a41f3290 2023-11-17T06:30:28.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3ab058700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a41f3a80 con 0x7fb3a415d5a0 2023-11-17T06:30:28.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3aa056700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3a40b2600 0x7fb3a41f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3aa056700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3a40b2600 0x7fb3a41f6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38346/0 (socket says 172.21.15.69:38346) 2023-11-17T06:30:28.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.824+0000 7fb3aa056700 1 -- 172.21.15.69:0/16584035 learned_addr learned my addr 172.21.15.69:0/16584035 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:28.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb3aa857700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3a41f3290 0x7fb3a40b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb3a9855700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3a415d5a0 0x7fb3a41f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb3aa056700 1 -- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3a415d5a0 msgr2=0x7fb3a41f2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb3aa056700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3a415d5a0 0x7fb3a41f2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb3aa056700 1 -- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3a41f3290 msgr2=0x7fb3a40b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:28.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb3aa056700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3a41f3290 0x7fb3a40b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:28.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb3aa056700 1 -- 172.21.15.69:0/16584035 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a00094b0 con 0x7fb3a40b2600 2023-11-17T06:30:28.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb3aa056700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3a40b2600 0x7fb3a41f6ce0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb3a408b420 tx=0x7fb3a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb39affd700 1 -- 172.21.15.69:0/16584035 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00036c0 con 0x7fb3a40b2600 2023-11-17T06:30:28.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb39affd700 1 -- 172.21.15.69:0/16584035 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a0003820 con 0x7fb3a40b2600 2023-11-17T06:30:28.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb3ab058700 1 -- 172.21.15.69:0/16584035 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a41f64e0 con 0x7fb3a40b2600 2023-11-17T06:30:28.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb39affd700 1 -- 172.21.15.69:0/16584035 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0003bd0 con 0x7fb3a40b2600 2023-11-17T06:30:28.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.828+0000 7fb3ab058700 1 -- 172.21.15.69:0/16584035 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a40c98c0 con 0x7fb3a40b2600 2023-11-17T06:30:28.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.832+0000 7fb3ab058700 1 -- 172.21.15.69:0/16584035 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a41f6340 con 0x7fb3a40b2600 2023-11-17T06:30:28.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.832+0000 7fb39affd700 1 -- 172.21.15.69:0/16584035 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb3a0003d30 con 0x7fb3a40b2600 2023-11-17T06:30:28.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.832+0000 7fb39affd700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb388066510 0x7fb3880689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:28.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.832+0000 7fb39affd700 1 -- 172.21.15.69:0/16584035 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3a0021030 con 0x7fb3a40b2600 2023-11-17T06:30:28.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.836+0000 7fb3a9855700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb388066510 0x7fb3880689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:28.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.836+0000 7fb3a9855700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb388066510 0x7fb3880689d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40b6f50 tx=0x7fb394009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:28.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:28.840+0000 7fb39affd700 1 -- 172.21.15.69:0/16584035 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb3a41f6340 con 0x7fb3a40b2600 2023-11-17T06:30:29.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.016+0000 7fb3ab058700 1 -- 172.21.15.69:0/16584035 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3a41f6a00 con 0x7fb3a40b2600 2023-11-17T06:30:29.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.016+0000 7fb39affd700 1 -- 172.21.15.69:0/16584035 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb3a41f6a00 con 0x7fb3a40b2600 2023-11-17T06:30:29.022 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 -- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb388066510 msgr2=0x7fb3880689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb388066510 0x7fb3880689d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb3a40b6f50 tx=0x7fb394009040 comp rx=0 tx=0).stop 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 -- 172.21.15.69:0/16584035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3a40b2600 msgr2=0x7fb3a41f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3a40b2600 0x7fb3a41f6ce0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb3a408b420 tx=0x7fb3a0004770 comp rx=0 tx=0).stop 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 -- 172.21.15.69:0/16584035 shutdown_connections 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb388066510 0x7fb3880689d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3a41f3290 0x7fb3a40b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3a415d5a0 0x7fb3a41f2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 --2- 172.21.15.69:0/16584035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3a40b2600 0x7fb3a41f6ce0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 -- 172.21.15.69:0/16584035 >> 172.21.15.69:0/16584035 conn(0x7fb3a406aca0 msgr2=0x7fb3a40d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 -- 172.21.15.69:0/16584035 shutdown_connections 2023-11-17T06:30:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.020+0000 7fb3ab058700 1 -- 172.21.15.69:0/16584035 wait complete. 2023-11-17T06:30:29.049 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:29.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b302d700 1 Processor -- start 2023-11-17T06:30:29.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b302d700 1 -- start start 2023-11-17T06:30:29.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b302d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12ac15b980 0x7f12ac15f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b302d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac06fc20 con 0x7f12ac0719e0 2023-11-17T06:30:29.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b302d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ac15fcc0 con 0x7f12ac0c9b30 2023-11-17T06:30:29.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b302d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ac070430 con 0x7f12ac15b980 2023-11-17T06:30:29.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b182a700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f12ac0719e0 0x7f12ac0c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37278/0 (socket says 172.21.15.69:37278) 2023-11-17T06:30:29.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b182a700 1 -- 172.21.15.69:0/770808706 learned_addr learned my addr 172.21.15.69:0/770808706 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:29.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b202b700 1 --2- 172.21.15.69:0/770808706 >> v2:172.21.15.69:3300/0 conn(0x7f12ac15b980 0x7f12ac15f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b1029700 1 -- 172.21.15.69:0/770808706 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992545082 0 0) 0x7f12ac06fc20 con 0x7f12ac0719e0 2023-11-17T06:30:29.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b1029700 1 -- 172.21.15.69:0/770808706 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12940035d0 con 0x7f12ac0719e0 2023-11-17T06:30:29.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.212+0000 7f12b202b700 1 -- 172.21.15.69:0/770808706 >> v1:172.21.15.93:6789/0 conn(0x7f12ac0c9b30 legacy=0x7f12ac15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b202b700 1 -- 172.21.15.69:0/770808706 >> v1:172.21.15.69:6789/0 conn(0x7f12ac0719e0 legacy=0x7f12ac0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b202b700 1 -- 172.21.15.69:0/770808706 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac06fe70 con 0x7f12ac15b980 2023-11-17T06:30:29.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b202b700 1 --2- 172.21.15.69:0/770808706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 0x7f12ac15f780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f129c009850 tx=0x7f129c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb9ce3d1841818f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b1029700 1 -- 172.21.15.69:0/770808706 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c011830 con 0x7f12ac15b980 2023-11-17T06:30:29.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b1029700 1 -- 172.21.15.69:0/770808706 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c011990 con 0x7f12ac15b980 2023-11-17T06:30:29.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b1029700 1 -- 172.21.15.69:0/770808706 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c011d40 con 0x7f12ac15b980 2023-11-17T06:30:29.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b302d700 1 -- 172.21.15.69:0/770808706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 msgr2=0x7f12ac15f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b302d700 1 --2- 172.21.15.69:0/770808706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 0x7f12ac15f780 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f129c009850 tx=0x7f129c009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:29.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b302d700 1 -- 172.21.15.69:0/770808706 shutdown_connections 2023-11-17T06:30:29.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b302d700 1 --2- 172.21.15.69:0/770808706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 0x7f12ac15f780 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b302d700 1 -- 172.21.15.69:0/770808706 >> 172.21.15.69:0/770808706 conn(0x7f12ac0b0900 msgr2=0x7f12ac0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:29.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b302d700 1 -- 172.21.15.69:0/770808706 shutdown_connections 2023-11-17T06:30:29.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.216+0000 7f12b302d700 1 -- 172.21.15.69:0/770808706 wait complete. 2023-11-17T06:30:29.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b302d700 1 Processor -- start 2023-11-17T06:30:29.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b302d700 1 -- start start 2023-11-17T06:30:29.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b302d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f12ac0719e0 0x7f12ac1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b302d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12ac0c9b30 0x7f12ac0c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b302d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 0x7f12ac0caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b302d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0c85b0 con 0x7f12ac15b980 2023-11-17T06:30:29.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b302d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac153d00 con 0x7f12ac0c9b30 2023-11-17T06:30:29.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b302d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ac0c7700 con 0x7f12ac0719e0 2023-11-17T06:30:29.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b282c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 0x7f12ac0caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b282c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 0x7f12ac0caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38360/0 (socket says 172.21.15.69:38360) 2023-11-17T06:30:29.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b282c700 1 -- 172.21.15.69:0/2165585510 learned_addr learned my addr 172.21.15.69:0/2165585510 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:29.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b182a700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12ac0c9b30 0x7f12ac0c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b202b700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f12ac0719e0 0x7f12ac1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b282c700 1 -- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f12ac0719e0 msgr2=0x7f12ac1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b282c700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f12ac0719e0 0x7f12ac1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b282c700 1 -- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12ac0c9b30 msgr2=0x7f12ac0c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b282c700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12ac0c9b30 0x7f12ac0c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b282c700 1 -- 172.21.15.69:0/2165585510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0094b0 con 0x7f12ac15b980 2023-11-17T06:30:29.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b282c700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 0x7f12ac0caf60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f12a400cbc0 tx=0x7f12a400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12aaffd700 1 -- 172.21.15.69:0/2165585510 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a4003c20 con 0x7f12ac15b980 2023-11-17T06:30:29.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12aaffd700 1 -- 172.21.15.69:0/2165585510 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4003d80 con 0x7f12ac15b980 2023-11-17T06:30:29.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b302d700 1 -- 172.21.15.69:0/2165585510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ac0c7930 con 0x7f12ac15b980 2023-11-17T06:30:29.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12aaffd700 1 -- 172.21.15.69:0/2165585510 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a400abf0 con 0x7f12ac15b980 2023-11-17T06:30:29.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.220+0000 7f12b302d700 1 -- 172.21.15.69:0/2165585510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ac0c7ef0 con 0x7f12ac15b980 2023-11-17T06:30:29.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.224+0000 7f12b302d700 1 -- 172.21.15.69:0/2165585510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ac0c86f0 con 0x7f12ac15b980 2023-11-17T06:30:29.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.224+0000 7f12aaffd700 1 -- 172.21.15.69:0/2165585510 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f12a400ad50 con 0x7f12ac15b980 2023-11-17T06:30:29.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.228+0000 7f12aaffd700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1298066540 0x7f1298068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.228+0000 7f12aaffd700 1 -- 172.21.15.69:0/2165585510 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12a4083fe0 con 0x7f12ac15b980 2023-11-17T06:30:29.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.228+0000 7f12b202b700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1298066540 0x7f1298068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.228+0000 7f12b202b700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1298066540 0x7f1298068a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f129c0090b0 tx=0x7f129c01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.232+0000 7f12aaffd700 1 -- 172.21.15.69:0/2165585510 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f12ac0c86f0 con 0x7f12ac15b980 2023-11-17T06:30:29.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.412+0000 7f12b302d700 1 -- 172.21.15.69:0/2165585510 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12ac0c86f0 con 0x7f12ac15b980 2023-11-17T06:30:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.416+0000 7f12aaffd700 1 -- 172.21.15.69:0/2165585510 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f12ac0c86f0 con 0x7f12ac15b980 2023-11-17T06:30:29.421 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:29.421 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:58.004301+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.416+0000 7f12b302d700 1 -- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1298066540 msgr2=0x7f1298068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.416+0000 7f12b302d700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1298066540 0x7f1298068a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f129c0090b0 tx=0x7f129c01c040 comp rx=0 tx=0).stop 2023-11-17T06:30:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.416+0000 7f12b302d700 1 -- 172.21.15.69:0/2165585510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 msgr2=0x7f12ac0caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.416+0000 7f12b302d700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 0x7f12ac0caf60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f12a400cbc0 tx=0x7f12a400cf80 comp rx=0 tx=0).stop 2023-11-17T06:30:29.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.420+0000 7f12b302d700 1 -- 172.21.15.69:0/2165585510 shutdown_connections 2023-11-17T06:30:29.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.420+0000 7f12b302d700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1298066540 0x7f1298068a00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.420+0000 7f12b302d700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ac15b980 0x7f12ac0caf60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.420+0000 7f12b302d700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12ac0c9b30 0x7f12ac0c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.420+0000 7f12b302d700 1 --2- 172.21.15.69:0/2165585510 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f12ac0719e0 0x7f12ac1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.420+0000 7f12b302d700 1 -- 172.21.15.69:0/2165585510 >> 172.21.15.69:0/2165585510 conn(0x7f12ac0b0900 msgr2=0x7f12ac0cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:29.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.420+0000 7f12b302d700 1 -- 172.21.15.69:0/2165585510 shutdown_connections 2023-11-17T06:30:29.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.420+0000 7f12b302d700 1 -- 172.21.15.69:0/2165585510 wait complete. 2023-11-17T06:30:29.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:29.441 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:29.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.616+0000 7f78fb59e700 1 Processor -- start 2023-11-17T06:30:29.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.616+0000 7f78fb59e700 1 -- start start 2023-11-17T06:30:29.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.620+0000 7f78fb59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f78fc15d490 0x7f78fc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.620+0000 7f78fb59e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f78fc0d13d0 0x7f78fc0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.620+0000 7f78fb59e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc0ce770 con 0x7f78fc0ce310 2023-11-17T06:30:29.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.620+0000 7f78fb59e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc0d1bb0 con 0x7f78fc0d13d0 2023-11-17T06:30:29.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.620+0000 7f78fb59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0d1e90 con 0x7f78fc15d490 2023-11-17T06:30:29.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.620+0000 7f78f9d9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f78fc0d13d0 0x7f78fc0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.620+0000 7f78fad9d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f78fc0ce310 0x7f78fc0b4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37286/0 (socket says 172.21.15.69:37286) 2023-11-17T06:30:29.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.620+0000 7f78fad9d700 1 -- 172.21.15.69:0/3950252438 learned_addr learned my addr 172.21.15.69:0/3950252438 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:29.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.620+0000 7f78fa59c700 1 --2- 172.21.15.69:0/3950252438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f78fc15d490 0x7f78fc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78f9d9b700 1 -- 172.21.15.69:0/3950252438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f78fc15d490 msgr2=0x7f78fc0b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:29.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78f9d9b700 1 --2- 172.21.15.69:0/3950252438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f78fc15d490 0x7f78fc0b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78f9d9b700 1 -- 172.21.15.69:0/3950252438 >> v1:172.21.15.69:6789/0 conn(0x7f78fc0ce310 legacy=0x7f78fc0b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78f9d9b700 1 -- 172.21.15.69:0/3950252438 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc0d2170 con 0x7f78fc0d13d0 2023-11-17T06:30:29.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78f9d9b700 1 --2- 172.21.15.69:0/3950252438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 0x7f78fc0cddd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009850 tx=0x7f78f0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec469b63edf0db67 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78f959a700 1 -- 172.21.15.69:0/3950252438 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0011830 con 0x7f78fc0d13d0 2023-11-17T06:30:29.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78f959a700 1 -- 172.21.15.69:0/3950252438 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0011990 con 0x7f78fc0d13d0 2023-11-17T06:30:29.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78f959a700 1 -- 172.21.15.69:0/3950252438 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0011d40 con 0x7f78fc0d13d0 2023-11-17T06:30:29.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78fb59e700 1 -- 172.21.15.69:0/3950252438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 msgr2=0x7f78fc0cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78fb59e700 1 --2- 172.21.15.69:0/3950252438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 0x7f78fc0cddd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f78f0009850 tx=0x7f78f0009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78fb59e700 1 -- 172.21.15.69:0/3950252438 shutdown_connections 2023-11-17T06:30:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78fb59e700 1 --2- 172.21.15.69:0/3950252438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 0x7f78fc0cddd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78fb59e700 1 --2- 172.21.15.69:0/3950252438 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f78fc15d490 0x7f78fc0b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78fb59e700 1 -- 172.21.15.69:0/3950252438 >> 172.21.15.69:0/3950252438 conn(0x7f78fc06ab40 msgr2=0x7f78fc06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78fb59e700 1 -- 172.21.15.69:0/3950252438 shutdown_connections 2023-11-17T06:30:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.624+0000 7f78fb59e700 1 -- 172.21.15.69:0/3950252438 wait complete. 2023-11-17T06:30:29.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.628+0000 7f78fb59e700 1 Processor -- start 2023-11-17T06:30:29.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.628+0000 7f78fb59e700 1 -- start start 2023-11-17T06:30:29.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78fb59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0ce310 0x7f78fc150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78fb59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 0x7f78fc155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78fb59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f78fc15d490 0x7f78fc15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78fb59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc154250 con 0x7f78fc0d13d0 2023-11-17T06:30:29.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78fb59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc154530 con 0x7f78fc0ce310 2023-11-17T06:30:29.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78fb59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc154810 con 0x7f78fc15d490 2023-11-17T06:30:29.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78f9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 0x7f78fc155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78f9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 0x7f78fc155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38374/0 (socket says 172.21.15.69:38374) 2023-11-17T06:30:29.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78f9d9b700 1 -- 172.21.15.69:0/408835595 learned_addr learned my addr 172.21.15.69:0/408835595 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78fa59c700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0ce310 0x7f78fc150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78fad9d700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f78fc15d490 0x7f78fc15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78f9d9b700 1 -- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f78fc15d490 msgr2=0x7f78fc15b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78f9d9b700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f78fc15d490 0x7f78fc15b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78f9d9b700 1 -- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0ce310 msgr2=0x7f78fc150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78f9d9b700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0ce310 0x7f78fc150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78f9d9b700 1 -- 172.21.15.69:0/408835595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f00094b0 con 0x7f78fc0d13d0 2023-11-17T06:30:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78f9d9b700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 0x7f78fc155240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78f00090b0 tx=0x7f78f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78eaffd700 1 -- 172.21.15.69:0/408835595 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0004570 con 0x7f78fc0d13d0 2023-11-17T06:30:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78eaffd700 1 -- 172.21.15.69:0/408835595 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f001f070 con 0x7f78fc0d13d0 2023-11-17T06:30:29.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78fb59e700 1 -- 172.21.15.69:0/408835595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc154af0 con 0x7f78fc0d13d0 2023-11-17T06:30:29.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78eaffd700 1 -- 172.21.15.69:0/408835595 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f0003900 con 0x7f78fc0d13d0 2023-11-17T06:30:29.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.632+0000 7f78fb59e700 1 -- 172.21.15.69:0/408835595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc153e70 con 0x7f78fc0d13d0 2023-11-17T06:30:29.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.636+0000 7f78fb59e700 1 -- 172.21.15.69:0/408835595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc073f00 con 0x7f78fc0d13d0 2023-11-17T06:30:29.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.636+0000 7f78eaffd700 1 -- 172.21.15.69:0/408835595 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f78f0021030 con 0x7f78fc0d13d0 2023-11-17T06:30:29.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.640+0000 7f78eaffd700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f78dc066560 0x7f78dc068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:29.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.640+0000 7f78eaffd700 1 -- 172.21.15.69:0/408835595 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78f0084ea0 con 0x7f78fc0d13d0 2023-11-17T06:30:29.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.640+0000 7f78fa59c700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f78dc066560 0x7f78dc068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:29.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.640+0000 7f78fa59c700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f78dc066560 0x7f78dc068a20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009ae0 tx=0x7f78ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:29.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.640+0000 7f78eaffd700 1 -- 172.21.15.69:0/408835595 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f78f0052300 con 0x7f78fc0d13d0 2023-11-17T06:30:29.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.820+0000 7f78fb59e700 1 -- 172.21.15.69:0/408835595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78fc0b6ca0 con 0x7f78fc0d13d0 2023-11-17T06:30:29.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.820+0000 7f78eaffd700 1 -- 172.21.15.69:0/408835595 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78f00150a0 con 0x7f78fc0d13d0 2023-11-17T06:30:29.825 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:29.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.820+0000 7f78fb59e700 1 -- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f78dc066560 msgr2=0x7f78dc068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f78dc066560 0x7f78dc068a20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009ae0 tx=0x7f78ec008040 comp rx=0 tx=0).stop 2023-11-17T06:30:29.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 -- 172.21.15.69:0/408835595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 msgr2=0x7f78fc155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:29.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 0x7f78fc155240 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f78f00090b0 tx=0x7f78f0004770 comp rx=0 tx=0).stop 2023-11-17T06:30:29.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 -- 172.21.15.69:0/408835595 shutdown_connections 2023-11-17T06:30:29.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f78dc066560 0x7f78dc068a20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f78fc15d490 0x7f78fc15b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f78fc0d13d0 0x7f78fc155240 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 --2- 172.21.15.69:0/408835595 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f78fc0ce310 0x7f78fc150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:29.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 -- 172.21.15.69:0/408835595 >> 172.21.15.69:0/408835595 conn(0x7f78fc06ab40 msgr2=0x7f78fc0b74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:29.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 -- 172.21.15.69:0/408835595 shutdown_connections 2023-11-17T06:30:29.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:29.824+0000 7f78fb59e700 1 -- 172.21.15.69:0/408835595 wait complete. 2023-11-17T06:30:29.854 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:30.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.032+0000 7fc3cffff700 1 Processor -- start 2023-11-17T06:30:30.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.032+0000 7fc3cffff700 1 -- start start 2023-11-17T06:30:30.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cffff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d015d490 0x7fc3d00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc3d00d13d0 0x7fc3d00cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cffff700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d00ce770 con 0x7fc3d00ce310 2023-11-17T06:30:30.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cffff700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d00d1bb0 con 0x7fc3d00d13d0 2023-11-17T06:30:30.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cffff700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00d1e90 con 0x7fc3d015d490 2023-11-17T06:30:30.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cf7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc3d00ce310 0x7fc3d00b4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37300/0 (socket says 172.21.15.69:37300) 2023-11-17T06:30:30.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cf7fe700 1 -- 172.21.15.69:0/1570145528 learned_addr learned my addr 172.21.15.69:0/1570145528 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:30.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3ce7fc700 1 --2- 172.21.15.69:0/1570145528 >> v2:172.21.15.69:3300/0 conn(0x7fc3d00d13d0 0x7fc3d00cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3ceffd700 1 --2- 172.21.15.69:0/1570145528 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d015d490 0x7fc3d00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3ce7fc700 1 -- 172.21.15.69:0/1570145528 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d015d490 msgr2=0x7fc3d00b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:30.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3ce7fc700 1 --2- 172.21.15.69:0/1570145528 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d015d490 0x7fc3d00b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3ce7fc700 1 -- 172.21.15.69:0/1570145528 >> v1:172.21.15.69:6789/0 conn(0x7fc3d00ce310 legacy=0x7fc3d00b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cdffb700 1 -- 172.21.15.69:0/1570145528 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175424147 0 0) 0x7fc3d00ce770 con 0x7fc3d00ce310 2023-11-17T06:30:30.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3ce7fc700 1 -- 172.21.15.69:0/1570145528 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d00d2170 con 0x7fc3d00d13d0 2023-11-17T06:30:30.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3ceffd700 1 --2- 172.21.15.69:0/1570145528 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d015d490 0x7fc3d00b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:30.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3ce7fc700 1 --2- 172.21.15.69:0/1570145528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d00d13d0 0x7fc3d00cddd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009850 tx=0x7fc3c4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1590df885e43cebb server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cdffb700 1 -- 172.21.15.69:0/1570145528 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4011830 con 0x7fc3d00d13d0 2023-11-17T06:30:30.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cdffb700 1 -- 172.21.15.69:0/1570145528 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c4011990 con 0x7fc3d00d13d0 2023-11-17T06:30:30.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cdffb700 1 -- 172.21.15.69:0/1570145528 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4011d20 con 0x7fc3d00d13d0 2023-11-17T06:30:30.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cffff700 1 -- 172.21.15.69:0/1570145528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d00d13d0 msgr2=0x7fc3d00cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.036+0000 7fc3cffff700 1 --2- 172.21.15.69:0/1570145528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d00d13d0 0x7fc3d00cddd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4009850 tx=0x7fc3c4009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.040+0000 7fc3cffff700 1 -- 172.21.15.69:0/1570145528 shutdown_connections 2023-11-17T06:30:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.040+0000 7fc3cffff700 1 --2- 172.21.15.69:0/1570145528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d00d13d0 0x7fc3d00cddd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.040+0000 7fc3cffff700 1 --2- 172.21.15.69:0/1570145528 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d015d490 0x7fc3d00b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.040+0000 7fc3cffff700 1 -- 172.21.15.69:0/1570145528 >> 172.21.15.69:0/1570145528 conn(0x7fc3d006ab40 msgr2=0x7fc3d006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:30.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.040+0000 7fc3cffff700 1 -- 172.21.15.69:0/1570145528 shutdown_connections 2023-11-17T06:30:30.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.040+0000 7fc3cffff700 1 -- 172.21.15.69:0/1570145528 wait complete. 2023-11-17T06:30:30.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.040+0000 7fc3cffff700 1 Processor -- start 2023-11-17T06:30:30.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cffff700 1 -- start start 2023-11-17T06:30:30.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3d00ce310 0x7fc3d01536d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cffff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d00d13d0 0x7fc3d01f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d015d490 0x7fc3d01f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cffff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d0149e00 con 0x7fc3d015d490 2023-11-17T06:30:30.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cffff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d01f6180 con 0x7fc3d00ce310 2023-11-17T06:30:30.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cffff700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d01f2f40 con 0x7fc3d00d13d0 2023-11-17T06:30:30.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cf7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d015d490 0x7fc3d01f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cf7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d015d490 0x7fc3d01f5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38388/0 (socket says 172.21.15.69:38388) 2023-11-17T06:30:30.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cf7fe700 1 -- 172.21.15.69:0/3816255970 learned_addr learned my addr 172.21.15.69:0/3816255970 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:30.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3ceffd700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3d00ce310 0x7fc3d01536d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3ce7fc700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d00d13d0 0x7fc3d01f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cf7fe700 1 -- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d00d13d0 msgr2=0x7fc3d01f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cf7fe700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d00d13d0 0x7fc3d01f5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cf7fe700 1 -- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3d00ce310 msgr2=0x7fc3d01536d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cf7fe700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3d00ce310 0x7fc3d01536d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cf7fe700 1 -- 172.21.15.69:0/3816255970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c40094b0 con 0x7fc3d015d490 2023-11-17T06:30:30.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.044+0000 7fc3cf7fe700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d015d490 0x7fc3d01f5c40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8002230 tx=0x7fc3c800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.048+0000 7fc3b7fff700 1 -- 172.21.15.69:0/3816255970 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c800aac0 con 0x7fc3d015d490 2023-11-17T06:30:30.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.048+0000 7fc3b7fff700 1 -- 172.21.15.69:0/3816255970 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c800ac40 con 0x7fc3d015d490 2023-11-17T06:30:30.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.048+0000 7fc3cffff700 1 -- 172.21.15.69:0/3816255970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d01f3500 con 0x7fc3d015d490 2023-11-17T06:30:30.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.048+0000 7fc3b7fff700 1 -- 172.21.15.69:0/3816255970 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c80070d0 con 0x7fc3d015d490 2023-11-17T06:30:30.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.048+0000 7fc3cffff700 1 -- 172.21.15.69:0/3816255970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d01f3ac0 con 0x7fc3d015d490 2023-11-17T06:30:30.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.048+0000 7fc3cffff700 1 -- 172.21.15.69:0/3816255970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d00b5d00 con 0x7fc3d015d490 2023-11-17T06:30:30.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.052+0000 7fc3b7fff700 1 -- 172.21.15.69:0/3816255970 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc3c8007250 con 0x7fc3d015d490 2023-11-17T06:30:30.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.052+0000 7fc3b7fff700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc3bc066510 0x7fc3bc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.052+0000 7fc3b7fff700 1 -- 172.21.15.69:0/3816255970 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3c8083c20 con 0x7fc3d015d490 2023-11-17T06:30:30.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.052+0000 7fc3ceffd700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc3bc066510 0x7fc3bc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.052+0000 7fc3ceffd700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc3bc066510 0x7fc3bc0689d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000ab60 tx=0x7fc3c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.060+0000 7fc3b7fff700 1 -- 172.21.15.69:0/3816255970 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc3c80510a0 con 0x7fc3d015d490 2023-11-17T06:30:30.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.236+0000 7fc3cffff700 1 -- 172.21.15.69:0/3816255970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3d0073f00 con 0x7fc3d015d490 2023-11-17T06:30:30.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.236+0000 7fc3b7fff700 1 -- 172.21.15.69:0/3816255970 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc3c8018020 con 0x7fc3d015d490 2023-11-17T06:30:30.241 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:30.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 -- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc3bc066510 msgr2=0x7fc3bc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc3bc066510 0x7fc3bc0689d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000ab60 tx=0x7fc3c0008040 comp rx=0 tx=0).stop 2023-11-17T06:30:30.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 -- 172.21.15.69:0/3816255970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d015d490 msgr2=0x7fc3d01f5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d015d490 0x7fc3d01f5c40 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8002230 tx=0x7fc3c800cf50 comp rx=0 tx=0).stop 2023-11-17T06:30:30.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 -- 172.21.15.69:0/3816255970 shutdown_connections 2023-11-17T06:30:30.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc3bc066510 0x7fc3bc0689d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d015d490 0x7fc3d01f5c40 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc3d00d13d0 0x7fc3d01f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 --2- 172.21.15.69:0/3816255970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3d00ce310 0x7fc3d01536d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 -- 172.21.15.69:0/3816255970 >> 172.21.15.69:0/3816255970 conn(0x7fc3d006ab40 msgr2=0x7fc3d0154540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:30.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 -- 172.21.15.69:0/3816255970 shutdown_connections 2023-11-17T06:30:30.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.240+0000 7fc3cffff700 1 -- 172.21.15.69:0/3816255970 wait complete. 2023-11-17T06:30:30.266 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:30.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.440+0000 7fee3428f700 1 Processor -- start 2023-11-17T06:30:30.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.440+0000 7fee3428f700 1 -- start start 2023-11-17T06:30:30.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.444+0000 7fee3428f700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fee2c1615a0 0x7fee2c0ceee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.444+0000 7fee3428f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c06c480 con 0x7fee2c160800 2023-11-17T06:30:30.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.444+0000 7fee3428f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c066510 con 0x7fee2c06c960 2023-11-17T06:30:30.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.444+0000 7fee3428f700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c0cf420 con 0x7fee2c1615a0 2023-11-17T06:30:30.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.444+0000 7fee3202b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fee2c160800 0x7fee2c160e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37308/0 (socket says 172.21.15.69:37308) 2023-11-17T06:30:30.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.444+0000 7fee3202b700 1 -- 172.21.15.69:0/2823624658 learned_addr learned my addr 172.21.15.69:0/2823624658 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:30.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.444+0000 7fee3182a700 1 --2- 172.21.15.69:0/2823624658 >> v2:172.21.15.93:3300/0 conn(0x7fee2c1615a0 0x7fee2c0ceee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.444+0000 7fee31029700 1 -- 172.21.15.69:0/2823624658 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015387360 0 0) 0x7fee2c06c480 con 0x7fee2c160800 2023-11-17T06:30:30.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee31029700 1 -- 172.21.15.69:0/2823624658 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee180035d0 con 0x7fee2c160800 2023-11-17T06:30:30.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3182a700 1 -- 172.21.15.69:0/2823624658 >> v1:172.21.15.93:6789/0 conn(0x7fee2c06c960 legacy=0x7fee2c06cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3182a700 1 -- 172.21.15.69:0/2823624658 >> v1:172.21.15.69:6789/0 conn(0x7fee2c160800 legacy=0x7fee2c160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3182a700 1 -- 172.21.15.69:0/2823624658 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c160be0 con 0x7fee2c1615a0 2023-11-17T06:30:30.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3182a700 1 --2- 172.21.15.69:0/2823624658 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee2c1615a0 0x7fee2c0ceee0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009850 tx=0x7fee1c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=116f8f2620802685 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee31029700 1 -- 172.21.15.69:0/2823624658 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c011830 con 0x7fee2c1615a0 2023-11-17T06:30:30.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee31029700 1 -- 172.21.15.69:0/2823624658 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c011990 con 0x7fee2c1615a0 2023-11-17T06:30:30.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee31029700 1 -- 172.21.15.69:0/2823624658 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c011d40 con 0x7fee2c1615a0 2023-11-17T06:30:30.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3428f700 1 -- 172.21.15.69:0/2823624658 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee2c1615a0 msgr2=0x7fee2c0ceee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3428f700 1 --2- 172.21.15.69:0/2823624658 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee2c1615a0 0x7fee2c0ceee0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009850 tx=0x7fee1c009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:30.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3428f700 1 -- 172.21.15.69:0/2823624658 shutdown_connections 2023-11-17T06:30:30.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3428f700 1 --2- 172.21.15.69:0/2823624658 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee2c1615a0 0x7fee2c0ceee0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3428f700 1 -- 172.21.15.69:0/2823624658 >> 172.21.15.69:0/2823624658 conn(0x7fee2c0cc0b0 msgr2=0x7fee2c0cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:30.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3428f700 1 -- 172.21.15.69:0/2823624658 shutdown_connections 2023-11-17T06:30:30.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.448+0000 7fee3428f700 1 -- 172.21.15.69:0/2823624658 wait complete. 2023-11-17T06:30:30.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3428f700 1 Processor -- start 2023-11-17T06:30:30.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3428f700 1 -- start start 2023-11-17T06:30:30.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3428f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee2c06c960 0x7fee2c145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3428f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee2c160800 0x7fee2c0ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3428f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee2c1615a0 0x7fee2c1e8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3428f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c146070 con 0x7fee2c160800 2023-11-17T06:30:30.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3428f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0c3b80 con 0x7fee2c1615a0 2023-11-17T06:30:30.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3428f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c0b4220 con 0x7fee2c06c960 2023-11-17T06:30:30.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3182a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee2c160800 0x7fee2c0ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3182a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee2c160800 0x7fee2c0ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38390/0 (socket says 172.21.15.69:38390) 2023-11-17T06:30:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3182a700 1 -- 172.21.15.69:0/3870131603 learned_addr learned my addr 172.21.15.69:0/3870131603 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3202b700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee2c06c960 0x7fee2c145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3282c700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee2c1615a0 0x7fee2c1e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3182a700 1 -- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee2c06c960 msgr2=0x7fee2c145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3182a700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee2c06c960 0x7fee2c145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3182a700 1 -- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee2c1615a0 msgr2=0x7fee2c1e8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3182a700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee2c1615a0 0x7fee2c1e8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3182a700 1 -- 172.21.15.69:0/3870131603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c0094b0 con 0x7fee2c160800 2023-11-17T06:30:30.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3282c700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee2c1615a0 0x7fee2c1e8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:30.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.452+0000 7fee3182a700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee2c160800 0x7fee2c0ae060 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee1c000c00 tx=0x7fee1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.456+0000 7fee22ffd700 1 -- 172.21.15.69:0/3870131603 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c01aac0 con 0x7fee2c160800 2023-11-17T06:30:30.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.456+0000 7fee22ffd700 1 -- 172.21.15.69:0/3870131603 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c01f070 con 0x7fee2c160800 2023-11-17T06:30:30.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.456+0000 7fee3428f700 1 -- 172.21.15.69:0/3870131603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c0b4500 con 0x7fee2c160800 2023-11-17T06:30:30.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.456+0000 7fee22ffd700 1 -- 172.21.15.69:0/3870131603 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c01ae60 con 0x7fee2c160800 2023-11-17T06:30:30.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.456+0000 7fee3428f700 1 -- 172.21.15.69:0/3870131603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c0b4ac0 con 0x7fee2c160800 2023-11-17T06:30:30.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.456+0000 7fee3428f700 1 -- 172.21.15.69:0/3870131603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c0c3d40 con 0x7fee2c160800 2023-11-17T06:30:30.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.460+0000 7fee22ffd700 1 -- 172.21.15.69:0/3870131603 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fee1c01b430 con 0x7fee2c160800 2023-11-17T06:30:30.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.460+0000 7fee22ffd700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fee10066510 0x7fee100689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.460+0000 7fee22ffd700 1 -- 172.21.15.69:0/3870131603 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee1c084fa0 con 0x7fee2c160800 2023-11-17T06:30:30.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.460+0000 7fee3202b700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fee10066510 0x7fee100689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.460+0000 7fee3202b700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fee10066510 0x7fee100689d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fee280011e0 tx=0x7fee28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.464+0000 7fee22ffd700 1 -- 172.21.15.69:0/3870131603 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fee1c0b6090 con 0x7fee2c160800 2023-11-17T06:30:30.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.640+0000 7fee3428f700 1 -- 172.21.15.69:0/3870131603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee2c073f00 con 0x7fee2c160800 2023-11-17T06:30:30.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.640+0000 7fee22ffd700 1 -- 172.21.15.69:0/3870131603 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee1c0150a0 con 0x7fee2c160800 2023-11-17T06:30:30.646 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:30.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 -- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fee10066510 msgr2=0x7fee100689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fee10066510 0x7fee100689d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fee280011e0 tx=0x7fee28009040 comp rx=0 tx=0).stop 2023-11-17T06:30:30.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 -- 172.21.15.69:0/3870131603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee2c160800 msgr2=0x7fee2c0ae060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee2c160800 0x7fee2c0ae060 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee1c000c00 tx=0x7fee1c004770 comp rx=0 tx=0).stop 2023-11-17T06:30:30.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 -- 172.21.15.69:0/3870131603 shutdown_connections 2023-11-17T06:30:30.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fee10066510 0x7fee100689d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fee2c1615a0 0x7fee2c1e8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee2c160800 0x7fee2c0ae060 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 --2- 172.21.15.69:0/3870131603 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fee2c06c960 0x7fee2c145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 -- 172.21.15.69:0/3870131603 >> 172.21.15.69:0/3870131603 conn(0x7fee2c0cc0b0 msgr2=0x7fee2c06cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:30.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 -- 172.21.15.69:0/3870131603 shutdown_connections 2023-11-17T06:30:30.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.644+0000 7fee3428f700 1 -- 172.21.15.69:0/3870131603 wait complete. 2023-11-17T06:30:30.671 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:30.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.832+0000 7fb7ebc63700 1 Processor -- start 2023-11-17T06:30:30.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.832+0000 7fb7ebc63700 1 -- start start 2023-11-17T06:30:30.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7ebc63700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb7e40c21a0 0x7fb7e406c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7ebc63700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e41652b0 0x7fb7e40cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7ebc63700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e406c200 con 0x7fb7e4165740 2023-11-17T06:30:30.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7ebc63700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e41662c0 con 0x7fb7e40c21a0 2023-11-17T06:30:30.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7ebc63700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4165d00 con 0x7fb7e41652b0 2023-11-17T06:30:30.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e99ff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb7e40c21a0 0x7fb7e406c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e99ff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb7e40c21a0 0x7fb7e406c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38406/0 (socket says 172.21.15.69:38406) 2023-11-17T06:30:30.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e99ff700 1 -- 172.21.15.69:0/379902890 learned_addr learned my addr 172.21.15.69:0/379902890 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:30.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e91fe700 1 --2- 172.21.15.69:0/379902890 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e41652b0 0x7fb7e40cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e99ff700 1 -- 172.21.15.69:0/379902890 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e41652b0 msgr2=0x7fb7e40cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:30.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e99ff700 1 --2- 172.21.15.69:0/379902890 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e41652b0 0x7fb7e40cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e99ff700 1 -- 172.21.15.69:0/379902890 >> v1:172.21.15.69:6789/0 conn(0x7fb7e4165740 legacy=0x7fb7e40cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e99ff700 1 -- 172.21.15.69:0/379902890 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e4165fe0 con 0x7fb7e40c21a0 2023-11-17T06:30:30.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e91fe700 1 --2- 172.21.15.69:0/379902890 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e41652b0 0x7fb7e40cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:30.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e99ff700 1 --2- 172.21.15.69:0/379902890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e40c21a0 0x7fb7e406c690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009910 tx=0x7fb7e0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afad2fe2e793c202 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e89fd700 1 -- 172.21.15.69:0/379902890 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000ba60 con 0x7fb7e40c21a0 2023-11-17T06:30:30.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e89fd700 1 -- 172.21.15.69:0/379902890 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e000bbc0 con 0x7fb7e40c21a0 2023-11-17T06:30:30.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.836+0000 7fb7e89fd700 1 -- 172.21.15.69:0/379902890 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0009e60 con 0x7fb7e40c21a0 2023-11-17T06:30:30.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.840+0000 7fb7ebc63700 1 -- 172.21.15.69:0/379902890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e40c21a0 msgr2=0x7fb7e406c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.840+0000 7fb7ebc63700 1 --2- 172.21.15.69:0/379902890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e40c21a0 0x7fb7e406c690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0009910 tx=0x7fb7e0009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:30.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.840+0000 7fb7ebc63700 1 -- 172.21.15.69:0/379902890 shutdown_connections 2023-11-17T06:30:30.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.840+0000 7fb7ebc63700 1 --2- 172.21.15.69:0/379902890 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e41652b0 0x7fb7e40cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.840+0000 7fb7ebc63700 1 --2- 172.21.15.69:0/379902890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e40c21a0 0x7fb7e406c690 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.840+0000 7fb7ebc63700 1 -- 172.21.15.69:0/379902890 >> 172.21.15.69:0/379902890 conn(0x7fb7e40b0900 msgr2=0x7fb7e40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:30.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.840+0000 7fb7ebc63700 1 -- 172.21.15.69:0/379902890 shutdown_connections 2023-11-17T06:30:30.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.840+0000 7fb7ebc63700 1 -- 172.21.15.69:0/379902890 wait complete. 2023-11-17T06:30:30.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7ebc63700 1 Processor -- start 2023-11-17T06:30:30.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7ebc63700 1 -- start start 2023-11-17T06:30:30.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7ebc63700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e40c21a0 0x7fb7e41f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7ebc63700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e41652b0 0x7fb7e40c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7ebc63700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7e4165740 0x7fb7e40c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7ebc63700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4161c60 con 0x7fb7e41652b0 2023-11-17T06:30:30.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7ebc63700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4161f40 con 0x7fb7e4165740 2023-11-17T06:30:30.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7ebc63700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e41f6d30 con 0x7fb7e40c21a0 2023-11-17T06:30:30.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e91fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e41652b0 0x7fb7e40c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e91fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e41652b0 0x7fb7e40c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38420/0 (socket says 172.21.15.69:38420) 2023-11-17T06:30:30.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e91fe700 1 -- 172.21.15.69:0/3867245189 learned_addr learned my addr 172.21.15.69:0/3867245189 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:30.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7ea200700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7e4165740 0x7fb7e40c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e99ff700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e40c21a0 0x7fb7e41f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e91fe700 1 -- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e40c21a0 msgr2=0x7fb7e41f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e91fe700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e40c21a0 0x7fb7e41f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e91fe700 1 -- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7e4165740 msgr2=0x7fb7e40c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e91fe700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7e4165740 0x7fb7e40c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e91fe700 1 -- 172.21.15.69:0/3867245189 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0009570 con 0x7fb7e41652b0 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7ea200700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7e4165740 0x7fb7e40c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e99ff700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e40c21a0 0x7fb7e41f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.844+0000 7fb7e91fe700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e41652b0 0x7fb7e40c68b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400c7a0 tx=0x7fb7d400cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.848+0000 7fb7da7fc700 1 -- 172.21.15.69:0/3867245189 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4011800 con 0x7fb7e41652b0 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.848+0000 7fb7da7fc700 1 -- 172.21.15.69:0/3867245189 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4011960 con 0x7fb7e41652b0 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.848+0000 7fb7ebc63700 1 -- 172.21.15.69:0/3867245189 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e40c7290 con 0x7fb7e41652b0 2023-11-17T06:30:30.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.848+0000 7fb7da7fc700 1 -- 172.21.15.69:0/3867245189 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4011d10 con 0x7fb7e41652b0 2023-11-17T06:30:30.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.848+0000 7fb7ebc63700 1 -- 172.21.15.69:0/3867245189 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e40c7850 con 0x7fb7e41652b0 2023-11-17T06:30:30.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.848+0000 7fb7ebc63700 1 -- 172.21.15.69:0/3867245189 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e4073f00 con 0x7fb7e41652b0 2023-11-17T06:30:30.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.848+0000 7fb7da7fc700 1 -- 172.21.15.69:0/3867245189 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb7d4018360 con 0x7fb7e41652b0 2023-11-17T06:30:30.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.852+0000 7fb7da7fc700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb7c8066540 0x7fb7c8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:30.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.852+0000 7fb7da7fc700 1 -- 172.21.15.69:0/3867245189 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7d4083ea0 con 0x7fb7e41652b0 2023-11-17T06:30:30.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.852+0000 7fb7e99ff700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb7c8066540 0x7fb7c8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:30.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.852+0000 7fb7e99ff700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb7c8066540 0x7fb7c8068a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0000c00 tx=0x7fb7e0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:30.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:30.856+0000 7fb7da7fc700 1 -- 172.21.15.69:0/3867245189 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb7d4051310 con 0x7fb7e41652b0 2023-11-17T06:30:31.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.028+0000 7fb7ebc63700 1 -- 172.21.15.69:0/3867245189 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7e40b4d50 con 0x7fb7e41652b0 2023-11-17T06:30:31.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.032+0000 7fb7da7fc700 1 -- 172.21.15.69:0/3867245189 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fb7d4059e60 con 0x7fb7e41652b0 2023-11-17T06:30:31.036 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:31.037 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:58.004301+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:31.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.032+0000 7fb7ebc63700 1 -- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb7c8066540 msgr2=0x7fb7c8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.032+0000 7fb7ebc63700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb7c8066540 0x7fb7c8068a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0000c00 tx=0x7fb7e0008030 comp rx=0 tx=0).stop 2023-11-17T06:30:31.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.032+0000 7fb7ebc63700 1 -- 172.21.15.69:0/3867245189 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e41652b0 msgr2=0x7fb7e40c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.032+0000 7fb7ebc63700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e41652b0 0x7fb7e40c68b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb7d400c7a0 tx=0x7fb7d400cb60 comp rx=0 tx=0).stop 2023-11-17T06:30:31.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.036+0000 7fb7ebc63700 1 -- 172.21.15.69:0/3867245189 shutdown_connections 2023-11-17T06:30:31.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.036+0000 7fb7ebc63700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb7c8066540 0x7fb7c8068a00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.036+0000 7fb7ebc63700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7e4165740 0x7fb7e40c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.036+0000 7fb7ebc63700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7e41652b0 0x7fb7e40c68b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.036+0000 7fb7ebc63700 1 --2- 172.21.15.69:0/3867245189 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7e40c21a0 0x7fb7e41f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.036+0000 7fb7ebc63700 1 -- 172.21.15.69:0/3867245189 >> 172.21.15.69:0/3867245189 conn(0x7fb7e40b0900 msgr2=0x7fb7e406fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:31.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.036+0000 7fb7ebc63700 1 -- 172.21.15.69:0/3867245189 shutdown_connections 2023-11-17T06:30:31.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.036+0000 7fb7ebc63700 1 -- 172.21.15.69:0/3867245189 wait complete. 2023-11-17T06:30:31.061 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:31.061 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:31.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.224+0000 7f5a02a60700 1 Processor -- start 2023-11-17T06:30:31.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.224+0000 7f5a02a60700 1 -- start start 2023-11-17T06:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f5a02a60700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f59fc15b120 0x7f59fc15eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f5a02a60700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc070120 con 0x7f59fc0cb340 2023-11-17T06:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f5a02a60700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59fc15fb00 con 0x7f59fc15b500 2023-11-17T06:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f5a02a60700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59fc15fd50 con 0x7f59fc15b120 2023-11-17T06:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f5a00ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f59fc0cb340 0x7f59fc0c94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37336/0 (socket says 172.21.15.69:37336) 2023-11-17T06:30:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f5a00ffd700 1 -- 172.21.15.69:0/2464866152 learned_addr learned my addr 172.21.15.69:0/2464866152 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f59fbfff700 1 --2- 172.21.15.69:0/2464866152 >> v2:172.21.15.93:3300/0 conn(0x7f59fc15b120 0x7f59fc15eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f59fb7fe700 1 -- 172.21.15.69:0/2464866152 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466981294 0 0) 0x7f59fc070120 con 0x7f59fc0cb340 2023-11-17T06:30:31.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f59fb7fe700 1 -- 172.21.15.69:0/2464866152 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59e80035d0 con 0x7f59fc0cb340 2023-11-17T06:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f59fbfff700 1 -- 172.21.15.69:0/2464866152 >> v1:172.21.15.93:6789/0 conn(0x7f59fc15b500 legacy=0x7f59fc15f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f59fbfff700 1 -- 172.21.15.69:0/2464866152 >> v1:172.21.15.69:6789/0 conn(0x7f59fc0cb340 legacy=0x7f59fc0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f59fbfff700 1 -- 172.21.15.69:0/2464866152 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc0705b0 con 0x7f59fc15b120 2023-11-17T06:30:31.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f59fbfff700 1 --2- 172.21.15.69:0/2464866152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59fc15b120 0x7f59fc15eeb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009850 tx=0x7f59ec009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c58968306a1f030 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f59fb7fe700 1 -- 172.21.15.69:0/2464866152 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec011830 con 0x7f59fc15b120 2023-11-17T06:30:31.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f59fb7fe700 1 -- 172.21.15.69:0/2464866152 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ec011990 con 0x7f59fc15b120 2023-11-17T06:30:31.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.228+0000 7f59fb7fe700 1 -- 172.21.15.69:0/2464866152 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ec011d40 con 0x7f59fc15b120 2023-11-17T06:30:31.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.232+0000 7f5a02a60700 1 -- 172.21.15.69:0/2464866152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59fc15b120 msgr2=0x7f59fc15eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.232+0000 7f5a02a60700 1 --2- 172.21.15.69:0/2464866152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59fc15b120 0x7f59fc15eeb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009850 tx=0x7f59ec009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:31.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.232+0000 7f5a02a60700 1 -- 172.21.15.69:0/2464866152 shutdown_connections 2023-11-17T06:30:31.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.232+0000 7f5a02a60700 1 --2- 172.21.15.69:0/2464866152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59fc15b120 0x7f59fc15eeb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.232+0000 7f5a02a60700 1 -- 172.21.15.69:0/2464866152 >> 172.21.15.69:0/2464866152 conn(0x7f59fc0cee80 msgr2=0x7f59fc0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:31.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.232+0000 7f5a02a60700 1 -- 172.21.15.69:0/2464866152 shutdown_connections 2023-11-17T06:30:31.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.232+0000 7f5a02a60700 1 -- 172.21.15.69:0/2464866152 wait complete. 2023-11-17T06:30:31.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.232+0000 7f5a02a60700 1 Processor -- start 2023-11-17T06:30:31.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a02a60700 1 -- start start 2023-11-17T06:30:31.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a02a60700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59fc0cb340 0x7f59fc1530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a02a60700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59fc15b120 0x7f59fc0b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a02a60700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59fc15b500 0x7f59fc155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a02a60700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc1585b0 con 0x7f59fc15b120 2023-11-17T06:30:31.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a02a60700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc1f3b20 con 0x7f59fc15b500 2023-11-17T06:30:31.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a02a60700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59fc1f2f10 con 0x7f59fc0cb340 2023-11-17T06:30:31.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59fc15b120 0x7f59fc0b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59fc15b120 0x7f59fc0b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38422/0 (socket says 172.21.15.69:38422) 2023-11-17T06:30:31.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f3fff700 1 -- 172.21.15.69:0/3088899896 learned_addr learned my addr 172.21.15.69:0/3088899896 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:31.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a00ffd700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59fc15b500 0x7f59fc155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59fbfff700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59fc0cb340 0x7f59fc1530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f3fff700 1 -- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59fc0cb340 msgr2=0x7f59fc1530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f3fff700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59fc0cb340 0x7f59fc1530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f3fff700 1 -- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59fc15b500 msgr2=0x7f59fc155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f3fff700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59fc15b500 0x7f59fc155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f3fff700 1 -- 172.21.15.69:0/3088899896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0094b0 con 0x7f59fc15b120 2023-11-17T06:30:31.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a00ffd700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59fc15b500 0x7f59fc155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:31.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f3fff700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59fc15b120 0x7f59fc0b0a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c500 tx=0x7f59e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f97fa700 1 -- 172.21.15.69:0/3088899896 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40052d0 con 0x7f59fc15b120 2023-11-17T06:30:31.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f97fa700 1 -- 172.21.15.69:0/3088899896 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4005430 con 0x7f59fc15b120 2023-11-17T06:30:31.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f59f97fa700 1 -- 172.21.15.69:0/3088899896 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40055a0 con 0x7f59fc15b120 2023-11-17T06:30:31.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a02a60700 1 -- 172.21.15.69:0/3088899896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59fc1f31f0 con 0x7f59fc15b120 2023-11-17T06:30:31.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.236+0000 7f5a02a60700 1 -- 172.21.15.69:0/3088899896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59fc1f37b0 con 0x7f59fc15b120 2023-11-17T06:30:31.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.240+0000 7f5a02a60700 1 -- 172.21.15.69:0/3088899896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59fc151c60 con 0x7f59fc15b120 2023-11-17T06:30:31.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.240+0000 7f59f97fa700 1 -- 172.21.15.69:0/3088899896 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59e40038c0 con 0x7f59fc15b120 2023-11-17T06:30:31.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.240+0000 7f59f97fa700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59dc066510 0x7f59dc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.240+0000 7f59f97fa700 1 -- 172.21.15.69:0/3088899896 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59e40832d0 con 0x7f59fc15b120 2023-11-17T06:30:31.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.244+0000 7f59fbfff700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59dc066510 0x7f59dc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.244+0000 7f59fbfff700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59dc066510 0x7f59dc0689d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0090b0 tx=0x7f59ec008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.248+0000 7f59f97fa700 1 -- 172.21.15.69:0/3088899896 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59fc151c60 con 0x7f59fc15b120 2023-11-17T06:30:31.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.423+0000 7f5a02a60700 1 -- 172.21.15.69:0/3088899896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59fc151c60 con 0x7f59fc15b120 2023-11-17T06:30:31.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.423+0000 7f59f97fa700 1 -- 172.21.15.69:0/3088899896 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59fc151c60 con 0x7f59fc15b120 2023-11-17T06:30:31.429 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:31.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 -- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59dc066510 msgr2=0x7f59dc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59dc066510 0x7f59dc0689d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0090b0 tx=0x7f59ec008030 comp rx=0 tx=0).stop 2023-11-17T06:30:31.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 -- 172.21.15.69:0/3088899896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59fc15b120 msgr2=0x7f59fc0b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59fc15b120 0x7f59fc0b0a00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c500 tx=0x7f59e400c8c0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 -- 172.21.15.69:0/3088899896 shutdown_connections 2023-11-17T06:30:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59dc066510 0x7f59dc0689d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59fc15b500 0x7f59fc155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59fc15b120 0x7f59fc0b0a00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 --2- 172.21.15.69:0/3088899896 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59fc0cb340 0x7f59fc1530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 -- 172.21.15.69:0/3088899896 >> 172.21.15.69:0/3088899896 conn(0x7f59fc0cee80 msgr2=0x7f59fc159220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 -- 172.21.15.69:0/3088899896 shutdown_connections 2023-11-17T06:30:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.427+0000 7f5a02a60700 1 -- 172.21.15.69:0/3088899896 wait complete. 2023-11-17T06:30:31.456 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:31.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.639+0000 7f7c30744700 1 Processor -- start 2023-11-17T06:30:31.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.639+0000 7f7c30744700 1 -- start start 2023-11-17T06:30:31.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.639+0000 7f7c30744700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7c2815b120 0x7f7c2815eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.639+0000 7f7c30744700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7c2815b500 0x7f7c2815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.639+0000 7f7c30744700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c28070120 con 0x7f7c280cb340 2023-11-17T06:30:31.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.639+0000 7f7c30744700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2815fd50 con 0x7f7c2815b120 2023-11-17T06:30:31.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.639+0000 7f7c30744700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280705b0 con 0x7f7c2815b500 2023-11-17T06:30:31.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2ece1700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7c280cb340 0x7f7c2806c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37350/0 (socket says 172.21.15.69:37350) 2023-11-17T06:30:31.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2ece1700 1 -- 172.21.15.69:0/3258092968 learned_addr learned my addr 172.21.15.69:0/3258092968 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:31.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2e4e0700 1 --2- 172.21.15.69:0/3258092968 >> v2:172.21.15.69:3300/0 conn(0x7f7c2815b120 0x7f7c2815eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2dcdf700 1 --2- 172.21.15.69:0/3258092968 >> v2:172.21.15.93:3300/0 conn(0x7f7c2815b500 0x7f7c2815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2d4de700 1 -- 172.21.15.69:0/3258092968 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788340445 0 0) 0x7f7c28070120 con 0x7f7c280cb340 2023-11-17T06:30:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2d4de700 1 -- 172.21.15.69:0/3258092968 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c140035d0 con 0x7f7c280cb340 2023-11-17T06:30:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2e4e0700 1 -- 172.21.15.69:0/3258092968 >> v2:172.21.15.93:3300/0 conn(0x7f7c2815b500 msgr2=0x7f7c2815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2e4e0700 1 --2- 172.21.15.69:0/3258092968 >> v2:172.21.15.93:3300/0 conn(0x7f7c2815b500 0x7f7c2815f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2e4e0700 1 -- 172.21.15.69:0/3258092968 >> v1:172.21.15.69:6789/0 conn(0x7f7c280cb340 legacy=0x7f7c2806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2e4e0700 1 -- 172.21.15.69:0/3258092968 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28071a20 con 0x7f7c2815b120 2023-11-17T06:30:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2e4e0700 1 --2- 172.21.15.69:0/3258092968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c2815b120 0x7f7c2815eeb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7c28072aa0 tx=0x7f7c24009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5865195b4961ec0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2d4de700 1 -- 172.21.15.69:0/3258092968 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24011830 con 0x7f7c2815b120 2023-11-17T06:30:31.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2d4de700 1 -- 172.21.15.69:0/3258092968 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24011990 con 0x7f7c2815b120 2023-11-17T06:30:31.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c2d4de700 1 -- 172.21.15.69:0/3258092968 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24011d20 con 0x7f7c2815b120 2023-11-17T06:30:31.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c30744700 1 -- 172.21.15.69:0/3258092968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c2815b120 msgr2=0x7f7c2815eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.643+0000 7f7c30744700 1 --2- 172.21.15.69:0/3258092968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c2815b120 0x7f7c2815eeb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7c28072aa0 tx=0x7f7c24009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:31.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.647+0000 7f7c30744700 1 -- 172.21.15.69:0/3258092968 shutdown_connections 2023-11-17T06:30:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.647+0000 7f7c30744700 1 --2- 172.21.15.69:0/3258092968 >> v2:172.21.15.93:3300/0 conn(0x7f7c2815b500 0x7f7c2815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.647+0000 7f7c30744700 1 --2- 172.21.15.69:0/3258092968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c2815b120 0x7f7c2815eeb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.647+0000 7f7c30744700 1 -- 172.21.15.69:0/3258092968 >> 172.21.15.69:0/3258092968 conn(0x7f7c280cee80 msgr2=0x7f7c280cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.647+0000 7f7c30744700 1 -- 172.21.15.69:0/3258092968 shutdown_connections 2023-11-17T06:30:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.647+0000 7f7c30744700 1 -- 172.21.15.69:0/3258092968 wait complete. 2023-11-17T06:30:31.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.647+0000 7f7c30744700 1 Processor -- start 2023-11-17T06:30:31.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.647+0000 7f7c30744700 1 -- start start 2023-11-17T06:30:31.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c30744700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c280cb340 0x7f7c28151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c30744700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c2815b120 0x7f7c28152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c30744700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2815b500 0x7f7c280b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c30744700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2815ca10 con 0x7f7c280cb340 2023-11-17T06:30:31.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c30744700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281537a0 con 0x7f7c2815b500 2023-11-17T06:30:31.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c30744700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c28153a80 con 0x7f7c2815b120 2023-11-17T06:30:31.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2e4e0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c280cb340 0x7f7c28151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2e4e0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c280cb340 0x7f7c28151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38440/0 (socket says 172.21.15.69:38440) 2023-11-17T06:30:31.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2e4e0700 1 -- 172.21.15.69:0/3147572549 learned_addr learned my addr 172.21.15.69:0/3147572549 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:31.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2dcdf700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c2815b120 0x7f7c28152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2ece1700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2815b500 0x7f7c280b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2e4e0700 1 -- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c2815b120 msgr2=0x7f7c28152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2e4e0700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c2815b120 0x7f7c28152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2e4e0700 1 -- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2815b500 msgr2=0x7f7c280b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2e4e0700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2815b500 0x7f7c280b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2e4e0700 1 -- 172.21.15.69:0/3147572549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c240094b0 con 0x7f7c280cb340 2023-11-17T06:30:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2ece1700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2815b500 0x7f7c280b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c2e4e0700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c280cb340 0x7f7c28151890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009b70 tx=0x7f7c24004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c1effd700 1 -- 172.21.15.69:0/3147572549 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c240036c0 con 0x7f7c280cb340 2023-11-17T06:30:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c1effd700 1 -- 172.21.15.69:0/3147572549 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24003820 con 0x7f7c280cb340 2023-11-17T06:30:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c30744700 1 -- 172.21.15.69:0/3147572549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c28153d60 con 0x7f7c280cb340 2023-11-17T06:30:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c1effd700 1 -- 172.21.15.69:0/3147572549 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24003b90 con 0x7f7c280cb340 2023-11-17T06:30:31.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c30744700 1 -- 172.21.15.69:0/3147572549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c280ce6a0 con 0x7f7c280cb340 2023-11-17T06:30:31.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.651+0000 7f7c30744700 1 -- 172.21.15.69:0/3147572549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c28073f00 con 0x7f7c280cb340 2023-11-17T06:30:31.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.655+0000 7f7c1effd700 1 -- 172.21.15.69:0/3147572549 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7c24021070 con 0x7f7c280cb340 2023-11-17T06:30:31.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.655+0000 7f7c1effd700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c0c066510 0x7f7c0c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:31.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.655+0000 7f7c1effd700 1 -- 172.21.15.69:0/3147572549 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c24085350 con 0x7f7c280cb340 2023-11-17T06:30:31.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.655+0000 7f7c2dcdf700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c0c066510 0x7f7c0c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:31.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.659+0000 7f7c2dcdf700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c0c066510 0x7f7c0c0689d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c2815f800 tx=0x7f7c18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:31.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.663+0000 7f7c1effd700 1 -- 172.21.15.69:0/3147572549 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7c240527c0 con 0x7f7c280cb340 2023-11-17T06:30:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.839+0000 7f7c30744700 1 -- 172.21.15.69:0/3147572549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c280cada0 con 0x7f7c280cb340 2023-11-17T06:30:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.839+0000 7f7c1effd700 1 -- 172.21.15.69:0/3147572549 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c24055de0 con 0x7f7c280cb340 2023-11-17T06:30:31.845 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:31.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 -- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c0c066510 msgr2=0x7f7c0c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c0c066510 0x7f7c0c0689d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7c2815f800 tx=0x7f7c18008040 comp rx=0 tx=0).stop 2023-11-17T06:30:31.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 -- 172.21.15.69:0/3147572549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c280cb340 msgr2=0x7f7c28151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:31.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c280cb340 0x7f7c28151890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009b70 tx=0x7f7c24004770 comp rx=0 tx=0).stop 2023-11-17T06:30:31.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 -- 172.21.15.69:0/3147572549 shutdown_connections 2023-11-17T06:30:31.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c0c066510 0x7f7c0c0689d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2815b500 0x7f7c280b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7c2815b120 0x7f7c28152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 --2- 172.21.15.69:0/3147572549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c280cb340 0x7f7c28151890 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 -- 172.21.15.69:0/3147572549 >> 172.21.15.69:0/3147572549 conn(0x7f7c280cee80 msgr2=0x7f7c280c4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 -- 172.21.15.69:0/3147572549 shutdown_connections 2023-11-17T06:30:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:31.843+0000 7f7c30744700 1 -- 172.21.15.69:0/3147572549 wait complete. 2023-11-17T06:30:31.872 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:32.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.043+0000 7f319ff6e700 1 Processor -- start 2023-11-17T06:30:32.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.043+0000 7f319ff6e700 1 -- start start 2023-11-17T06:30:32.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.047+0000 7f319ff6e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f319815d0d0 0x7f31980cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.047+0000 7f319ff6e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f31980660a0 0x7f3198160e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.047+0000 7f319ff6e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3198066580 con 0x7f319815d4b0 2023-11-17T06:30:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.047+0000 7f319ff6e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31980cf3b0 con 0x7f31980660a0 2023-11-17T06:30:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.047+0000 7f319ff6e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319806c510 con 0x7f319815d0d0 2023-11-17T06:30:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.047+0000 7f319dd0a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f319815d0d0 0x7f31980cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.047+0000 7f319dd0a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f319815d0d0 0x7f31980cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:53274/0 (socket says 172.21.15.69:53274) 2023-11-17T06:30:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.047+0000 7f319d509700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f31980660a0 0x7f3198160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.047+0000 7f319dd0a700 1 -- 172.21.15.69:0/3334299615 learned_addr learned my addr 172.21.15.69:0/3334299615 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319d509700 1 -- 172.21.15.69:0/3334299615 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f319815d0d0 msgr2=0x7f31980cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319d509700 1 --2- 172.21.15.69:0/3334299615 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f319815d0d0 0x7f31980cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319d509700 1 -- 172.21.15.69:0/3334299615 >> v1:172.21.15.93:6789/0 conn(0x7f319815d4b0 legacy=0x7f319806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319d509700 1 -- 172.21.15.69:0/3334299615 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31980cd3a0 con 0x7f31980660a0 2023-11-17T06:30:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319d509700 1 --2- 172.21.15.69:0/3334299615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31980660a0 0x7f3198160e90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3188009850 tx=0x7f3188009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d62f20c48767727d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319cd08700 1 -- 172.21.15.69:0/3334299615 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188011830 con 0x7f31980660a0 2023-11-17T06:30:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319cd08700 1 -- 172.21.15.69:0/3334299615 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3188011990 con 0x7f31980660a0 2023-11-17T06:30:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319cd08700 1 -- 172.21.15.69:0/3334299615 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188011d40 con 0x7f31980660a0 2023-11-17T06:30:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319ff6e700 1 -- 172.21.15.69:0/3334299615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31980660a0 msgr2=0x7f3198160e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319ff6e700 1 --2- 172.21.15.69:0/3334299615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31980660a0 0x7f3198160e90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3188009850 tx=0x7f3188009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319ff6e700 1 -- 172.21.15.69:0/3334299615 shutdown_connections 2023-11-17T06:30:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319ff6e700 1 --2- 172.21.15.69:0/3334299615 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31980660a0 0x7f3198160e90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319ff6e700 1 --2- 172.21.15.69:0/3334299615 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f319815d0d0 0x7f31980cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319ff6e700 1 -- 172.21.15.69:0/3334299615 >> 172.21.15.69:0/3334299615 conn(0x7f31980cc0b0 msgr2=0x7f31980cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319ff6e700 1 -- 172.21.15.69:0/3334299615 shutdown_connections 2023-11-17T06:30:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.051+0000 7f319ff6e700 1 -- 172.21.15.69:0/3334299615 wait complete. 2023-11-17T06:30:32.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319ff6e700 1 Processor -- start 2023-11-17T06:30:32.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319ff6e700 1 -- start start 2023-11-17T06:30:32.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319ff6e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31980660a0 0x7f3198156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319ff6e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f319815d0d0 0x7f31981616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319ff6e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f319815d4b0 0x7f319815e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319ff6e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31981565a0 con 0x7f319815d0d0 2023-11-17T06:30:32.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319ff6e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3198161c00 con 0x7f319815d4b0 2023-11-17T06:30:32.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319ff6e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3198160620 con 0x7f31980660a0 2023-11-17T06:30:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319d509700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f319815d0d0 0x7f31981616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319d509700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f319815d0d0 0x7f31981616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38456/0 (socket says 172.21.15.69:38456) 2023-11-17T06:30:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319d509700 1 -- 172.21.15.69:0/2954163548 learned_addr learned my addr 172.21.15.69:0/2954163548 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319dd0a700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31980660a0 0x7f3198156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319e50b700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f319815d4b0 0x7f319815e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319d509700 1 -- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31980660a0 msgr2=0x7f3198156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319d509700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31980660a0 0x7f3198156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319d509700 1 -- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f319815d4b0 msgr2=0x7f319815e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319d509700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f319815d4b0 0x7f319815e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319d509700 1 -- 172.21.15.69:0/2954163548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31880094b0 con 0x7f319815d0d0 2023-11-17T06:30:32.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319dd0a700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31980660a0 0x7f3198156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:32.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f319d509700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f319815d0d0 0x7f31981616c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3188014040 tx=0x7f3188004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.055+0000 7f318e7fc700 1 -- 172.21.15.69:0/2954163548 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31880036c0 con 0x7f319815d0d0 2023-11-17T06:30:32.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.059+0000 7f318e7fc700 1 -- 172.21.15.69:0/2954163548 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318801e070 con 0x7f319815d0d0 2023-11-17T06:30:32.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.059+0000 7f318e7fc700 1 -- 172.21.15.69:0/2954163548 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188003a80 con 0x7f319815d0d0 2023-11-17T06:30:32.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.059+0000 7f319ff6e700 1 -- 172.21.15.69:0/2954163548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3198160900 con 0x7f319815d0d0 2023-11-17T06:30:32.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.059+0000 7f319ff6e700 1 -- 172.21.15.69:0/2954163548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3198160ec0 con 0x7f319815d0d0 2023-11-17T06:30:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.059+0000 7f319ff6e700 1 -- 172.21.15.69:0/2954163548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3198073f00 con 0x7f319815d0d0 2023-11-17T06:30:32.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.063+0000 7f318e7fc700 1 -- 172.21.15.69:0/2954163548 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3188003be0 con 0x7f319815d0d0 2023-11-17T06:30:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.063+0000 7f318e7fc700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f317c066540 0x7f317c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.063+0000 7f318e7fc700 1 -- 172.21.15.69:0/2954163548 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3188020070 con 0x7f319815d0d0 2023-11-17T06:30:32.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.063+0000 7f319dd0a700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f317c066540 0x7f317c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.063+0000 7f319dd0a700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f317c066540 0x7f317c068a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3194009c40 tx=0x7f3194008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.067+0000 7f318e7fc700 1 -- 172.21.15.69:0/2954163548 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3188052120 con 0x7f319815d0d0 2023-11-17T06:30:32.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.243+0000 7f319ff6e700 1 -- 172.21.15.69:0/2954163548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31980cc960 con 0x7f319815d0d0 2023-11-17T06:30:32.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.243+0000 7f318e7fc700 1 -- 172.21.15.69:0/2954163548 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f31880150a0 con 0x7f319815d0d0 2023-11-17T06:30:32.249 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:32.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 -- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f317c066540 msgr2=0x7f317c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f317c066540 0x7f317c068a00 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3194009c40 tx=0x7f3194008040 comp rx=0 tx=0).stop 2023-11-17T06:30:32.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 -- 172.21.15.69:0/2954163548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f319815d0d0 msgr2=0x7f31981616c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f319815d0d0 0x7f31981616c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3188014040 tx=0x7f3188004770 comp rx=0 tx=0).stop 2023-11-17T06:30:32.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 -- 172.21.15.69:0/2954163548 shutdown_connections 2023-11-17T06:30:32.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f317c066540 0x7f317c068a00 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f319815d4b0 0x7f319815e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f319815d0d0 0x7f31981616c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 --2- 172.21.15.69:0/2954163548 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31980660a0 0x7f3198156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 -- 172.21.15.69:0/2954163548 >> 172.21.15.69:0/2954163548 conn(0x7f31980cc0b0 msgr2=0x7f31980af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:32.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 -- 172.21.15.69:0/2954163548 shutdown_connections 2023-11-17T06:30:32.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.247+0000 7f319ff6e700 1 -- 172.21.15.69:0/2954163548 wait complete. 2023-11-17T06:30:32.272 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:32.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.439+0000 7fc03e47b700 1 Processor -- start 2023-11-17T06:30:32.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.439+0000 7fc03e47b700 1 -- start start 2023-11-17T06:30:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.439+0000 7fc03e47b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc0381652b0 0x7fc0380cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.439+0000 7fc03e47b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc03806c200 con 0x7fc0380c21a0 2023-11-17T06:30:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.439+0000 7fc03e47b700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc038165d00 con 0x7fc038165740 2023-11-17T06:30:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.439+0000 7fc03e47b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0381662c0 con 0x7fc0381652b0 2023-11-17T06:30:32.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.439+0000 7fc03d479700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc0380c21a0 0x7fc03806c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37352/0 (socket says 172.21.15.69:37352) 2023-11-17T06:30:32.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03d479700 1 -- 172.21.15.69:0/3173674649 learned_addr learned my addr 172.21.15.69:0/3173674649 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:32.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03cc78700 1 --2- 172.21.15.69:0/3173674649 >> v2:172.21.15.93:3300/0 conn(0x7fc0381652b0 0x7fc0380cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87265026 0 0) 0x7fc03806c200 con 0x7fc0380c21a0 2023-11-17T06:30:32.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0240035d0 con 0x7fc0380c21a0 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149300569 0 0) 0x7fc038165d00 con 0x7fc038165740 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc03806c200 con 0x7fc038165740 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3715103342 0 0) 0x7fc0240035d0 con 0x7fc0380c21a0 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 >> v2:172.21.15.93:3300/0 conn(0x7fc0381652b0 msgr2=0x7fc0380cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 --2- 172.21.15.69:0/3173674649 >> v2:172.21.15.93:3300/0 conn(0x7fc0381652b0 0x7fc0380cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 >> v1:172.21.15.93:6789/0 conn(0x7fc038165740 legacy=0x7fc0380cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc038165fe0 con 0x7fc0380c21a0 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7fc034001670 con 0x7fc0380c21a0 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 >> v1:172.21.15.69:6789/0 conn(0x7fc0380c21a0 legacy=0x7fc03806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc024003bb0 0x7fc024003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc024004870 0x7fc024004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc024005230 0x7fc02400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0381662c0 con 0x7fc024005230 2023-11-17T06:30:32.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc02400c160 con 0x7fc024004870 2023-11-17T06:30:32.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc02400c320 con 0x7fc024003bb0 2023-11-17T06:30:32.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03cc78700 1 --2- 172.21.15.69:0/3173674649 >> v2:172.21.15.93:3300/0 conn(0x7fc0381652b0 0x7fc0380cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03dc7a700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc024005230 0x7fc02400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03d479700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc024003bb0 0x7fc024003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03cc78700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc024004870 0x7fc024004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03dc7a700 1 -- 172.21.15.69:0/3173674649 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc024003bb0 msgr2=0x7fc024003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03dc7a700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc024003bb0 0x7fc024003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03dc7a700 1 -- 172.21.15.69:0/3173674649 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc024004870 msgr2=0x7fc024004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:32.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03dc7a700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc024004870 0x7fc024004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03dc7a700 1 -- 172.21.15.69:0/3173674649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240035d0 con 0x7fc024005230 2023-11-17T06:30:32.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03dc7a700 1 -- 172.21.15.69:0/3173674649 reap_dead start 2023-11-17T06:30:32.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.443+0000 7fc03dc7a700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc024005230 0x7fc02400ba30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c2f0 tx=0x7fc0240058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7586221d1c3c742d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.447+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030001f30 con 0x7fc024005230 2023-11-17T06:30:32.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.447+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc030003a20 con 0x7fc024005230 2023-11-17T06:30:32.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.447+0000 7fc02ffff700 1 -- 172.21.15.69:0/3173674649 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030003dd0 con 0x7fc024005230 2023-11-17T06:30:32.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.447+0000 7fc03e47b700 1 -- 172.21.15.69:0/3173674649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc024005230 msgr2=0x7fc02400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.447+0000 7fc03e47b700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc024005230 0x7fc02400ba30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc03000c2f0 tx=0x7fc0240058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.447+0000 7fc03e47b700 1 -- 172.21.15.69:0/3173674649 shutdown_connections 2023-11-17T06:30:32.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.447+0000 7fc03e47b700 1 --2- 172.21.15.69:0/3173674649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc024005230 0x7fc02400ba30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.447+0000 7fc03e47b700 1 -- 172.21.15.69:0/3173674649 >> 172.21.15.69:0/3173674649 conn(0x7fc0380b0900 msgr2=0x7fc0380b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:32.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.447+0000 7fc03e47b700 1 -- 172.21.15.69:0/3173674649 shutdown_connections 2023-11-17T06:30:32.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.447+0000 7fc03e47b700 1 -- 172.21.15.69:0/3173674649 wait complete. 2023-11-17T06:30:32.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03e47b700 1 Processor -- start 2023-11-17T06:30:32.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03e47b700 1 -- start start 2023-11-17T06:30:32.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03e47b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc024005230 0x7fc0381f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03e47b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0381f50c0 0x7fc0380c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03e47b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0380c8440 0x7fc0381fa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03e47b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380c88f0 con 0x7fc0380c8440 2023-11-17T06:30:32.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03e47b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0381fb470 con 0x7fc0381f50c0 2023-11-17T06:30:32.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03e47b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0380c6ef0 con 0x7fc024005230 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03dc7a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0380c8440 0x7fc0381fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03dc7a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0380c8440 0x7fc0381fa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38464/0 (socket says 172.21.15.69:38464) 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03dc7a700 1 -- 172.21.15.69:0/3723789263 learned_addr learned my addr 172.21.15.69:0/3723789263 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03d479700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc024005230 0x7fc0381f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03cc78700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0381f50c0 0x7fc0380c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03dc7a700 1 -- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc024005230 msgr2=0x7fc0381f4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03dc7a700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc024005230 0x7fc0381f4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03dc7a700 1 -- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0381f50c0 msgr2=0x7fc0380c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03dc7a700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0381f50c0 0x7fc0380c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03dc7a700 1 -- 172.21.15.69:0/3723789263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0380c7140 con 0x7fc0380c8440 2023-11-17T06:30:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03cc78700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0381f50c0 0x7fc0380c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:32.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03dc7a700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0380c8440 0x7fc0381fa530 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc030000f80 tx=0x7fc030001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc02dffb700 1 -- 172.21.15.69:0/3723789263 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc030005270 con 0x7fc0380c8440 2023-11-17T06:30:32.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc02dffb700 1 -- 172.21.15.69:0/3723789263 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0300053f0 con 0x7fc0380c8440 2023-11-17T06:30:32.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc03e47b700 1 -- 172.21.15.69:0/3723789263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0380c7420 con 0x7fc0380c8440 2023-11-17T06:30:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.451+0000 7fc02dffb700 1 -- 172.21.15.69:0/3723789263 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0300057a0 con 0x7fc0380c8440 2023-11-17T06:30:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.455+0000 7fc03e47b700 1 -- 172.21.15.69:0/3723789263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0380c79e0 con 0x7fc0380c8440 2023-11-17T06:30:32.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.455+0000 7fc03e47b700 1 -- 172.21.15.69:0/3723789263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0380c7c00 con 0x7fc0380c8440 2023-11-17T06:30:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.455+0000 7fc02dffb700 1 -- 172.21.15.69:0/3723789263 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc030027460 con 0x7fc0380c8440 2023-11-17T06:30:32.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.459+0000 7fc02dffb700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc01c066560 0x7fc01c068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.459+0000 7fc02dffb700 1 -- 172.21.15.69:0/3723789263 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc030084ff0 con 0x7fc0380c8440 2023-11-17T06:30:32.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.459+0000 7fc03d479700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc01c066560 0x7fc01c068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.459+0000 7fc03d479700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc01c066560 0x7fc01c068a20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc034000c00 tx=0x7fc034001e00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.463+0000 7fc02dffb700 1 -- 172.21.15.69:0/3723789263 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc030052500 con 0x7fc0380c8440 2023-11-17T06:30:32.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.639+0000 7fc03e47b700 1 -- 172.21.15.69:0/3723789263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0380c7c00 con 0x7fc0380c8440 2023-11-17T06:30:32.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.639+0000 7fc02dffb700 1 -- 172.21.15.69:0/3723789263 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16425 (secure 0 0 0) 0x7fc030003e60 con 0x7fc0380c8440 2023-11-17T06:30:32.647 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:32.647 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:29:58.004301+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:32.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 -- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc01c066560 msgr2=0x7fc01c068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc01c066560 0x7fc01c068a20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc034000c00 tx=0x7fc034001e00 comp rx=0 tx=0).stop 2023-11-17T06:30:32.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 -- 172.21.15.69:0/3723789263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0380c8440 msgr2=0x7fc0381fa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0380c8440 0x7fc0381fa530 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc030000f80 tx=0x7fc030001650 comp rx=0 tx=0).stop 2023-11-17T06:30:32.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 -- 172.21.15.69:0/3723789263 shutdown_connections 2023-11-17T06:30:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc01c066560 0x7fc01c068a20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc0380c8440 0x7fc0381fa530 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0381f50c0 0x7fc0380c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 --2- 172.21.15.69:0/3723789263 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc024005230 0x7fc0381f4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 -- 172.21.15.69:0/3723789263 >> 172.21.15.69:0/3723789263 conn(0x7fc0380b0900 msgr2=0x7fc0380cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 -- 172.21.15.69:0/3723789263 shutdown_connections 2023-11-17T06:30:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.643+0000 7fc03e47b700 1 -- 172.21.15.69:0/3723789263 wait complete. 2023-11-17T06:30:32.671 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:32.672 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:32.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.839+0000 7fefb76cb700 1 Processor -- start 2023-11-17T06:30:32.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.839+0000 7fefb76cb700 1 -- start start 2023-11-17T06:30:32.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb76cb700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fefb00cfc80 0x7fefb006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb76cb700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb006b7a0 con 0x7fefb015d310 2023-11-17T06:30:32.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb76cb700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb00d0180 con 0x7fefb015d6f0 2023-11-17T06:30:32.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb76cb700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb00d0460 con 0x7fefb00cfc80 2023-11-17T06:30:32.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb5467700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fefb015d310 0x7fefb00d1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37358/0 (socket says 172.21.15.69:37358) 2023-11-17T06:30:32.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb5467700 1 -- 172.21.15.69:0/741981124 learned_addr learned my addr 172.21.15.69:0/741981124 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:32.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb4c66700 1 --2- 172.21.15.69:0/741981124 >> v2:172.21.15.93:3300/0 conn(0x7fefb00cfc80 0x7fefb006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefa7fff700 1 -- 172.21.15.69:0/741981124 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317947142 0 0) 0x7fefb006b7a0 con 0x7fefb015d310 2023-11-17T06:30:32.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefa7fff700 1 -- 172.21.15.69:0/741981124 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef9c0035d0 con 0x7fefb015d310 2023-11-17T06:30:32.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb4c66700 1 -- 172.21.15.69:0/741981124 >> v1:172.21.15.93:6789/0 conn(0x7fefb015d6f0 legacy=0x7fefb006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefa7fff700 1 -- 172.21.15.69:0/741981124 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1244418502 0 0) 0x7fef9c0035d0 con 0x7fefb015d310 2023-11-17T06:30:32.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb4c66700 1 -- 172.21.15.69:0/741981124 >> v1:172.21.15.69:6789/0 conn(0x7fefb015d310 legacy=0x7fefb00d1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb4c66700 1 -- 172.21.15.69:0/741981124 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb00d0740 con 0x7fefb00cfc80 2023-11-17T06:30:32.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.843+0000 7fefb4c66700 1 --2- 172.21.15.69:0/741981124 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefb00cfc80 0x7fefb006ea50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009850 tx=0x7fefa0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5579fc5421a0d63 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefa7fff700 1 -- 172.21.15.69:0/741981124 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac0017f0 con 0x7fefb00cfc80 2023-11-17T06:30:32.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefa7fff700 1 -- 172.21.15.69:0/741981124 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa0004030 con 0x7fefb00cfc80 2023-11-17T06:30:32.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefa7fff700 1 -- 172.21.15.69:0/741981124 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa00043a0 con 0x7fefb00cfc80 2023-11-17T06:30:32.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefb76cb700 1 -- 172.21.15.69:0/741981124 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefb00cfc80 msgr2=0x7fefb006ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefb76cb700 1 --2- 172.21.15.69:0/741981124 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefb00cfc80 0x7fefb006ea50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fefa0009850 tx=0x7fefa0009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:32.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefb76cb700 1 -- 172.21.15.69:0/741981124 shutdown_connections 2023-11-17T06:30:32.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefb76cb700 1 --2- 172.21.15.69:0/741981124 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefb00cfc80 0x7fefb006ea50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefb76cb700 1 -- 172.21.15.69:0/741981124 >> 172.21.15.69:0/741981124 conn(0x7fefb009a360 msgr2=0x7fefb00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:32.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefb76cb700 1 -- 172.21.15.69:0/741981124 shutdown_connections 2023-11-17T06:30:32.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefb76cb700 1 -- 172.21.15.69:0/741981124 wait complete. 2023-11-17T06:30:32.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefb76cb700 1 Processor -- start 2023-11-17T06:30:32.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.847+0000 7fefb76cb700 1 -- start start 2023-11-17T06:30:32.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb76cb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefb00cfc80 0x7fefb00ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb76cb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fefb015d310 0x7fefb00c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb76cb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefb015d6f0 0x7fefb00c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb76cb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00c99f0 con 0x7fefb00cfc80 2023-11-17T06:30:32.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb76cb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00c8b30 con 0x7fefb015d6f0 2023-11-17T06:30:32.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb76cb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb00c8de0 con 0x7fefb015d310 2023-11-17T06:30:32.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb5467700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefb00cfc80 0x7fefb00ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb5467700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefb00cfc80 0x7fefb00ca780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38476/0 (socket says 172.21.15.69:38476) 2023-11-17T06:30:32.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb5467700 1 -- 172.21.15.69:0/3664894917 learned_addr learned my addr 172.21.15.69:0/3664894917 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:32.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb5c68700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefb015d6f0 0x7fefb00c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb4c66700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fefb015d310 0x7fefb00c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb5467700 1 -- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fefb015d310 msgr2=0x7fefb00c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb5467700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fefb015d310 0x7fefb00c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb5467700 1 -- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefb015d6f0 msgr2=0x7fefb00c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:32.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb5467700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefb015d6f0 0x7fefb00c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:32.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb5467700 1 -- 172.21.15.69:0/3664894917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa00094b0 con 0x7fefb00cfc80 2023-11-17T06:30:32.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb5467700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefb00cfc80 0x7fefb00ca780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fefac00c750 tx=0x7fefac00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefa5ffb700 1 -- 172.21.15.69:0/3664894917 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac005c60 con 0x7fefb00cfc80 2023-11-17T06:30:32.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefa5ffb700 1 -- 172.21.15.69:0/3664894917 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac005de0 con 0x7fefb00cfc80 2023-11-17T06:30:32.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb76cb700 1 -- 172.21.15.69:0/3664894917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb00c90c0 con 0x7fefb00cfc80 2023-11-17T06:30:32.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefa5ffb700 1 -- 172.21.15.69:0/3664894917 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac0072b0 con 0x7fefb00cfc80 2023-11-17T06:30:32.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.851+0000 7fefb76cb700 1 -- 172.21.15.69:0/3664894917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb00c9680 con 0x7fefb00cfc80 2023-11-17T06:30:32.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.855+0000 7fefb76cb700 1 -- 172.21.15.69:0/3664894917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb00686a0 con 0x7fefb00cfc80 2023-11-17T06:30:32.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.855+0000 7fefa5ffb700 1 -- 172.21.15.69:0/3664894917 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fefac007410 con 0x7fefb00cfc80 2023-11-17T06:30:32.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.855+0000 7fefa5ffb700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef94066510 0x7fef940689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:32.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.855+0000 7fefa5ffb700 1 -- 172.21.15.69:0/3664894917 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefac083420 con 0x7fefb00cfc80 2023-11-17T06:30:32.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.855+0000 7fefb4c66700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef94066510 0x7fef940689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:32.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.859+0000 7fefb4c66700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef94066510 0x7fef940689d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fefa00090b0 tx=0x7fefa0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:32.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:32.863+0000 7fefa5ffb700 1 -- 172.21.15.69:0/3664894917 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fefac050800 con 0x7fefb00cfc80 2023-11-17T06:30:33.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.043+0000 7fefb76cb700 1 -- 172.21.15.69:0/3664894917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fefb00b6c00 con 0x7fefb00cfc80 2023-11-17T06:30:33.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.043+0000 7fefa5ffb700 1 -- 172.21.15.69:0/3664894917 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fefac0170a0 con 0x7fefb00cfc80 2023-11-17T06:30:33.051 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:33.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.047+0000 7fefb76cb700 1 -- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef94066510 msgr2=0x7fef940689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.047+0000 7fefb76cb700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef94066510 0x7fef940689d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fefa00090b0 tx=0x7fefa0008030 comp rx=0 tx=0).stop 2023-11-17T06:30:33.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.047+0000 7fefb76cb700 1 -- 172.21.15.69:0/3664894917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefb00cfc80 msgr2=0x7fefb00ca780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.047+0000 7fefb76cb700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefb00cfc80 0x7fefb00ca780 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fefac00c750 tx=0x7fefac00cb10 comp rx=0 tx=0).stop 2023-11-17T06:30:33.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.051+0000 7fefb76cb700 1 -- 172.21.15.69:0/3664894917 shutdown_connections 2023-11-17T06:30:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.051+0000 7fefb76cb700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fef94066510 0x7fef940689d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.051+0000 7fefb76cb700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fefb015d6f0 0x7fefb00c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.051+0000 7fefb76cb700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fefb015d310 0x7fefb00c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.051+0000 7fefb76cb700 1 --2- 172.21.15.69:0/3664894917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefb00cfc80 0x7fefb00ca780 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.051+0000 7fefb76cb700 1 -- 172.21.15.69:0/3664894917 >> 172.21.15.69:0/3664894917 conn(0x7fefb009a360 msgr2=0x7fefb00d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.051+0000 7fefb76cb700 1 -- 172.21.15.69:0/3664894917 shutdown_connections 2023-11-17T06:30:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.051+0000 7fefb76cb700 1 -- 172.21.15.69:0/3664894917 wait complete. 2023-11-17T06:30:33.076 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:33.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.243+0000 7f1c21814700 1 Processor -- start 2023-11-17T06:30:33.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.243+0000 7f1c21814700 1 -- start start 2023-11-17T06:30:33.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c21814700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 0x7f1c1c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c21814700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1c1c0ce4e0 0x7f1c1c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c21814700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c0d1bb0 con 0x7f1c1c0d13d0 2023-11-17T06:30:33.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c21814700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0d1e90 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c21814700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0d2170 con 0x7f1c1c15d490 2023-11-17T06:30:33.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c20812700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 0x7f1c1c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c1bfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1c1c0d13d0 0x7f1c1c0cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37364/0 (socket says 172.21.15.69:37364) 2023-11-17T06:30:33.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c1bfff700 1 -- 172.21.15.69:0/1575199585 learned_addr learned my addr 172.21.15.69:0/1575199585 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:33.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c21013700 1 --2- 172.21.15.69:0/1575199585 >> v2:172.21.15.69:3300/0 conn(0x7f1c1c0ce4e0 0x7f1c1c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c20812700 1 -- 172.21.15.69:0/1575199585 >> v2:172.21.15.69:3300/0 conn(0x7f1c1c0ce4e0 msgr2=0x7f1c1c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:33.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c20812700 1 --2- 172.21.15.69:0/1575199585 >> v2:172.21.15.69:3300/0 conn(0x7f1c1c0ce4e0 0x7f1c1c0b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c20812700 1 -- 172.21.15.69:0/1575199585 >> v1:172.21.15.69:6789/0 conn(0x7f1c1c0d13d0 legacy=0x7f1c1c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c20812700 1 -- 172.21.15.69:0/1575199585 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0d2450 con 0x7f1c1c15d490 2023-11-17T06:30:33.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.247+0000 7f1c1b7fe700 1 -- 172.21.15.69:0/1575199585 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426231301 0 0) 0x7f1c1c0d1bb0 con 0x7f1c1c0d13d0 2023-11-17T06:30:33.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c20812700 1 --2- 172.21.15.69:0/1575199585 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 0x7f1c1c0b8bc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009850 tx=0x7f1c10009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e05842ca03bacde server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:33.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c1b7fe700 1 -- 172.21.15.69:0/1575199585 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10011830 con 0x7f1c1c15d490 2023-11-17T06:30:33.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c1b7fe700 1 -- 172.21.15.69:0/1575199585 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10011990 con 0x7f1c1c15d490 2023-11-17T06:30:33.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c1b7fe700 1 -- 172.21.15.69:0/1575199585 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10011d40 con 0x7f1c1c15d490 2023-11-17T06:30:33.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c21814700 1 -- 172.21.15.69:0/1575199585 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 msgr2=0x7f1c1c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c21814700 1 --2- 172.21.15.69:0/1575199585 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 0x7f1c1c0b8bc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009850 tx=0x7f1c10009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:33.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c21814700 1 -- 172.21.15.69:0/1575199585 shutdown_connections 2023-11-17T06:30:33.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c21814700 1 --2- 172.21.15.69:0/1575199585 >> v2:172.21.15.69:3300/0 conn(0x7f1c1c0ce4e0 0x7f1c1c0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c21814700 1 --2- 172.21.15.69:0/1575199585 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 0x7f1c1c0b8bc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c21814700 1 -- 172.21.15.69:0/1575199585 >> 172.21.15.69:0/1575199585 conn(0x7f1c1c06ab40 msgr2=0x7f1c1c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:33.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c21814700 1 -- 172.21.15.69:0/1575199585 shutdown_connections 2023-11-17T06:30:33.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.251+0000 7f1c21814700 1 -- 172.21.15.69:0/1575199585 wait complete. 2023-11-17T06:30:33.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c21814700 1 Processor -- start 2023-11-17T06:30:33.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c21814700 1 -- start start 2023-11-17T06:30:33.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c21814700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c1c0ce4e0 0x7f1c1c160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c21814700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c1c0d13d0 0x7f1c1c14af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c21814700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 0x7f1c1c0c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c21814700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c14c4c0 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c21814700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c14b8f0 con 0x7f1c1c0d13d0 2023-11-17T06:30:33.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c21814700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c14e240 con 0x7f1c1c15d490 2023-11-17T06:30:33.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c20812700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c1c0ce4e0 0x7f1c1c160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c20812700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c1c0ce4e0 0x7f1c1c160290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38496/0 (socket says 172.21.15.69:38496) 2023-11-17T06:30:33.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c20812700 1 -- 172.21.15.69:0/1104109981 learned_addr learned my addr 172.21.15.69:0/1104109981 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:33.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c21013700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 0x7f1c1c0c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c1bfff700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c1c0d13d0 0x7f1c1c14af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c20812700 1 -- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 msgr2=0x7f1c1c0c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c20812700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 0x7f1c1c0c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c20812700 1 -- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c1c0d13d0 msgr2=0x7f1c1c14af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c20812700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c1c0d13d0 0x7f1c1c14af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c20812700 1 -- 172.21.15.69:0/1104109981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100094b0 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c1bfff700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c1c0d13d0 0x7f1c1c14af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:33.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c20812700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c1c0ce4e0 0x7f1c1c160290 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1c10000c00 tx=0x7f1c10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:33.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.255+0000 7f1c197fa700 1 -- 172.21.15.69:0/1104109981 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1001aac0 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.259+0000 7f1c197fa700 1 -- 172.21.15.69:0/1104109981 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1001f070 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.259+0000 7f1c197fa700 1 -- 172.21.15.69:0/1104109981 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1001ae60 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.259+0000 7f1c21814700 1 -- 172.21.15.69:0/1104109981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c14d9a0 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.259+0000 7f1c21814700 1 -- 172.21.15.69:0/1104109981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c14df60 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.259+0000 7f1c21814700 1 -- 172.21.15.69:0/1104109981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c0b6040 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.259+0000 7f1c197fa700 1 -- 172.21.15.69:0/1104109981 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1c1001b430 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.263+0000 7f1c197fa700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1c00066540 0x7f1c00068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.263+0000 7f1c197fa700 1 -- 172.21.15.69:0/1104109981 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c10084fa0 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.263+0000 7f1c1bfff700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1c00066540 0x7f1c00068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.263+0000 7f1c1bfff700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1c00066540 0x7f1c00068a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0c4580 tx=0x7f1c08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:33.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.271+0000 7f1c197fa700 1 -- 172.21.15.69:0/1104109981 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1c100b6090 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.443+0000 7f1c21814700 1 -- 172.21.15.69:0/1104109981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c1c073f00 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.447+0000 7f1c197fa700 1 -- 172.21.15.69:0/1104109981 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c10015020 con 0x7f1c1c0ce4e0 2023-11-17T06:30:33.451 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:33.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 -- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1c00066540 msgr2=0x7f1c00068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1c00066540 0x7f1c00068a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0c4580 tx=0x7f1c08009040 comp rx=0 tx=0).stop 2023-11-17T06:30:33.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 -- 172.21.15.69:0/1104109981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c1c0ce4e0 msgr2=0x7f1c1c160290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c1c0ce4e0 0x7f1c1c160290 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1c10000c00 tx=0x7f1c10004770 comp rx=0 tx=0).stop 2023-11-17T06:30:33.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 -- 172.21.15.69:0/1104109981 shutdown_connections 2023-11-17T06:30:33.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1c00066540 0x7f1c00068a00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1c1c15d490 0x7f1c1c0c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c1c0d13d0 0x7f1c1c14af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 --2- 172.21.15.69:0/1104109981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c1c0ce4e0 0x7f1c1c160290 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 -- 172.21.15.69:0/1104109981 >> 172.21.15.69:0/1104109981 conn(0x7f1c1c06ab40 msgr2=0x7f1c1c15c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:33.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 -- 172.21.15.69:0/1104109981 shutdown_connections 2023-11-17T06:30:33.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.451+0000 7f1c21814700 1 -- 172.21.15.69:0/1104109981 wait complete. 2023-11-17T06:30:33.479 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:33.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.651+0000 7fe52dd2e700 1 Processor -- start 2023-11-17T06:30:33.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.651+0000 7fe52dd2e700 1 -- start start 2023-11-17T06:30:33.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.651+0000 7fe52dd2e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe52815b980 0x7fe52815f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.651+0000 7fe52dd2e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe5280719e0 0x7fe5280c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.651+0000 7fe52dd2e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe52815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.651+0000 7fe52dd2e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5280c9e10 con 0x7fe5280719e0 2023-11-17T06:30:33.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.651+0000 7fe52dd2e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe528070430 con 0x7fe52815b980 2023-11-17T06:30:33.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.651+0000 7fe52dd2e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52815ed70 con 0x7fe5280c9960 2023-11-17T06:30:33.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe51ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe5280719e0 0x7fe5280c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52cd2c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe52815b980 0x7fe52815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe51ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe5280719e0 0x7fe5280c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38498/0 (socket says 172.21.15.69:38498) 2023-11-17T06:30:33.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe51ffff700 1 -- 172.21.15.69:0/948089979 learned_addr learned my addr 172.21.15.69:0/948089979 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:33.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52d52d700 1 --2- 172.21.15.69:0/948089979 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe52815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52cd2c700 1 -- 172.21.15.69:0/948089979 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 msgr2=0x7fe52815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:33.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52cd2c700 1 --2- 172.21.15.69:0/948089979 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe52815bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52cd2c700 1 -- 172.21.15.69:0/948089979 >> v2:172.21.15.69:3300/0 conn(0x7fe5280719e0 msgr2=0x7fe5280c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:33.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52cd2c700 1 --2- 172.21.15.69:0/948089979 >> v2:172.21.15.69:3300/0 conn(0x7fe5280719e0 0x7fe5280c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52cd2c700 1 -- 172.21.15.69:0/948089979 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52806fc20 con 0x7fe52815b980 2023-11-17T06:30:33.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52d52d700 1 --2- 172.21.15.69:0/948089979 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe52815bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:33.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe51ffff700 1 --2- 172.21.15.69:0/948089979 >> v2:172.21.15.69:3300/0 conn(0x7fe5280719e0 0x7fe5280c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:33.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52cd2c700 1 --2- 172.21.15.69:0/948089979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe52815b980 0x7fe52815f780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe5280cec90 tx=0x7fe524009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ee5c7ed83bbbb17 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:33.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe51f7fe700 1 -- 172.21.15.69:0/948089979 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524011830 con 0x7fe52815b980 2023-11-17T06:30:33.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe51f7fe700 1 -- 172.21.15.69:0/948089979 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524011990 con 0x7fe52815b980 2023-11-17T06:30:33.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe51f7fe700 1 -- 172.21.15.69:0/948089979 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe524011d20 con 0x7fe52815b980 2023-11-17T06:30:33.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52dd2e700 1 -- 172.21.15.69:0/948089979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe52815b980 msgr2=0x7fe52815f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52dd2e700 1 --2- 172.21.15.69:0/948089979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe52815b980 0x7fe52815f780 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe5280cec90 tx=0x7fe524009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:33.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52dd2e700 1 -- 172.21.15.69:0/948089979 shutdown_connections 2023-11-17T06:30:33.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52dd2e700 1 --2- 172.21.15.69:0/948089979 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe52815bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52dd2e700 1 --2- 172.21.15.69:0/948089979 >> v2:172.21.15.69:3300/0 conn(0x7fe5280719e0 0x7fe5280c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52dd2e700 1 --2- 172.21.15.69:0/948089979 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe52815b980 0x7fe52815f780 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52dd2e700 1 -- 172.21.15.69:0/948089979 >> 172.21.15.69:0/948089979 conn(0x7fe5280b0900 msgr2=0x7fe5280b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:33.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.655+0000 7fe52dd2e700 1 -- 172.21.15.69:0/948089979 shutdown_connections 2023-11-17T06:30:33.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.659+0000 7fe52dd2e700 1 -- 172.21.15.69:0/948089979 wait complete. 2023-11-17T06:30:33.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.659+0000 7fe52dd2e700 1 Processor -- start 2023-11-17T06:30:33.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.659+0000 7fe52dd2e700 1 -- start start 2023-11-17T06:30:33.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52dd2e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5280719e0 0x7fe528157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52dd2e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe528153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52dd2e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe52815b980 0x7fe528159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:33.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52dd2e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280b2b70 con 0x7fe5280719e0 2023-11-17T06:30:33.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52dd2e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280b1ef0 con 0x7fe52815b980 2023-11-17T06:30:33.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52dd2e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5280b21d0 con 0x7fe5280c9960 2023-11-17T06:30:33.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52cd2c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5280719e0 0x7fe528157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe528153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52cd2c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5280719e0 0x7fe528157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38512/0 (socket says 172.21.15.69:38512) 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe528153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:53330/0 (socket says 172.21.15.69:53330) 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52cd2c700 1 -- 172.21.15.69:0/3785884902 learned_addr learned my addr 172.21.15.69:0/3785884902 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52d52d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe52815b980 0x7fe528159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51ffff700 1 -- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe52815b980 msgr2=0x7fe528159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51ffff700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe52815b980 0x7fe528159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51ffff700 1 -- 172.21.15.69:0/3785884902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5280719e0 msgr2=0x7fe528157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51ffff700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5280719e0 0x7fe528157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51ffff700 1 -- 172.21.15.69:0/3785884902 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518009570 con 0x7fe5280c9960 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52cd2c700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5280719e0 0x7fe528157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:33.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51ffff700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe528153870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe51800e940 tx=0x7fe51800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:33.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51d7fa700 1 -- 172.21.15.69:0/3785884902 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518013680 con 0x7fe5280c9960 2023-11-17T06:30:42.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51d7fa700 1 -- 172.21.15.69:0/3785884902 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5180137e0 con 0x7fe5280c9960 2023-11-17T06:30:42.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52dd2e700 1 -- 172.21.15.69:0/3785884902 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5240094b0 con 0x7fe5280c9960 2023-11-17T06:30:42.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe51d7fa700 1 -- 172.21.15.69:0/3785884902 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518013b90 con 0x7fe5280c9960 2023-11-17T06:30:42.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.663+0000 7fe52dd2e700 1 -- 172.21.15.69:0/3785884902 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5280b2790 con 0x7fe5280c9960 2023-11-17T06:30:42.155 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:30:42.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.667+0000 7fe52dd2e700 1 -- 172.21.15.69:0/3785884902 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5280b2cb0 con 0x7fe5280c9960 2023-11-17T06:30:42.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.667+0000 7fe51d7fa700 1 -- 172.21.15.69:0/3785884902 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe518013cf0 con 0x7fe5280c9960 2023-11-17T06:30:42.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.671+0000 7fe51d7fa700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe514066540 0x7fe514068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.671+0000 7fe51d7fa700 1 -- 172.21.15.69:0/3785884902 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe518083da0 con 0x7fe5280c9960 2023-11-17T06:30:42.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.671+0000 7fe52cd2c700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe514066540 0x7fe514068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.671+0000 7fe52cd2c700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe514066540 0x7fe514068a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5281578f0 tx=0x7fe524008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.679+0000 7fe51d7fa700 1 -- 172.21.15.69:0/3785884902 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe5280b2cb0 con 0x7fe5280c9960 2023-11-17T06:30:42.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.855+0000 7fe52dd2e700 1 -- 172.21.15.69:0/3785884902 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5280b2cb0 con 0x7fe5280c9960 2023-11-17T06:30:42.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.855+0000 7fe51d7fa700 1 -- 172.21.15.69:0/3785884902 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5280b2cb0 con 0x7fe5280c9960 2023-11-17T06:30:42.157 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 -- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe514066540 msgr2=0x7fe514068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe514066540 0x7fe514068a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe5281578f0 tx=0x7fe524008030 comp rx=0 tx=0).stop 2023-11-17T06:30:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 -- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 msgr2=0x7fe528153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe528153870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe51800e940 tx=0x7fe51800ec50 comp rx=0 tx=0).stop 2023-11-17T06:30:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 -- 172.21.15.69:0/3785884902 shutdown_connections 2023-11-17T06:30:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe514066540 0x7fe514068a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe52815b980 0x7fe528159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe5280c9960 0x7fe528153870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 --2- 172.21.15.69:0/3785884902 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5280719e0 0x7fe528157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 -- 172.21.15.69:0/3785884902 >> 172.21.15.69:0/3785884902 conn(0x7fe5280b0900 msgr2=0x7fe5280cbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 -- 172.21.15.69:0/3785884902 shutdown_connections 2023-11-17T06:30:42.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:33.859+0000 7fe52dd2e700 1 -- 172.21.15.69:0/3785884902 wait complete. 2023-11-17T06:30:42.171 INFO:tasks.cephfs_test_runner:Starting test: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-17T06:30:42.172 INFO:tasks.cephfs_test_runner:test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-17T06:30:42.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:42.210 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:30:42.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.415+0000 7fe03a3fe700 1 Processor -- start 2023-11-17T06:30:42.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe03a3fe700 1 -- start start 2023-11-17T06:30:42.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe03a3fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe0341617a0 0x7fe0340cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe03a3fe700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe034166040 con 0x7fe0340ce7a0 2023-11-17T06:30:42.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe03a3fe700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0340cebd0 con 0x7fe0340cbfc0 2023-11-17T06:30:42.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe03a3fe700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0340cc450 con 0x7fe0341617a0 2023-11-17T06:30:42.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe033fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe0341617a0 0x7fe0340cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe03899b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe0340ce7a0 0x7fe0340cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47752/0 (socket says 172.21.15.69:47752) 2023-11-17T06:30:42.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe03899b700 1 -- 172.21.15.69:0/2008375533 learned_addr learned my addr 172.21.15.69:0/2008375533 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:42.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe033fff700 1 -- 172.21.15.69:0/2008375533 >> v1:172.21.15.93:6789/0 conn(0x7fe0340cbfc0 legacy=0x7fe0340ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe033fff700 1 -- 172.21.15.69:0/2008375533 >> v1:172.21.15.69:6789/0 conn(0x7fe0340ce7a0 legacy=0x7fe0340cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.419+0000 7fe033fff700 1 -- 172.21.15.69:0/2008375533 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034165430 con 0x7fe0341617a0 2023-11-17T06:30:42.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe033fff700 1 --2- 172.21.15.69:0/2008375533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 0x7fe0340cba80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009d90 tx=0x7fe02c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497386805939b2f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe032ffd700 1 -- 172.21.15.69:0/2008375533 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00e070 con 0x7fe0341617a0 2023-11-17T06:30:42.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe032ffd700 1 -- 172.21.15.69:0/2008375533 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c00bbd0 con 0x7fe0341617a0 2023-11-17T06:30:42.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe032ffd700 1 -- 172.21.15.69:0/2008375533 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c012430 con 0x7fe0341617a0 2023-11-17T06:30:42.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe03a3fe700 1 -- 172.21.15.69:0/2008375533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 msgr2=0x7fe0340cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe03a3fe700 1 --2- 172.21.15.69:0/2008375533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 0x7fe0340cba80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe02c009d90 tx=0x7fe02c00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:42.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe03a3fe700 1 -- 172.21.15.69:0/2008375533 shutdown_connections 2023-11-17T06:30:42.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe03a3fe700 1 --2- 172.21.15.69:0/2008375533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 0x7fe0340cba80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe03a3fe700 1 -- 172.21.15.69:0/2008375533 >> 172.21.15.69:0/2008375533 conn(0x7fe03406a480 msgr2=0x7fe03406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:42.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe03a3fe700 1 -- 172.21.15.69:0/2008375533 shutdown_connections 2023-11-17T06:30:42.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe03a3fe700 1 -- 172.21.15.69:0/2008375533 wait complete. 2023-11-17T06:30:42.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.423+0000 7fe03a3fe700 1 Processor -- start 2023-11-17T06:30:42.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03a3fe700 1 -- start start 2023-11-17T06:30:42.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03a3fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0340cbfc0 0x7fe034158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03a3fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0340ce7a0 0x7fe0340c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03a3fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 0x7fe0340b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03a3fe700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0340c2e10 con 0x7fe0341617a0 2023-11-17T06:30:42.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03a3fe700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0340c3020 con 0x7fe0340cbfc0 2023-11-17T06:30:42.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03a3fe700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0340c3300 con 0x7fe0340ce7a0 2023-11-17T06:30:42.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03899b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 0x7fe0340b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03899b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 0x7fe0340b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43356/0 (socket says 172.21.15.69:43356) 2023-11-17T06:30:42.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03899b700 1 -- 172.21.15.69:0/311456782 learned_addr learned my addr 172.21.15.69:0/311456782 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:42.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe033fff700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0340cbfc0 0x7fe034158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe0337fe700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0340ce7a0 0x7fe0340c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03899b700 1 -- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0340ce7a0 msgr2=0x7fe0340c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03899b700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0340ce7a0 0x7fe0340c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03899b700 1 -- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0340cbfc0 msgr2=0x7fe034158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03899b700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0340cbfc0 0x7fe034158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03899b700 1 -- 172.21.15.69:0/311456782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c009a70 con 0x7fe0341617a0 2023-11-17T06:30:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03899b700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 0x7fe0340b3b20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00c4d0 tx=0x7fe01c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe030ff9700 1 -- 172.21.15.69:0/311456782 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c005d90 con 0x7fe0341617a0 2023-11-17T06:30:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe030ff9700 1 -- 172.21.15.69:0/311456782 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c0070d0 con 0x7fe0341617a0 2023-11-17T06:30:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe030ff9700 1 -- 172.21.15.69:0/311456782 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c007440 con 0x7fe0341617a0 2023-11-17T06:30:42.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.427+0000 7fe03a3fe700 1 -- 172.21.15.69:0/311456782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0340c35e0 con 0x7fe0341617a0 2023-11-17T06:30:42.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.431+0000 7fe03a3fe700 1 -- 172.21.15.69:0/311456782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0340c3ba0 con 0x7fe0341617a0 2023-11-17T06:30:42.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.431+0000 7fe03a3fe700 1 -- 172.21.15.69:0/311456782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe034073f00 con 0x7fe0341617a0 2023-11-17T06:30:42.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.431+0000 7fe030ff9700 1 -- 172.21.15.69:0/311456782 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe01c0075a0 con 0x7fe0341617a0 2023-11-17T06:30:42.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.435+0000 7fe030ff9700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe014066510 0x7fe0140689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.435+0000 7fe030ff9700 1 -- 172.21.15.69:0/311456782 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe01c083160 con 0x7fe0341617a0 2023-11-17T06:30:42.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.435+0000 7fe033fff700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe014066510 0x7fe0140689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.435+0000 7fe033fff700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe014066510 0x7fe0140689d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe02c014040 tx=0x7fe02c011000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.439+0000 7fe030ff9700 1 -- 172.21.15.69:0/311456782 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe01c0505d0 con 0x7fe0341617a0 2023-11-17T06:30:42.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.627+0000 7fe03a3fe700 1 -- 172.21.15.69:0/311456782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0340b4d40 con 0x7fe0341617a0 2023-11-17T06:30:42.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.631+0000 7fe030ff9700 1 -- 172.21.15.69:0/311456782 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7fe01c053bf0 con 0x7fe0341617a0 2023-11-17T06:30:42.638 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:42.638 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:42.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 -- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe014066510 msgr2=0x7fe0140689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe014066510 0x7fe0140689d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe02c014040 tx=0x7fe02c011000 comp rx=0 tx=0).stop 2023-11-17T06:30:42.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 -- 172.21.15.69:0/311456782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 msgr2=0x7fe0340b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 0x7fe0340b3b20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00c4d0 tx=0x7fe01c00c7e0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 -- 172.21.15.69:0/311456782 shutdown_connections 2023-11-17T06:30:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe014066510 0x7fe0140689d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0341617a0 0x7fe0340b3b20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0340ce7a0 0x7fe0340c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 --2- 172.21.15.69:0/311456782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0340cbfc0 0x7fe034158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 -- 172.21.15.69:0/311456782 >> 172.21.15.69:0/311456782 conn(0x7fe03406a480 msgr2=0x7fe03415bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 -- 172.21.15.69:0/311456782 shutdown_connections 2023-11-17T06:30:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.635+0000 7fe03a3fe700 1 -- 172.21.15.69:0/311456782 wait complete. 2023-11-17T06:30:42.662 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:42.663 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5b016ff700 1 Processor -- start 2023-11-17T06:30:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5b016ff700 1 -- start start 2023-11-17T06:30:42.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5b016ff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b500 0x7f5afc15f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5b016ff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5afc0cb340 0x7f5afc0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5b016ff700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc070120 con 0x7f5afc15b120 2023-11-17T06:30:42.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5b016ff700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc15fd50 con 0x7f5afc0cb340 2023-11-17T06:30:42.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5b016ff700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc06d830 con 0x7f5afc15b500 2023-11-17T06:30:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5afb7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5afc0cb340 0x7f5afc0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5af3fff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b500 0x7f5afc15f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5af3fff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b500 0x7f5afc15f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:36642/0 (socket says 172.21.15.69:36642) 2023-11-17T06:30:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5afb7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f5afc0cb340 0x7f5afc0c94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:42962/0 (socket says 172.21.15.69:42962) 2023-11-17T06:30:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5af3fff700 1 -- 172.21.15.69:0/1108313366 learned_addr learned my addr 172.21.15.69:0/1108313366 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5afaffd700 1 --1- 172.21.15.69:0/1108313366 >> v1:172.21.15.93:6789/0 conn(0x7f5afc15b120 0x7f5afc15eeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:52488/0 (socket says 172.21.15.69:52488) 2023-11-17T06:30:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5af3fff700 1 -- 172.21.15.69:0/1108313366 >> v2:172.21.15.93:3300/0 conn(0x7f5afc0cb340 msgr2=0x7f5afc0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5af3fff700 1 --2- 172.21.15.69:0/1108313366 >> v2:172.21.15.93:3300/0 conn(0x7f5afc0cb340 0x7f5afc0c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5af3fff700 1 -- 172.21.15.69:0/1108313366 >> v1:172.21.15.93:6789/0 conn(0x7f5afc15b120 legacy=0x7f5afc15eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.835+0000 7f5af3fff700 1 -- 172.21.15.69:0/1108313366 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc15fb00 con 0x7f5afc15b500 2023-11-17T06:30:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5af3fff700 1 --2- 172.21.15.69:0/1108313366 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b500 0x7f5afc15f5c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009910 tx=0x7f5ae4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3b04110e241eb8b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5afa7fc700 1 -- 172.21.15.69:0/1108313366 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011830 con 0x7f5afc15b500 2023-11-17T06:30:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5afa7fc700 1 -- 172.21.15.69:0/1108313366 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4011990 con 0x7f5afc15b500 2023-11-17T06:30:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5afa7fc700 1 -- 172.21.15.69:0/1108313366 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4011d40 con 0x7f5afc15b500 2023-11-17T06:30:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5b016ff700 1 -- 172.21.15.69:0/1108313366 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b500 msgr2=0x7f5afc15f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5b016ff700 1 --2- 172.21.15.69:0/1108313366 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b500 0x7f5afc15f5c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009910 tx=0x7f5ae4009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5b016ff700 1 -- 172.21.15.69:0/1108313366 shutdown_connections 2023-11-17T06:30:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5b016ff700 1 --2- 172.21.15.69:0/1108313366 >> v2:172.21.15.93:3300/0 conn(0x7f5afc0cb340 0x7f5afc0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5b016ff700 1 --2- 172.21.15.69:0/1108313366 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b500 0x7f5afc15f5c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5b016ff700 1 -- 172.21.15.69:0/1108313366 >> 172.21.15.69:0/1108313366 conn(0x7f5afc0cee80 msgr2=0x7f5afc0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5b016ff700 1 -- 172.21.15.69:0/1108313366 shutdown_connections 2023-11-17T06:30:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.839+0000 7f5b016ff700 1 -- 172.21.15.69:0/1108313366 wait complete. 2023-11-17T06:30:42.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.843+0000 7f5b016ff700 1 Processor -- start 2023-11-17T06:30:42.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.843+0000 7f5b016ff700 1 -- start start 2023-11-17T06:30:42.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.843+0000 7f5b016ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5afc0cb340 0x7f5afc0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5b016ff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b120 0x7f5afc149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5b016ff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5afc15b500 0x7f5afc14a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5b016ff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc14d720 con 0x7f5afc15b500 2023-11-17T06:30:42.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5b016ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc1f6200 con 0x7f5afc0cb340 2023-11-17T06:30:42.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5b016ff700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc1f64e0 con 0x7f5afc15b120 2023-11-17T06:30:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5afb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5afc15b500 0x7f5afc14a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5afb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5afc15b500 0x7f5afc14a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43360/0 (socket says 172.21.15.69:43360) 2023-11-17T06:30:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5afb7fe700 1 -- 172.21.15.69:0/545217039 learned_addr learned my addr 172.21.15.69:0/545217039 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5afaffd700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5afc0cb340 0x7f5afc0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5af3fff700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b120 0x7f5afc149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5afb7fe700 1 -- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b120 msgr2=0x7f5afc149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5afb7fe700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b120 0x7f5afc149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5afb7fe700 1 -- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5afc0cb340 msgr2=0x7f5afc0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:42.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5afb7fe700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5afc0cb340 0x7f5afc0ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:42.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5afb7fe700 1 -- 172.21.15.69:0/545217039 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae4009570 con 0x7f5afc15b500 2023-11-17T06:30:42.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5afb7fe700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5afc15b500 0x7f5afc14a270 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5af400efc0 tx=0x7f5af400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5af37fe700 1 -- 172.21.15.69:0/545217039 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af4009ea0 con 0x7f5afc15b500 2023-11-17T06:30:42.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5af37fe700 1 -- 172.21.15.69:0/545217039 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400f040 con 0x7f5afc15b500 2023-11-17T06:30:42.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5af37fe700 1 -- 172.21.15.69:0/545217039 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400ced0 con 0x7f5afc15b500 2023-11-17T06:30:42.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5b016ff700 1 -- 172.21.15.69:0/545217039 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc1f67c0 con 0x7f5afc15b500 2023-11-17T06:30:42.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.847+0000 7f5b016ff700 1 -- 172.21.15.69:0/545217039 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc0cacf0 con 0x7f5afc15b500 2023-11-17T06:30:42.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.851+0000 7f5b016ff700 1 -- 172.21.15.69:0/545217039 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc1f69b0 con 0x7f5afc15b500 2023-11-17T06:30:42.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.851+0000 7f5af37fe700 1 -- 172.21.15.69:0/545217039 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5af4014480 con 0x7f5afc15b500 2023-11-17T06:30:42.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.851+0000 7f5af37fe700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5adc066540 0x7f5adc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:42.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.855+0000 7f5af37fe700 1 -- 172.21.15.69:0/545217039 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5af40844f0 con 0x7f5afc15b500 2023-11-17T06:30:42.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.855+0000 7f5afaffd700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5adc066540 0x7f5adc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:42.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.855+0000 7f5afaffd700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5adc066540 0x7f5adc068a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5aec000f60 tx=0x7f5aec007f30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:42.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:42.855+0000 7f5af37fe700 1 -- 172.21.15.69:0/545217039 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5af4051960 con 0x7f5afc15b500 2023-11-17T06:30:43.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.031+0000 7f5b016ff700 1 -- 172.21.15.69:0/545217039 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5afc0cacf0 con 0x7f5afc15b500 2023-11-17T06:30:43.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.031+0000 7f5af37fe700 1 -- 172.21.15.69:0/545217039 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5af4018020 con 0x7f5afc15b500 2023-11-17T06:30:43.037 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:43.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 -- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5adc066540 msgr2=0x7f5adc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5adc066540 0x7f5adc068a00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5aec000f60 tx=0x7f5aec007f30 comp rx=0 tx=0).stop 2023-11-17T06:30:43.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 -- 172.21.15.69:0/545217039 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5afc15b500 msgr2=0x7f5afc14a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5afc15b500 0x7f5afc14a270 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5af400efc0 tx=0x7f5af400c3a0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 -- 172.21.15.69:0/545217039 shutdown_connections 2023-11-17T06:30:43.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5adc066540 0x7f5adc068a00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5afc15b500 0x7f5afc14a270 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5afc15b120 0x7f5afc149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 --2- 172.21.15.69:0/545217039 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5afc0cb340 0x7f5afc0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 -- 172.21.15.69:0/545217039 >> 172.21.15.69:0/545217039 conn(0x7f5afc0cee80 msgr2=0x7f5afc06cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:43.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 -- 172.21.15.69:0/545217039 shutdown_connections 2023-11-17T06:30:43.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.035+0000 7f5b016ff700 1 -- 172.21.15.69:0/545217039 wait complete. 2023-11-17T06:30:43.064 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:43.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed913c700 1 Processor -- start 2023-11-17T06:30:43.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed913c700 1 -- start start 2023-11-17T06:30:43.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed913c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4ed415b120 0x7f4ed415eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed913c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b500 0x7f4ed415f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed913c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4ed40cb340 0x7f4ed406c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed913c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed415fd50 con 0x7f4ed415b120 2023-11-17T06:30:43.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed913c700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed4070120 con 0x7f4ed40cb340 2023-11-17T06:30:43.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed913c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed40705b0 con 0x7f4ed415b500 2023-11-17T06:30:43.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed2d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4ed415b120 0x7f4ed415eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed2d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4ed415b120 0x7f4ed415eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43376/0 (socket says 172.21.15.69:43376) 2023-11-17T06:30:43.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed2d9d700 1 -- 172.21.15.69:0/3408396948 learned_addr learned my addr 172.21.15.69:0/3408396948 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:43.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed259c700 1 --2- 172.21.15.69:0/3408396948 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b500 0x7f4ed415f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.239+0000 7f4ed359e700 1 --2- 172.21.15.69:0/3408396948 >> v2:172.21.15.93:3300/0 conn(0x7f4ed40cb340 0x7f4ed406c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed2d9d700 1 -- 172.21.15.69:0/3408396948 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b500 msgr2=0x7f4ed415f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:43.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed2d9d700 1 --2- 172.21.15.69:0/3408396948 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b500 0x7f4ed415f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed2d9d700 1 -- 172.21.15.69:0/3408396948 >> v2:172.21.15.93:3300/0 conn(0x7f4ed40cb340 msgr2=0x7f4ed406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:43.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed2d9d700 1 --2- 172.21.15.69:0/3408396948 >> v2:172.21.15.93:3300/0 conn(0x7f4ed40cb340 0x7f4ed406c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed2d9d700 1 -- 172.21.15.69:0/3408396948 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4071a20 con 0x7f4ed415b120 2023-11-17T06:30:43.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed259c700 1 --2- 172.21.15.69:0/3408396948 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b500 0x7f4ed415f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:43.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed359e700 1 --2- 172.21.15.69:0/3408396948 >> v2:172.21.15.93:3300/0 conn(0x7f4ed40cb340 0x7f4ed406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:43.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed2d9d700 1 --2- 172.21.15.69:0/3408396948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed415b120 0x7f4ed415eeb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40b1980 tx=0x7f4ec400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea123104f85b7cae server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed1d9b700 1 -- 172.21.15.69:0/3408396948 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec400e070 con 0x7f4ed415b120 2023-11-17T06:30:43.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed1d9b700 1 -- 172.21.15.69:0/3408396948 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec400b9c0 con 0x7f4ed415b120 2023-11-17T06:30:43.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed1d9b700 1 -- 172.21.15.69:0/3408396948 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec400bd70 con 0x7f4ed415b120 2023-11-17T06:30:43.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed913c700 1 -- 172.21.15.69:0/3408396948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed415b120 msgr2=0x7f4ed415eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed913c700 1 --2- 172.21.15.69:0/3408396948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed415b120 0x7f4ed415eeb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40b1980 tx=0x7f4ec400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:43.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed913c700 1 -- 172.21.15.69:0/3408396948 shutdown_connections 2023-11-17T06:30:43.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed913c700 1 --2- 172.21.15.69:0/3408396948 >> v2:172.21.15.93:3300/0 conn(0x7f4ed40cb340 0x7f4ed406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed913c700 1 --2- 172.21.15.69:0/3408396948 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b500 0x7f4ed415f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed913c700 1 --2- 172.21.15.69:0/3408396948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed415b120 0x7f4ed415eeb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed913c700 1 -- 172.21.15.69:0/3408396948 >> 172.21.15.69:0/3408396948 conn(0x7f4ed40cee80 msgr2=0x7f4ed40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:43.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed913c700 1 -- 172.21.15.69:0/3408396948 shutdown_connections 2023-11-17T06:30:43.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.243+0000 7f4ed913c700 1 -- 172.21.15.69:0/3408396948 wait complete. 2023-11-17T06:30:43.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.247+0000 7f4ed913c700 1 Processor -- start 2023-11-17T06:30:43.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.247+0000 7f4ed913c700 1 -- start start 2023-11-17T06:30:43.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed913c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed40cb340 0x7f4ed414f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed913c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b120 0x7f4ed415da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed913c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ed415b500 0x7f4ed415dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed913c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed4154120 con 0x7f4ed40cb340 2023-11-17T06:30:43.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed913c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed415d5f0 con 0x7f4ed415b500 2023-11-17T06:30:43.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed913c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed415ca20 con 0x7f4ed415b120 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed40cb340 0x7f4ed414f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed40cb340 0x7f4ed414f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43388/0 (socket says 172.21.15.69:43388) 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed2d9d700 1 -- 172.21.15.69:0/4283894978 learned_addr learned my addr 172.21.15.69:0/4283894978 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed359e700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ed415b500 0x7f4ed415dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed259c700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b120 0x7f4ed415da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed2d9d700 1 -- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b120 msgr2=0x7f4ed415da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed2d9d700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b120 0x7f4ed415da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed2d9d700 1 -- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ed415b500 msgr2=0x7f4ed415dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed2d9d700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ed415b500 0x7f4ed415dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed2d9d700 1 -- 172.21.15.69:0/4283894978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec4009b30 con 0x7f4ed40cb340 2023-11-17T06:30:43.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed2d9d700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed40cb340 0x7f4ed414f300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400b370 tx=0x7f4ec4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ebb7fe700 1 -- 172.21.15.69:0/4283894978 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4004250 con 0x7f4ed40cb340 2023-11-17T06:30:43.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed913c700 1 -- 172.21.15.69:0/4283894978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed415ccc0 con 0x7f4ed40cb340 2023-11-17T06:30:43.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ebb7fe700 1 -- 172.21.15.69:0/4283894978 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec40043b0 con 0x7f4ed40cb340 2023-11-17T06:30:43.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ebb7fe700 1 -- 172.21.15.69:0/4283894978 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec4004740 con 0x7f4ed40cb340 2023-11-17T06:30:43.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed913c700 1 -- 172.21.15.69:0/4283894978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed415d280 con 0x7f4ed40cb340 2023-11-17T06:30:43.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.251+0000 7f4ed913c700 1 -- 172.21.15.69:0/4283894978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed414f8a0 con 0x7f4ed40cb340 2023-11-17T06:30:43.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.255+0000 7f4ebb7fe700 1 -- 172.21.15.69:0/4283894978 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4ec401c440 con 0x7f4ed40cb340 2023-11-17T06:30:43.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.255+0000 7f4ebb7fe700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4ec0066510 0x7f4ec00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.255+0000 7f4ebb7fe700 1 -- 172.21.15.69:0/4283894978 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4ec4085480 con 0x7f4ed40cb340 2023-11-17T06:30:43.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.255+0000 7f4ed259c700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4ec0066510 0x7f4ec00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.255+0000 7f4ed259c700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4ec0066510 0x7f4ec00689d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40cb2c0 tx=0x7f4ec8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.259+0000 7f4ebb7fe700 1 -- 172.21.15.69:0/4283894978 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4ec4056410 con 0x7f4ed40cb340 2023-11-17T06:30:43.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.439+0000 7f4ed913c700 1 -- 172.21.15.69:0/4283894978 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ed4073f00 con 0x7f4ed40cb340 2023-11-17T06:30:43.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ebb7fe700 1 -- 172.21.15.69:0/4283894978 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ec40048a0 con 0x7f4ed40cb340 2023-11-17T06:30:43.447 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 -- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4ec0066510 msgr2=0x7f4ec00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4ec0066510 0x7f4ec00689d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4ed40cb2c0 tx=0x7f4ec8008040 comp rx=0 tx=0).stop 2023-11-17T06:30:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 -- 172.21.15.69:0/4283894978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed40cb340 msgr2=0x7f4ed414f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed40cb340 0x7f4ed414f300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4ec400b370 tx=0x7f4ec4004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 -- 172.21.15.69:0/4283894978 shutdown_connections 2023-11-17T06:30:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4ec0066510 0x7f4ec00689d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4ed415b500 0x7f4ed415dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4ed415b120 0x7f4ed415da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 --2- 172.21.15.69:0/4283894978 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ed40cb340 0x7f4ed414f300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 -- 172.21.15.69:0/4283894978 >> 172.21.15.69:0/4283894978 conn(0x7f4ed40cee80 msgr2=0x7f4ed40b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 -- 172.21.15.69:0/4283894978 shutdown_connections 2023-11-17T06:30:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.443+0000 7f4ed913c700 1 -- 172.21.15.69:0/4283894978 wait complete. 2023-11-17T06:30:43.471 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:43.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.655+0000 7ff28ef06700 1 Processor -- start 2023-11-17T06:30:43.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.655+0000 7ff28ef06700 1 -- start start 2023-11-17T06:30:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.659+0000 7ff28ef06700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff28815d5d0 0x7ff2880d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.659+0000 7ff28ef06700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff2880d1830 0x7ff2880d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.659+0000 7ff28ef06700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2880cf880 con 0x7ff2880ce820 2023-11-17T06:30:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.659+0000 7ff28ef06700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2880d21e0 con 0x7ff2880d1830 2023-11-17T06:30:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.659+0000 7ff28ef06700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2880cefe0 con 0x7ff28815d5d0 2023-11-17T06:30:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.659+0000 7ff27ffff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ff2880ce820 0x7ff2880d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:47766/0 (socket says 172.21.15.69:47766) 2023-11-17T06:30:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.659+0000 7ff27ffff700 1 -- 172.21.15.69:0/879289913 learned_addr learned my addr 172.21.15.69:0/879289913 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.659+0000 7ff28cca2700 1 --2- 172.21.15.69:0/879289913 >> v2:172.21.15.93:3300/0 conn(0x7ff28815d5d0 0x7ff2880d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.659+0000 7ff28d4a3700 1 --2- 172.21.15.69:0/879289913 >> v2:172.21.15.69:3300/0 conn(0x7ff2880d1830 0x7ff2880d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.659+0000 7ff27f7fe700 1 -- 172.21.15.69:0/879289913 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557639833 0 0) 0x7ff2880cf880 con 0x7ff2880ce820 2023-11-17T06:30:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff27f7fe700 1 -- 172.21.15.69:0/879289913 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2700035d0 con 0x7ff2880ce820 2023-11-17T06:30:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28d4a3700 1 -- 172.21.15.69:0/879289913 >> v2:172.21.15.93:3300/0 conn(0x7ff28815d5d0 msgr2=0x7ff2880d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28d4a3700 1 --2- 172.21.15.69:0/879289913 >> v2:172.21.15.93:3300/0 conn(0x7ff28815d5d0 0x7ff2880d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28d4a3700 1 -- 172.21.15.69:0/879289913 >> v1:172.21.15.69:6789/0 conn(0x7ff2880ce820 legacy=0x7ff2880d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28d4a3700 1 -- 172.21.15.69:0/879289913 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880cfad0 con 0x7ff2880d1830 2023-11-17T06:30:43.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28cca2700 1 --2- 172.21.15.69:0/879289913 >> v2:172.21.15.93:3300/0 conn(0x7ff28815d5d0 0x7ff2880d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:43.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28d4a3700 1 --2- 172.21.15.69:0/879289913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2880d1830 0x7ff2880d1ca0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff28806acf0 tx=0x7ff28000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b950b7c2df60b2a5 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff27f7fe700 1 -- 172.21.15.69:0/879289913 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28000e070 con 0x7ff2880d1830 2023-11-17T06:30:43.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff27f7fe700 1 -- 172.21.15.69:0/879289913 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28000bb20 con 0x7ff2880d1830 2023-11-17T06:30:43.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff27f7fe700 1 -- 172.21.15.69:0/879289913 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280012430 con 0x7ff2880d1830 2023-11-17T06:30:43.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28ef06700 1 -- 172.21.15.69:0/879289913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2880d1830 msgr2=0x7ff2880d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28ef06700 1 --2- 172.21.15.69:0/879289913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2880d1830 0x7ff2880d1ca0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff28806acf0 tx=0x7ff28000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:43.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28ef06700 1 -- 172.21.15.69:0/879289913 shutdown_connections 2023-11-17T06:30:43.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28ef06700 1 --2- 172.21.15.69:0/879289913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2880d1830 0x7ff2880d1ca0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28ef06700 1 --2- 172.21.15.69:0/879289913 >> v2:172.21.15.93:3300/0 conn(0x7ff28815d5d0 0x7ff2880d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28ef06700 1 -- 172.21.15.69:0/879289913 >> 172.21.15.69:0/879289913 conn(0x7ff2880d3250 msgr2=0x7ff2880d3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:43.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28ef06700 1 -- 172.21.15.69:0/879289913 shutdown_connections 2023-11-17T06:30:43.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.663+0000 7ff28ef06700 1 -- 172.21.15.69:0/879289913 wait complete. 2023-11-17T06:30:43.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.667+0000 7ff28ef06700 1 Processor -- start 2023-11-17T06:30:43.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.667+0000 7ff28ef06700 1 -- start start 2023-11-17T06:30:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.667+0000 7ff28ef06700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2880ce820 0x7ff2881515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.667+0000 7ff28ef06700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff2880d1830 0x7ff2880cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.667+0000 7ff28ef06700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28815d5d0 0x7ff2880ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.667+0000 7ff28ef06700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff288151ae0 con 0x7ff28815d5d0 2023-11-17T06:30:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.667+0000 7ff28ef06700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880cb7e0 con 0x7ff2880ce820 2023-11-17T06:30:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.667+0000 7ff28ef06700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880cbac0 con 0x7ff2880d1830 2023-11-17T06:30:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28d4a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28815d5d0 0x7ff2880ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28d4a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28815d5d0 0x7ff2880ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43412/0 (socket says 172.21.15.69:43412) 2023-11-17T06:30:43.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28d4a3700 1 -- 172.21.15.69:0/2704975586 learned_addr learned my addr 172.21.15.69:0/2704975586 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:43.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28cca2700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2880ce820 0x7ff2881515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28d4a3700 1 -- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff2880d1830 msgr2=0x7ff2880cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28d4a3700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff2880d1830 0x7ff2880cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28d4a3700 1 -- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2880ce820 msgr2=0x7ff2881515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28d4a3700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2880ce820 0x7ff2881515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28d4a3700 1 -- 172.21.15.69:0/2704975586 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2840094b0 con 0x7ff28815d5d0 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28cca2700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2880ce820 0x7ff2881515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28d4a3700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28815d5d0 0x7ff2880ccae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff280014040 tx=0x7ff280004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff27d7fa700 1 -- 172.21.15.69:0/2704975586 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280012430 con 0x7ff28815d5d0 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff27d7fa700 1 -- 172.21.15.69:0/2704975586 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280020070 con 0x7ff28815d5d0 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28ef06700 1 -- 172.21.15.69:0/2704975586 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff280009a70 con 0x7ff28815d5d0 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff27d7fa700 1 -- 172.21.15.69:0/2704975586 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280004280 con 0x7ff28815d5d0 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28ef06700 1 -- 172.21.15.69:0/2704975586 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2880cc080 con 0x7ff28815d5d0 2023-11-17T06:30:43.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.671+0000 7ff28ef06700 1 -- 172.21.15.69:0/2704975586 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2880cc2a0 con 0x7ff28815d5d0 2023-11-17T06:30:43.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.675+0000 7ff27d7fa700 1 -- 172.21.15.69:0/2704975586 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff2800043e0 con 0x7ff28815d5d0 2023-11-17T06:30:43.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.675+0000 7ff27d7fa700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff274066540 0x7ff274068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:43.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.675+0000 7ff27d7fa700 1 -- 172.21.15.69:0/2704975586 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff280022070 con 0x7ff28815d5d0 2023-11-17T06:30:43.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.675+0000 7ff28cca2700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff274066540 0x7ff274068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:43.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.675+0000 7ff28cca2700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff274066540 0x7ff274068a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff28815be00 tx=0x7ff284008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:43.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.679+0000 7ff27d7fa700 1 -- 172.21.15.69:0/2704975586 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff280053350 con 0x7ff28815d5d0 2023-11-17T06:30:43.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.851+0000 7ff28ef06700 1 -- 172.21.15.69:0/2704975586 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2880686a0 con 0x7ff28815d5d0 2023-11-17T06:30:43.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.851+0000 7ff27d7fa700 1 -- 172.21.15.69:0/2704975586 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff280056970 con 0x7ff28815d5d0 2023-11-17T06:30:43.858 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:43.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 -- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff274066540 msgr2=0x7ff274068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff274066540 0x7ff274068a00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff28815be00 tx=0x7ff284008040 comp rx=0 tx=0).stop 2023-11-17T06:30:43.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 -- 172.21.15.69:0/2704975586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28815d5d0 msgr2=0x7ff2880ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:43.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28815d5d0 0x7ff2880ccae0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff280014040 tx=0x7ff280004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 -- 172.21.15.69:0/2704975586 shutdown_connections 2023-11-17T06:30:43.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff274066540 0x7ff274068a00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28815d5d0 0x7ff2880ccae0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff2880d1830 0x7ff2880cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 --2- 172.21.15.69:0/2704975586 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2880ce820 0x7ff2881515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:43.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 -- 172.21.15.69:0/2704975586 >> 172.21.15.69:0/2704975586 conn(0x7ff2880d3250 msgr2=0x7ff28806c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:43.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 -- 172.21.15.69:0/2704975586 shutdown_connections 2023-11-17T06:30:43.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:43.855+0000 7ff28ef06700 1 -- 172.21.15.69:0/2704975586 wait complete. 2023-11-17T06:30:43.885 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection' 2023-11-17T06:30:44.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.083+0000 7f60fe93c700 1 Processor -- start 2023-11-17T06:30:44.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.083+0000 7f60fe93c700 1 -- start start 2023-11-17T06:30:44.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60fe93c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f60f81617a0 0x7f60f80cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60fe93c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f80cbfc0 0x7f60f80ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60fe93c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f60f80ce5d0 0x7f60f80b0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60fe93c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f8166040 con 0x7f60f81617a0 2023-11-17T06:30:44.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60fe93c700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f80cc420 con 0x7f60f80ce5d0 2023-11-17T06:30:44.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60fe93c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f8165430 con 0x7f60f80cbfc0 2023-11-17T06:30:44.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f7fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f60f81617a0 0x7f60f80cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f7fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f60f81617a0 0x7f60f80cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44876/0 (socket says 172.21.15.69:44876) 2023-11-17T06:30:44.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f7fff700 1 -- 172.21.15.69:0/614958199 learned_addr learned my addr 172.21.15.69:0/614958199 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:44.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60ef7fe700 1 --2- 172.21.15.69:0/614958199 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f80cbfc0 0x7f60f80ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60fced9700 1 --2- 172.21.15.69:0/614958199 >> v2:172.21.15.93:3300/0 conn(0x7f60f80ce5d0 0x7f60f80b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f7fff700 1 -- 172.21.15.69:0/614958199 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f80cbfc0 msgr2=0x7f60f80ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:44.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f7fff700 1 --2- 172.21.15.69:0/614958199 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f80cbfc0 0x7f60f80ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f7fff700 1 -- 172.21.15.69:0/614958199 >> v2:172.21.15.93:3300/0 conn(0x7f60f80ce5d0 msgr2=0x7f60f80b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:44.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f7fff700 1 --2- 172.21.15.69:0/614958199 >> v2:172.21.15.93:3300/0 conn(0x7f60f80ce5d0 0x7f60f80b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f7fff700 1 -- 172.21.15.69:0/614958199 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f8165710 con 0x7f60f81617a0 2023-11-17T06:30:44.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60fced9700 1 --2- 172.21.15.69:0/614958199 >> v2:172.21.15.93:3300/0 conn(0x7f60f80ce5d0 0x7f60f80b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:44.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f7fff700 1 --2- 172.21.15.69:0/614958199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f81617a0 0x7f60f80cba80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f60f806fb60 tx=0x7f60e8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6707e92ad4c45c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:44.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f77fe700 1 -- 172.21.15.69:0/614958199 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8011830 con 0x7f60f81617a0 2023-11-17T06:30:44.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f77fe700 1 -- 172.21.15.69:0/614958199 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e8011990 con 0x7f60f81617a0 2023-11-17T06:30:44.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.087+0000 7f60f77fe700 1 -- 172.21.15.69:0/614958199 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8011d20 con 0x7f60f81617a0 2023-11-17T06:30:44.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.091+0000 7f60fe93c700 1 -- 172.21.15.69:0/614958199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f81617a0 msgr2=0x7f60f80cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.091+0000 7f60fe93c700 1 --2- 172.21.15.69:0/614958199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f81617a0 0x7f60f80cba80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f60f806fb60 tx=0x7f60e8009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.091+0000 7f60fe93c700 1 -- 172.21.15.69:0/614958199 shutdown_connections 2023-11-17T06:30:44.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.091+0000 7f60fe93c700 1 --2- 172.21.15.69:0/614958199 >> v2:172.21.15.93:3300/0 conn(0x7f60f80ce5d0 0x7f60f80b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.091+0000 7f60fe93c700 1 --2- 172.21.15.69:0/614958199 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f80cbfc0 0x7f60f80ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.091+0000 7f60fe93c700 1 --2- 172.21.15.69:0/614958199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f81617a0 0x7f60f80cba80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.091+0000 7f60fe93c700 1 -- 172.21.15.69:0/614958199 >> 172.21.15.69:0/614958199 conn(0x7f60f806a480 msgr2=0x7f60f806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:44.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.091+0000 7f60fe93c700 1 -- 172.21.15.69:0/614958199 shutdown_connections 2023-11-17T06:30:44.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.091+0000 7f60fe93c700 1 -- 172.21.15.69:0/614958199 wait complete. 2023-11-17T06:30:44.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60fe93c700 1 Processor -- start 2023-11-17T06:30:44.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60fe93c700 1 -- start start 2023-11-17T06:30:44.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60fe93c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60f80cbfc0 0x7f60f815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60fe93c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f80ce5d0 0x7f60f81520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60fe93c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f81617a0 0x7f60f80b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60fe93c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f81609a0 con 0x7f60f80ce5d0 2023-11-17T06:30:44.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60fe93c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f815b560 con 0x7f60f80cbfc0 2023-11-17T06:30:44.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60fe93c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f815b790 con 0x7f60f81617a0 2023-11-17T06:30:44.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60ef7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f80ce5d0 0x7f60f81520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60ef7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f80ce5d0 0x7f60f81520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44882/0 (socket says 172.21.15.69:44882) 2023-11-17T06:30:44.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60ef7fe700 1 -- 172.21.15.69:0/4035591903 learned_addr learned my addr 172.21.15.69:0/4035591903 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:44.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60fced9700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f81617a0 0x7f60f80b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.095+0000 7f60f7fff700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60f80cbfc0 0x7f60f815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60ef7fe700 1 -- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f81617a0 msgr2=0x7f60f80b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60ef7fe700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f81617a0 0x7f60f80b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60ef7fe700 1 -- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60f80cbfc0 msgr2=0x7f60f815b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:44.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60ef7fe700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60f80cbfc0 0x7f60f815b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:44.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60ef7fe700 1 -- 172.21.15.69:0/4035591903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e8009570 con 0x7f60f80ce5d0 2023-11-17T06:30:44.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60fced9700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f81617a0 0x7f60f80b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:44.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60ef7fe700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f80ce5d0 0x7f60f81520d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f60e000e960 tx=0x7f60e000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:44.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60f57fa700 1 -- 172.21.15.69:0/4035591903 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e00096c0 con 0x7f60f80ce5d0 2023-11-17T06:30:44.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60f57fa700 1 -- 172.21.15.69:0/4035591903 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e000c850 con 0x7f60f80ce5d0 2023-11-17T06:30:44.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60fe93c700 1 -- 172.21.15.69:0/4035591903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f80c43d0 con 0x7f60f80ce5d0 2023-11-17T06:30:44.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60f57fa700 1 -- 172.21.15.69:0/4035591903 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000cbe0 con 0x7f60f80ce5d0 2023-11-17T06:30:44.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60fe93c700 1 -- 172.21.15.69:0/4035591903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f80c4990 con 0x7f60f80ce5d0 2023-11-17T06:30:44.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.099+0000 7f60fe93c700 1 -- 172.21.15.69:0/4035591903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f8073f00 con 0x7f60f80ce5d0 2023-11-17T06:30:44.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.103+0000 7f60f57fa700 1 -- 172.21.15.69:0/4035591903 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f60e000cd40 con 0x7f60f80ce5d0 2023-11-17T06:30:44.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.103+0000 7f60f57fa700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60d8066510 0x7f60d80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:44.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.103+0000 7f60f57fa700 1 -- 172.21.15.69:0/4035591903 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f60e0083f50 con 0x7f60f80ce5d0 2023-11-17T06:30:44.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.103+0000 7f60f7fff700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60d8066510 0x7f60d80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:44.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.103+0000 7f60f7fff700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60d8066510 0x7f60d80689d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f60e8000c00 tx=0x7f60e8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:44.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.107+0000 7f60f57fa700 1 -- 172.21.15.69:0/4035591903 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f60e00513b0 con 0x7f60f80ce5d0 2023-11-17T06:30:44.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:44.343+0000 7f60fe93c700 1 -- 172.21.15.69:0/4035591903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]} v 0) v1 -- 0x7f60f80b4d40 con 0x7f60f80ce5d0 2023-11-17T06:30:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.167+0000 7f60f57fa700 1 -- 172.21.15.69:0/4035591903 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]}]=0 v84) v1 ==== 148+0+0 (secure 0 0 0) 0x7f60e00549d0 con 0x7f60f80ce5d0 2023-11-17T06:30:45.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 -- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60d8066510 msgr2=0x7f60d80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60d8066510 0x7f60d80689d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f60e8000c00 tx=0x7f60e8008030 comp rx=0 tx=0).stop 2023-11-17T06:30:45.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 -- 172.21.15.69:0/4035591903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f80ce5d0 msgr2=0x7f60f81520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f80ce5d0 0x7f60f81520d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f60e000e960 tx=0x7f60e000ed20 comp rx=0 tx=0).stop 2023-11-17T06:30:45.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 -- 172.21.15.69:0/4035591903 shutdown_connections 2023-11-17T06:30:45.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60d8066510 0x7f60d80689d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f60f81617a0 0x7f60f80b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60f80ce5d0 0x7f60f81520d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 --2- 172.21.15.69:0/4035591903 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60f80cbfc0 0x7f60f815b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 -- 172.21.15.69:0/4035591903 >> 172.21.15.69:0/4035591903 conn(0x7f60f806a480 msgr2=0x7f60f80cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:45.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 -- 172.21.15.69:0/4035591903 shutdown_connections 2023-11-17T06:30:45.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.171+0000 7f60fe93c700 1 -- 172.21.15.69:0/4035591903 wait complete. 2023-11-17T06:30:45.204 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-17T06:30:45.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.387+0000 7ff91cf2b700 1 Processor -- start 2023-11-17T06:30:45.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.387+0000 7ff91cf2b700 1 -- start start 2023-11-17T06:30:45.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91cf2b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff9180c94d0 0x7ff9180c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91cf2b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff9180cde00 0x7ff91806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91cf2b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91806be10 con 0x7ff9180ccee0 2023-11-17T06:30:45.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91cf2b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9180c9df0 con 0x7ff9180c94d0 2023-11-17T06:30:45.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91cf2b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91806c060 con 0x7ff9180cde00 2023-11-17T06:30:45.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff915d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ff9180ccee0 0x7ff91806fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59614/0 (socket says 172.21.15.69:59614) 2023-11-17T06:30:45.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff915d9b700 1 -- 172.21.15.69:0/1260903312 learned_addr learned my addr 172.21.15.69:0/1260903312 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:45.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91659c700 1 --2- 172.21.15.69:0/1260903312 >> v2:172.21.15.69:3300/0 conn(0x7ff9180c94d0 0x7ff9180c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff916d9d700 1 --2- 172.21.15.69:0/1260903312 >> v2:172.21.15.93:3300/0 conn(0x7ff9180cde00 0x7ff91806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91659c700 1 -- 172.21.15.69:0/1260903312 >> v2:172.21.15.93:3300/0 conn(0x7ff9180cde00 msgr2=0x7ff91806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:45.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91659c700 1 --2- 172.21.15.69:0/1260903312 >> v2:172.21.15.93:3300/0 conn(0x7ff9180cde00 0x7ff91806ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91559a700 1 -- 172.21.15.69:0/1260903312 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438489750 0 0) 0x7ff91806be10 con 0x7ff9180ccee0 2023-11-17T06:30:45.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91659c700 1 -- 172.21.15.69:0/1260903312 >> v1:172.21.15.69:6789/0 conn(0x7ff9180ccee0 legacy=0x7ff91806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91659c700 1 -- 172.21.15.69:0/1260903312 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91806c340 con 0x7ff9180c94d0 2023-11-17T06:30:45.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91659c700 1 --2- 172.21.15.69:0/1260903312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 0x7ff9180c98b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff918072780 tx=0x7ff908009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382b8dc686248d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:45.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91559a700 1 -- 172.21.15.69:0/1260903312 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908011830 con 0x7ff9180c94d0 2023-11-17T06:30:45.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91559a700 1 -- 172.21.15.69:0/1260903312 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908011990 con 0x7ff9180c94d0 2023-11-17T06:30:45.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.391+0000 7ff91559a700 1 -- 172.21.15.69:0/1260903312 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff908011d40 con 0x7ff9180c94d0 2023-11-17T06:30:45.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.395+0000 7ff91cf2b700 1 -- 172.21.15.69:0/1260903312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 msgr2=0x7ff9180c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.395+0000 7ff91cf2b700 1 --2- 172.21.15.69:0/1260903312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 0x7ff9180c98b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff918072780 tx=0x7ff908009b30 comp rx=0 tx=0).stop 2023-11-17T06:30:45.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.395+0000 7ff91cf2b700 1 -- 172.21.15.69:0/1260903312 shutdown_connections 2023-11-17T06:30:45.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.395+0000 7ff91cf2b700 1 --2- 172.21.15.69:0/1260903312 >> v2:172.21.15.93:3300/0 conn(0x7ff9180cde00 0x7ff91806ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.395+0000 7ff91cf2b700 1 --2- 172.21.15.69:0/1260903312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 0x7ff9180c98b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.395+0000 7ff91cf2b700 1 -- 172.21.15.69:0/1260903312 >> 172.21.15.69:0/1260903312 conn(0x7ff9180cee80 msgr2=0x7ff9180cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:45.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.395+0000 7ff91cf2b700 1 -- 172.21.15.69:0/1260903312 shutdown_connections 2023-11-17T06:30:45.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.395+0000 7ff91cf2b700 1 -- 172.21.15.69:0/1260903312 wait complete. 2023-11-17T06:30:45.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.395+0000 7ff91cf2b700 1 Processor -- start 2023-11-17T06:30:45.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91cf2b700 1 -- start start 2023-11-17T06:30:45.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91cf2b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 0x7ff91815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91cf2b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9180cde00 0x7ff9180af160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91cf2b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff9180c8f50 0x7ff9180b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91cf2b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c3d60 con 0x7ff9180c94d0 2023-11-17T06:30:45.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91cf2b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c83e0 con 0x7ff9180cde00 2023-11-17T06:30:45.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91cf2b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180c7b40 con 0x7ff9180c8f50 2023-11-17T06:30:45.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 0x7ff91815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 0x7ff91815bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44894/0 (socket says 172.21.15.69:44894) 2023-11-17T06:30:45.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91659c700 1 -- 172.21.15.69:0/3789216181 learned_addr learned my addr 172.21.15.69:0/3789216181 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:45.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff916d9d700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff9180c8f50 0x7ff9180b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff915d9b700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9180cde00 0x7ff9180af160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91659c700 1 -- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff9180c8f50 msgr2=0x7ff9180b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91659c700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff9180c8f50 0x7ff9180b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91659c700 1 -- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9180cde00 msgr2=0x7ff9180af160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91659c700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9180cde00 0x7ff9180af160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91659c700 1 -- 172.21.15.69:0/3789216181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9080094b0 con 0x7ff9180c94d0 2023-11-17T06:30:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff916d9d700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff9180c8f50 0x7ff9180b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff915d9b700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9180cde00 0x7ff9180af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff91659c700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 0x7ff91815bf80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff9080090b0 tx=0x7ff908004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff906ffd700 1 -- 172.21.15.69:0/3789216181 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90801aac0 con 0x7ff9180c94d0 2023-11-17T06:30:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.399+0000 7ff906ffd700 1 -- 172.21.15.69:0/3789216181 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90801f070 con 0x7ff9180c94d0 2023-11-17T06:30:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.403+0000 7ff91cf2b700 1 -- 172.21.15.69:0/3789216181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9180c7e20 con 0x7ff9180c94d0 2023-11-17T06:30:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.403+0000 7ff906ffd700 1 -- 172.21.15.69:0/3789216181 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff90801ae80 con 0x7ff9180c94d0 2023-11-17T06:30:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.403+0000 7ff91cf2b700 1 -- 172.21.15.69:0/3789216181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91815c4c0 con 0x7ff9180c94d0 2023-11-17T06:30:45.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.403+0000 7ff91cf2b700 1 -- 172.21.15.69:0/3789216181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff918073f00 con 0x7ff9180c94d0 2023-11-17T06:30:45.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.403+0000 7ff906ffd700 1 -- 172.21.15.69:0/3789216181 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff90801b430 con 0x7ff9180c94d0 2023-11-17T06:30:45.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.407+0000 7ff906ffd700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff8f8066510 0x7ff8f80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:45.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.407+0000 7ff906ffd700 1 -- 172.21.15.69:0/3789216181 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff908085050 con 0x7ff9180c94d0 2023-11-17T06:30:45.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.407+0000 7ff915d9b700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff8f8066510 0x7ff8f80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:45.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.407+0000 7ff915d9b700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff8f8066510 0x7ff8f80689d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9180c8ca0 tx=0x7ff90c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:45.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.411+0000 7ff906ffd700 1 -- 172.21.15.69:0/3789216181 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff9080524c0 con 0x7ff9180c94d0 2023-11-17T06:30:45.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.587+0000 7ff91cf2b700 1 -- 172.21.15.69:0/3789216181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff9180cfb50 con 0x7ff9180c94d0 2023-11-17T06:30:45.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.595+0000 7ff906ffd700 1 -- 172.21.15.69:0/3789216181 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff908006ce0 con 0x7ff9180c94d0 2023-11-17T06:30:45.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 -- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff8f8066510 msgr2=0x7ff8f80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff8f8066510 0x7ff8f80689d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff9180c8ca0 tx=0x7ff90c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:45.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 -- 172.21.15.69:0/3789216181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 msgr2=0x7ff91815bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:45.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 0x7ff91815bf80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff9080090b0 tx=0x7ff908004770 comp rx=0 tx=0).stop 2023-11-17T06:30:45.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 -- 172.21.15.69:0/3789216181 shutdown_connections 2023-11-17T06:30:45.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff8f8066510 0x7ff8f80689d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff9180c8f50 0x7ff9180b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff9180cde00 0x7ff9180af160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 --2- 172.21.15.69:0/3789216181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9180c94d0 0x7ff91815bf80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:45.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 -- 172.21.15.69:0/3789216181 >> 172.21.15.69:0/3789216181 conn(0x7ff9180cee80 msgr2=0x7ff9180ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:45.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 -- 172.21.15.69:0/3789216181 shutdown_connections 2023-11-17T06:30:45.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:45.599+0000 7ff91cf2b700 1 -- 172.21.15.69:0/3789216181 wait complete. 2023-11-17T06:30:45.627 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-17T06:30:45.627 DEBUG:teuthology.orchestra.run.smithi069:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-17T06:30:45.672 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-17T06:30:45.717 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-17T06:30:45.717 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:30:45.717 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:45.738 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:30:45.738 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:45.798 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:46.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.019+0000 7ffbeb841700 1 Processor -- start 2023-11-17T06:30:46.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.019+0000 7ffbeb841700 1 -- start start 2023-11-17T06:30:46.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbeb841700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffbe41617a0 0x7ffbe40cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbeb841700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbe40cbfc0 0x7ffbe40ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbeb841700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbe4166040 con 0x7ffbe40ce5d0 2023-11-17T06:30:46.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbeb841700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbe4165430 con 0x7ffbe41617a0 2023-11-17T06:30:46.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbeb841700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe4165710 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbe95dd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffbe41617a0 0x7ffbe40cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbe95dd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffbe41617a0 0x7ffbe40cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44908/0 (socket says 172.21.15.69:44908) 2023-11-17T06:30:46.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbe95dd700 1 -- 172.21.15.69:0/2817958879 learned_addr learned my addr 172.21.15.69:0/2817958879 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:46.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbe8ddc700 1 --2- 172.21.15.69:0/2817958879 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbe40cbfc0 0x7ffbe40ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbe95dd700 1 -- 172.21.15.69:0/2817958879 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbe40cbfc0 msgr2=0x7ffbe40ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:46.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbe95dd700 1 --2- 172.21.15.69:0/2817958879 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbe40cbfc0 0x7ffbe40ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbe95dd700 1 -- 172.21.15.69:0/2817958879 >> v1:172.21.15.93:6789/0 conn(0x7ffbe40ce5d0 legacy=0x7ffbe40b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbe95dd700 1 -- 172.21.15.69:0/2817958879 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe40cc420 con 0x7ffbe41617a0 2023-11-17T06:30:46.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbe95dd700 1 --2- 172.21.15.69:0/2817958879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe41617a0 0x7ffbe40cba80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009910 tx=0x7ffbe0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227bd846d7793e8c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbdbfff700 1 -- 172.21.15.69:0/2817958879 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0011830 con 0x7ffbe41617a0 2023-11-17T06:30:46.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbdbfff700 1 -- 172.21.15.69:0/2817958879 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe0011990 con 0x7ffbe41617a0 2023-11-17T06:30:46.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.023+0000 7ffbdbfff700 1 -- 172.21.15.69:0/2817958879 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0011d40 con 0x7ffbe41617a0 2023-11-17T06:30:46.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.027+0000 7ffbeb841700 1 -- 172.21.15.69:0/2817958879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe41617a0 msgr2=0x7ffbe40cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.027+0000 7ffbeb841700 1 --2- 172.21.15.69:0/2817958879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe41617a0 0x7ffbe40cba80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009910 tx=0x7ffbe0009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:46.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.027+0000 7ffbeb841700 1 -- 172.21.15.69:0/2817958879 shutdown_connections 2023-11-17T06:30:46.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.027+0000 7ffbeb841700 1 --2- 172.21.15.69:0/2817958879 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbe40cbfc0 0x7ffbe40ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.027+0000 7ffbeb841700 1 --2- 172.21.15.69:0/2817958879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe41617a0 0x7ffbe40cba80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.027+0000 7ffbeb841700 1 -- 172.21.15.69:0/2817958879 >> 172.21.15.69:0/2817958879 conn(0x7ffbe406a480 msgr2=0x7ffbe406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:46.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.027+0000 7ffbeb841700 1 -- 172.21.15.69:0/2817958879 shutdown_connections 2023-11-17T06:30:46.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.027+0000 7ffbeb841700 1 -- 172.21.15.69:0/2817958879 wait complete. 2023-11-17T06:30:46.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.027+0000 7ffbeb841700 1 Processor -- start 2023-11-17T06:30:46.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.027+0000 7ffbeb841700 1 -- start start 2023-11-17T06:30:46.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbeb841700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe40cbfc0 0x7ffbe41f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbeb841700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbe40ce5d0 0x7ffbe40b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbeb841700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe41617a0 0x7ffbe4163160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbeb841700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe415d360 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbeb841700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe41f9ff0 con 0x7ffbe41617a0 2023-11-17T06:30:46.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbeb841700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbe40b2ee0 con 0x7ffbe40ce5d0 2023-11-17T06:30:46.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe95dd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe40cbfc0 0x7ffbe41f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe95dd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe40cbfc0 0x7ffbe41f9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44922/0 (socket says 172.21.15.69:44922) 2023-11-17T06:30:46.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe95dd700 1 -- 172.21.15.69:0/2551079604 learned_addr learned my addr 172.21.15.69:0/2551079604 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:46.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe9dde700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe41617a0 0x7ffbe4163160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe8ddc700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbe40ce5d0 0x7ffbe40b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe95dd700 1 -- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbe40ce5d0 msgr2=0x7ffbe40b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe95dd700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbe40ce5d0 0x7ffbe40b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe95dd700 1 -- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe41617a0 msgr2=0x7ffbe4163160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe95dd700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe41617a0 0x7ffbe4163160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe95dd700 1 -- 172.21.15.69:0/2551079604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe0009570 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbe95dd700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe40cbfc0 0x7ffbe41f9ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009c60 tx=0x7ffbe0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbd9ffb700 1 -- 172.21.15.69:0/2551079604 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe0004300 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbd9ffb700 1 -- 172.21.15.69:0/2551079604 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbe001f070 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbd9ffb700 1 -- 172.21.15.69:0/2551079604 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbe00036c0 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.031+0000 7ffbeb841700 1 -- 172.21.15.69:0/2551079604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe40b31c0 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.035+0000 7ffbeb841700 1 -- 172.21.15.69:0/2551079604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe40b3780 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.035+0000 7ffbeb841700 1 -- 172.21.15.69:0/2551079604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbe4073f00 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.035+0000 7ffbd9ffb700 1 -- 172.21.15.69:0/2551079604 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffbe0021030 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.039+0000 7ffbd9ffb700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffbc8066510 0x7ffbc80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.039+0000 7ffbd9ffb700 1 -- 172.21.15.69:0/2551079604 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ffbe00851b0 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.039+0000 7ffbe8ddc700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffbc8066510 0x7ffbc80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.039+0000 7ffbe8ddc700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffbc8066510 0x7ffbc80689d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40cb7e0 tx=0x7ffbd4009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.043+0000 7ffbd9ffb700 1 -- 172.21.15.69:0/2551079604 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffbe0052590 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.223+0000 7ffbeb841700 1 -- 172.21.15.69:0/2551079604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbe40c9940 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.223+0000 7ffbd9ffb700 1 -- 172.21.15.69:0/2551079604 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7ffbe0055bb0 con 0x7ffbe40cbfc0 2023-11-17T06:30:46.230 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:46.230 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:46.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 -- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffbc8066510 msgr2=0x7ffbc80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffbc8066510 0x7ffbc80689d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40cb7e0 tx=0x7ffbd4009240 comp rx=0 tx=0).stop 2023-11-17T06:30:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 -- 172.21.15.69:0/2551079604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe40cbfc0 msgr2=0x7ffbe41f9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe40cbfc0 0x7ffbe41f9ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ffbe0009c60 tx=0x7ffbe0004770 comp rx=0 tx=0).stop 2023-11-17T06:30:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 -- 172.21.15.69:0/2551079604 shutdown_connections 2023-11-17T06:30:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffbc8066510 0x7ffbc80689d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffbe41617a0 0x7ffbe4163160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffbe40ce5d0 0x7ffbe40b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 --2- 172.21.15.69:0/2551079604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbe40cbfc0 0x7ffbe41f9ab0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 -- 172.21.15.69:0/2551079604 >> 172.21.15.69:0/2551079604 conn(0x7ffbe406a480 msgr2=0x7ffbe406a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 -- 172.21.15.69:0/2551079604 shutdown_connections 2023-11-17T06:30:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.227+0000 7ffbeb841700 1 -- 172.21.15.69:0/2551079604 wait complete. 2023-11-17T06:30:46.255 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:46.255 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:46.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.423+0000 7f623939f700 1 Processor -- start 2023-11-17T06:30:46.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.423+0000 7f623939f700 1 -- start start 2023-11-17T06:30:46.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f623939f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f623415d490 0x7f62340b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f623939f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f62340d13d0 0x7f62340cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f623939f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62340ce770 con 0x7f62340ce310 2023-11-17T06:30:46.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f623939f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62340d1bb0 con 0x7f623415d490 2023-11-17T06:30:46.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f623939f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62340d1e90 con 0x7f62340d13d0 2023-11-17T06:30:46.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f6233fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f623415d490 0x7f62340b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f6233fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f623415d490 0x7f62340b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44930/0 (socket says 172.21.15.69:44930) 2023-11-17T06:30:46.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f6233fff700 1 -- 172.21.15.69:0/4172542018 learned_addr learned my addr 172.21.15.69:0/4172542018 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:46.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f62337fe700 1 --2- 172.21.15.69:0/4172542018 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f62340d13d0 0x7f62340cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f6233fff700 1 -- 172.21.15.69:0/4172542018 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f62340d13d0 msgr2=0x7f62340cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:46.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f6233fff700 1 --2- 172.21.15.69:0/4172542018 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f62340d13d0 0x7f62340cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f6233fff700 1 -- 172.21.15.69:0/4172542018 >> v1:172.21.15.93:6789/0 conn(0x7f62340ce310 legacy=0x7f62340b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f6233fff700 1 -- 172.21.15.69:0/4172542018 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62340d2170 con 0x7f623415d490 2023-11-17T06:30:46.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f6233fff700 1 --2- 172.21.15.69:0/4172542018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f623415d490 0x7f62340b8bc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6224009910 tx=0x7f6224009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ca6e7bb90ed1d4 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.427+0000 7f6232ffd700 1 -- 172.21.15.69:0/4172542018 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622400ba60 con 0x7f623415d490 2023-11-17T06:30:46.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f6232ffd700 1 -- 172.21.15.69:0/4172542018 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622400bbc0 con 0x7f623415d490 2023-11-17T06:30:46.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f6232ffd700 1 -- 172.21.15.69:0/4172542018 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224009e60 con 0x7f623415d490 2023-11-17T06:30:46.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f623939f700 1 -- 172.21.15.69:0/4172542018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f623415d490 msgr2=0x7f62340b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f623939f700 1 --2- 172.21.15.69:0/4172542018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f623415d490 0x7f62340b8bc0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6224009910 tx=0x7f6224009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:46.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f623939f700 1 -- 172.21.15.69:0/4172542018 shutdown_connections 2023-11-17T06:30:46.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f623939f700 1 --2- 172.21.15.69:0/4172542018 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f62340d13d0 0x7f62340cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f623939f700 1 --2- 172.21.15.69:0/4172542018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f623415d490 0x7f62340b8bc0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f623939f700 1 -- 172.21.15.69:0/4172542018 >> 172.21.15.69:0/4172542018 conn(0x7f623406ab40 msgr2=0x7f623406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:46.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f623939f700 1 -- 172.21.15.69:0/4172542018 shutdown_connections 2023-11-17T06:30:46.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f623939f700 1 -- 172.21.15.69:0/4172542018 wait complete. 2023-11-17T06:30:46.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.431+0000 7f623939f700 1 Processor -- start 2023-11-17T06:30:46.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f623939f700 1 -- start start 2023-11-17T06:30:46.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f623939f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62340ce310 0x7f62341f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f623939f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62340d13d0 0x7f62340cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f623939f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f623415d490 0x7f62340cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f623939f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f623415f570 con 0x7f62340d13d0 2023-11-17T06:30:46.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f623939f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6234160530 con 0x7f62340ce310 2023-11-17T06:30:46.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f623939f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623415e960 con 0x7f623415d490 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f62337fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62340d13d0 0x7f62340cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f62337fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62340d13d0 0x7f62340cfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44942/0 (socket says 172.21.15.69:44942) 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f62337fe700 1 -- 172.21.15.69:0/1227384812 learned_addr learned my addr 172.21.15.69:0/1227384812 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f6233fff700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62340ce310 0x7f62341f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f6238b9e700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f623415d490 0x7f62340cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f6233fff700 1 -- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f623415d490 msgr2=0x7f62340cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f6233fff700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f623415d490 0x7f62340cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f6233fff700 1 -- 172.21.15.69:0/1227384812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62340d13d0 msgr2=0x7f62340cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f6233fff700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62340d13d0 0x7f62340cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f6233fff700 1 -- 172.21.15.69:0/1227384812 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6224009570 con 0x7f62340ce310 2023-11-17T06:30:46.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f62337fe700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62340d13d0 0x7f62340cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:46.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.435+0000 7f6233fff700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62340ce310 0x7f62341f23c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6224016000 tx=0x7f6224004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.439+0000 7f6230ff9700 1 -- 172.21.15.69:0/1227384812 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224004510 con 0x7f62340ce310 2023-11-17T06:30:46.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.439+0000 7f6230ff9700 1 -- 172.21.15.69:0/1227384812 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622401e070 con 0x7f62340ce310 2023-11-17T06:30:46.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.439+0000 7f6230ff9700 1 -- 172.21.15.69:0/1227384812 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224003900 con 0x7f62340ce310 2023-11-17T06:30:46.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.439+0000 7f623939f700 1 -- 172.21.15.69:0/1227384812 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f623415ec40 con 0x7f62340ce310 2023-11-17T06:30:46.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.439+0000 7f623939f700 1 -- 172.21.15.69:0/1227384812 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f623415f200 con 0x7f62340ce310 2023-11-17T06:30:46.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.439+0000 7f623939f700 1 -- 172.21.15.69:0/1227384812 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f623415f390 con 0x7f62340ce310 2023-11-17T06:30:46.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.439+0000 7f6230ff9700 1 -- 172.21.15.69:0/1227384812 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6224003a60 con 0x7f62340ce310 2023-11-17T06:30:46.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.443+0000 7f6230ff9700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6220066510 0x7f62200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.443+0000 7f6230ff9700 1 -- 172.21.15.69:0/1227384812 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6224020070 con 0x7f62340ce310 2023-11-17T06:30:46.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.443+0000 7f62337fe700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6220066510 0x7f62200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.443+0000 7f62337fe700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6220066510 0x7f62200689d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6234141b90 tx=0x7f6228008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.451+0000 7f6230ff9700 1 -- 172.21.15.69:0/1227384812 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6224052600 con 0x7f62340ce310 2023-11-17T06:30:46.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.627+0000 7f623939f700 1 -- 172.21.15.69:0/1227384812 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62340d2420 con 0x7f62340ce310 2023-11-17T06:30:46.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.627+0000 7f6230ff9700 1 -- 172.21.15.69:0/1227384812 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6224055c20 con 0x7f62340ce310 2023-11-17T06:30:46.634 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:46.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 -- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6220066510 msgr2=0x7f62200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6220066510 0x7f62200689d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6234141b90 tx=0x7f6228008040 comp rx=0 tx=0).stop 2023-11-17T06:30:46.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 -- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62340ce310 msgr2=0x7f62341f23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62340ce310 0x7f62341f23c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6224016000 tx=0x7f6224004770 comp rx=0 tx=0).stop 2023-11-17T06:30:46.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 -- 172.21.15.69:0/1227384812 shutdown_connections 2023-11-17T06:30:46.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6220066510 0x7f62200689d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f623415d490 0x7f62340cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62340d13d0 0x7f62340cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 --2- 172.21.15.69:0/1227384812 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62340ce310 0x7f62341f23c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 -- 172.21.15.69:0/1227384812 >> 172.21.15.69:0/1227384812 conn(0x7f623406ab40 msgr2=0x7f623415c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:46.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 -- 172.21.15.69:0/1227384812 shutdown_connections 2023-11-17T06:30:46.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.635+0000 7f623939f700 1 -- 172.21.15.69:0/1227384812 wait complete. 2023-11-17T06:30:46.662 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:46.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.835+0000 7f01063d0700 1 Processor -- start 2023-11-17T06:30:46.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f01063d0700 1 -- start start 2023-11-17T06:30:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f01063d0700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01001652b0 0x7f01000cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f01063d0700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010006c200 con 0x7f0100165740 2023-11-17T06:30:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f01063d0700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0100165d00 con 0x7f01000c21a0 2023-11-17T06:30:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f01063d0700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01001662c0 con 0x7f01001652b0 2023-11-17T06:30:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f0105bcf700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f0100165740 0x7f01000cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59628/0 (socket says 172.21.15.69:59628) 2023-11-17T06:30:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f0105bcf700 1 -- 172.21.15.69:0/759639472 learned_addr learned my addr 172.21.15.69:0/759639472 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:46.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f0104bcd700 1 --2- 172.21.15.69:0/759639472 >> v2:172.21.15.93:3300/0 conn(0x7f01001652b0 0x7f01000cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f00f7fff700 1 -- 172.21.15.69:0/759639472 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125087387 0 0) 0x7f010006c200 con 0x7f0100165740 2023-11-17T06:30:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f00f7fff700 1 -- 172.21.15.69:0/759639472 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ec0035d0 con 0x7f0100165740 2023-11-17T06:30:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f0104bcd700 1 -- 172.21.15.69:0/759639472 >> v1:172.21.15.93:6789/0 conn(0x7f01000c21a0 legacy=0x7f010006c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f0104bcd700 1 -- 172.21.15.69:0/759639472 >> v1:172.21.15.69:6789/0 conn(0x7f0100165740 legacy=0x7f01000cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f0104bcd700 1 -- 172.21.15.69:0/759639472 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0100165fe0 con 0x7f01001652b0 2023-11-17T06:30:46.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.839+0000 7f0104bcd700 1 --2- 172.21.15.69:0/759639472 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01001652b0 0x7f01000cb7e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009850 tx=0x7f00f0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d41e93997661a0f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.843+0000 7f00f7fff700 1 -- 172.21.15.69:0/759639472 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0011830 con 0x7f01001652b0 2023-11-17T06:30:46.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.843+0000 7f00f7fff700 1 -- 172.21.15.69:0/759639472 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f0011990 con 0x7f01001652b0 2023-11-17T06:30:46.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.843+0000 7f00f7fff700 1 -- 172.21.15.69:0/759639472 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0011d40 con 0x7f01001652b0 2023-11-17T06:30:46.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.843+0000 7f01063d0700 1 -- 172.21.15.69:0/759639472 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01001652b0 msgr2=0x7f01000cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.843+0000 7f01063d0700 1 --2- 172.21.15.69:0/759639472 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01001652b0 0x7f01000cb7e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009850 tx=0x7f00f0009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:46.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.843+0000 7f01063d0700 1 -- 172.21.15.69:0/759639472 shutdown_connections 2023-11-17T06:30:46.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.843+0000 7f01063d0700 1 --2- 172.21.15.69:0/759639472 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01001652b0 0x7f01000cb7e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.843+0000 7f01063d0700 1 -- 172.21.15.69:0/759639472 >> 172.21.15.69:0/759639472 conn(0x7f01000b0900 msgr2=0x7f01000b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:46.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.843+0000 7f01063d0700 1 -- 172.21.15.69:0/759639472 shutdown_connections 2023-11-17T06:30:46.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.843+0000 7f01063d0700 1 -- 172.21.15.69:0/759639472 wait complete. 2023-11-17T06:30:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.847+0000 7f01063d0700 1 Processor -- start 2023-11-17T06:30:46.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.847+0000 7f01063d0700 1 -- start start 2023-11-17T06:30:46.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01063d0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01000c21a0 0x7f01001fad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01053ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01000c21a0 0x7f01001fad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01053ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01000c21a0 0x7f01001fad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44946/0 (socket says 172.21.15.69:44946) 2023-11-17T06:30:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01063d0700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f01001652b0 0x7f01000b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01053ce700 1 -- 172.21.15.69:0/3996777170 learned_addr learned my addr 172.21.15.69:0/3996777170 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01063d0700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0100165740 0x7f01001f6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01001fb2d0 con 0x7f01000c21a0 2023-11-17T06:30:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01001fa340 con 0x7f0100165740 2023-11-17T06:30:46.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01001fa900 con 0x7f01001652b0 2023-11-17T06:30:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01053ce700 1 -- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f01001652b0 msgr2=0x7f01000b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01053ce700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f01001652b0 0x7f01000b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01053ce700 1 -- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0100165740 msgr2=0x7f01001f6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01053ce700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0100165740 0x7f01001f6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01053ce700 1 -- 172.21.15.69:0/3996777170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f00094b0 con 0x7f01000c21a0 2023-11-17T06:30:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01053ce700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01000c21a0 0x7f01001fad90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c500 tx=0x7f00fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f00f5ffb700 1 -- 172.21.15.69:0/3996777170 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0052d0 con 0x7f01000c21a0 2023-11-17T06:30:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f00f5ffb700 1 -- 172.21.15.69:0/3996777170 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc005430 con 0x7f01000c21a0 2023-11-17T06:30:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f00f5ffb700 1 -- 172.21.15.69:0/3996777170 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc0055a0 con 0x7f01000c21a0 2023-11-17T06:30:46.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01000b4af0 con 0x7f01000c21a0 2023-11-17T06:30:46.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.851+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01001f7b80 con 0x7f01000c21a0 2023-11-17T06:30:46.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.855+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0100073f00 con 0x7f01000c21a0 2023-11-17T06:30:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.855+0000 7f00f5ffb700 1 -- 172.21.15.69:0/3996777170 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f00fc0038e0 con 0x7f01000c21a0 2023-11-17T06:30:46.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.859+0000 7f00f5ffb700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00e4066510 0x7f00e40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:46.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.859+0000 7f00f5ffb700 1 -- 172.21.15.69:0/3996777170 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f00fc083310 con 0x7f01000c21a0 2023-11-17T06:30:46.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.859+0000 7f0104bcd700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00e4066510 0x7f00e40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:46.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.859+0000 7f0104bcd700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00e4066510 0x7f00e40689d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0100164d80 tx=0x7f00f0010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:46.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:46.863+0000 7f00f5ffb700 1 -- 172.21.15.69:0/3996777170 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f00fc050800 con 0x7f01000c21a0 2023-11-17T06:30:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.035+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0100073400 con 0x7f01000c21a0 2023-11-17T06:30:47.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.035+0000 7f00f5ffb700 1 -- 172.21.15.69:0/3996777170 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00fc053e20 con 0x7f01000c21a0 2023-11-17T06:30:47.043 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:47.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00e4066510 msgr2=0x7f00e40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00e4066510 0x7f00e40689d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0100164d80 tx=0x7f00f0010000 comp rx=0 tx=0).stop 2023-11-17T06:30:47.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01000c21a0 msgr2=0x7f01001fad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01000c21a0 0x7f01001fad90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f00fc00c500 tx=0x7f00fc00c8c0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 shutdown_connections 2023-11-17T06:30:47.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00e4066510 0x7f00e40689d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0100165740 0x7f01001f6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f01001652b0 0x7f01000b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 --2- 172.21.15.69:0/3996777170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01000c21a0 0x7f01001fad90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 >> 172.21.15.69:0/3996777170 conn(0x7f01000b0900 msgr2=0x7f01000cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:47.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 shutdown_connections 2023-11-17T06:30:47.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.039+0000 7f01063d0700 1 -- 172.21.15.69:0/3996777170 wait complete. 2023-11-17T06:30:47.066 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:47.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.235+0000 7fbd546ec700 1 Processor -- start 2023-11-17T06:30:47.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.235+0000 7fbd546ec700 1 -- start start 2023-11-17T06:30:47.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd546ec700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c15d5d0 0x7fbd4c0d1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd546ec700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbd4c0d1830 0x7fbd4c0d1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd546ec700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c0cf880 con 0x7fbd4c0ce820 2023-11-17T06:30:47.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd546ec700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0d2200 con 0x7fbd4c0d1830 2023-11-17T06:30:47.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd546ec700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0cefe0 con 0x7fbd4c15d5d0 2023-11-17T06:30:47.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd51c87700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fbd4c0ce820 0x7fbd4c0d05b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59644/0 (socket says 172.21.15.69:59644) 2023-11-17T06:30:47.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd51c87700 1 -- 172.21.15.69:0/4152556864 learned_addr learned my addr 172.21.15.69:0/4152556864 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:47.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd52c89700 1 --2- 172.21.15.69:0/4152556864 >> v2:172.21.15.93:3300/0 conn(0x7fbd4c0d1830 0x7fbd4c0d1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd52488700 1 --2- 172.21.15.69:0/4152556864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c15d5d0 0x7fbd4c0d1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd51486700 1 -- 172.21.15.69:0/4152556864 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 87160342 0 0) 0x7fbd4c0cf880 con 0x7fbd4c0ce820 2023-11-17T06:30:47.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd51486700 1 -- 172.21.15.69:0/4152556864 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd380035d0 con 0x7fbd4c0ce820 2023-11-17T06:30:47.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd52c89700 1 -- 172.21.15.69:0/4152556864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c15d5d0 msgr2=0x7fbd4c0d1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:47.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd52c89700 1 --2- 172.21.15.69:0/4152556864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c15d5d0 0x7fbd4c0d1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd52c89700 1 -- 172.21.15.69:0/4152556864 >> v1:172.21.15.69:6789/0 conn(0x7fbd4c0ce820 legacy=0x7fbd4c0d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd52c89700 1 -- 172.21.15.69:0/4152556864 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0cfad0 con 0x7fbd4c0d1830 2023-11-17T06:30:47.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.239+0000 7fbd52c89700 1 --2- 172.21.15.69:0/4152556864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd4c0d1830 0x7fbd4c0d1cc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009d90 tx=0x7fbd4400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8e33d659a1e70dc server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd51486700 1 -- 172.21.15.69:0/4152556864 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4400e070 con 0x7fbd4c0d1830 2023-11-17T06:30:47.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd51486700 1 -- 172.21.15.69:0/4152556864 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4400bb20 con 0x7fbd4c0d1830 2023-11-17T06:30:47.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd51486700 1 -- 172.21.15.69:0/4152556864 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44012430 con 0x7fbd4c0d1830 2023-11-17T06:30:47.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd546ec700 1 -- 172.21.15.69:0/4152556864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd4c0d1830 msgr2=0x7fbd4c0d1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd546ec700 1 --2- 172.21.15.69:0/4152556864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd4c0d1830 0x7fbd4c0d1cc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009d90 tx=0x7fbd4400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:47.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd546ec700 1 -- 172.21.15.69:0/4152556864 shutdown_connections 2023-11-17T06:30:47.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd546ec700 1 --2- 172.21.15.69:0/4152556864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd4c0d1830 0x7fbd4c0d1cc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd546ec700 1 --2- 172.21.15.69:0/4152556864 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c15d5d0 0x7fbd4c0d1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd546ec700 1 -- 172.21.15.69:0/4152556864 >> 172.21.15.69:0/4152556864 conn(0x7fbd4c0d3250 msgr2=0x7fbd4c0d3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:47.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd546ec700 1 -- 172.21.15.69:0/4152556864 shutdown_connections 2023-11-17T06:30:47.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd546ec700 1 -- 172.21.15.69:0/4152556864 wait complete. 2023-11-17T06:30:47.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.243+0000 7fbd546ec700 1 Processor -- start 2023-11-17T06:30:47.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd546ec700 1 -- start start 2023-11-17T06:30:47.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd546ec700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c0ce820 0x7fbd4c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd546ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbd4c0d1830 0x7fbd4c09e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd546ec700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd4c15d5d0 0x7fbd4c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd546ec700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15def0 con 0x7fbd4c0d1830 2023-11-17T06:30:47.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd546ec700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15e690 con 0x7fbd4c15d5d0 2023-11-17T06:30:47.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd546ec700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c15e970 con 0x7fbd4c0ce820 2023-11-17T06:30:47.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd51c87700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbd4c0d1830 0x7fbd4c09e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd52488700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c0ce820 0x7fbd4c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd51c87700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbd4c0d1830 0x7fbd4c09e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44962/0 (socket says 172.21.15.69:44962) 2023-11-17T06:30:47.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd52488700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c0ce820 0x7fbd4c15d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:35156/0 (socket says 172.21.15.69:35156) 2023-11-17T06:30:47.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd51c87700 1 -- 172.21.15.69:0/2337864324 learned_addr learned my addr 172.21.15.69:0/2337864324 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:47.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd52c89700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd4c15d5d0 0x7fbd4c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd51c87700 1 -- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c0ce820 msgr2=0x7fbd4c15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd51c87700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c0ce820 0x7fbd4c15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd51c87700 1 -- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd4c15d5d0 msgr2=0x7fbd4c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd51c87700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd4c15d5d0 0x7fbd4c15b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd51c87700 1 -- 172.21.15.69:0/2337864324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd44009a70 con 0x7fbd4c0d1830 2023-11-17T06:30:47.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd52c89700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd4c15d5d0 0x7fbd4c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:47.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd51c87700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbd4c0d1830 0x7fbd4c09e650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c4d0 tx=0x7fbd3c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd42ffd700 1 -- 172.21.15.69:0/2337864324 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c005d90 con 0x7fbd4c0d1830 2023-11-17T06:30:47.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd42ffd700 1 -- 172.21.15.69:0/2337864324 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c0070d0 con 0x7fbd4c0d1830 2023-11-17T06:30:47.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.247+0000 7fbd546ec700 1 -- 172.21.15.69:0/2337864324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c15ec50 con 0x7fbd4c0d1830 2023-11-17T06:30:47.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.251+0000 7fbd42ffd700 1 -- 172.21.15.69:0/2337864324 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c007480 con 0x7fbd4c0d1830 2023-11-17T06:30:47.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.251+0000 7fbd546ec700 1 -- 172.21.15.69:0/2337864324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c15f210 con 0x7fbd4c0d1830 2023-11-17T06:30:47.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.251+0000 7fbd546ec700 1 -- 172.21.15.69:0/2337864324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c0686a0 con 0x7fbd4c0d1830 2023-11-17T06:30:47.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.251+0000 7fbd42ffd700 1 -- 172.21.15.69:0/2337864324 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbd3c0075e0 con 0x7fbd4c0d1830 2023-11-17T06:30:47.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.255+0000 7fbd42ffd700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbd30066510 0x7fbd300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.255+0000 7fbd42ffd700 1 -- 172.21.15.69:0/2337864324 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbd3c083330 con 0x7fbd4c0d1830 2023-11-17T06:30:47.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.255+0000 7fbd52488700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbd30066510 0x7fbd300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.255+0000 7fbd52488700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbd30066510 0x7fbd300689d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009bf0 tx=0x7fbd48009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.259+0000 7fbd42ffd700 1 -- 172.21.15.69:0/2337864324 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbd3c050790 con 0x7fbd4c0d1830 2023-11-17T06:30:47.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.439+0000 7fbd546ec700 1 -- 172.21.15.69:0/2337864324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbd4c08c9a0 con 0x7fbd4c0d1830 2023-11-17T06:30:47.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd42ffd700 1 -- 172.21.15.69:0/2337864324 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbd3c053db0 con 0x7fbd4c0d1830 2023-11-17T06:30:47.449 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:47.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 -- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbd30066510 msgr2=0x7fbd300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbd30066510 0x7fbd300689d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009bf0 tx=0x7fbd48009240 comp rx=0 tx=0).stop 2023-11-17T06:30:47.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 -- 172.21.15.69:0/2337864324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbd4c0d1830 msgr2=0x7fbd4c09e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbd4c0d1830 0x7fbd4c09e650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c00c4d0 tx=0x7fbd3c00c7e0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 -- 172.21.15.69:0/2337864324 shutdown_connections 2023-11-17T06:30:47.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbd30066510 0x7fbd300689d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbd4c15d5d0 0x7fbd4c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbd4c0d1830 0x7fbd4c09e650 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 --2- 172.21.15.69:0/2337864324 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbd4c0ce820 0x7fbd4c15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 -- 172.21.15.69:0/2337864324 >> 172.21.15.69:0/2337864324 conn(0x7fbd4c0d3250 msgr2=0x7fbd4c15c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:47.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 -- 172.21.15.69:0/2337864324 shutdown_connections 2023-11-17T06:30:47.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.443+0000 7fbd546ec700 1 -- 172.21.15.69:0/2337864324 wait complete. 2023-11-17T06:30:47.469 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:47.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.639+0000 7f159ac96700 1 Processor -- start 2023-11-17T06:30:47.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.639+0000 7f159ac96700 1 -- start start 2023-11-17T06:30:47.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f159ac96700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f15940ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f159ac96700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1594166040 con 0x7f15941617a0 2023-11-17T06:30:47.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f159ac96700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1594165430 con 0x7f15940ce5d0 2023-11-17T06:30:47.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f159ac96700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1594165710 con 0x7f15940cc190 2023-11-17T06:30:47.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1598a32700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f15941617a0 0x7f15940cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59648/0 (socket says 172.21.15.69:59648) 2023-11-17T06:30:47.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1598a32700 1 -- 172.21.15.69:0/2218710581 learned_addr learned my addr 172.21.15.69:0/2218710581 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:47.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1593fff700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f15940ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542631029 0 0) 0x7f1594166040 con 0x7f15941617a0 2023-11-17T06:30:47.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15840035d0 con 0x7f15941617a0 2023-11-17T06:30:47.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1391429667 0 0) 0x7f15840035d0 con 0x7f15941617a0 2023-11-17T06:30:47.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 msgr2=0x7f15940ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f15940ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 >> v1:172.21.15.93:6789/0 conn(0x7f15940ce5d0 legacy=0x7f15940cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15941659f0 con 0x7f15941617a0 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f1588001670 con 0x7f15941617a0 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 >> v1:172.21.15.69:6789/0 conn(0x7f15941617a0 legacy=0x7f15940cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f1584003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1584004080 0x7f1584004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1584004db0 0x7f1584005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594165710 con 0x7f1584004080 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158400bbf0 con 0x7f1584004db0 2023-11-17T06:30:47.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158400bdb0 con 0x7f15940cc190 2023-11-17T06:30:47.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1593fff700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1584004080 0x7f1584004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1598a32700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f1584003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1599233700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1584004db0 0x7f1584005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1598a32700 1 -- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1584004db0 msgr2=0x7f1584005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:47.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1598a32700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1584004db0 0x7f1584005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1598a32700 1 -- 172.21.15.69:0/2218710581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1584004080 msgr2=0x7f1584004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:47.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1598a32700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1584004080 0x7f1584004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1598a32700 1 -- 172.21.15.69:0/2218710581 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15840035d0 con 0x7f15940cc190 2023-11-17T06:30:47.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.643+0000 7f1598a32700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f1584003a50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f158800c320 tx=0x7f15840058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc2ee4c124a096c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.647+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588007c30 con 0x7f15940cc190 2023-11-17T06:30:47.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.647+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158800ce80 con 0x7f15940cc190 2023-11-17T06:30:47.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.647+0000 7f15937fe700 1 -- 172.21.15.69:0/2218710581 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588005bc0 con 0x7f15940cc190 2023-11-17T06:30:47.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.647+0000 7f159ac96700 1 -- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 msgr2=0x7f1584003a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.647+0000 7f159ac96700 1 --2- 172.21.15.69:0/2218710581 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f1584003a50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f158800c320 tx=0x7f15840058a0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.647+0000 7f1599233700 1 -- 172.21.15.69:0/2218710581 reap_dead start 2023-11-17T06:30:47.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.647+0000 7f159ac96700 1 -- 172.21.15.69:0/2218710581 shutdown_connections 2023-11-17T06:30:47.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.647+0000 7f159ac96700 1 -- 172.21.15.69:0/2218710581 >> 172.21.15.69:0/2218710581 conn(0x7f159406a480 msgr2=0x7f159406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:47.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.647+0000 7f159ac96700 1 -- 172.21.15.69:0/2218710581 shutdown_connections 2023-11-17T06:30:47.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.647+0000 7f159ac96700 1 -- 172.21.15.69:0/2218710581 wait complete. 2023-11-17T06:30:47.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f159ac96700 1 Processor -- start 2023-11-17T06:30:47.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f159ac96700 1 -- start start 2023-11-17T06:30:47.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f159ac96700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f159415fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f159ac96700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1594159220 0x7f1594159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f159ac96700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15940c2200 0x7f15940c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f159ac96700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c3b00 con 0x7f15940c2200 2023-11-17T06:30:47.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f159ac96700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1594159bc0 con 0x7f1594159220 2023-11-17T06:30:47.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f159ac96700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15940c2f80 con 0x7f15940cc190 2023-11-17T06:30:47.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1599233700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15940c2200 0x7f15940c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1599233700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15940c2200 0x7f15940c2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44982/0 (socket says 172.21.15.69:44982) 2023-11-17T06:30:47.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1599233700 1 -- 172.21.15.69:0/267999770 learned_addr learned my addr 172.21.15.69:0/267999770 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1598a32700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f159415fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1593fff700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1594159220 0x7f1594159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1599233700 1 -- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 msgr2=0x7f159415fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1599233700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f159415fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1599233700 1 -- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1594159220 msgr2=0x7f1594159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1599233700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1594159220 0x7f1594159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1599233700 1 -- 172.21.15.69:0/267999770 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940c3260 con 0x7f15940c2200 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f1599233700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15940c2200 0x7f15940c2680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f159406de90 tx=0x7f158c00d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f15917fa700 1 -- 172.21.15.69:0/267999770 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c003c30 con 0x7f15940c2200 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f15917fa700 1 -- 172.21.15.69:0/267999770 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c003db0 con 0x7f15940c2200 2023-11-17T06:30:47.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f159ac96700 1 -- 172.21.15.69:0/267999770 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15940c3540 con 0x7f15940c2200 2023-11-17T06:30:47.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.651+0000 7f15917fa700 1 -- 172.21.15.69:0/267999770 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00d960 con 0x7f15940c2200 2023-11-17T06:30:47.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.655+0000 7f159ac96700 1 -- 172.21.15.69:0/267999770 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15940c2bc0 con 0x7f15940c2200 2023-11-17T06:30:47.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.655+0000 7f159ac96700 1 -- 172.21.15.69:0/267999770 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15940c2d50 con 0x7f15940c2200 2023-11-17T06:30:47.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.655+0000 7f15917fa700 1 -- 172.21.15.69:0/267999770 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f158c00dac0 con 0x7f15940c2200 2023-11-17T06:30:47.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.659+0000 7f15917fa700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1578066510 0x7f15780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:47.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.659+0000 7f15917fa700 1 -- 172.21.15.69:0/267999770 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f158c083ff0 con 0x7f15940c2200 2023-11-17T06:30:47.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.659+0000 7f1598a32700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1578066510 0x7f15780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:47.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.659+0000 7f1598a32700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1578066510 0x7f15780689d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1588000c00 tx=0x7f1588007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:47.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.663+0000 7f15917fa700 1 -- 172.21.15.69:0/267999770 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f158c0b5090 con 0x7f15940c2200 2023-11-17T06:30:47.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.855+0000 7f159ac96700 1 -- 172.21.15.69:0/267999770 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f159415d3c0 con 0x7f15940c2200 2023-11-17T06:30:47.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.855+0000 7f15917fa700 1 -- 172.21.15.69:0/267999770 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f159415d3c0 con 0x7f15940c2200 2023-11-17T06:30:47.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 -- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1578066510 msgr2=0x7f15780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1578066510 0x7f15780689d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1588000c00 tx=0x7f1588007000 comp rx=0 tx=0).stop 2023-11-17T06:30:47.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 -- 172.21.15.69:0/267999770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15940c2200 msgr2=0x7f15940c2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:47.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15940c2200 0x7f15940c2680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f159406de90 tx=0x7f158c00d150 comp rx=0 tx=0).stop 2023-11-17T06:30:47.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 -- 172.21.15.69:0/267999770 shutdown_connections 2023-11-17T06:30:47.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1578066510 0x7f15780689d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15940c2200 0x7f15940c2680 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1594159220 0x7f1594159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 --2- 172.21.15.69:0/267999770 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f15940cc190 0x7f159415fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:47.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 -- 172.21.15.69:0/267999770 >> 172.21.15.69:0/267999770 conn(0x7f159406a480 msgr2=0x7f15940cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:47.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 -- 172.21.15.69:0/267999770 shutdown_connections 2023-11-17T06:30:47.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:47.859+0000 7f159ac96700 1 -- 172.21.15.69:0/267999770 wait complete. 2023-11-17T06:30:47.868 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2023-11-17T06:30:47.890 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:30:47.891 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:47.907 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:48.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.127+0000 7fde7dc76700 1 Processor -- start 2023-11-17T06:30:48.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.127+0000 7fde7dc76700 1 -- start start 2023-11-17T06:30:48.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.127+0000 7fde7dc76700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde7815b340 0x7fde780cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.127+0000 7fde7dc76700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fde780cd0d0 0x7fde780cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.127+0000 7fde7dc76700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde780b2ee0 con 0x7fde7815af60 2023-11-17T06:30:48.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.127+0000 7fde7dc76700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde780cba00 con 0x7fde780cd0d0 2023-11-17T06:30:48.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.127+0000 7fde7dc76700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde780cd660 con 0x7fde7815b340 2023-11-17T06:30:48.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde77fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fde780cd0d0 0x7fde780cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde77fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fde780cd0d0 0x7fde780cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44990/0 (socket says 172.21.15.69:44990) 2023-11-17T06:30:48.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde77fff700 1 -- 172.21.15.69:0/1105308458 learned_addr learned my addr 172.21.15.69:0/1105308458 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:48.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde6effd700 1 --2- 172.21.15.69:0/1105308458 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde7815b340 0x7fde780cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde77fff700 1 -- 172.21.15.69:0/1105308458 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde7815b340 msgr2=0x7fde780cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:48.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde77fff700 1 --2- 172.21.15.69:0/1105308458 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde7815b340 0x7fde780cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde77fff700 1 -- 172.21.15.69:0/1105308458 >> v1:172.21.15.69:6789/0 conn(0x7fde7815af60 legacy=0x7fde780cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde77fff700 1 -- 172.21.15.69:0/1105308458 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde780b3130 con 0x7fde780cd0d0 2023-11-17T06:30:48.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde77fff700 1 --2- 172.21.15.69:0/1105308458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde780cd0d0 0x7fde780cdf50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fde70009e50 tx=0x7fde7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78882bf686199e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde76ffd700 1 -- 172.21.15.69:0/1105308458 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e070 con 0x7fde780cd0d0 2023-11-17T06:30:48.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde76ffd700 1 -- 172.21.15.69:0/1105308458 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000b910 con 0x7fde780cd0d0 2023-11-17T06:30:48.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde76ffd700 1 -- 172.21.15.69:0/1105308458 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000bcc0 con 0x7fde780cd0d0 2023-11-17T06:30:48.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde7dc76700 1 -- 172.21.15.69:0/1105308458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde780cd0d0 msgr2=0x7fde780cdf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.131+0000 7fde7dc76700 1 --2- 172.21.15.69:0/1105308458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde780cd0d0 0x7fde780cdf50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fde70009e50 tx=0x7fde7000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:48.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.135+0000 7fde7dc76700 1 -- 172.21.15.69:0/1105308458 shutdown_connections 2023-11-17T06:30:48.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.135+0000 7fde7dc76700 1 --2- 172.21.15.69:0/1105308458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde780cd0d0 0x7fde780cdf50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.135+0000 7fde7dc76700 1 --2- 172.21.15.69:0/1105308458 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde7815b340 0x7fde780cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.135+0000 7fde7dc76700 1 -- 172.21.15.69:0/1105308458 >> 172.21.15.69:0/1105308458 conn(0x7fde78065e90 msgr2=0x7fde780662a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:48.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.135+0000 7fde7dc76700 1 -- 172.21.15.69:0/1105308458 shutdown_connections 2023-11-17T06:30:48.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.135+0000 7fde7dc76700 1 -- 172.21.15.69:0/1105308458 wait complete. 2023-11-17T06:30:48.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde7dc76700 1 Processor -- start 2023-11-17T06:30:48.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde7dc76700 1 -- start start 2023-11-17T06:30:48.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde7dc76700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde780cd0d0 0x7fde7814ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde7dc76700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde7815af60 0x7fde780c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde7dc76700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde7815b340 0x7fde781f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde7dc76700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde780c80d0 con 0x7fde7815af60 2023-11-17T06:30:48.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde7dc76700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde780c8650 con 0x7fde7815b340 2023-11-17T06:30:48.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde7dc76700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde781f7d70 con 0x7fde780cd0d0 2023-11-17T06:30:48.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde6effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde7815af60 0x7fde780c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde6effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde7815af60 0x7fde780c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45004/0 (socket says 172.21.15.69:45004) 2023-11-17T06:30:48.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde6effd700 1 -- 172.21.15.69:0/3670299021 learned_addr learned my addr 172.21.15.69:0/3670299021 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:48.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde77fff700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde7815b340 0x7fde781f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde777fe700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde780cd0d0 0x7fde7814ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde6effd700 1 -- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde780cd0d0 msgr2=0x7fde7814ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde6effd700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde780cd0d0 0x7fde7814ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde6effd700 1 -- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde7815b340 msgr2=0x7fde781f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde6effd700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde7815b340 0x7fde781f71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde6effd700 1 -- 172.21.15.69:0/3670299021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde70009b30 con 0x7fde7815af60 2023-11-17T06:30:48.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde6effd700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde7815af60 0x7fde780c9820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fde60009fd0 tx=0x7fde6000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde74ff9700 1 -- 172.21.15.69:0/3670299021 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde600095a0 con 0x7fde7815af60 2023-11-17T06:30:48.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.139+0000 7fde74ff9700 1 -- 172.21.15.69:0/3670299021 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde60013680 con 0x7fde7815af60 2023-11-17T06:30:48.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.143+0000 7fde7dc76700 1 -- 172.21.15.69:0/3670299021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde781f8050 con 0x7fde7815af60 2023-11-17T06:30:48.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.143+0000 7fde74ff9700 1 -- 172.21.15.69:0/3670299021 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60013a30 con 0x7fde7815af60 2023-11-17T06:30:48.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.143+0000 7fde7dc76700 1 -- 172.21.15.69:0/3670299021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7814f2b0 con 0x7fde7815af60 2023-11-17T06:30:48.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.143+0000 7fde7dc76700 1 -- 172.21.15.69:0/3670299021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde78073f00 con 0x7fde7815af60 2023-11-17T06:30:48.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.143+0000 7fde74ff9700 1 -- 172.21.15.69:0/3670299021 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fde60013b90 con 0x7fde7815af60 2023-11-17T06:30:48.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.147+0000 7fde74ff9700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fde58066510 0x7fde580689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.147+0000 7fde74ff9700 1 -- 172.21.15.69:0/3670299021 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fde60083e60 con 0x7fde7815af60 2023-11-17T06:30:48.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.147+0000 7fde777fe700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fde58066510 0x7fde580689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.147+0000 7fde777fe700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fde58066510 0x7fde580689d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde7806d0b0 tx=0x7fde68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.151+0000 7fde74ff9700 1 -- 172.21.15.69:0/3670299021 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fde60051230 con 0x7fde7815af60 2023-11-17T06:30:48.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.331+0000 7fde7dc76700 1 -- 172.21.15.69:0/3670299021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde780c8790 con 0x7fde7815af60 2023-11-17T06:30:48.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.331+0000 7fde74ff9700 1 -- 172.21.15.69:0/3670299021 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7fde60054850 con 0x7fde7815af60 2023-11-17T06:30:48.339 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:48.339 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:48.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 -- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fde58066510 msgr2=0x7fde580689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fde58066510 0x7fde580689d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde7806d0b0 tx=0x7fde68009040 comp rx=0 tx=0).stop 2023-11-17T06:30:48.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 -- 172.21.15.69:0/3670299021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde7815af60 msgr2=0x7fde780c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde7815af60 0x7fde780c9820 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fde60009fd0 tx=0x7fde6000ebd0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 -- 172.21.15.69:0/3670299021 shutdown_connections 2023-11-17T06:30:48.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fde58066510 0x7fde580689d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde7815b340 0x7fde781f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde7815af60 0x7fde780c9820 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 --2- 172.21.15.69:0/3670299021 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde780cd0d0 0x7fde7814ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 -- 172.21.15.69:0/3670299021 >> 172.21.15.69:0/3670299021 conn(0x7fde78065e90 msgr2=0x7fde780cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:48.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 -- 172.21.15.69:0/3670299021 shutdown_connections 2023-11-17T06:30:48.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.335+0000 7fde7dc76700 1 -- 172.21.15.69:0/3670299021 wait complete. 2023-11-17T06:30:48.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:48.362 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:48.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.539+0000 7f1bfda76700 1 Processor -- start 2023-11-17T06:30:48.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.539+0000 7f1bfda76700 1 -- start start 2023-11-17T06:30:48.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.539+0000 7f1bfda76700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1bf80c94d0 0x7f1bf80c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.539+0000 7f1bfda76700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf806be10 con 0x7f1bf80cde00 2023-11-17T06:30:48.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.539+0000 7f1bfda76700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf80c9df0 con 0x7f1bf80ccee0 2023-11-17T06:30:48.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.539+0000 7f1bfda76700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf806c060 con 0x7f1bf80c94d0 2023-11-17T06:30:48.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.539+0000 7f1bf7fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1bf80cde00 0x7f1bf806ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59662/0 (socket says 172.21.15.69:59662) 2023-11-17T06:30:48.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.539+0000 7f1bf7fff700 1 -- 172.21.15.69:0/2350956190 learned_addr learned my addr 172.21.15.69:0/2350956190 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:48.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.539+0000 7f1bf77fe700 1 --2- 172.21.15.69:0/2350956190 >> v2:172.21.15.93:3300/0 conn(0x7f1bf80c94d0 0x7f1bf80c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf67fc700 1 -- 172.21.15.69:0/2350956190 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960320819 0 0) 0x7f1bf806be10 con 0x7f1bf80cde00 2023-11-17T06:30:48.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf67fc700 1 -- 172.21.15.69:0/2350956190 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be00035d0 con 0x7f1bf80cde00 2023-11-17T06:30:48.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf67fc700 1 -- 172.21.15.69:0/2350956190 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807768712 0 0) 0x7f1bf80c9df0 con 0x7f1bf80ccee0 2023-11-17T06:30:48.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf67fc700 1 -- 172.21.15.69:0/2350956190 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf806be10 con 0x7f1bf80ccee0 2023-11-17T06:30:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf67fc700 1 -- 172.21.15.69:0/2350956190 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1164092235 0 0) 0x7f1be00035d0 con 0x7f1bf80cde00 2023-11-17T06:30:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf77fe700 1 -- 172.21.15.69:0/2350956190 >> v1:172.21.15.93:6789/0 conn(0x7f1bf80ccee0 legacy=0x7f1bf806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf77fe700 1 -- 172.21.15.69:0/2350956190 >> v1:172.21.15.69:6789/0 conn(0x7f1bf80cde00 legacy=0x7f1bf806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf77fe700 1 -- 172.21.15.69:0/2350956190 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf806c340 con 0x7f1bf80c94d0 2023-11-17T06:30:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf77fe700 1 --2- 172.21.15.69:0/2350956190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bf80c94d0 0x7f1bf80c98b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009850 tx=0x7f1be8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dfc61e9d10f6c0d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf67fc700 1 -- 172.21.15.69:0/2350956190 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8011830 con 0x7f1bf80c94d0 2023-11-17T06:30:48.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf67fc700 1 -- 172.21.15.69:0/2350956190 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be8011990 con 0x7f1bf80c94d0 2023-11-17T06:30:48.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bf67fc700 1 -- 172.21.15.69:0/2350956190 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be8011d40 con 0x7f1bf80c94d0 2023-11-17T06:30:48.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bfda76700 1 -- 172.21.15.69:0/2350956190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bf80c94d0 msgr2=0x7f1bf80c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bfda76700 1 --2- 172.21.15.69:0/2350956190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bf80c94d0 0x7f1bf80c98b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009850 tx=0x7f1be8009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:48.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bfda76700 1 -- 172.21.15.69:0/2350956190 shutdown_connections 2023-11-17T06:30:48.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bfda76700 1 --2- 172.21.15.69:0/2350956190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bf80c94d0 0x7f1bf80c98b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bfda76700 1 -- 172.21.15.69:0/2350956190 >> 172.21.15.69:0/2350956190 conn(0x7f1bf80cee80 msgr2=0x7f1bf80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:48.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bfda76700 1 -- 172.21.15.69:0/2350956190 shutdown_connections 2023-11-17T06:30:48.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.543+0000 7f1bfda76700 1 -- 172.21.15.69:0/2350956190 wait complete. 2023-11-17T06:30:48.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.547+0000 7f1bfda76700 1 Processor -- start 2023-11-17T06:30:48.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bfda76700 1 -- start start 2023-11-17T06:30:48.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bfda76700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bf80c94d0 0x7f1bf80c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bfda76700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bf80cde00 0x7f1bf80c3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bfda76700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bf815f390 0x7f1bf80c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bfda76700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80bed20 con 0x7f1bf80c94d0 2023-11-17T06:30:48.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bfda76700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80c3fb0 con 0x7f1bf80cde00 2023-11-17T06:30:48.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bfda76700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf80c8170 con 0x7f1bf815f390 2023-11-17T06:30:48.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bf80c94d0 0x7f1bf80c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bf80c94d0 0x7f1bf80c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45016/0 (socket says 172.21.15.69:45016) 2023-11-17T06:30:48.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf77fe700 1 -- 172.21.15.69:0/1933051209 learned_addr learned my addr 172.21.15.69:0/1933051209 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:48.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf7fff700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bf815f390 0x7f1bf80c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf6ffd700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bf80cde00 0x7f1bf80c3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf77fe700 1 -- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bf815f390 msgr2=0x7f1bf80c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf77fe700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bf815f390 0x7f1bf80c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf77fe700 1 -- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bf80cde00 msgr2=0x7f1bf80c3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf77fe700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bf80cde00 0x7f1bf80c3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf77fe700 1 -- 172.21.15.69:0/1933051209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be80094b0 con 0x7f1bf80c94d0 2023-11-17T06:30:48.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf6ffd700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bf80cde00 0x7f1bf80c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:48.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bf77fe700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bf80c94d0 0x7f1bf80c7ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009eb0 tx=0x7f1be8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bdffff700 1 -- 172.21.15.69:0/1933051209 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be801aa10 con 0x7f1bf80c94d0 2023-11-17T06:30:48.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bdffff700 1 -- 172.21.15.69:0/1933051209 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be801f070 con 0x7f1bf80c94d0 2023-11-17T06:30:48.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bfda76700 1 -- 172.21.15.69:0/1933051209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf80c8450 con 0x7f1bf80c94d0 2023-11-17T06:30:48.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bdffff700 1 -- 172.21.15.69:0/1933051209 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be801adf0 con 0x7f1bf80c94d0 2023-11-17T06:30:48.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.551+0000 7f1bfda76700 1 -- 172.21.15.69:0/1933051209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf80c8a10 con 0x7f1bf80c94d0 2023-11-17T06:30:48.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.555+0000 7f1bfda76700 1 -- 172.21.15.69:0/1933051209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf8073f00 con 0x7f1bf80c94d0 2023-11-17T06:30:48.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.555+0000 7f1bdffff700 1 -- 172.21.15.69:0/1933051209 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1be801b430 con 0x7f1bf80c94d0 2023-11-17T06:30:48.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.559+0000 7f1bdffff700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be4066540 0x7f1be4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.559+0000 7f1bdffff700 1 -- 172.21.15.69:0/1933051209 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1be8084e40 con 0x7f1bf80c94d0 2023-11-17T06:30:48.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.559+0000 7f1bf6ffd700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be4066540 0x7f1be4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.559+0000 7f1bf6ffd700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be4066540 0x7f1be4068a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80c8f50 tx=0x7f1bec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.563+0000 7f1bdffff700 1 -- 172.21.15.69:0/1933051209 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1be80522b0 con 0x7f1bf80c94d0 2023-11-17T06:30:48.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.739+0000 7f1bfda76700 1 -- 172.21.15.69:0/1933051209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1bf80c9ac0 con 0x7f1bf80c94d0 2023-11-17T06:30:48.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.739+0000 7f1bdffff700 1 -- 172.21.15.69:0/1933051209 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1be8015020 con 0x7f1bf80c94d0 2023-11-17T06:30:48.746 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 -- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be4066540 msgr2=0x7f1be4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be4066540 0x7f1be4068a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1bf80c8f50 tx=0x7f1bec009040 comp rx=0 tx=0).stop 2023-11-17T06:30:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 -- 172.21.15.69:0/1933051209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bf80c94d0 msgr2=0x7f1bf80c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bf80c94d0 0x7f1bf80c7ab0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1be8009eb0 tx=0x7f1be8004770 comp rx=0 tx=0).stop 2023-11-17T06:30:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 -- 172.21.15.69:0/1933051209 shutdown_connections 2023-11-17T06:30:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be4066540 0x7f1be4068a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bf815f390 0x7f1bf80c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bf80cde00 0x7f1bf80c3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 --2- 172.21.15.69:0/1933051209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bf80c94d0 0x7f1bf80c7ab0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 -- 172.21.15.69:0/1933051209 >> 172.21.15.69:0/1933051209 conn(0x7f1bf80cee80 msgr2=0x7f1bf80ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:48.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 -- 172.21.15.69:0/1933051209 shutdown_connections 2023-11-17T06:30:48.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.743+0000 7f1bfda76700 1 -- 172.21.15.69:0/1933051209 wait complete. 2023-11-17T06:30:48.774 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:48.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.947+0000 7fb9914e2700 1 Processor -- start 2023-11-17T06:30:48.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.947+0000 7fb9914e2700 1 -- start start 2023-11-17T06:30:48.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb9914e2700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c15d490 0x7fb98c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb9914e2700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb98c0ce4e0 0x7fb98c0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb9914e2700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb98c0d1bb0 con 0x7fb98c0d13d0 2023-11-17T06:30:48.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb9914e2700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98c0d1e90 con 0x7fb98c0ce4e0 2023-11-17T06:30:48.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb9914e2700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c0d2170 con 0x7fb98c15d490 2023-11-17T06:30:48.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb98bfff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c15d490 0x7fb98c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb990ce1700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb98c0ce4e0 0x7fb98c0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb990ce1700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb98c0ce4e0 0x7fb98c0b6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:48866/0 (socket says 172.21.15.69:48866) 2023-11-17T06:30:48.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb98bfff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c15d490 0x7fb98c0b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:35194/0 (socket says 172.21.15.69:35194) 2023-11-17T06:30:48.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb990ce1700 1 -- 172.21.15.69:0/3626980580 learned_addr learned my addr 172.21.15.69:0/3626980580 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:48.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb98bfff700 1 -- 172.21.15.69:0/3626980580 >> v2:172.21.15.93:3300/0 conn(0x7fb98c0ce4e0 msgr2=0x7fb98c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:48.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb98bfff700 1 --2- 172.21.15.69:0/3626980580 >> v2:172.21.15.93:3300/0 conn(0x7fb98c0ce4e0 0x7fb98c0b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb98bfff700 1 -- 172.21.15.69:0/3626980580 >> v1:172.21.15.93:6789/0 conn(0x7fb98c0d13d0 legacy=0x7fb98c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb98bfff700 1 -- 172.21.15.69:0/3626980580 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98c0d2450 con 0x7fb98c15d490 2023-11-17T06:30:48.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.951+0000 7fb98bfff700 1 --2- 172.21.15.69:0/3626980580 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c15d490 0x7fb98c0b8bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009850 tx=0x7fb97c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c7af302c5e53725 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb98affd700 1 -- 172.21.15.69:0/3626980580 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c011830 con 0x7fb98c15d490 2023-11-17T06:30:48.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb98affd700 1 -- 172.21.15.69:0/3626980580 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97c011990 con 0x7fb98c15d490 2023-11-17T06:30:48.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb98affd700 1 -- 172.21.15.69:0/3626980580 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c011d40 con 0x7fb98c15d490 2023-11-17T06:30:48.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb9914e2700 1 -- 172.21.15.69:0/3626980580 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c15d490 msgr2=0x7fb98c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb9914e2700 1 --2- 172.21.15.69:0/3626980580 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c15d490 0x7fb98c0b8bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009850 tx=0x7fb97c009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:48.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb9914e2700 1 -- 172.21.15.69:0/3626980580 shutdown_connections 2023-11-17T06:30:48.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb9914e2700 1 --2- 172.21.15.69:0/3626980580 >> v2:172.21.15.93:3300/0 conn(0x7fb98c0ce4e0 0x7fb98c0b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb9914e2700 1 --2- 172.21.15.69:0/3626980580 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c15d490 0x7fb98c0b8bc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb9914e2700 1 -- 172.21.15.69:0/3626980580 >> 172.21.15.69:0/3626980580 conn(0x7fb98c06ab40 msgr2=0x7fb98c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:48.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb9914e2700 1 -- 172.21.15.69:0/3626980580 shutdown_connections 2023-11-17T06:30:48.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb9914e2700 1 -- 172.21.15.69:0/3626980580 wait complete. 2023-11-17T06:30:48.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.955+0000 7fb9914e2700 1 Processor -- start 2023-11-17T06:30:48.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb9914e2700 1 -- start start 2023-11-17T06:30:48.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb9914e2700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c0ce4e0 0x7fb98c14d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb9914e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb98c0d13d0 0x7fb98c14f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb9914e2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb98c15d490 0x7fb98c14bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb9914e2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c14c4e0 con 0x7fb98c0d13d0 2023-11-17T06:30:48.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb9914e2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c15d910 con 0x7fb98c15d490 2023-11-17T06:30:48.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb9914e2700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c15dbf0 con 0x7fb98c0ce4e0 2023-11-17T06:30:48.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb98b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb98c0d13d0 0x7fb98c14f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb98b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb98c0d13d0 0x7fb98c14f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45028/0 (socket says 172.21.15.69:45028) 2023-11-17T06:30:48.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb98b7fe700 1 -- 172.21.15.69:0/1409486587 learned_addr learned my addr 172.21.15.69:0/1409486587 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:48.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb990ce1700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb98c15d490 0x7fb98c14bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb98bfff700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c0ce4e0 0x7fb98c14d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb98b7fe700 1 -- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c0ce4e0 msgr2=0x7fb98c14d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb98b7fe700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c0ce4e0 0x7fb98c14d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb98b7fe700 1 -- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb98c15d490 msgr2=0x7fb98c14bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:48.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb98b7fe700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb98c15d490 0x7fb98c14bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:48.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb98b7fe700 1 -- 172.21.15.69:0/1409486587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0094b0 con 0x7fb98c0d13d0 2023-11-17T06:30:48.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb98b7fe700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb98c0d13d0 0x7fb98c14f210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb98000c500 tx=0x7fb98000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb988ff9700 1 -- 172.21.15.69:0/1409486587 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9800052d0 con 0x7fb98c0d13d0 2023-11-17T06:30:48.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb988ff9700 1 -- 172.21.15.69:0/1409486587 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb980005430 con 0x7fb98c0d13d0 2023-11-17T06:30:48.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb9914e2700 1 -- 172.21.15.69:0/1409486587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98c15ded0 con 0x7fb98c0d13d0 2023-11-17T06:30:48.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb988ff9700 1 -- 172.21.15.69:0/1409486587 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9800055a0 con 0x7fb98c0d13d0 2023-11-17T06:30:48.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.959+0000 7fb9914e2700 1 -- 172.21.15.69:0/1409486587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98c14d660 con 0x7fb98c0d13d0 2023-11-17T06:30:48.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.963+0000 7fb9914e2700 1 -- 172.21.15.69:0/1409486587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98c15e3f0 con 0x7fb98c0d13d0 2023-11-17T06:30:48.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.963+0000 7fb988ff9700 1 -- 172.21.15.69:0/1409486587 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb9800038e0 con 0x7fb98c0d13d0 2023-11-17T06:30:48.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.967+0000 7fb988ff9700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb978066510 0x7fb9780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:48.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.967+0000 7fb988ff9700 1 -- 172.21.15.69:0/1409486587 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb980083270 con 0x7fb98c0d13d0 2023-11-17T06:30:48.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.967+0000 7fb98bfff700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb978066510 0x7fb9780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:48.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.967+0000 7fb98bfff700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb978066510 0x7fb9780689d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0090b0 tx=0x7fb97c01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:48.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:48.971+0000 7fb988ff9700 1 -- 172.21.15.69:0/1409486587 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb98c15e3f0 con 0x7fb98c0d13d0 2023-11-17T06:30:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.147+0000 7fb9914e2700 1 -- 172.21.15.69:0/1409486587 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb98c15e3f0 con 0x7fb98c0d13d0 2023-11-17T06:30:49.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.147+0000 7fb988ff9700 1 -- 172.21.15.69:0/1409486587 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb98c15e3f0 con 0x7fb98c0d13d0 2023-11-17T06:30:49.153 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:49.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 -- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb978066510 msgr2=0x7fb9780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb978066510 0x7fb9780689d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0090b0 tx=0x7fb97c01c040 comp rx=0 tx=0).stop 2023-11-17T06:30:49.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 -- 172.21.15.69:0/1409486587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb98c0d13d0 msgr2=0x7fb98c14f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb98c0d13d0 0x7fb98c14f210 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb98000c500 tx=0x7fb98000c810 comp rx=0 tx=0).stop 2023-11-17T06:30:49.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 -- 172.21.15.69:0/1409486587 shutdown_connections 2023-11-17T06:30:49.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb978066510 0x7fb9780689d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb98c15d490 0x7fb98c14bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb98c0d13d0 0x7fb98c14f210 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 --2- 172.21.15.69:0/1409486587 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb98c0ce4e0 0x7fb98c14d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 -- 172.21.15.69:0/1409486587 >> 172.21.15.69:0/1409486587 conn(0x7fb98c06ab40 msgr2=0x7fb98c0c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:49.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 -- 172.21.15.69:0/1409486587 shutdown_connections 2023-11-17T06:30:49.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.151+0000 7fb9914e2700 1 -- 172.21.15.69:0/1409486587 wait complete. 2023-11-17T06:30:49.178 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:49.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.351+0000 7fca202a0700 1 Processor -- start 2023-11-17T06:30:49.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.351+0000 7fca202a0700 1 -- start start 2023-11-17T06:30:49.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.351+0000 7fca202a0700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fca180b5440 0x7fca180d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca202a0700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180d1ca0 0x7fca180b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca202a0700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca180b6750 con 0x7fca1815d980 2023-11-17T06:30:49.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca202a0700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca180d2a30 con 0x7fca180b5440 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca202a0700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca180b6980 con 0x7fca180d1ca0 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d83b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fca180b5440 0x7fca180d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d83b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fca180b5440 0x7fca180d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:48892/0 (socket says 172.21.15.69:48892) 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1e03c700 1 --1- 172.21.15.69:0/3511539846 >> v1:172.21.15.93:6789/0 conn(0x7fca1815d980 0x7fca180b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:46986/0 (socket says 172.21.15.69:46986) 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d83b700 1 -- 172.21.15.69:0/3511539846 learned_addr learned my addr 172.21.15.69:0/3511539846 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1e83d700 1 --2- 172.21.15.69:0/3511539846 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180d1ca0 0x7fca180b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d83b700 1 -- 172.21.15.69:0/3511539846 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180d1ca0 msgr2=0x7fca180b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d83b700 1 --2- 172.21.15.69:0/3511539846 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180d1ca0 0x7fca180b7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d83b700 1 -- 172.21.15.69:0/3511539846 >> v1:172.21.15.93:6789/0 conn(0x7fca1815d980 legacy=0x7fca180b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d83b700 1 -- 172.21.15.69:0/3511539846 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca180d2470 con 0x7fca180b5440 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d83b700 1 --2- 172.21.15.69:0/3511539846 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca180b5440 0x7fca180d1760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca08009910 tx=0x7fca08009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c998dffd811c71 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d03a700 1 -- 172.21.15.69:0/3511539846 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08011830 con 0x7fca180b5440 2023-11-17T06:30:49.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d03a700 1 -- 172.21.15.69:0/3511539846 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08011990 con 0x7fca180b5440 2023-11-17T06:30:49.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca1d03a700 1 -- 172.21.15.69:0/3511539846 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08011d40 con 0x7fca180b5440 2023-11-17T06:30:49.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca202a0700 1 -- 172.21.15.69:0/3511539846 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca180b5440 msgr2=0x7fca180d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca202a0700 1 --2- 172.21.15.69:0/3511539846 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca180b5440 0x7fca180d1760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca08009910 tx=0x7fca08009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:49.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca202a0700 1 -- 172.21.15.69:0/3511539846 shutdown_connections 2023-11-17T06:30:49.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca202a0700 1 --2- 172.21.15.69:0/3511539846 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180d1ca0 0x7fca180b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca202a0700 1 --2- 172.21.15.69:0/3511539846 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca180b5440 0x7fca180d1760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.355+0000 7fca202a0700 1 -- 172.21.15.69:0/3511539846 >> 172.21.15.69:0/3511539846 conn(0x7fca180cfd30 msgr2=0x7fca180d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:49.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.359+0000 7fca202a0700 1 -- 172.21.15.69:0/3511539846 shutdown_connections 2023-11-17T06:30:49.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.359+0000 7fca202a0700 1 -- 172.21.15.69:0/3511539846 wait complete. 2023-11-17T06:30:49.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.359+0000 7fca202a0700 1 Processor -- start 2023-11-17T06:30:49.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.359+0000 7fca202a0700 1 -- start start 2023-11-17T06:30:49.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca202a0700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b5440 0x7fca181512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca202a0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180d1ca0 0x7fca180b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca202a0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca180b43d0 0x7fca181f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca202a0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca180b4860 con 0x7fca180d1ca0 2023-11-17T06:30:49.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca202a0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca181533a0 con 0x7fca180b43d0 2023-11-17T06:30:49.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca202a0700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca18151820 con 0x7fca180b5440 2023-11-17T06:30:49.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1d83b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180d1ca0 0x7fca180b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1d83b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180d1ca0 0x7fca180b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45030/0 (socket says 172.21.15.69:45030) 2023-11-17T06:30:49.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1d83b700 1 -- 172.21.15.69:0/341563403 learned_addr learned my addr 172.21.15.69:0/341563403 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:49.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1e83d700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca180b43d0 0x7fca181f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1e03c700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b5440 0x7fca181512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1d83b700 1 -- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b5440 msgr2=0x7fca181512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1d83b700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b5440 0x7fca181512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1d83b700 1 -- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca180b43d0 msgr2=0x7fca181f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1d83b700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca180b43d0 0x7fca181f5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1d83b700 1 -- 172.21.15.69:0/341563403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08009570 con 0x7fca180d1ca0 2023-11-17T06:30:49.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca1d83b700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180d1ca0 0x7fca180b3e90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca180b59c0 tx=0x7fca08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca0effd700 1 -- 172.21.15.69:0/341563403 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08004510 con 0x7fca180d1ca0 2023-11-17T06:30:49.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca0effd700 1 -- 172.21.15.69:0/341563403 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0801e070 con 0x7fca180d1ca0 2023-11-17T06:30:49.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca202a0700 1 -- 172.21.15.69:0/341563403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca181f6870 con 0x7fca180d1ca0 2023-11-17T06:30:49.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca0effd700 1 -- 172.21.15.69:0/341563403 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08003900 con 0x7fca180d1ca0 2023-11-17T06:30:49.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.363+0000 7fca202a0700 1 -- 172.21.15.69:0/341563403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca18153030 con 0x7fca180d1ca0 2023-11-17T06:30:49.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.367+0000 7fca202a0700 1 -- 172.21.15.69:0/341563403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca18152bb0 con 0x7fca180d1ca0 2023-11-17T06:30:49.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.367+0000 7fca0effd700 1 -- 172.21.15.69:0/341563403 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fca08003a60 con 0x7fca180d1ca0 2023-11-17T06:30:49.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.367+0000 7fca0effd700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066510 0x7fc9fc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.371+0000 7fca0effd700 1 -- 172.21.15.69:0/341563403 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fca08084db0 con 0x7fca180d1ca0 2023-11-17T06:30:49.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.371+0000 7fca1e03c700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066510 0x7fc9fc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.371+0000 7fca1e03c700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066510 0x7fc9fc0689d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca14000f60 tx=0x7fca14007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.375+0000 7fca0effd700 1 -- 172.21.15.69:0/341563403 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fca18152bb0 con 0x7fca180d1ca0 2023-11-17T06:30:49.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.551+0000 7fca202a0700 1 -- 172.21.15.69:0/341563403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fca18152bb0 con 0x7fca180d1ca0 2023-11-17T06:30:49.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.551+0000 7fca0effd700 1 -- 172.21.15.69:0/341563403 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fca08020020 con 0x7fca180d1ca0 2023-11-17T06:30:49.557 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:49.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 -- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066510 msgr2=0x7fc9fc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066510 0x7fc9fc0689d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca14000f60 tx=0x7fca14007d50 comp rx=0 tx=0).stop 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 -- 172.21.15.69:0/341563403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180d1ca0 msgr2=0x7fca180b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180d1ca0 0x7fca180b3e90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca180b59c0 tx=0x7fca08004770 comp rx=0 tx=0).stop 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 -- 172.21.15.69:0/341563403 shutdown_connections 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc9fc066510 0x7fc9fc0689d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca180b43d0 0x7fca181f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca180d1ca0 0x7fca180b3e90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 --2- 172.21.15.69:0/341563403 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fca180b5440 0x7fca181512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 -- 172.21.15.69:0/341563403 >> 172.21.15.69:0/341563403 conn(0x7fca180cfd30 msgr2=0x7fca180ce6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 -- 172.21.15.69:0/341563403 shutdown_connections 2023-11-17T06:30:49.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.555+0000 7fca202a0700 1 -- 172.21.15.69:0/341563403 wait complete. 2023-11-17T06:30:49.583 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:49.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.755+0000 7fe0a69c1700 1 Processor -- start 2023-11-17T06:30:49.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.755+0000 7fe0a69c1700 1 -- start start 2023-11-17T06:30:49.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe0a015d490 0x7fe0a00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a00d13d0 0x7fe0a00cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe0a00ce310 0x7fe0a00b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a00ce770 con 0x7fe0a015d490 2023-11-17T06:30:49.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a00d1bb0 con 0x7fe0a00ce310 2023-11-17T06:30:49.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00d1e90 con 0x7fe0a00d13d0 2023-11-17T06:30:49.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a59bf700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe0a015d490 0x7fe0a00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a59bf700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe0a015d490 0x7fe0a00b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45042/0 (socket says 172.21.15.69:45042) 2023-11-17T06:30:49.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a59bf700 1 -- 172.21.15.69:0/1239057636 learned_addr learned my addr 172.21.15.69:0/1239057636 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:49.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a61c0700 1 --2- 172.21.15.69:0/1239057636 >> v2:172.21.15.93:3300/0 conn(0x7fe0a00ce310 0x7fe0a00b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a51be700 1 --2- 172.21.15.69:0/1239057636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a00d13d0 0x7fe0a00cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a59bf700 1 -- 172.21.15.69:0/1239057636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a00d13d0 msgr2=0x7fe0a00cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:49.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a59bf700 1 --2- 172.21.15.69:0/1239057636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a00d13d0 0x7fe0a00cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a59bf700 1 -- 172.21.15.69:0/1239057636 >> v2:172.21.15.93:3300/0 conn(0x7fe0a00ce310 msgr2=0x7fe0a00b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:49.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a59bf700 1 --2- 172.21.15.69:0/1239057636 >> v2:172.21.15.93:3300/0 conn(0x7fe0a00ce310 0x7fe0a00b4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a59bf700 1 -- 172.21.15.69:0/1239057636 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a00d2170 con 0x7fe0a015d490 2023-11-17T06:30:49.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a59bf700 1 --2- 172.21.15.69:0/1239057636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a015d490 0x7fe0a00b8bc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe0a006d550 tx=0x7fe09c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cca1dfabfed40e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a49bd700 1 -- 172.21.15.69:0/1239057636 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c011830 con 0x7fe0a015d490 2023-11-17T06:30:49.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a49bd700 1 -- 172.21.15.69:0/1239057636 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c011990 con 0x7fe0a015d490 2023-11-17T06:30:49.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a49bd700 1 -- 172.21.15.69:0/1239057636 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c011d20 con 0x7fe0a015d490 2023-11-17T06:30:49.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 -- 172.21.15.69:0/1239057636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a015d490 msgr2=0x7fe0a00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 --2- 172.21.15.69:0/1239057636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a015d490 0x7fe0a00b8bc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe0a006d550 tx=0x7fe09c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 -- 172.21.15.69:0/1239057636 shutdown_connections 2023-11-17T06:30:49.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 --2- 172.21.15.69:0/1239057636 >> v2:172.21.15.93:3300/0 conn(0x7fe0a00ce310 0x7fe0a00b4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 --2- 172.21.15.69:0/1239057636 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a00d13d0 0x7fe0a00cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 --2- 172.21.15.69:0/1239057636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a015d490 0x7fe0a00b8bc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.759+0000 7fe0a69c1700 1 -- 172.21.15.69:0/1239057636 >> 172.21.15.69:0/1239057636 conn(0x7fe0a006ab40 msgr2=0x7fe0a006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:49.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.763+0000 7fe0a69c1700 1 -- 172.21.15.69:0/1239057636 shutdown_connections 2023-11-17T06:30:49.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.763+0000 7fe0a69c1700 1 -- 172.21.15.69:0/1239057636 wait complete. 2023-11-17T06:30:49.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.763+0000 7fe0a69c1700 1 Processor -- start 2023-11-17T06:30:49.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.763+0000 7fe0a69c1700 1 -- start start 2023-11-17T06:30:49.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a69c1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00ce310 0x7fe0a01452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a69c1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a00d13d0 0x7fe0a014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a69c1700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a015d490 0x7fe0a0152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a69c1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01501f0 con 0x7fe0a00d13d0 2023-11-17T06:30:49.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a69c1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0145800 con 0x7fe0a00ce310 2023-11-17T06:30:49.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a69c1700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01f2d70 con 0x7fe0a015d490 2023-11-17T06:30:49.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a51be700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a00d13d0 0x7fe0a014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a51be700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a00d13d0 0x7fe0a014ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45044/0 (socket says 172.21.15.69:45044) 2023-11-17T06:30:49.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a51be700 1 -- 172.21.15.69:0/3676369556 learned_addr learned my addr 172.21.15.69:0/3676369556 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:49.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a59bf700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00ce310 0x7fe0a01452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a61c0700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a015d490 0x7fe0a0152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a51be700 1 -- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a015d490 msgr2=0x7fe0a0152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a51be700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a015d490 0x7fe0a0152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a51be700 1 -- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00ce310 msgr2=0x7fe0a01452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a51be700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00ce310 0x7fe0a01452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a51be700 1 -- 172.21.15.69:0/3676369556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c009570 con 0x7fe0a00d13d0 2023-11-17T06:30:49.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a59bf700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00ce310 0x7fe0a01452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:49.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a51be700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a00d13d0 0x7fe0a014ec90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe09000e840 tx=0x7fe09000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0967fc700 1 -- 172.21.15.69:0/3676369556 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900095a0 con 0x7fe0a00d13d0 2023-11-17T06:30:49.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0967fc700 1 -- 172.21.15.69:0/3676369556 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09000c690 con 0x7fe0a00d13d0 2023-11-17T06:30:49.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0967fc700 1 -- 172.21.15.69:0/3676369556 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09000ca00 con 0x7fe0a00d13d0 2023-11-17T06:30:49.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a69c1700 1 -- 172.21.15.69:0/3676369556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a014f570 con 0x7fe0a00d13d0 2023-11-17T06:30:49.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.767+0000 7fe0a69c1700 1 -- 172.21.15.69:0/3676369556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a014fb30 con 0x7fe0a00d13d0 2023-11-17T06:30:49.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.771+0000 7fe0a69c1700 1 -- 172.21.15.69:0/3676369556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a0073f00 con 0x7fe0a00d13d0 2023-11-17T06:30:49.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.771+0000 7fe0967fc700 1 -- 172.21.15.69:0/3676369556 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe09000cb60 con 0x7fe0a00d13d0 2023-11-17T06:30:49.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.771+0000 7fe0967fc700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066510 0x7fe0840689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:49.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.771+0000 7fe0967fc700 1 -- 172.21.15.69:0/3676369556 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe090083eb0 con 0x7fe0a00d13d0 2023-11-17T06:30:49.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.775+0000 7fe0a59bf700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066510 0x7fe0840689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:49.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.775+0000 7fe0a59bf700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066510 0x7fe0840689d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe09c000c00 tx=0x7fe09c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.779+0000 7fe0967fc700 1 -- 172.21.15.69:0/3676369556 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe090051280 con 0x7fe0a00d13d0 2023-11-17T06:30:49.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.963+0000 7fe0a69c1700 1 -- 172.21.15.69:0/3676369556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0a015c120 con 0x7fe0a00d13d0 2023-11-17T06:30:49.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.963+0000 7fe0967fc700 1 -- 172.21.15.69:0/3676369556 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe090021080 con 0x7fe0a00d13d0 2023-11-17T06:30:49.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 -- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066510 msgr2=0x7fe0840689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066510 0x7fe0840689d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe09c000c00 tx=0x7fe09c008030 comp rx=0 tx=0).stop 2023-11-17T06:30:49.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 -- 172.21.15.69:0/3676369556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a00d13d0 msgr2=0x7fe0a014ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:49.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a00d13d0 0x7fe0a014ec90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe09000e840 tx=0x7fe09000ec00 comp rx=0 tx=0).stop 2023-11-17T06:30:49.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 -- 172.21.15.69:0/3676369556 shutdown_connections 2023-11-17T06:30:49.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe084066510 0x7fe0840689d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0a015d490 0x7fe0a0152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0a00d13d0 0x7fe0a014ec90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 --2- 172.21.15.69:0/3676369556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0a00ce310 0x7fe0a01452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:49.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 -- 172.21.15.69:0/3676369556 >> 172.21.15.69:0/3676369556 conn(0x7fe0a006ab40 msgr2=0x7fe0a00b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:49.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 -- 172.21.15.69:0/3676369556 shutdown_connections 2023-11-17T06:30:49.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:49.967+0000 7fe0a69c1700 1 -- 172.21.15.69:0/3676369556 wait complete. 2023-11-17T06:30:49.977 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2023-11-17T06:30:49.997 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi069.front.sepia.ceph.com... 2023-11-17T06:30:49.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:49.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-17T06:30:50.045 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:50.045 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:30:50.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:50.045 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-17T06:30:50.114 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:30:50.114 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:50.131 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:30:50.132 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:50.193 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:50.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.391+0000 7f96d6462700 1 Processor -- start 2023-11-17T06:30:50.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.391+0000 7f96d6462700 1 -- start start 2023-11-17T06:30:50.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.391+0000 7f96d6462700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f96d00c21a0 0x7f96d006c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.391+0000 7f96d6462700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 0x7f96d00cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.391+0000 7f96d6462700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d006c200 con 0x7f96d01652b0 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.391+0000 7f96d6462700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d01662c0 con 0x7f96d00c21a0 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.391+0000 7f96d6462700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d0165d00 con 0x7f96d00cbef0 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d5460700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f96d00c21a0 0x7f96d006c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d5460700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f96d00c21a0 0x7f96d006c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45046/0 (socket says 172.21.15.69:45046) 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d5460700 1 -- 172.21.15.69:0/2756542151 learned_addr learned my addr 172.21.15.69:0/2756542151 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d5c61700 1 --2- 172.21.15.69:0/2756542151 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 0x7f96d00cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d5460700 1 -- 172.21.15.69:0/2756542151 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 msgr2=0x7f96d00cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d5460700 1 --2- 172.21.15.69:0/2756542151 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 0x7f96d00cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d5460700 1 -- 172.21.15.69:0/2756542151 >> v1:172.21.15.93:6789/0 conn(0x7f96d01652b0 legacy=0x7f96d00cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:50.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d5460700 1 -- 172.21.15.69:0/2756542151 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d0165fe0 con 0x7f96d00c21a0 2023-11-17T06:30:50.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d5460700 1 --2- 172.21.15.69:0/2756542151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d00c21a0 0x7f96d006c690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009910 tx=0x7f96cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b8b6772ec76e81 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96c7fff700 1 -- 172.21.15.69:0/2756542151 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc004230 con 0x7f96d00c21a0 2023-11-17T06:30:50.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96c7fff700 1 -- 172.21.15.69:0/2756542151 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96cc004390 con 0x7f96d00c21a0 2023-11-17T06:30:50.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96c7fff700 1 -- 172.21.15.69:0/2756542151 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc009e60 con 0x7f96d00c21a0 2023-11-17T06:30:50.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d6462700 1 -- 172.21.15.69:0/2756542151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d00c21a0 msgr2=0x7f96d006c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d6462700 1 --2- 172.21.15.69:0/2756542151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d00c21a0 0x7f96d006c690 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009910 tx=0x7f96cc009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:50.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d6462700 1 -- 172.21.15.69:0/2756542151 shutdown_connections 2023-11-17T06:30:50.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d6462700 1 --2- 172.21.15.69:0/2756542151 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 0x7f96d00cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d6462700 1 --2- 172.21.15.69:0/2756542151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d00c21a0 0x7f96d006c690 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d6462700 1 -- 172.21.15.69:0/2756542151 >> 172.21.15.69:0/2756542151 conn(0x7f96d00b0900 msgr2=0x7f96d00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:50.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d6462700 1 -- 172.21.15.69:0/2756542151 shutdown_connections 2023-11-17T06:30:50.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.395+0000 7f96d6462700 1 -- 172.21.15.69:0/2756542151 wait complete. 2023-11-17T06:30:50.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.399+0000 7f96d6462700 1 Processor -- start 2023-11-17T06:30:50.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.399+0000 7f96d6462700 1 -- start start 2023-11-17T06:30:50.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.399+0000 7f96d6462700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96d00c21a0 0x7f96d0152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.399+0000 7f96d6462700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 0x7f96d00c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.399+0000 7f96d6462700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d01652b0 0x7f96d00c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.399+0000 7f96d6462700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00c7770 con 0x7f96d01652b0 2023-11-17T06:30:50.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.399+0000 7f96d6462700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00c6b60 con 0x7f96d00c21a0 2023-11-17T06:30:50.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.399+0000 7f96d6462700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00c6e40 con 0x7f96d00cbef0 2023-11-17T06:30:50.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d5c61700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d01652b0 0x7f96d00c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d5c61700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d01652b0 0x7f96d00c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45048/0 (socket says 172.21.15.69:45048) 2023-11-17T06:30:50.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d5c61700 1 -- 172.21.15.69:0/3900829105 learned_addr learned my addr 172.21.15.69:0/3900829105 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:50.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d4c5f700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 0x7f96d00c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d5460700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96d00c21a0 0x7f96d0152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d5c61700 1 -- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 msgr2=0x7f96d00c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d5c61700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 0x7f96d00c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d5c61700 1 -- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96d00c21a0 msgr2=0x7f96d0152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d5c61700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96d00c21a0 0x7f96d0152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d5c61700 1 -- 172.21.15.69:0/3900829105 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc009570 con 0x7f96d01652b0 2023-11-17T06:30:50.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d4c5f700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 0x7f96d00c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:50.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d5c61700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d01652b0 0x7f96d00c4df0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f96c8007e40 tx=0x7f96c800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96c5ffb700 1 -- 172.21.15.69:0/3900829105 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c800eea0 con 0x7f96d01652b0 2023-11-17T06:30:50.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96c5ffb700 1 -- 172.21.15.69:0/3900829105 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8014420 con 0x7f96d01652b0 2023-11-17T06:30:50.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d6462700 1 -- 172.21.15.69:0/3900829105 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d00c7120 con 0x7f96d01652b0 2023-11-17T06:30:50.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96c5ffb700 1 -- 172.21.15.69:0/3900829105 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c80147b0 con 0x7f96d01652b0 2023-11-17T06:30:50.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d6462700 1 -- 172.21.15.69:0/3900829105 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d00c5ea0 con 0x7f96d01652b0 2023-11-17T06:30:50.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.403+0000 7f96d6462700 1 -- 172.21.15.69:0/3900829105 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d00c78e0 con 0x7f96d01652b0 2023-11-17T06:30:50.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.407+0000 7f96c5ffb700 1 -- 172.21.15.69:0/3900829105 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f96c8014910 con 0x7f96d01652b0 2023-11-17T06:30:50.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.407+0000 7f96c5ffb700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96b4066510 0x7f96b40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.407+0000 7f96c5ffb700 1 -- 172.21.15.69:0/3900829105 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f96c80846d0 con 0x7f96d01652b0 2023-11-17T06:30:50.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.407+0000 7f96d5460700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96b4066510 0x7f96b40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.407+0000 7f96d5460700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96b4066510 0x7f96b40689d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009910 tx=0x7f96cc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.411+0000 7f96c5ffb700 1 -- 172.21.15.69:0/3900829105 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96c8051a90 con 0x7f96d01652b0 2023-11-17T06:30:50.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.587+0000 7f96d6462700 1 -- 172.21.15.69:0/3900829105 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96d0073f00 con 0x7f96d01652b0 2023-11-17T06:30:50.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.587+0000 7f96c5ffb700 1 -- 172.21.15.69:0/3900829105 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f96c80550b0 con 0x7f96d01652b0 2023-11-17T06:30:50.595 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:50.595 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.591+0000 7f96d6462700 1 -- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96b4066510 msgr2=0x7f96b40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.591+0000 7f96d6462700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96b4066510 0x7f96b40689d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009910 tx=0x7f96cc008030 comp rx=0 tx=0).stop 2023-11-17T06:30:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.591+0000 7f96d6462700 1 -- 172.21.15.69:0/3900829105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d01652b0 msgr2=0x7f96d00c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.591+0000 7f96d6462700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d01652b0 0x7f96d00c4df0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f96c8007e40 tx=0x7f96c800e3c0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.595+0000 7f96d6462700 1 -- 172.21.15.69:0/3900829105 shutdown_connections 2023-11-17T06:30:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.595+0000 7f96d6462700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96b4066510 0x7f96b40689d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.595+0000 7f96d6462700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d01652b0 0x7f96d00c4df0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.595+0000 7f96d6462700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96d00cbef0 0x7f96d00c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.595+0000 7f96d6462700 1 --2- 172.21.15.69:0/3900829105 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96d00c21a0 0x7f96d0152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.595+0000 7f96d6462700 1 -- 172.21.15.69:0/3900829105 >> 172.21.15.69:0/3900829105 conn(0x7f96d00b0900 msgr2=0x7f96d006fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:50.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.595+0000 7f96d6462700 1 -- 172.21.15.69:0/3900829105 shutdown_connections 2023-11-17T06:30:50.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.595+0000 7f96d6462700 1 -- 172.21.15.69:0/3900829105 wait complete. 2023-11-17T06:30:50.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:50.619 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:50.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.787+0000 7fb00fcdb700 1 Processor -- start 2023-11-17T06:30:50.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00fcdb700 1 -- start start 2023-11-17T06:30:50.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00fcdb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 0x7fb008070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00fcdb700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb008159df0 con 0x7fb008159a10 2023-11-17T06:30:50.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00fcdb700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb008070870 con 0x7fb00806d7e0 2023-11-17T06:30:50.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00fcdb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb008070b50 con 0x7fb00806cdb0 2023-11-17T06:30:50.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00da77700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb008159a10 0x7fb00806c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59668/0 (socket says 172.21.15.69:59668) 2023-11-17T06:30:50.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00da77700 1 -- 172.21.15.69:0/1362731932 learned_addr learned my addr 172.21.15.69:0/1362731932 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:50.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00d276700 1 --2- 172.21.15.69:0/1362731932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 0x7fb008070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00ca75700 1 -- 172.21.15.69:0/1362731932 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729361770 0 0) 0x7fb008159df0 con 0x7fb008159a10 2023-11-17T06:30:50.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00ca75700 1 -- 172.21.15.69:0/1362731932 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faff40035d0 con 0x7fb008159a10 2023-11-17T06:30:50.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00ca75700 1 -- 172.21.15.69:0/1362731932 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3341647785 0 0) 0x7fb008070870 con 0x7fb00806d7e0 2023-11-17T06:30:50.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00ca75700 1 -- 172.21.15.69:0/1362731932 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb008159df0 con 0x7fb00806d7e0 2023-11-17T06:30:50.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00d276700 1 -- 172.21.15.69:0/1362731932 >> v1:172.21.15.93:6789/0 conn(0x7fb00806d7e0 legacy=0x7fb0080cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00d276700 1 -- 172.21.15.69:0/1362731932 >> v1:172.21.15.69:6789/0 conn(0x7fb008159a10 legacy=0x7fb00806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00ca75700 1 -- 172.21.15.69:0/1362731932 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1225549164 0 0) 0x7faff40035d0 con 0x7fb008159a10 2023-11-17T06:30:50.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.791+0000 7fb00d276700 1 -- 172.21.15.69:0/1362731932 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb008070e30 con 0x7fb00806cdb0 2023-11-17T06:30:50.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00d276700 1 --2- 172.21.15.69:0/1362731932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 0x7fb008070190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faff8009880 tx=0x7faff8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56400999b39801f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00ca75700 1 -- 172.21.15.69:0/1362731932 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004001670 con 0x7fb00806cdb0 2023-11-17T06:30:50.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00ca75700 1 -- 172.21.15.69:0/1362731932 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff8004030 con 0x7fb00806cdb0 2023-11-17T06:30:50.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00ca75700 1 -- 172.21.15.69:0/1362731932 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff80043c0 con 0x7fb00806cdb0 2023-11-17T06:30:50.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00fcdb700 1 -- 172.21.15.69:0/1362731932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 msgr2=0x7fb008070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00fcdb700 1 --2- 172.21.15.69:0/1362731932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 0x7fb008070190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faff8009880 tx=0x7faff8009b90 comp rx=0 tx=0).stop 2023-11-17T06:30:50.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00fcdb700 1 -- 172.21.15.69:0/1362731932 shutdown_connections 2023-11-17T06:30:50.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00fcdb700 1 --2- 172.21.15.69:0/1362731932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 0x7fb008070190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00fcdb700 1 -- 172.21.15.69:0/1362731932 >> 172.21.15.69:0/1362731932 conn(0x7fb0080cee80 msgr2=0x7fb0080cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:50.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00fcdb700 1 -- 172.21.15.69:0/1362731932 shutdown_connections 2023-11-17T06:30:50.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.795+0000 7fb00fcdb700 1 -- 172.21.15.69:0/1362731932 wait complete. 2023-11-17T06:30:50.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00fcdb700 1 Processor -- start 2023-11-17T06:30:50.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00fcdb700 1 -- start start 2023-11-17T06:30:50.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00fcdb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 0x7fb0080b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00fcdb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00806d7e0 0x7fb0080b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00fcdb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb008159a10 0x7fb00814a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00fcdb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00815a090 con 0x7fb00806d7e0 2023-11-17T06:30:50.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00fcdb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080af1f0 con 0x7fb008159a10 2023-11-17T06:30:50.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00fcdb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080b49f0 con 0x7fb00806cdb0 2023-11-17T06:30:50.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00d276700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00806d7e0 0x7fb0080b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00d276700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00806d7e0 0x7fb0080b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45052/0 (socket says 172.21.15.69:45052) 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00d276700 1 -- 172.21.15.69:0/2122286992 learned_addr learned my addr 172.21.15.69:0/2122286992 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00da77700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 0x7fb0080b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00e278700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb008159a10 0x7fb00814a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00d276700 1 -- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 msgr2=0x7fb0080b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00d276700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 0x7fb0080b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00d276700 1 -- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb008159a10 msgr2=0x7fb00814a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00d276700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb008159a10 0x7fb00814a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00d276700 1 -- 172.21.15.69:0/2122286992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff80094b0 con 0x7fb00806d7e0 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.799+0000 7fb00d276700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00806d7e0 0x7fb0080b44b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faff80097d0 tx=0x7faff8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.803+0000 7faffe7fc700 1 -- 172.21.15.69:0/2122286992 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8003c50 con 0x7fb00806d7e0 2023-11-17T06:30:50.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.803+0000 7faffe7fc700 1 -- 172.21.15.69:0/2122286992 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff8003db0 con 0x7fb00806d7e0 2023-11-17T06:30:50.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.803+0000 7fb00fcdb700 1 -- 172.21.15.69:0/2122286992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0080b3af0 con 0x7fb00806d7e0 2023-11-17T06:30:50.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.803+0000 7faffe7fc700 1 -- 172.21.15.69:0/2122286992 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff8011870 con 0x7fb00806d7e0 2023-11-17T06:30:50.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.803+0000 7fb00fcdb700 1 -- 172.21.15.69:0/2122286992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0080af720 con 0x7fb00806d7e0 2023-11-17T06:30:50.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.803+0000 7fb00fcdb700 1 -- 172.21.15.69:0/2122286992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb008073f00 con 0x7fb00806d7e0 2023-11-17T06:30:50.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.803+0000 7faffe7fc700 1 -- 172.21.15.69:0/2122286992 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faff8018050 con 0x7fb00806d7e0 2023-11-17T06:30:50.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.807+0000 7faffe7fc700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafec066510 0x7fafec0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:50.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.807+0000 7faffe7fc700 1 -- 172.21.15.69:0/2122286992 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7faff80847b0 con 0x7fb00806d7e0 2023-11-17T06:30:50.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.807+0000 7fb00da77700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafec066510 0x7fafec0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:50.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.807+0000 7fb00da77700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafec066510 0x7fafec0689d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb004001380 tx=0x7fb004007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:50.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.811+0000 7faffe7fc700 1 -- 172.21.15.69:0/2122286992 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faff8051c00 con 0x7fb00806d7e0 2023-11-17T06:30:50.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.983+0000 7fb00fcdb700 1 -- 172.21.15.69:0/2122286992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb008168760 con 0x7fb00806d7e0 2023-11-17T06:30:50.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.987+0000 7faffe7fc700 1 -- 172.21.15.69:0/2122286992 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7faff80160a0 con 0x7fb00806d7e0 2023-11-17T06:30:50.991 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:50.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 -- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafec066510 msgr2=0x7fafec0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafec066510 0x7fafec0689d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb004001380 tx=0x7fb004007c00 comp rx=0 tx=0).stop 2023-11-17T06:30:50.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 -- 172.21.15.69:0/2122286992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00806d7e0 msgr2=0x7fb0080b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:50.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00806d7e0 0x7fb0080b44b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faff80097d0 tx=0x7faff8004770 comp rx=0 tx=0).stop 2023-11-17T06:30:50.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 -- 172.21.15.69:0/2122286992 shutdown_connections 2023-11-17T06:30:50.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafec066510 0x7fafec0689d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb008159a10 0x7fb00814a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00806d7e0 0x7fb0080b44b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 --2- 172.21.15.69:0/2122286992 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb00806cdb0 0x7fb0080b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:50.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 -- 172.21.15.69:0/2122286992 >> 172.21.15.69:0/2122286992 conn(0x7fb0080cee80 msgr2=0x7fb0080acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:50.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 -- 172.21.15.69:0/2122286992 shutdown_connections 2023-11-17T06:30:50.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:50.991+0000 7fb00fcdb700 1 -- 172.21.15.69:0/2122286992 wait complete. 2023-11-17T06:30:51.024 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:51.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.191+0000 7ff5853ac700 1 Processor -- start 2023-11-17T06:30:51.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.191+0000 7ff5853ac700 1 -- start start 2023-11-17T06:30:51.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff5853ac700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 0x7ff5800ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff5853ac700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff5800c98c0 0x7ff5800cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff5853ac700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5800cca40 con 0x7ff58015a2b0 2023-11-17T06:30:51.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff5853ac700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5800ccdb0 con 0x7ff5800c98c0 2023-11-17T06:30:51.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff5853ac700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5800caef0 con 0x7ff580159ed0 2023-11-17T06:30:51.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57f7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff5800c98c0 0x7ff5800cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57effd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 0x7ff5800ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57f7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff5800c98c0 0x7ff5800cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:48950/0 (socket says 172.21.15.69:48950) 2023-11-17T06:30:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57f7fe700 1 -- 172.21.15.69:0/1346747766 learned_addr learned my addr 172.21.15.69:0/1346747766 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57e7fc700 1 --1- 172.21.15.69:0/1346747766 >> v1:172.21.15.93:6789/0 conn(0x7ff58015a2b0 0x7ff5800706f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:47016/0 (socket says 172.21.15.69:47016) 2023-11-17T06:30:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57effd700 1 -- 172.21.15.69:0/1346747766 >> v2:172.21.15.93:3300/0 conn(0x7ff5800c98c0 msgr2=0x7ff5800cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57effd700 1 --2- 172.21.15.69:0/1346747766 >> v2:172.21.15.93:3300/0 conn(0x7ff5800c98c0 0x7ff5800cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57effd700 1 -- 172.21.15.69:0/1346747766 >> v1:172.21.15.93:6789/0 conn(0x7ff58015a2b0 legacy=0x7ff5800706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57effd700 1 -- 172.21.15.69:0/1346747766 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5800cdf60 con 0x7ff580159ed0 2023-11-17T06:30:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57dffb700 1 -- 172.21.15.69:0/1346747766 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3409187627 0 0) 0x7ff5800cca40 con 0x7ff58015a2b0 2023-11-17T06:30:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57effd700 1 --2- 172.21.15.69:0/1346747766 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 0x7ff5800ca9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff570009850 tx=0x7ff570009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6d449615aec915a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57dffb700 1 -- 172.21.15.69:0/1346747766 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570011830 con 0x7ff580159ed0 2023-11-17T06:30:51.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57dffb700 1 -- 172.21.15.69:0/1346747766 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff570011990 con 0x7ff580159ed0 2023-11-17T06:30:51.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.195+0000 7ff57dffb700 1 -- 172.21.15.69:0/1346747766 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff570011d40 con 0x7ff580159ed0 2023-11-17T06:30:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.199+0000 7ff5853ac700 1 -- 172.21.15.69:0/1346747766 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 msgr2=0x7ff5800ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.199+0000 7ff5853ac700 1 --2- 172.21.15.69:0/1346747766 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 0x7ff5800ca9b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff570009850 tx=0x7ff570009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.199+0000 7ff5853ac700 1 -- 172.21.15.69:0/1346747766 shutdown_connections 2023-11-17T06:30:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.199+0000 7ff5853ac700 1 --2- 172.21.15.69:0/1346747766 >> v2:172.21.15.93:3300/0 conn(0x7ff5800c98c0 0x7ff5800cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.199+0000 7ff5853ac700 1 --2- 172.21.15.69:0/1346747766 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 0x7ff5800ca9b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.199+0000 7ff5853ac700 1 -- 172.21.15.69:0/1346747766 >> 172.21.15.69:0/1346747766 conn(0x7ff5800b0900 msgr2=0x7ff5800b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.199+0000 7ff5853ac700 1 -- 172.21.15.69:0/1346747766 shutdown_connections 2023-11-17T06:30:51.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.199+0000 7ff5853ac700 1 -- 172.21.15.69:0/1346747766 wait complete. 2023-11-17T06:30:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff5853ac700 1 Processor -- start 2023-11-17T06:30:51.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff5853ac700 1 -- start start 2023-11-17T06:30:51.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff5853ac700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5800c98c0 0x7ff58014cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff5853ac700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 0x7ff5800c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff5853ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff58015a2b0 0x7ff5800ce630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff5853ac700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5800c60b0 con 0x7ff58015a2b0 2023-11-17T06:30:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff5853ac700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5800c70c0 con 0x7ff5800c98c0 2023-11-17T06:30:51.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff5853ac700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff58014d460 con 0x7ff580159ed0 2023-11-17T06:30:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff57f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff58015a2b0 0x7ff5800ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff57f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff58015a2b0 0x7ff5800ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45068/0 (socket says 172.21.15.69:45068) 2023-11-17T06:30:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff57f7fe700 1 -- 172.21.15.69:0/188587718 learned_addr learned my addr 172.21.15.69:0/188587718 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff57e7fc700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 0x7ff5800c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.203+0000 7ff57effd700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5800c98c0 0x7ff58014cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.207+0000 7ff57f7fe700 1 -- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 msgr2=0x7ff5800c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.207+0000 7ff57f7fe700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 0x7ff5800c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.207+0000 7ff57f7fe700 1 -- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5800c98c0 msgr2=0x7ff58014cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.207+0000 7ff57f7fe700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5800c98c0 0x7ff58014cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.207+0000 7ff57f7fe700 1 -- 172.21.15.69:0/188587718 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5700094b0 con 0x7ff58015a2b0 2023-11-17T06:30:51.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.207+0000 7ff57f7fe700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff58015a2b0 0x7ff5800ce630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff578010f30 tx=0x7ff57800e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:51.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.207+0000 7ff5677fe700 1 -- 172.21.15.69:0/188587718 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578003a40 con 0x7ff58015a2b0 2023-11-17T06:30:51.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.211+0000 7ff5677fe700 1 -- 172.21.15.69:0/188587718 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff578011040 con 0x7ff58015a2b0 2023-11-17T06:30:51.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.211+0000 7ff5853ac700 1 -- 172.21.15.69:0/188587718 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5800c6300 con 0x7ff58015a2b0 2023-11-17T06:30:51.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.211+0000 7ff5677fe700 1 -- 172.21.15.69:0/188587718 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff578003dc0 con 0x7ff58015a2b0 2023-11-17T06:30:51.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.211+0000 7ff5853ac700 1 -- 172.21.15.69:0/188587718 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5800c68c0 con 0x7ff58015a2b0 2023-11-17T06:30:51.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.211+0000 7ff5853ac700 1 -- 172.21.15.69:0/188587718 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff580070de0 con 0x7ff58015a2b0 2023-11-17T06:30:51.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.211+0000 7ff5677fe700 1 -- 172.21.15.69:0/188587718 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff57800e940 con 0x7ff58015a2b0 2023-11-17T06:30:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.215+0000 7ff5677fe700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff56c066510 0x7ff56c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.215+0000 7ff5677fe700 1 -- 172.21.15.69:0/188587718 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff578086200 con 0x7ff58015a2b0 2023-11-17T06:30:51.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.215+0000 7ff57effd700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff56c066510 0x7ff56c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.215+0000 7ff57effd700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff56c066510 0x7ff56c0689d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff5700090b0 tx=0x7ff570008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:51.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.219+0000 7ff5677fe700 1 -- 172.21.15.69:0/188587718 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff580070de0 con 0x7ff58015a2b0 2023-11-17T06:30:51.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.395+0000 7ff5853ac700 1 -- 172.21.15.69:0/188587718 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff580070de0 con 0x7ff58015a2b0 2023-11-17T06:30:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.395+0000 7ff5677fe700 1 -- 172.21.15.69:0/188587718 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff580070de0 con 0x7ff58015a2b0 2023-11-17T06:30:51.400 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:51.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.395+0000 7ff5853ac700 1 -- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff56c066510 msgr2=0x7ff56c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.395+0000 7ff5853ac700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff56c066510 0x7ff56c0689d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff5700090b0 tx=0x7ff570008030 comp rx=0 tx=0).stop 2023-11-17T06:30:51.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.399+0000 7ff5853ac700 1 -- 172.21.15.69:0/188587718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff58015a2b0 msgr2=0x7ff5800ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.399+0000 7ff5853ac700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff58015a2b0 0x7ff5800ce630 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff578010f30 tx=0x7ff57800e3a0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.399+0000 7ff5853ac700 1 -- 172.21.15.69:0/188587718 shutdown_connections 2023-11-17T06:30:51.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.399+0000 7ff5853ac700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff56c066510 0x7ff56c0689d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.399+0000 7ff5853ac700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff58015a2b0 0x7ff5800ce630 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.399+0000 7ff5853ac700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff580159ed0 0x7ff5800c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.399+0000 7ff5853ac700 1 --2- 172.21.15.69:0/188587718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5800c98c0 0x7ff58014cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.399+0000 7ff5853ac700 1 -- 172.21.15.69:0/188587718 >> 172.21.15.69:0/188587718 conn(0x7ff5800b0900 msgr2=0x7ff580071010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:51.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.399+0000 7ff5853ac700 1 -- 172.21.15.69:0/188587718 shutdown_connections 2023-11-17T06:30:51.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.399+0000 7ff5853ac700 1 -- 172.21.15.69:0/188587718 wait complete. 2023-11-17T06:30:51.428 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:51.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.599+0000 7f9f4b59e700 1 Processor -- start 2023-11-17T06:30:51.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.599+0000 7f9f4b59e700 1 -- start start 2023-11-17T06:30:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.599+0000 7f9f4b59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 0x7f9f4c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.599+0000 7f9f4b59e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4c0b9000 con 0x7f9f4c15d490 2023-11-17T06:30:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.599+0000 7f9f4b59e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4c0d1bb0 con 0x7f9f4c0ce310 2023-11-17T06:30:51.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.599+0000 7f9f4b59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0ce790 con 0x7f9f4c0b8bc0 2023-11-17T06:30:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.599+0000 7f9f4a59c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f9f4c15d490 0x7f9f4c0d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59680/0 (socket says 172.21.15.69:59680) 2023-11-17T06:30:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.599+0000 7f9f4a59c700 1 -- 172.21.15.69:0/2723294524 learned_addr learned my addr 172.21.15.69:0/2723294524 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:51.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f49d9b700 1 --2- 172.21.15.69:0/2723294524 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 0x7f9f4c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4959a700 1 -- 172.21.15.69:0/2723294524 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048339580 0 0) 0x7f9f3c001040 con 0x7f9f4c15d490 2023-11-17T06:30:51.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4959a700 1 -- 172.21.15.69:0/2723294524 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f340035d0 con 0x7f9f4c15d490 2023-11-17T06:30:51.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4959a700 1 -- 172.21.15.69:0/2723294524 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335869900 0 0) 0x7f9f4c0d1bb0 con 0x7f9f4c0ce310 2023-11-17T06:30:51.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4959a700 1 -- 172.21.15.69:0/2723294524 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3c001040 con 0x7f9f4c0ce310 2023-11-17T06:30:51.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f49d9b700 1 -- 172.21.15.69:0/2723294524 >> v1:172.21.15.93:6789/0 conn(0x7f9f4c0ce310 legacy=0x7f9f4c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f49d9b700 1 -- 172.21.15.69:0/2723294524 >> v1:172.21.15.69:6789/0 conn(0x7f9f4c15d490 legacy=0x7f9f4c0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f49d9b700 1 -- 172.21.15.69:0/2723294524 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c0d1e90 con 0x7f9f4c0b8bc0 2023-11-17T06:30:51.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f49d9b700 1 --2- 172.21.15.69:0/2723294524 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 0x7f9f4c0cddd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009880 tx=0x7f9f40009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff0fcc90d0869f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:51.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4959a700 1 -- 172.21.15.69:0/2723294524 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40011830 con 0x7f9f4c0b8bc0 2023-11-17T06:30:51.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4959a700 1 -- 172.21.15.69:0/2723294524 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f40011990 con 0x7f9f4c0b8bc0 2023-11-17T06:30:51.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4959a700 1 -- 172.21.15.69:0/2723294524 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f40011d20 con 0x7f9f4c0b8bc0 2023-11-17T06:30:51.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4b59e700 1 -- 172.21.15.69:0/2723294524 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 msgr2=0x7f9f4c0cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4b59e700 1 --2- 172.21.15.69:0/2723294524 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 0x7f9f4c0cddd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9f40009880 tx=0x7f9f40009b90 comp rx=0 tx=0).stop 2023-11-17T06:30:51.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4b59e700 1 -- 172.21.15.69:0/2723294524 shutdown_connections 2023-11-17T06:30:51.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4b59e700 1 --2- 172.21.15.69:0/2723294524 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 0x7f9f4c0cddd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4b59e700 1 -- 172.21.15.69:0/2723294524 >> 172.21.15.69:0/2723294524 conn(0x7f9f4c06ab40 msgr2=0x7f9f4c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:51.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4b59e700 1 -- 172.21.15.69:0/2723294524 shutdown_connections 2023-11-17T06:30:51.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.603+0000 7f9f4b59e700 1 -- 172.21.15.69:0/2723294524 wait complete. 2023-11-17T06:30:51.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4b59e700 1 Processor -- start 2023-11-17T06:30:51.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4b59e700 1 -- start start 2023-11-17T06:30:51.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4b59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 0x7f9f4c1601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4b59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f4c0ce310 0x7f9f4c1f6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4b59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f4c15d490 0x7f9f4c15e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4b59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c160860 con 0x7f9f4c15d490 2023-11-17T06:30:51.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4b59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c1f71e0 con 0x7f9f4c0ce310 2023-11-17T06:30:51.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4b59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0c7b80 con 0x7f9f4c0b8bc0 2023-11-17T06:30:51.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f4c15d490 0x7f9f4c15e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f4c15d490 0x7f9f4c15e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45078/0 (socket says 172.21.15.69:45078) 2023-11-17T06:30:51.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.607+0000 7f9f4ad9d700 1 -- 172.21.15.69:0/1418445457 learned_addr learned my addr 172.21.15.69:0/1418445457 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:51.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f49d9b700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f4c0ce310 0x7f9f4c1f6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f4a59c700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 0x7f9f4c1601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f4ad9d700 1 -- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 msgr2=0x7f9f4c1601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f4ad9d700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 0x7f9f4c1601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f4ad9d700 1 -- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f4c0ce310 msgr2=0x7f9f4c1f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f4ad9d700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f4c0ce310 0x7f9f4c1f6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f4ad9d700 1 -- 172.21.15.69:0/1418445457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400094b0 con 0x7f9f4c15d490 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f4ad9d700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f4c15d490 0x7f9f4c15e1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400cc20 tx=0x7f9f4400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f3affd700 1 -- 172.21.15.69:0/1418445457 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44003c20 con 0x7f9f4c15d490 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f3affd700 1 -- 172.21.15.69:0/1418445457 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f44003d80 con 0x7f9f4c15d490 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f4b59e700 1 -- 172.21.15.69:0/1418445457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4c0c7e60 con 0x7f9f4c15d490 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f3affd700 1 -- 172.21.15.69:0/1418445457 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400aae0 con 0x7f9f4c15d490 2023-11-17T06:30:51.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f4b59e700 1 -- 172.21.15.69:0/1418445457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c0c8420 con 0x7f9f4c15d490 2023-11-17T06:30:51.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.611+0000 7f9f4b59e700 1 -- 172.21.15.69:0/1418445457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c073f00 con 0x7f9f4c15d490 2023-11-17T06:30:51.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.615+0000 7f9f3affd700 1 -- 172.21.15.69:0/1418445457 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9f4400ac40 con 0x7f9f4c15d490 2023-11-17T06:30:51.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.615+0000 7f9f3affd700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9f2c066510 0x7f9f2c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:51.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.615+0000 7f9f3affd700 1 -- 172.21.15.69:0/1418445457 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9f44083f50 con 0x7f9f4c15d490 2023-11-17T06:30:51.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.619+0000 7f9f4a59c700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9f2c066510 0x7f9f2c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:51.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.619+0000 7f9f4a59c700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9f2c066510 0x7f9f2c0689d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c005930 tx=0x7f9f3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:51.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.623+0000 7f9f3affd700 1 -- 172.21.15.69:0/1418445457 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9f44051310 con 0x7f9f4c15d490 2023-11-17T06:30:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.795+0000 7f9f4b59e700 1 -- 172.21.15.69:0/1418445457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f4c0c8610 con 0x7f9f4c15d490 2023-11-17T06:30:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.795+0000 7f9f3affd700 1 -- 172.21.15.69:0/1418445457 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f44059e60 con 0x7f9f4c15d490 2023-11-17T06:30:51.802 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 -- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9f2c066510 msgr2=0x7f9f2c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9f2c066510 0x7f9f2c0689d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c005930 tx=0x7f9f3c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 -- 172.21.15.69:0/1418445457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f4c15d490 msgr2=0x7f9f4c15e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f4c15d490 0x7f9f4c15e1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9f4400cc20 tx=0x7f9f4400cf30 comp rx=0 tx=0).stop 2023-11-17T06:30:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 -- 172.21.15.69:0/1418445457 shutdown_connections 2023-11-17T06:30:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9f2c066510 0x7f9f2c0689d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f4c15d490 0x7f9f4c15e1d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f4c0ce310 0x7f9f4c1f6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 --2- 172.21.15.69:0/1418445457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9f4c0b8bc0 0x7f9f4c1601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 -- 172.21.15.69:0/1418445457 >> 172.21.15.69:0/1418445457 conn(0x7f9f4c06ab40 msgr2=0x7f9f4c0731e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 -- 172.21.15.69:0/1418445457 shutdown_connections 2023-11-17T06:30:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:51.799+0000 7f9f4b59e700 1 -- 172.21.15.69:0/1418445457 wait complete. 2023-11-17T06:30:51.838 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:52.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda43b06700 1 Processor -- start 2023-11-17T06:30:52.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda43b06700 1 -- start start 2023-11-17T06:30:52.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda43b06700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fda3c0cc190 0x7fda3c0ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda43b06700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c0ce5d0 0x7fda3c0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda43b06700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3c166040 con 0x7fda3c1617a0 2023-11-17T06:30:52.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda43b06700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3c165430 con 0x7fda3c0cc190 2023-11-17T06:30:52.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda43b06700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c165710 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda410a1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fda3c0cc190 0x7fda3c0ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda410a1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fda3c0cc190 0x7fda3c0ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45086/0 (socket says 172.21.15.69:45086) 2023-11-17T06:30:52.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda410a1700 1 -- 172.21.15.69:0/1181363228 learned_addr learned my addr 172.21.15.69:0/1181363228 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:52.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda420a3700 1 --2- 172.21.15.69:0/1181363228 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c0ce5d0 0x7fda3c0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.003+0000 7fda418a2700 1 --1- 172.21.15.69:0/1181363228 >> v1:172.21.15.93:6789/0 conn(0x7fda3c1617a0 0x7fda3c0cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:47038/0 (socket says 172.21.15.69:47038) 2023-11-17T06:30:52.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda408a0700 1 -- 172.21.15.69:0/1181363228 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760152595 0 0) 0x7fda3c166040 con 0x7fda3c1617a0 2023-11-17T06:30:52.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda410a1700 1 -- 172.21.15.69:0/1181363228 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c0ce5d0 msgr2=0x7fda3c0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:52.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda410a1700 1 --2- 172.21.15.69:0/1181363228 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c0ce5d0 0x7fda3c0cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda410a1700 1 -- 172.21.15.69:0/1181363228 >> v1:172.21.15.93:6789/0 conn(0x7fda3c1617a0 legacy=0x7fda3c0cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda410a1700 1 -- 172.21.15.69:0/1181363228 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c1659f0 con 0x7fda3c0cc190 2023-11-17T06:30:52.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda410a1700 1 --2- 172.21.15.69:0/1181363228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0cc190 0x7fda3c0ce090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009910 tx=0x7fda2c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f32303b13432bb server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda408a0700 1 -- 172.21.15.69:0/1181363228 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c011830 con 0x7fda3c0cc190 2023-11-17T06:30:52.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda408a0700 1 -- 172.21.15.69:0/1181363228 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c011990 con 0x7fda3c0cc190 2023-11-17T06:30:52.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda408a0700 1 -- 172.21.15.69:0/1181363228 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c011d40 con 0x7fda3c0cc190 2023-11-17T06:30:52.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda43b06700 1 -- 172.21.15.69:0/1181363228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0cc190 msgr2=0x7fda3c0ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda43b06700 1 --2- 172.21.15.69:0/1181363228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0cc190 0x7fda3c0ce090 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009910 tx=0x7fda2c009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:52.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda43b06700 1 -- 172.21.15.69:0/1181363228 shutdown_connections 2023-11-17T06:30:52.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda43b06700 1 --2- 172.21.15.69:0/1181363228 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c0ce5d0 0x7fda3c0cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda43b06700 1 --2- 172.21.15.69:0/1181363228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0cc190 0x7fda3c0ce090 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda43b06700 1 -- 172.21.15.69:0/1181363228 >> 172.21.15.69:0/1181363228 conn(0x7fda3c06a480 msgr2=0x7fda3c06a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:52.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda43b06700 1 -- 172.21.15.69:0/1181363228 shutdown_connections 2023-11-17T06:30:52.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.007+0000 7fda43b06700 1 -- 172.21.15.69:0/1181363228 wait complete. 2023-11-17T06:30:52.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda43b06700 1 Processor -- start 2023-11-17T06:30:52.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda43b06700 1 -- start start 2023-11-17T06:30:52.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda43b06700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda3c0cc190 0x7fda3c163300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda43b06700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0ce5d0 0x7fda3c162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda43b06700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c1617a0 0x7fda3c15bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda43b06700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c163dd0 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda43b06700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c163840 con 0x7fda3c0cc190 2023-11-17T06:30:52.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda43b06700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c163af0 con 0x7fda3c1617a0 2023-11-17T06:30:52.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda410a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0ce5d0 0x7fda3c162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda410a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0ce5d0 0x7fda3c162910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45092/0 (socket says 172.21.15.69:45092) 2023-11-17T06:30:52.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.011+0000 7fda410a1700 1 -- 172.21.15.69:0/3649509548 learned_addr learned my addr 172.21.15.69:0/3649509548 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:52.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda418a2700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda3c0cc190 0x7fda3c163300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda420a3700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c1617a0 0x7fda3c15bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda410a1700 1 -- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c1617a0 msgr2=0x7fda3c15bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda410a1700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c1617a0 0x7fda3c15bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda410a1700 1 -- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda3c0cc190 msgr2=0x7fda3c163300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda410a1700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda3c0cc190 0x7fda3c163300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda410a1700 1 -- 172.21.15.69:0/3649509548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c009570 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda418a2700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda3c0cc190 0x7fda3c163300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:52.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda420a3700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c1617a0 0x7fda3c15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:52.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda410a1700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0ce5d0 0x7fda3c162910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0cc8d0 tx=0x7fda2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda327fc700 1 -- 172.21.15.69:0/3649509548 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0036c0 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda327fc700 1 -- 172.21.15.69:0/3649509548 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c01e070 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda43b06700 1 -- 172.21.15.69:0/3649509548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c161e30 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda327fc700 1 -- 172.21.15.69:0/3649509548 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c003a60 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda43b06700 1 -- 172.21.15.69:0/3649509548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3c1623f0 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.015+0000 7fda43b06700 1 -- 172.21.15.69:0/3649509548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3c162610 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.019+0000 7fda327fc700 1 -- 172.21.15.69:0/3649509548 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fda2c003bc0 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.019+0000 7fda327fc700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda20066510 0x7fda200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.019+0000 7fda327fc700 1 -- 172.21.15.69:0/3649509548 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fda2c020070 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.019+0000 7fda418a2700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda20066510 0x7fda200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.023+0000 7fda418a2700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda20066510 0x7fda200689d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda38000f60 tx=0x7fda38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.027+0000 7fda327fc700 1 -- 172.21.15.69:0/3649509548 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fda2c052870 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.215+0000 7fda43b06700 1 -- 172.21.15.69:0/3649509548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fda3c165ca0 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.219+0000 7fda327fc700 1 -- 172.21.15.69:0/3649509548 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fda2c055e90 con 0x7fda3c0ce5d0 2023-11-17T06:30:52.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 -- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda20066510 msgr2=0x7fda200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda20066510 0x7fda200689d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fda38000f60 tx=0x7fda38009040 comp rx=0 tx=0).stop 2023-11-17T06:30:52.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 -- 172.21.15.69:0/3649509548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0ce5d0 msgr2=0x7fda3c162910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0ce5d0 0x7fda3c162910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fda3c0cc8d0 tx=0x7fda2c004770 comp rx=0 tx=0).stop 2023-11-17T06:30:52.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 -- 172.21.15.69:0/3649509548 shutdown_connections 2023-11-17T06:30:52.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fda20066510 0x7fda200689d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fda3c1617a0 0x7fda3c15bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3c0ce5d0 0x7fda3c162910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 --2- 172.21.15.69:0/3649509548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda3c0cc190 0x7fda3c163300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 -- 172.21.15.69:0/3649509548 >> 172.21.15.69:0/3649509548 conn(0x7fda3c06a480 msgr2=0x7fda3c06c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:52.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 -- 172.21.15.69:0/3649509548 shutdown_connections 2023-11-17T06:30:52.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.223+0000 7fda43b06700 1 -- 172.21.15.69:0/3649509548 wait complete. 2023-11-17T06:30:52.230 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2023-11-17T06:30:52.251 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:30:52.251 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:52.272 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:52.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689284d700 1 Processor -- start 2023-11-17T06:30:52.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689284d700 1 -- start start 2023-11-17T06:30:52.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689284d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f688c0b8bc0 0x7f688c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689284d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c0b9000 con 0x7f688c15d490 2023-11-17T06:30:52.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689284d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c0d1bb0 con 0x7f688c0ce310 2023-11-17T06:30:52.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689284d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c0ce7c0 con 0x7f688c0b8bc0 2023-11-17T06:30:52.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689184b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f688c15d490 0x7f688c0d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59694/0 (socket says 172.21.15.69:59694) 2023-11-17T06:30:52.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689184b700 1 -- 172.21.15.69:0/1628205361 learned_addr learned my addr 172.21.15.69:0/1628205361 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:52.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689104a700 1 --2- 172.21.15.69:0/1628205361 >> v2:172.21.15.69:3300/0 conn(0x7f688c0b8bc0 0x7f688c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f6890849700 1 -- 172.21.15.69:0/1628205361 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226770375 0 0) 0x7f6888001110 con 0x7f688c15d490 2023-11-17T06:30:52.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f6890849700 1 -- 172.21.15.69:0/1628205361 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68780035d0 con 0x7f688c15d490 2023-11-17T06:30:52.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689104a700 1 -- 172.21.15.69:0/1628205361 >> v1:172.21.15.93:6789/0 conn(0x7f688c0ce310 legacy=0x7f688c0b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689104a700 1 -- 172.21.15.69:0/1628205361 >> v1:172.21.15.69:6789/0 conn(0x7f688c15d490 legacy=0x7f688c0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.447+0000 7f689104a700 1 -- 172.21.15.69:0/1628205361 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0d1e90 con 0x7f688c0b8bc0 2023-11-17T06:30:52.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f689104a700 1 --2- 172.21.15.69:0/1628205361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 0x7f688c0cddd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f687c009850 tx=0x7f687c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e2e532b2df41028 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f6890849700 1 -- 172.21.15.69:0/1628205361 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c011830 con 0x7f688c0b8bc0 2023-11-17T06:30:52.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f6890849700 1 -- 172.21.15.69:0/1628205361 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c011990 con 0x7f688c0b8bc0 2023-11-17T06:30:52.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f6890849700 1 -- 172.21.15.69:0/1628205361 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c011d40 con 0x7f688c0b8bc0 2023-11-17T06:30:52.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f689284d700 1 -- 172.21.15.69:0/1628205361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 msgr2=0x7f688c0cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f689284d700 1 --2- 172.21.15.69:0/1628205361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 0x7f688c0cddd0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f687c009850 tx=0x7f687c009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:52.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f689284d700 1 -- 172.21.15.69:0/1628205361 shutdown_connections 2023-11-17T06:30:52.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f689284d700 1 --2- 172.21.15.69:0/1628205361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 0x7f688c0cddd0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f689284d700 1 -- 172.21.15.69:0/1628205361 >> 172.21.15.69:0/1628205361 conn(0x7f688c06ab40 msgr2=0x7f688c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:52.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f689284d700 1 -- 172.21.15.69:0/1628205361 shutdown_connections 2023-11-17T06:30:52.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.451+0000 7f689284d700 1 -- 172.21.15.69:0/1628205361 wait complete. 2023-11-17T06:30:52.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689284d700 1 Processor -- start 2023-11-17T06:30:52.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689284d700 1 -- start start 2023-11-17T06:30:52.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689284d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 0x7f688c14c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689284d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f688c0ce310 0x7f688c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689284d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f688c15d490 0x7f688c159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689284d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c15dff0 con 0x7f688c0b8bc0 2023-11-17T06:30:52.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689284d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c156280 con 0x7f688c0ce310 2023-11-17T06:30:52.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689284d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c1559e0 con 0x7f688c15d490 2023-11-17T06:30:52.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689184b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 0x7f688c14c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689184b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 0x7f688c14c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45106/0 (socket says 172.21.15.69:45106) 2023-11-17T06:30:52.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689184b700 1 -- 172.21.15.69:0/1760100970 learned_addr learned my addr 172.21.15.69:0/1760100970 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:52.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689104a700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f688c0ce310 0x7f688c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689204c700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f688c15d490 0x7f688c159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689184b700 1 -- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f688c15d490 msgr2=0x7f688c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689184b700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f688c15d490 0x7f688c159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689184b700 1 -- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f688c0ce310 msgr2=0x7f688c154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689184b700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f688c0ce310 0x7f688c154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689184b700 1 -- 172.21.15.69:0/1760100970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c0094b0 con 0x7f688c0b8bc0 2023-11-17T06:30:52.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689184b700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 0x7f688c14c4c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6888001270 tx=0x7f688800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f68827fc700 1 -- 172.21.15.69:0/1760100970 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888005d90 con 0x7f688c0b8bc0 2023-11-17T06:30:52.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689284d700 1 -- 172.21.15.69:0/1760100970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c155cc0 con 0x7f688c0b8bc0 2023-11-17T06:30:52.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f68827fc700 1 -- 172.21.15.69:0/1760100970 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68880070d0 con 0x7f688c0b8bc0 2023-11-17T06:30:52.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f68827fc700 1 -- 172.21.15.69:0/1760100970 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6888007480 con 0x7f688c0b8bc0 2023-11-17T06:30:52.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.455+0000 7f689284d700 1 -- 172.21.15.69:0/1760100970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c0c8a80 con 0x7f688c0b8bc0 2023-11-17T06:30:52.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.459+0000 7f689284d700 1 -- 172.21.15.69:0/1760100970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c15ddc0 con 0x7f688c0b8bc0 2023-11-17T06:30:52.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.459+0000 7f68827fc700 1 -- 172.21.15.69:0/1760100970 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f68880075e0 con 0x7f688c0b8bc0 2023-11-17T06:30:52.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.463+0000 7f68827fc700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6870066510 0x7f68700689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.463+0000 7f68827fc700 1 -- 172.21.15.69:0/1760100970 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6888083180 con 0x7f688c0b8bc0 2023-11-17T06:30:52.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.463+0000 7f689104a700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6870066510 0x7f68700689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.463+0000 7f689104a700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6870066510 0x7f68700689d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f687c009850 tx=0x7f687c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.467+0000 7f68827fc700 1 -- 172.21.15.69:0/1760100970 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f688c15ddc0 con 0x7f688c0b8bc0 2023-11-17T06:30:52.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.647+0000 7f689284d700 1 -- 172.21.15.69:0/1760100970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f688c0b9000 con 0x7f688c0b8bc0 2023-11-17T06:30:52.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.647+0000 7f68827fc700 1 -- 172.21.15.69:0/1760100970 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f688c0b9000 con 0x7f688c0b8bc0 2023-11-17T06:30:52.654 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:52.654 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:52.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.651+0000 7f689284d700 1 -- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6870066510 msgr2=0x7f68700689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.651+0000 7f689284d700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6870066510 0x7f68700689d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f687c009850 tx=0x7f687c008030 comp rx=0 tx=0).stop 2023-11-17T06:30:52.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.655+0000 7f689284d700 1 -- 172.21.15.69:0/1760100970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 msgr2=0x7f688c14c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.655+0000 7f689284d700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 0x7f688c14c4c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6888001270 tx=0x7f688800c7d0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.655+0000 7f689284d700 1 -- 172.21.15.69:0/1760100970 shutdown_connections 2023-11-17T06:30:52.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.655+0000 7f689284d700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6870066510 0x7f68700689d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.655+0000 7f689284d700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f688c15d490 0x7f688c159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.655+0000 7f689284d700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f688c0ce310 0x7f688c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.655+0000 7f689284d700 1 --2- 172.21.15.69:0/1760100970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f688c0b8bc0 0x7f688c14c4c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.655+0000 7f689284d700 1 -- 172.21.15.69:0/1760100970 >> 172.21.15.69:0/1760100970 conn(0x7f688c06ab40 msgr2=0x7f688c0b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:52.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.655+0000 7f689284d700 1 -- 172.21.15.69:0/1760100970 shutdown_connections 2023-11-17T06:30:52.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.655+0000 7f689284d700 1 -- 172.21.15.69:0/1760100970 wait complete. 2023-11-17T06:30:52.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:52.681 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:52.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.855+0000 7f80eb375700 1 Processor -- start 2023-11-17T06:30:52.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.855+0000 7f80eb375700 1 -- start start 2023-11-17T06:30:52.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.855+0000 7f80eb375700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f80e40b8150 0x7f80e40d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.855+0000 7f80eb375700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e40b6750 con 0x7f80e415d980 2023-11-17T06:30:52.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.855+0000 7f80eb375700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e40d2a30 con 0x7f80e40b5440 2023-11-17T06:30:52.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.855+0000 7f80eb375700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e40b6980 con 0x7f80e40b8150 2023-11-17T06:30:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.855+0000 7f80e9111700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f80e415d980 0x7f80e40b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59704/0 (socket says 172.21.15.69:59704) 2023-11-17T06:30:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.855+0000 7f80e9111700 1 -- 172.21.15.69:0/1138324362 learned_addr learned my addr 172.21.15.69:0/1138324362 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80e9912700 1 --2- 172.21.15.69:0/1138324362 >> v2:172.21.15.93:3300/0 conn(0x7f80e40b8150 0x7f80e40d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80dbfff700 1 -- 172.21.15.69:0/1138324362 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431059048 0 0) 0x7f80e40b6750 con 0x7f80e415d980 2023-11-17T06:30:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80dbfff700 1 -- 172.21.15.69:0/1138324362 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80d00035d0 con 0x7f80e415d980 2023-11-17T06:30:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80e9912700 1 -- 172.21.15.69:0/1138324362 >> v1:172.21.15.93:6789/0 conn(0x7f80e40b5440 legacy=0x7f80e40d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80e9912700 1 -- 172.21.15.69:0/1138324362 >> v1:172.21.15.69:6789/0 conn(0x7f80e415d980 legacy=0x7f80e40b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80e9912700 1 -- 172.21.15.69:0/1138324362 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e40d2470 con 0x7f80e40b8150 2023-11-17T06:30:52.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80e9912700 1 --2- 172.21.15.69:0/1138324362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80e40b8150 0x7f80e40d1e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009d90 tx=0x7f80dc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88ca8e75317564ad server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80dbfff700 1 -- 172.21.15.69:0/1138324362 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00e070 con 0x7f80e40b8150 2023-11-17T06:30:52.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80dbfff700 1 -- 172.21.15.69:0/1138324362 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc003a40 con 0x7f80e40b8150 2023-11-17T06:30:52.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80dbfff700 1 -- 172.21.15.69:0/1138324362 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc003db0 con 0x7f80e40b8150 2023-11-17T06:30:52.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80eb375700 1 -- 172.21.15.69:0/1138324362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80e40b8150 msgr2=0x7f80e40d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80eb375700 1 --2- 172.21.15.69:0/1138324362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80e40b8150 0x7f80e40d1e70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009d90 tx=0x7f80dc00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:52.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80eb375700 1 -- 172.21.15.69:0/1138324362 shutdown_connections 2023-11-17T06:30:52.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80eb375700 1 --2- 172.21.15.69:0/1138324362 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80e40b8150 0x7f80e40d1e70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80eb375700 1 -- 172.21.15.69:0/1138324362 >> 172.21.15.69:0/1138324362 conn(0x7f80e40cfd30 msgr2=0x7f80e40d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:52.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80eb375700 1 -- 172.21.15.69:0/1138324362 shutdown_connections 2023-11-17T06:30:52.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.859+0000 7f80eb375700 1 -- 172.21.15.69:0/1138324362 wait complete. 2023-11-17T06:30:52.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.863+0000 7f80eb375700 1 Processor -- start 2023-11-17T06:30:52.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.863+0000 7f80eb375700 1 -- start start 2023-11-17T06:30:52.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.863+0000 7f80eb375700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80e40b5440 0x7f80e40b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.863+0000 7f80eb375700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80e40b8150 0x7f80e4150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.863+0000 7f80eb375700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80e414f6e0 0x7f80e414d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.863+0000 7f80eb375700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e414eec0 con 0x7f80e414f6e0 2023-11-17T06:30:52.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.863+0000 7f80eb375700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4150700 con 0x7f80e40b5440 2023-11-17T06:30:52.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.863+0000 7f80eb375700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e4150140 con 0x7f80e40b8150 2023-11-17T06:30:52.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e9912700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80e414f6e0 0x7f80e414d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e9912700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80e414f6e0 0x7f80e414d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45108/0 (socket says 172.21.15.69:45108) 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e9912700 1 -- 172.21.15.69:0/3817868823 learned_addr learned my addr 172.21.15.69:0/3817868823 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e8910700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80e40b8150 0x7f80e4150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e9111700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80e40b5440 0x7f80e40b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e9912700 1 -- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80e40b8150 msgr2=0x7f80e4150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e9912700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80e40b8150 0x7f80e4150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e9912700 1 -- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80e40b5440 msgr2=0x7f80e40b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e9912700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80e40b5440 0x7f80e40b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e9912700 1 -- 172.21.15.69:0/3817868823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc009a70 con 0x7f80e414f6e0 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80e9912700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80e414f6e0 0x7f80e414d090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f80e40b59c0 tx=0x7f80dc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80d9ffb700 1 -- 172.21.15.69:0/3817868823 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0048f0 con 0x7f80e414f6e0 2023-11-17T06:30:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80d9ffb700 1 -- 172.21.15.69:0/3817868823 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc009410 con 0x7f80e414f6e0 2023-11-17T06:30:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80eb375700 1 -- 172.21.15.69:0/3817868823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e4150420 con 0x7f80e414f6e0 2023-11-17T06:30:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80d9ffb700 1 -- 172.21.15.69:0/3817868823 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc012670 con 0x7f80e414f6e0 2023-11-17T06:30:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.867+0000 7f80eb375700 1 -- 172.21.15.69:0/3817868823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e414f350 con 0x7f80e414f6e0 2023-11-17T06:30:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.871+0000 7f80eb375700 1 -- 172.21.15.69:0/3817868823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e414f030 con 0x7f80e414f6e0 2023-11-17T06:30:52.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.871+0000 7f80d9ffb700 1 -- 172.21.15.69:0/3817868823 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f80dc0127d0 con 0x7f80e414f6e0 2023-11-17T06:30:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.871+0000 7f80d9ffb700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80c8066540 0x7f80c8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.871+0000 7f80d9ffb700 1 -- 172.21.15.69:0/3817868823 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f80dc085ad0 con 0x7f80e414f6e0 2023-11-17T06:30:52.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.871+0000 7f80e9111700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80c8066540 0x7f80c8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.875+0000 7f80e9111700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80c8066540 0x7f80c8068a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f80e0007fd0 tx=0x7f80e0007da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:52.879+0000 7f80d9ffb700 1 -- 172.21.15.69:0/3817868823 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f80dc052f20 con 0x7f80e414f6e0 2023-11-17T06:30:53.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.059+0000 7f80eb375700 1 -- 172.21.15.69:0/3817868823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80e4073f00 con 0x7f80e414f6e0 2023-11-17T06:30:53.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.059+0000 7f80d9ffb700 1 -- 172.21.15.69:0/3817868823 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f80dc02a020 con 0x7f80e414f6e0 2023-11-17T06:30:53.067 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:53.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 -- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80c8066540 msgr2=0x7f80c8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80c8066540 0x7f80c8068a00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f80e0007fd0 tx=0x7f80e0007da0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 -- 172.21.15.69:0/3817868823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80e414f6e0 msgr2=0x7f80e414d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80e414f6e0 0x7f80e414d090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f80e40b59c0 tx=0x7f80dc004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 -- 172.21.15.69:0/3817868823 shutdown_connections 2023-11-17T06:30:53.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80c8066540 0x7f80c8068a00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80e414f6e0 0x7f80e414d090 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80e40b8150 0x7f80e4150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 --2- 172.21.15.69:0/3817868823 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80e40b5440 0x7f80e40b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 -- 172.21.15.69:0/3817868823 >> 172.21.15.69:0/3817868823 conn(0x7f80e40cfd30 msgr2=0x7f80e40b4990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:53.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 -- 172.21.15.69:0/3817868823 shutdown_connections 2023-11-17T06:30:53.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.063+0000 7f80eb375700 1 -- 172.21.15.69:0/3817868823 wait complete. 2023-11-17T06:30:53.091 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:53.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.275+0000 7f0bc6272700 1 Processor -- start 2023-11-17T06:30:53.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.275+0000 7f0bc6272700 1 -- start start 2023-11-17T06:30:53.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.275+0000 7f0bc6272700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0bc00c9420 0x7f0bc00cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.275+0000 7f0bc6272700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc006c060 con 0x7f0bc015d3e0 2023-11-17T06:30:53.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.275+0000 7f0bc6272700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc006c340 con 0x7f0bc00cba60 2023-11-17T06:30:53.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.275+0000 7f0bc6272700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc00cbef0 con 0x7f0bc00c9420 2023-11-17T06:30:53.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc5270700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f0bc015d3e0 0x7f0bc0161950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59718/0 (socket says 172.21.15.69:59718) 2023-11-17T06:30:53.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc5270700 1 -- 172.21.15.69:0/2041783577 learned_addr learned my addr 172.21.15.69:0/2041783577 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:53.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc4a6f700 1 --2- 172.21.15.69:0/2041783577 >> v2:172.21.15.93:3300/0 conn(0x7f0bc00c9420 0x7f0bc00cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bb7fff700 1 -- 172.21.15.69:0/2041783577 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967484110 0 0) 0x7f0bc006c060 con 0x7f0bc015d3e0 2023-11-17T06:30:53.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bb7fff700 1 -- 172.21.15.69:0/2041783577 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bac0035d0 con 0x7f0bc015d3e0 2023-11-17T06:30:53.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc4a6f700 1 -- 172.21.15.69:0/2041783577 >> v1:172.21.15.93:6789/0 conn(0x7f0bc00cba60 legacy=0x7f0bc00ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bb7fff700 1 -- 172.21.15.69:0/2041783577 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494064163 0 0) 0x7f0bc006c340 con 0x7f0bc00cba60 2023-11-17T06:30:53.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc4a6f700 1 -- 172.21.15.69:0/2041783577 >> v1:172.21.15.69:6789/0 conn(0x7f0bc015d3e0 legacy=0x7f0bc0161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc4a6f700 1 -- 172.21.15.69:0/2041783577 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc006c620 con 0x7f0bc00c9420 2023-11-17T06:30:53.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc4a6f700 1 --2- 172.21.15.69:0/2041783577 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc00c9420 0x7f0bc00cb520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009850 tx=0x7f0bb0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24106b73d3bbd22d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:53.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bb7fff700 1 -- 172.21.15.69:0/2041783577 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0011830 con 0x7f0bc00c9420 2023-11-17T06:30:53.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bb7fff700 1 -- 172.21.15.69:0/2041783577 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb0011990 con 0x7f0bc00c9420 2023-11-17T06:30:53.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bb7fff700 1 -- 172.21.15.69:0/2041783577 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0011d40 con 0x7f0bc00c9420 2023-11-17T06:30:53.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc6272700 1 -- 172.21.15.69:0/2041783577 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc00c9420 msgr2=0x7f0bc00cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc6272700 1 --2- 172.21.15.69:0/2041783577 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc00c9420 0x7f0bc00cb520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009850 tx=0x7f0bb0009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:53.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc6272700 1 -- 172.21.15.69:0/2041783577 shutdown_connections 2023-11-17T06:30:53.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc6272700 1 --2- 172.21.15.69:0/2041783577 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc00c9420 0x7f0bc00cb520 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.279+0000 7f0bc6272700 1 -- 172.21.15.69:0/2041783577 >> 172.21.15.69:0/2041783577 conn(0x7f0bc00b0900 msgr2=0x7f0bc00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:53.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.283+0000 7f0bc6272700 1 -- 172.21.15.69:0/2041783577 shutdown_connections 2023-11-17T06:30:53.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.283+0000 7f0bc6272700 1 -- 172.21.15.69:0/2041783577 wait complete. 2023-11-17T06:30:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc6272700 1 Processor -- start 2023-11-17T06:30:53.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc6272700 1 -- start start 2023-11-17T06:30:53.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc6272700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc00c9420 0x7f0bc0156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc6272700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc00cba60 0x7f0bc00b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc6272700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0bc015d3e0 0x7f0bc00b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc6272700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00b2560 con 0x7f0bc00c9420 2023-11-17T06:30:53.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc6272700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00b2840 con 0x7f0bc00cba60 2023-11-17T06:30:53.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc6272700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc00b2b20 con 0x7f0bc015d3e0 2023-11-17T06:30:53.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc5270700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc00c9420 0x7f0bc0156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc5270700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc00c9420 0x7f0bc0156690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45124/0 (socket says 172.21.15.69:45124) 2023-11-17T06:30:53.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc5270700 1 -- 172.21.15.69:0/2089797788 learned_addr learned my addr 172.21.15.69:0/2089797788 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:53.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc4a6f700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc00cba60 0x7f0bc00b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc5a71700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0bc015d3e0 0x7f0bc00b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc5270700 1 -- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0bc015d3e0 msgr2=0x7f0bc00b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc5270700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0bc015d3e0 0x7f0bc00b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc5270700 1 -- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc00cba60 msgr2=0x7f0bc00b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc5270700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc00cba60 0x7f0bc00b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc5270700 1 -- 172.21.15.69:0/2089797788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00094b0 con 0x7f0bc00c9420 2023-11-17T06:30:53.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc5270700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc00c9420 0x7f0bc0156690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00c4d0 tx=0x7f0bbc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:53.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bb5ffb700 1 -- 172.21.15.69:0/2089797788 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc005d90 con 0x7f0bc00c9420 2023-11-17T06:30:53.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bb5ffb700 1 -- 172.21.15.69:0/2089797788 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc0070d0 con 0x7f0bc00c9420 2023-11-17T06:30:53.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bb5ffb700 1 -- 172.21.15.69:0/2089797788 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc007440 con 0x7f0bc00c9420 2023-11-17T06:30:53.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.287+0000 7f0bc6272700 1 -- 172.21.15.69:0/2089797788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc00b2e00 con 0x7f0bc00c9420 2023-11-17T06:30:53.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.291+0000 7f0bc6272700 1 -- 172.21.15.69:0/2089797788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc015ef70 con 0x7f0bc00c9420 2023-11-17T06:30:53.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.291+0000 7f0bc6272700 1 -- 172.21.15.69:0/2089797788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc00b3320 con 0x7f0bc00c9420 2023-11-17T06:30:53.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.291+0000 7f0bb5ffb700 1 -- 172.21.15.69:0/2089797788 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0bbc0075a0 con 0x7f0bc00c9420 2023-11-17T06:30:53.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.295+0000 7f0bb5ffb700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ba4066510 0x7f0ba40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.295+0000 7f0bb5ffb700 1 -- 172.21.15.69:0/2089797788 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0bbc0831c0 con 0x7f0bc00c9420 2023-11-17T06:30:53.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.295+0000 7f0bc4a6f700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ba4066510 0x7f0ba40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.299+0000 7f0bc4a6f700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ba4066510 0x7f0ba40689d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00090b0 tx=0x7f0bb0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:53.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.303+0000 7f0bb5ffb700 1 -- 172.21.15.69:0/2089797788 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0bc00b3320 con 0x7f0bc00c9420 2023-11-17T06:30:53.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.475+0000 7f0bc6272700 1 -- 172.21.15.69:0/2089797788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0bc00b3320 con 0x7f0bc00c9420 2023-11-17T06:30:53.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.475+0000 7f0bb5ffb700 1 -- 172.21.15.69:0/2089797788 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0bc00b3320 con 0x7f0bc00c9420 2023-11-17T06:30:53.482 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 -- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ba4066510 msgr2=0x7f0ba40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ba4066510 0x7f0ba40689d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00090b0 tx=0x7f0bb0008030 comp rx=0 tx=0).stop 2023-11-17T06:30:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 -- 172.21.15.69:0/2089797788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc00c9420 msgr2=0x7f0bc0156690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc00c9420 0x7f0bc0156690 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00c4d0 tx=0x7f0bbc00c7e0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 -- 172.21.15.69:0/2089797788 shutdown_connections 2023-11-17T06:30:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ba4066510 0x7f0ba40689d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0bc015d3e0 0x7f0bc00b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bc00cba60 0x7f0bc00b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 --2- 172.21.15.69:0/2089797788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0bc00c9420 0x7f0bc0156690 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 -- 172.21.15.69:0/2089797788 >> 172.21.15.69:0/2089797788 conn(0x7f0bc00b0900 msgr2=0x7f0bc015bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 -- 172.21.15.69:0/2089797788 shutdown_connections 2023-11-17T06:30:53.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.479+0000 7f0bc6272700 1 -- 172.21.15.69:0/2089797788 wait complete. 2023-11-17T06:30:53.505 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:53.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.679+0000 7fab4c8e2700 1 Processor -- start 2023-11-17T06:30:53.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.679+0000 7fab4c8e2700 1 -- start start 2023-11-17T06:30:53.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.679+0000 7fab4c8e2700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fab4815b980 0x7fab4815f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.679+0000 7fab4c8e2700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4806fc20 con 0x7fab480719e0 2023-11-17T06:30:53.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.679+0000 7fab4c8e2700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4815fcc0 con 0x7fab480c9b30 2023-11-17T06:30:53.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.679+0000 7fab4c8e2700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab48070430 con 0x7fab4815b980 2023-11-17T06:30:53.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.679+0000 7fab46ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fab480719e0 0x7fab480c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59726/0 (socket says 172.21.15.69:59726) 2023-11-17T06:30:53.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.679+0000 7fab46ffd700 1 -- 172.21.15.69:0/4079711325 learned_addr learned my addr 172.21.15.69:0/4079711325 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:53.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.679+0000 7fab477fe700 1 --2- 172.21.15.69:0/4079711325 >> v2:172.21.15.93:3300/0 conn(0x7fab4815b980 0x7fab4815f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab467fc700 1 -- 172.21.15.69:0/4079711325 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526255278 0 0) 0x7fab4806fc20 con 0x7fab480719e0 2023-11-17T06:30:53.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab467fc700 1 -- 172.21.15.69:0/4079711325 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab300035d0 con 0x7fab480719e0 2023-11-17T06:30:53.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab477fe700 1 -- 172.21.15.69:0/4079711325 >> v1:172.21.15.93:6789/0 conn(0x7fab480c9b30 legacy=0x7fab4815bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab477fe700 1 -- 172.21.15.69:0/4079711325 >> v1:172.21.15.69:6789/0 conn(0x7fab480719e0 legacy=0x7fab480c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab467fc700 1 -- 172.21.15.69:0/4079711325 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144675095 0 0) 0x7fab4815fcc0 con 0x7fab480c9b30 2023-11-17T06:30:53.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab477fe700 1 -- 172.21.15.69:0/4079711325 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4806fe70 con 0x7fab4815b980 2023-11-17T06:30:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab477fe700 1 --2- 172.21.15.69:0/4079711325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab4815b980 0x7fab4815f780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab38009850 tx=0x7fab38009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f5bd491ae53a107 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab467fc700 1 -- 172.21.15.69:0/4079711325 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38011830 con 0x7fab4815b980 2023-11-17T06:30:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab467fc700 1 -- 172.21.15.69:0/4079711325 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab38011990 con 0x7fab4815b980 2023-11-17T06:30:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab467fc700 1 -- 172.21.15.69:0/4079711325 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38011d40 con 0x7fab4815b980 2023-11-17T06:30:53.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab4c8e2700 1 -- 172.21.15.69:0/4079711325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab4815b980 msgr2=0x7fab4815f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab4c8e2700 1 --2- 172.21.15.69:0/4079711325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab4815b980 0x7fab4815f780 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fab38009850 tx=0x7fab38009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:53.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab4c8e2700 1 -- 172.21.15.69:0/4079711325 shutdown_connections 2023-11-17T06:30:53.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab4c8e2700 1 --2- 172.21.15.69:0/4079711325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab4815b980 0x7fab4815f780 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab4c8e2700 1 -- 172.21.15.69:0/4079711325 >> 172.21.15.69:0/4079711325 conn(0x7fab480b0900 msgr2=0x7fab480b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:53.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab4c8e2700 1 -- 172.21.15.69:0/4079711325 shutdown_connections 2023-11-17T06:30:53.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.683+0000 7fab4c8e2700 1 -- 172.21.15.69:0/4079711325 wait complete. 2023-11-17T06:30:53.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab4c8e2700 1 Processor -- start 2023-11-17T06:30:53.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab4c8e2700 1 -- start start 2023-11-17T06:30:53.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab4c8e2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab480719e0 0x7fab4815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab4c8e2700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fab480c9b30 0x7fab4815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab4c8e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4815b980 0x7fab480b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab4c8e2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48154c10 con 0x7fab4815b980 2023-11-17T06:30:53.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab4c8e2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4815ea70 con 0x7fab480719e0 2023-11-17T06:30:53.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab4c8e2700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab480c7cd0 con 0x7fab480c9b30 2023-11-17T06:30:53.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab47fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4815b980 0x7fab480b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab47fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4815b980 0x7fab480b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45130/0 (socket says 172.21.15.69:45130) 2023-11-17T06:30:53.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab47fff700 1 -- 172.21.15.69:0/3137664209 learned_addr learned my addr 172.21.15.69:0/3137664209 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:53.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab46ffd700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fab480c9b30 0x7fab4815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab477fe700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab480719e0 0x7fab4815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab47fff700 1 -- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fab480c9b30 msgr2=0x7fab4815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab47fff700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fab480c9b30 0x7fab4815ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab47fff700 1 -- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab480719e0 msgr2=0x7fab4815c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab47fff700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab480719e0 0x7fab4815c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.687+0000 7fab47fff700 1 -- 172.21.15.69:0/3137664209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab380094b0 con 0x7fab4815b980 2023-11-17T06:30:53.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.691+0000 7fab47fff700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4815b980 0x7fab480b2bd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fab4000cc40 tx=0x7fab4000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:53.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.691+0000 7fab2ffff700 1 -- 172.21.15.69:0/3137664209 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40003e50 con 0x7fab4815b980 2023-11-17T06:30:53.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.691+0000 7fab2ffff700 1 -- 172.21.15.69:0/3137664209 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4000a6b0 con 0x7fab4815b980 2023-11-17T06:30:53.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.691+0000 7fab4c8e2700 1 -- 172.21.15.69:0/3137664209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4815d350 con 0x7fab4815b980 2023-11-17T06:30:53.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.691+0000 7fab2ffff700 1 -- 172.21.15.69:0/3137664209 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4000aa60 con 0x7fab4815b980 2023-11-17T06:30:53.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.691+0000 7fab4c8e2700 1 -- 172.21.15.69:0/3137664209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab480c5f40 con 0x7fab4815b980 2023-11-17T06:30:53.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.691+0000 7fab4c8e2700 1 -- 172.21.15.69:0/3137664209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab48073f00 con 0x7fab4815b980 2023-11-17T06:30:53.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.691+0000 7fab2ffff700 1 -- 172.21.15.69:0/3137664209 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fab4000abc0 con 0x7fab4815b980 2023-11-17T06:30:53.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.695+0000 7fab2ffff700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fab34066510 0x7fab340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:53.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.695+0000 7fab2ffff700 1 -- 172.21.15.69:0/3137664209 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fab40083840 con 0x7fab4815b980 2023-11-17T06:30:53.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.695+0000 7fab477fe700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fab34066510 0x7fab340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:53.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.695+0000 7fab477fe700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fab34066510 0x7fab340689d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fab380090b0 tx=0x7fab3801c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:53.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.703+0000 7fab2ffff700 1 -- 172.21.15.69:0/3137664209 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fab40050d30 con 0x7fab4815b980 2023-11-17T06:30:53.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.879+0000 7fab4c8e2700 1 -- 172.21.15.69:0/3137664209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab480cc690 con 0x7fab4815b980 2023-11-17T06:30:53.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.879+0000 7fab2ffff700 1 -- 172.21.15.69:0/3137664209 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab40017020 con 0x7fab4815b980 2023-11-17T06:30:53.885 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:53.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.879+0000 7fab4c8e2700 1 -- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fab34066510 msgr2=0x7fab340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.879+0000 7fab4c8e2700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fab34066510 0x7fab340689d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fab380090b0 tx=0x7fab3801c040 comp rx=0 tx=0).stop 2023-11-17T06:30:53.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.879+0000 7fab4c8e2700 1 -- 172.21.15.69:0/3137664209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4815b980 msgr2=0x7fab480b2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:53.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.879+0000 7fab4c8e2700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4815b980 0x7fab480b2bd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fab4000cc40 tx=0x7fab4000cf50 comp rx=0 tx=0).stop 2023-11-17T06:30:53.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.883+0000 7fab4c8e2700 1 -- 172.21.15.69:0/3137664209 shutdown_connections 2023-11-17T06:30:53.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.883+0000 7fab4c8e2700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fab34066510 0x7fab340689d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.883+0000 7fab4c8e2700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab4815b980 0x7fab480b2bd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.883+0000 7fab4c8e2700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fab480c9b30 0x7fab4815ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.883+0000 7fab4c8e2700 1 --2- 172.21.15.69:0/3137664209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fab480719e0 0x7fab4815c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:53.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.883+0000 7fab4c8e2700 1 -- 172.21.15.69:0/3137664209 >> 172.21.15.69:0/3137664209 conn(0x7fab480b0900 msgr2=0x7fab480aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:53.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.883+0000 7fab4c8e2700 1 -- 172.21.15.69:0/3137664209 shutdown_connections 2023-11-17T06:30:53.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:53.883+0000 7fab4c8e2700 1 -- 172.21.15.69:0/3137664209 wait complete. 2023-11-17T06:30:53.909 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.083+0000 7f7dc637a700 1 Processor -- start 2023-11-17T06:30:54.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.083+0000 7f7dc637a700 1 -- start start 2023-11-17T06:30:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc637a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7dc015d490 0x7f7dc00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc637a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7dc00d13d0 0x7f7dc00cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc637a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7dc00ce310 0x7f7dc00b4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc637a700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc00ce770 con 0x7f7dc015d490 2023-11-17T06:30:54.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc637a700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc00d1bb0 con 0x7f7dc00ce310 2023-11-17T06:30:54.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc637a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc00d1e90 con 0x7f7dc00d13d0 2023-11-17T06:30:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5378700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7dc015d490 0x7f7dc00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5b79700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7dc00ce310 0x7f7dc00b4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5378700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7dc015d490 0x7f7dc00b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49696/0 (socket says 172.21.15.69:49696) 2023-11-17T06:30:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5378700 1 -- 172.21.15.69:0/2089386859 learned_addr learned my addr 172.21.15.69:0/2089386859 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc4b77700 1 --2- 172.21.15.69:0/2089386859 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7dc00d13d0 0x7f7dc00cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5b79700 1 -- 172.21.15.69:0/2089386859 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7dc00d13d0 msgr2=0x7f7dc00cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:54.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5b79700 1 --2- 172.21.15.69:0/2089386859 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7dc00d13d0 0x7f7dc00cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5b79700 1 -- 172.21.15.69:0/2089386859 >> v2:172.21.15.69:3300/0 conn(0x7f7dc015d490 msgr2=0x7f7dc00b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5b79700 1 --2- 172.21.15.69:0/2089386859 >> v2:172.21.15.69:3300/0 conn(0x7f7dc015d490 0x7f7dc00b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5b79700 1 -- 172.21.15.69:0/2089386859 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc00d2170 con 0x7f7dc00ce310 2023-11-17T06:30:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5378700 1 --2- 172.21.15.69:0/2089386859 >> v2:172.21.15.69:3300/0 conn(0x7f7dc015d490 0x7f7dc00b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:54.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7dc5b79700 1 --2- 172.21.15.69:0/2089386859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dc00ce310 0x7f7dc00b4a80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7dc006d550 tx=0x7f7db800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6e7bb4954031d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:54.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7db7fff700 1 -- 172.21.15.69:0/2089386859 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800e070 con 0x7f7dc00ce310 2023-11-17T06:30:54.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7db7fff700 1 -- 172.21.15.69:0/2089386859 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db800bb20 con 0x7f7dc00ce310 2023-11-17T06:30:54.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.087+0000 7f7db7fff700 1 -- 172.21.15.69:0/2089386859 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8012430 con 0x7f7dc00ce310 2023-11-17T06:30:54.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 -- 172.21.15.69:0/2089386859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dc00ce310 msgr2=0x7f7dc00b4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 --2- 172.21.15.69:0/2089386859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dc00ce310 0x7f7dc00b4a80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7dc006d550 tx=0x7f7db800b330 comp rx=0 tx=0).stop 2023-11-17T06:30:54.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 -- 172.21.15.69:0/2089386859 shutdown_connections 2023-11-17T06:30:54.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 --2- 172.21.15.69:0/2089386859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dc00ce310 0x7f7dc00b4a80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 --2- 172.21.15.69:0/2089386859 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7dc00d13d0 0x7f7dc00cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 --2- 172.21.15.69:0/2089386859 >> v2:172.21.15.69:3300/0 conn(0x7f7dc015d490 0x7f7dc00b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 -- 172.21.15.69:0/2089386859 >> 172.21.15.69:0/2089386859 conn(0x7f7dc006ab40 msgr2=0x7f7dc006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:54.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 -- 172.21.15.69:0/2089386859 shutdown_connections 2023-11-17T06:30:54.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 -- 172.21.15.69:0/2089386859 wait complete. 2023-11-17T06:30:54.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 Processor -- start 2023-11-17T06:30:54.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.091+0000 7f7dc637a700 1 -- start start 2023-11-17T06:30:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc637a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dc00ce310 0x7f7dc014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc637a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7dc00d13d0 0x7f7dc014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc637a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dc015d490 0x7f7dc01504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc637a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc01602c0 con 0x7f7dc015d490 2023-11-17T06:30:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc637a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc0150a20 con 0x7f7dc00ce310 2023-11-17T06:30:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc637a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc0160780 con 0x7f7dc00d13d0 2023-11-17T06:30:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc5b79700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dc015d490 0x7f7dc01504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc5b79700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dc015d490 0x7f7dc01504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49698/0 (socket says 172.21.15.69:49698) 2023-11-17T06:30:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc5b79700 1 -- 172.21.15.69:0/1112283782 learned_addr learned my addr 172.21.15.69:0/1112283782 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:54.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc5378700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dc00ce310 0x7f7dc014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc4b77700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7dc00d13d0 0x7f7dc014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc5b79700 1 -- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7dc00d13d0 msgr2=0x7f7dc014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc5b79700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7dc00d13d0 0x7f7dc014ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc5b79700 1 -- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dc00ce310 msgr2=0x7f7dc014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc5b79700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dc00ce310 0x7f7dc014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc5b79700 1 -- 172.21.15.69:0/1112283782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dbc009570 con 0x7f7dc015d490 2023-11-17T06:30:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc5b79700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dc015d490 0x7f7dc01504e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00d1cf0 tx=0x7f7db8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7db5ffb700 1 -- 172.21.15.69:0/1112283782 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db80048e0 con 0x7f7dc015d490 2023-11-17T06:30:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7db5ffb700 1 -- 172.21.15.69:0/1112283782 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db8020070 con 0x7f7dc015d490 2023-11-17T06:30:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc637a700 1 -- 172.21.15.69:0/1112283782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db8009a70 con 0x7f7dc015d490 2023-11-17T06:30:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7db5ffb700 1 -- 172.21.15.69:0/1112283782 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db80276c0 con 0x7f7dc015d490 2023-11-17T06:30:54.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.095+0000 7f7dc637a700 1 -- 172.21.15.69:0/1112283782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc015ec50 con 0x7f7dc015d490 2023-11-17T06:30:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.099+0000 7f7dc637a700 1 -- 172.21.15.69:0/1112283782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc00c7b80 con 0x7f7dc015d490 2023-11-17T06:30:54.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.099+0000 7f7db5ffb700 1 -- 172.21.15.69:0/1112283782 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7db8012430 con 0x7f7dc015d490 2023-11-17T06:30:54.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.099+0000 7f7db5ffb700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7da4066510 0x7f7da40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.099+0000 7f7db5ffb700 1 -- 172.21.15.69:0/1112283782 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7db8022070 con 0x7f7dc015d490 2023-11-17T06:30:54.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.099+0000 7f7dc5378700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7da4066510 0x7f7da40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.103+0000 7f7dc5378700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7da4066510 0x7f7da40689d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00c6140 tx=0x7f7dbc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:54.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.107+0000 7f7db5ffb700 1 -- 172.21.15.69:0/1112283782 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7dc00c7b80 con 0x7f7dc015d490 2023-11-17T06:30:54.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.291+0000 7f7dc637a700 1 -- 172.21.15.69:0/1112283782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7dc00c7b80 con 0x7f7dc015d490 2023-11-17T06:30:54.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7db5ffb700 1 -- 172.21.15.69:0/1112283782 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7dc00c7b80 con 0x7f7dc015d490 2023-11-17T06:30:54.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 -- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7da4066510 msgr2=0x7f7da40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7da4066510 0x7f7da40689d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00c6140 tx=0x7f7dbc008040 comp rx=0 tx=0).stop 2023-11-17T06:30:54.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 -- 172.21.15.69:0/1112283782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dc015d490 msgr2=0x7f7dc01504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dc015d490 0x7f7dc01504e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00d1cf0 tx=0x7f7db8004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 -- 172.21.15.69:0/1112283782 shutdown_connections 2023-11-17T06:30:54.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7da4066510 0x7f7da40689d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dc015d490 0x7f7dc01504e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7dc00d13d0 0x7f7dc014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 --2- 172.21.15.69:0/1112283782 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7dc00ce310 0x7f7dc014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 -- 172.21.15.69:0/1112283782 >> 172.21.15.69:0/1112283782 conn(0x7f7dc006ab40 msgr2=0x7f7dc0159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:54.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 -- 172.21.15.69:0/1112283782 shutdown_connections 2023-11-17T06:30:54.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.295+0000 7f7dc637a700 1 -- 172.21.15.69:0/1112283782 wait complete. 2023-11-17T06:30:54.304 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2023-11-17T06:30:54.323 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-17T06:30:54.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:54.323 DEBUG:teuthology.orchestra.run.smithi093:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-17T06:30:54.372 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:54.372 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:30:54.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:54.372 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-17T06:30:54.541 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:30:54.541 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:54.562 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:30:54.562 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:54.622 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:54.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.839+0000 7fd67a573700 1 Processor -- start 2023-11-17T06:30:54.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.839+0000 7fd67a573700 1 -- start start 2023-11-17T06:30:54.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.839+0000 7fd67a573700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd67415d490 0x7fd6740b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.839+0000 7fd67a573700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd6740d13d0 0x7fd6740cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.839+0000 7fd67a573700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6740d1bb0 con 0x7fd6740ce310 2023-11-17T06:30:54.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.839+0000 7fd67a573700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6740ce7a0 con 0x7fd6740d13d0 2023-11-17T06:30:54.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.839+0000 7fd67a573700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6740d1e90 con 0x7fd67415d490 2023-11-17T06:30:54.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd678d70700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd6740d13d0 0x7fd6740cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd678d70700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd6740d13d0 0x7fd6740cddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49714/0 (socket says 172.21.15.69:49714) 2023-11-17T06:30:54.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd678d70700 1 -- 172.21.15.69:0/3164226909 learned_addr learned my addr 172.21.15.69:0/3164226909 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:54.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd679571700 1 --2- 172.21.15.69:0/3164226909 >> v2:172.21.15.93:3300/0 conn(0x7fd67415d490 0x7fd6740b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd678d70700 1 -- 172.21.15.69:0/3164226909 >> v2:172.21.15.93:3300/0 conn(0x7fd67415d490 msgr2=0x7fd6740b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:54.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd678d70700 1 --2- 172.21.15.69:0/3164226909 >> v2:172.21.15.93:3300/0 conn(0x7fd67415d490 0x7fd6740b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd678d70700 1 -- 172.21.15.69:0/3164226909 >> v1:172.21.15.93:6789/0 conn(0x7fd6740ce310 legacy=0x7fd6740b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:54.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd678d70700 1 -- 172.21.15.69:0/3164226909 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6740d2170 con 0x7fd6740d13d0 2023-11-17T06:30:54.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd679571700 1 --2- 172.21.15.69:0/3164226909 >> v2:172.21.15.93:3300/0 conn(0x7fd67415d490 0x7fd6740b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:54.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd678d70700 1 --2- 172.21.15.69:0/3164226909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6740d13d0 0x7fd6740cddd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd674066df0 tx=0x7fd664009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2243f5deb45ac server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:54.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd66bfff700 1 -- 172.21.15.69:0/3164226909 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66400b8a0 con 0x7fd6740d13d0 2023-11-17T06:30:54.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd66bfff700 1 -- 172.21.15.69:0/3164226909 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66400ba00 con 0x7fd6740d13d0 2023-11-17T06:30:54.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd66bfff700 1 -- 172.21.15.69:0/3164226909 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66400bd90 con 0x7fd6740d13d0 2023-11-17T06:30:54.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd67a573700 1 -- 172.21.15.69:0/3164226909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6740d13d0 msgr2=0x7fd6740cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd67a573700 1 --2- 172.21.15.69:0/3164226909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6740d13d0 0x7fd6740cddd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd674066df0 tx=0x7fd664009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd67a573700 1 -- 172.21.15.69:0/3164226909 shutdown_connections 2023-11-17T06:30:54.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd67a573700 1 --2- 172.21.15.69:0/3164226909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6740d13d0 0x7fd6740cddd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd67a573700 1 --2- 172.21.15.69:0/3164226909 >> v2:172.21.15.93:3300/0 conn(0x7fd67415d490 0x7fd6740b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.843+0000 7fd67a573700 1 -- 172.21.15.69:0/3164226909 >> 172.21.15.69:0/3164226909 conn(0x7fd67406ab40 msgr2=0x7fd67406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:54.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.847+0000 7fd67a573700 1 -- 172.21.15.69:0/3164226909 shutdown_connections 2023-11-17T06:30:54.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.847+0000 7fd67a573700 1 -- 172.21.15.69:0/3164226909 wait complete. 2023-11-17T06:30:54.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.847+0000 7fd67a573700 1 Processor -- start 2023-11-17T06:30:54.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.847+0000 7fd67a573700 1 -- start start 2023-11-17T06:30:54.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd67a573700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd6740ce310 0x7fd67415d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd67a573700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6740d13d0 0x7fd6741579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd67a573700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67415d490 0x7fd67415ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd67a573700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd674157f00 con 0x7fd67415d490 2023-11-17T06:30:54.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd67a573700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67415eaf0 con 0x7fd6740d13d0 2023-11-17T06:30:54.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd67a573700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67415f4c0 con 0x7fd6740ce310 2023-11-17T06:30:54.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd679d72700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67415d490 0x7fd67415ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd679d72700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67415d490 0x7fd67415ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49722/0 (socket says 172.21.15.69:49722) 2023-11-17T06:30:54.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd679d72700 1 -- 172.21.15.69:0/1587117669 learned_addr learned my addr 172.21.15.69:0/1587117669 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:54.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd678d70700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6740d13d0 0x7fd6741579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd679571700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd6740ce310 0x7fd67415d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd679d72700 1 -- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd6740ce310 msgr2=0x7fd67415d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd679d72700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd6740ce310 0x7fd67415d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd679d72700 1 -- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6740d13d0 msgr2=0x7fd6741579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:54.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd679d72700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6740d13d0 0x7fd6741579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:54.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd679d72700 1 -- 172.21.15.69:0/1587117669 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd664009570 con 0x7fd67415d490 2023-11-17T06:30:54.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd679d72700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67415d490 0x7fd67415ef80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00cb50 tx=0x7fd66c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:54.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd669ffb700 1 -- 172.21.15.69:0/1587117669 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c003c20 con 0x7fd67415d490 2023-11-17T06:30:54.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd669ffb700 1 -- 172.21.15.69:0/1587117669 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66c003d80 con 0x7fd67415d490 2023-11-17T06:30:54.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd669ffb700 1 -- 172.21.15.69:0/1587117669 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c00aa20 con 0x7fd67415d490 2023-11-17T06:30:54.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd67a573700 1 -- 172.21.15.69:0/1587117669 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67415dee0 con 0x7fd67415d490 2023-11-17T06:30:54.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.851+0000 7fd67a573700 1 -- 172.21.15.69:0/1587117669 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67415e4a0 con 0x7fd67415d490 2023-11-17T06:30:54.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.855+0000 7fd67a573700 1 -- 172.21.15.69:0/1587117669 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd674073f00 con 0x7fd67415d490 2023-11-17T06:30:54.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.855+0000 7fd669ffb700 1 -- 172.21.15.69:0/1587117669 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd66c00ab80 con 0x7fd67415d490 2023-11-17T06:30:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.855+0000 7fd669ffb700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd658066510 0x7fd6580689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.855+0000 7fd669ffb700 1 -- 172.21.15.69:0/1587117669 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd66c083dc0 con 0x7fd67415d490 2023-11-17T06:30:54.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.859+0000 7fd679571700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd658066510 0x7fd6580689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:54.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.859+0000 7fd679571700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd658066510 0x7fd6580689d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd6700099f0 tx=0x7fd670008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:54.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:54.863+0000 7fd669ffb700 1 -- 172.21.15.69:0/1587117669 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd66c0512b0 con 0x7fd67415d490 2023-11-17T06:30:55.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.035+0000 7fd67a573700 1 -- 172.21.15.69:0/1587117669 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd67415ec30 con 0x7fd67415d490 2023-11-17T06:30:55.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.039+0000 7fd669ffb700 1 -- 172.21.15.69:0/1587117669 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7fd66c0548d0 con 0x7fd67415d490 2023-11-17T06:30:55.045 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:55.045 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:55.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 -- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd658066510 msgr2=0x7fd6580689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd658066510 0x7fd6580689d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd6700099f0 tx=0x7fd670008040 comp rx=0 tx=0).stop 2023-11-17T06:30:55.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 -- 172.21.15.69:0/1587117669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67415d490 msgr2=0x7fd67415ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67415d490 0x7fd67415ef80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00cb50 tx=0x7fd66c00ce60 comp rx=0 tx=0).stop 2023-11-17T06:30:55.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 -- 172.21.15.69:0/1587117669 shutdown_connections 2023-11-17T06:30:55.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd658066510 0x7fd6580689d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd67415d490 0x7fd67415ef80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd6740d13d0 0x7fd6741579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 --2- 172.21.15.69:0/1587117669 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd6740ce310 0x7fd67415d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 -- 172.21.15.69:0/1587117669 >> 172.21.15.69:0/1587117669 conn(0x7fd67406ab40 msgr2=0x7fd67406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:55.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 -- 172.21.15.69:0/1587117669 shutdown_connections 2023-11-17T06:30:55.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.043+0000 7fd67a573700 1 -- 172.21.15.69:0/1587117669 wait complete. 2023-11-17T06:30:55.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:55.071 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:55.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.247+0000 7fb3e132e700 1 Processor -- start 2023-11-17T06:30:55.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.247+0000 7fb3e132e700 1 -- start start 2023-11-17T06:30:55.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.247+0000 7fb3e132e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb3dc15d3e0 0x7fb3dc0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.247+0000 7fb3e132e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3dc161950 0x7fb3dc0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3dc0c9960 con 0x7fb3dc0cba60 2023-11-17T06:30:55.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3dc0cbef0 con 0x7fb3dc15d3e0 2023-11-17T06:30:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc06c060 con 0x7fb3dc161950 2023-11-17T06:30:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3dbfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb3dc15d3e0 0x7fb3dc0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3dbfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb3dc15d3e0 0x7fb3dc0c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49736/0 (socket says 172.21.15.69:49736) 2023-11-17T06:30:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3dbfff700 1 -- 172.21.15.69:0/2554076915 learned_addr learned my addr 172.21.15.69:0/2554076915 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3db7fe700 1 --2- 172.21.15.69:0/2554076915 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3dc161950 0x7fb3dc0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3dbfff700 1 -- 172.21.15.69:0/2554076915 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3dc161950 msgr2=0x7fb3dc0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3dbfff700 1 --2- 172.21.15.69:0/2554076915 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3dc161950 0x7fb3dc0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3dbfff700 1 -- 172.21.15.69:0/2554076915 >> v1:172.21.15.69:6789/0 conn(0x7fb3dc0cba60 legacy=0x7fb3dc0ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3dbfff700 1 -- 172.21.15.69:0/2554076915 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc06c340 con 0x7fb3dc15d3e0 2023-11-17T06:30:55.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3dbfff700 1 --2- 172.21.15.69:0/2554076915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc15d3e0 0x7fb3dc0c9420 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009910 tx=0x7fb3cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2232b725d661c7b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3daffd700 1 -- 172.21.15.69:0/2554076915 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011830 con 0x7fb3dc15d3e0 2023-11-17T06:30:55.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3daffd700 1 -- 172.21.15.69:0/2554076915 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc011990 con 0x7fb3dc15d3e0 2023-11-17T06:30:55.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3daffd700 1 -- 172.21.15.69:0/2554076915 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc011d40 con 0x7fb3dc15d3e0 2023-11-17T06:30:55.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 -- 172.21.15.69:0/2554076915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc15d3e0 msgr2=0x7fb3dc0c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 --2- 172.21.15.69:0/2554076915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc15d3e0 0x7fb3dc0c9420 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009910 tx=0x7fb3cc009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:55.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 -- 172.21.15.69:0/2554076915 shutdown_connections 2023-11-17T06:30:55.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 --2- 172.21.15.69:0/2554076915 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3dc161950 0x7fb3dc0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 --2- 172.21.15.69:0/2554076915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc15d3e0 0x7fb3dc0c9420 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 -- 172.21.15.69:0/2554076915 >> 172.21.15.69:0/2554076915 conn(0x7fb3dc0b0900 msgr2=0x7fb3dc0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:55.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 -- 172.21.15.69:0/2554076915 shutdown_connections 2023-11-17T06:30:55.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.251+0000 7fb3e132e700 1 -- 172.21.15.69:0/2554076915 wait complete. 2023-11-17T06:30:55.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.255+0000 7fb3e132e700 1 Processor -- start 2023-11-17T06:30:55.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.255+0000 7fb3e132e700 1 -- start start 2023-11-17T06:30:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3e132e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc0cba60 0x7fb3dc1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3e132e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3dc15d3e0 0x7fb3dc0b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3e132e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3dc161950 0x7fb3dc1f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3e132e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc1f6e80 con 0x7fb3dc0cba60 2023-11-17T06:30:55.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3e132e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0c6020 con 0x7fb3dc161950 2023-11-17T06:30:55.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3e132e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3dc0c6300 con 0x7fb3dc15d3e0 2023-11-17T06:30:55.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc0cba60 0x7fb3dc1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3dbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc0cba60 0x7fb3dc1561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49742/0 (socket says 172.21.15.69:49742) 2023-11-17T06:30:55.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3dbfff700 1 -- 172.21.15.69:0/1580203424 learned_addr learned my addr 172.21.15.69:0/1580203424 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3e0b2d700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3dc161950 0x7fb3dc1f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3db7fe700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3dc15d3e0 0x7fb3dc0b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3dbfff700 1 -- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3dc15d3e0 msgr2=0x7fb3dc0b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3dbfff700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3dc15d3e0 0x7fb3dc0b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3dbfff700 1 -- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3dc161950 msgr2=0x7fb3dc1f60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3dbfff700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3dc161950 0x7fb3dc1f60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3dbfff700 1 -- 172.21.15.69:0/1580203424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc009570 con 0x7fb3dc0cba60 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3dbfff700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc0cba60 0x7fb3dc1561b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc000c00 tx=0x7fb3cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3d8ff9700 1 -- 172.21.15.69:0/1580203424 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc004610 con 0x7fb3dc0cba60 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3d8ff9700 1 -- 172.21.15.69:0/1580203424 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3cc0036c0 con 0x7fb3dc0cba60 2023-11-17T06:30:55.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3d8ff9700 1 -- 172.21.15.69:0/1580203424 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc003a50 con 0x7fb3dc0cba60 2023-11-17T06:30:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3e132e700 1 -- 172.21.15.69:0/1580203424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3dc0c65e0 con 0x7fb3dc0cba60 2023-11-17T06:30:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3e132e700 1 -- 172.21.15.69:0/1580203424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3dc0c6ba0 con 0x7fb3dc0cba60 2023-11-17T06:30:55.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.259+0000 7fb3e132e700 1 -- 172.21.15.69:0/1580203424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3dc073f00 con 0x7fb3dc0cba60 2023-11-17T06:30:55.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.263+0000 7fb3d8ff9700 1 -- 172.21.15.69:0/1580203424 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb3cc003bb0 con 0x7fb3dc0cba60 2023-11-17T06:30:55.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.263+0000 7fb3d8ff9700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb3c8066510 0x7fb3c80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.263+0000 7fb3d8ff9700 1 -- 172.21.15.69:0/1580203424 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fb3cc021030 con 0x7fb3dc0cba60 2023-11-17T06:30:55.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.263+0000 7fb3db7fe700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb3c8066510 0x7fb3c80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.267+0000 7fb3db7fe700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb3c8066510 0x7fb3c80689d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0cf7e0 tx=0x7fb3d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.271+0000 7fb3d8ff9700 1 -- 172.21.15.69:0/1580203424 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb3cc052a60 con 0x7fb3dc0cba60 2023-11-17T06:30:55.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.451+0000 7fb3e132e700 1 -- 172.21.15.69:0/1580203424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3dc0b4d50 con 0x7fb3dc0cba60 2023-11-17T06:30:55.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.451+0000 7fb3d8ff9700 1 -- 172.21.15.69:0/1580203424 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3cc003e60 con 0x7fb3dc0cba60 2023-11-17T06:30:55.456 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:55.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.451+0000 7fb3e132e700 1 -- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb3c8066510 msgr2=0x7fb3c80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.451+0000 7fb3e132e700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb3c8066510 0x7fb3c80689d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc0cf7e0 tx=0x7fb3d0008040 comp rx=0 tx=0).stop 2023-11-17T06:30:55.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.451+0000 7fb3e132e700 1 -- 172.21.15.69:0/1580203424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc0cba60 msgr2=0x7fb3dc1561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.451+0000 7fb3e132e700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc0cba60 0x7fb3dc1561b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc000c00 tx=0x7fb3cc004770 comp rx=0 tx=0).stop 2023-11-17T06:30:55.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.455+0000 7fb3e132e700 1 -- 172.21.15.69:0/1580203424 shutdown_connections 2023-11-17T06:30:55.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.455+0000 7fb3e132e700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb3c8066510 0x7fb3c80689d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.455+0000 7fb3e132e700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb3dc161950 0x7fb3dc1f60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.455+0000 7fb3e132e700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb3dc15d3e0 0x7fb3dc0b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.455+0000 7fb3e132e700 1 --2- 172.21.15.69:0/1580203424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3dc0cba60 0x7fb3dc1561b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.455+0000 7fb3e132e700 1 -- 172.21.15.69:0/1580203424 >> 172.21.15.69:0/1580203424 conn(0x7fb3dc0b0900 msgr2=0x7fb3dc15b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:55.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.455+0000 7fb3e132e700 1 -- 172.21.15.69:0/1580203424 shutdown_connections 2023-11-17T06:30:55.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.455+0000 7fb3e132e700 1 -- 172.21.15.69:0/1580203424 wait complete. 2023-11-17T06:30:55.486 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:55.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.651+0000 7f896aa63700 1 Processor -- start 2023-11-17T06:30:55.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.651+0000 7f896aa63700 1 -- start start 2023-11-17T06:30:55.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f896aa63700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f896415d980 0x7f89640b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f896aa63700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f89640b5270 0x7f89640d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f896aa63700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89640d1ca0 0x7f896406ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f896aa63700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89640b6750 con 0x7f896415d980 2023-11-17T06:30:55.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f896aa63700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89640b56d0 con 0x7f89640b5270 2023-11-17T06:30:55.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f896aa63700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640d2a30 con 0x7f89640d1ca0 2023-11-17T06:30:55.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f8963fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f896415d980 0x7f89640b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f8963fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f896415d980 0x7f89640b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49750/0 (socket says 172.21.15.69:49750) 2023-11-17T06:30:55.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f8963fff700 1 -- 172.21.15.69:0/1804430665 learned_addr learned my addr 172.21.15.69:0/1804430665 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:55.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f8969000700 1 --2- 172.21.15.69:0/1804430665 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89640d1ca0 0x7f896406ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f895bfff700 1 --2- 172.21.15.69:0/1804430665 >> v2:172.21.15.93:3300/0 conn(0x7f89640b5270 0x7f89640d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f8963fff700 1 -- 172.21.15.69:0/1804430665 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89640d1ca0 msgr2=0x7f896406ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:55.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f8963fff700 1 --2- 172.21.15.69:0/1804430665 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89640d1ca0 0x7f896406ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f8963fff700 1 -- 172.21.15.69:0/1804430665 >> v2:172.21.15.93:3300/0 conn(0x7f89640b5270 msgr2=0x7f89640d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:55.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f8963fff700 1 --2- 172.21.15.69:0/1804430665 >> v2:172.21.15.93:3300/0 conn(0x7f89640b5270 0x7f89640d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f8963fff700 1 -- 172.21.15.69:0/1804430665 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640b6980 con 0x7f896415d980 2023-11-17T06:30:55.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f8963fff700 1 --2- 172.21.15.69:0/1804430665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f896415d980 0x7f89640b4d30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f89640b5ea0 tx=0x7f8954009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff87efdc6d10175 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f89637fe700 1 -- 172.21.15.69:0/1804430665 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400b8a0 con 0x7f896415d980 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f89637fe700 1 -- 172.21.15.69:0/1804430665 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895400ba00 con 0x7f896415d980 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.655+0000 7f89637fe700 1 -- 172.21.15.69:0/1804430665 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400bd90 con 0x7f896415d980 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 -- 172.21.15.69:0/1804430665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f896415d980 msgr2=0x7f89640b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 --2- 172.21.15.69:0/1804430665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f896415d980 0x7f89640b4d30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f89640b5ea0 tx=0x7f8954009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 -- 172.21.15.69:0/1804430665 shutdown_connections 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 --2- 172.21.15.69:0/1804430665 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89640d1ca0 0x7f896406ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 --2- 172.21.15.69:0/1804430665 >> v2:172.21.15.93:3300/0 conn(0x7f89640b5270 0x7f89640d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 --2- 172.21.15.69:0/1804430665 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f896415d980 0x7f89640b4d30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 -- 172.21.15.69:0/1804430665 >> 172.21.15.69:0/1804430665 conn(0x7f89640cfd30 msgr2=0x7f89640d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 -- 172.21.15.69:0/1804430665 shutdown_connections 2023-11-17T06:30:55.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 -- 172.21.15.69:0/1804430665 wait complete. 2023-11-17T06:30:55.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 Processor -- start 2023-11-17T06:30:55.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.659+0000 7f896aa63700 1 -- start start 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f896aa63700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89640b5270 0x7f89640c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f896aa63700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89640d1ca0 0x7f896415fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f896aa63700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8964160040 0x7f8964153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f896aa63700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89641604f0 con 0x7f8964160040 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f896aa63700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c9210 con 0x7f89640b5270 2023-11-17T06:30:55.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f896aa63700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f896415f0d0 con 0x7f89640d1ca0 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f8969000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8964160040 0x7f8964153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f8969000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8964160040 0x7f8964153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49766/0 (socket says 172.21.15.69:49766) 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f8969000700 1 -- 172.21.15.69:0/56877729 learned_addr learned my addr 172.21.15.69:0/56877729 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f8963fff700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89640b5270 0x7f89640c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f895bfff700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89640d1ca0 0x7f896415fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f8969000700 1 -- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89640d1ca0 msgr2=0x7f896415fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f8969000700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89640d1ca0 0x7f896415fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f8969000700 1 -- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89640b5270 msgr2=0x7f89640c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f8969000700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89640b5270 0x7f89640c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f8969000700 1 -- 172.21.15.69:0/56877729 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8954009570 con 0x7f8964160040 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f8969000700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8964160040 0x7f8964153540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f895c007e60 tx=0x7f895c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f89617fa700 1 -- 172.21.15.69:0/56877729 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c00ede0 con 0x7f8964160040 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f89617fa700 1 -- 172.21.15.69:0/56877729 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c014420 con 0x7f8964160040 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f896aa63700 1 -- 172.21.15.69:0/56877729 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8964154120 con 0x7f8964160040 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f89617fa700 1 -- 172.21.15.69:0/56877729 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c0147d0 con 0x7f8964160040 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f896aa63700 1 -- 172.21.15.69:0/56877729 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89641546e0 con 0x7f8964160040 2023-11-17T06:30:55.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.663+0000 7f896aa63700 1 -- 172.21.15.69:0/56877729 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89640cf820 con 0x7f8964160040 2023-11-17T06:30:55.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.667+0000 7f89617fa700 1 -- 172.21.15.69:0/56877729 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f895c014930 con 0x7f8964160040 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.667+0000 7f89617fa700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8944066510 0x7f89440689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:55.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.667+0000 7f89617fa700 1 -- 172.21.15.69:0/56877729 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f895c0845e0 con 0x7f8964160040 2023-11-17T06:30:55.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.671+0000 7f8963fff700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8944066510 0x7f89440689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:55.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.671+0000 7f8963fff700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8944066510 0x7f89440689d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8954009860 tx=0x7f8954008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:55.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.679+0000 7f89617fa700 1 -- 172.21.15.69:0/56877729 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f895c0519a0 con 0x7f8964160040 2023-11-17T06:30:55.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.851+0000 7f896aa63700 1 -- 172.21.15.69:0/56877729 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8964073f00 con 0x7f8964160040 2023-11-17T06:30:55.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.855+0000 7f89617fa700 1 -- 172.21.15.69:0/56877729 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f895c054fc0 con 0x7f8964160040 2023-11-17T06:30:55.860 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:55.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 -- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8944066510 msgr2=0x7f89440689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8944066510 0x7f89440689d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8954009860 tx=0x7f8954008030 comp rx=0 tx=0).stop 2023-11-17T06:30:55.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 -- 172.21.15.69:0/56877729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8964160040 msgr2=0x7f8964153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:55.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8964160040 0x7f8964153540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f895c007e60 tx=0x7f895c00e3c0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 -- 172.21.15.69:0/56877729 shutdown_connections 2023-11-17T06:30:55.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8944066510 0x7f89440689d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8964160040 0x7f8964153540 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f89640d1ca0 0x7f896415fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 --2- 172.21.15.69:0/56877729 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f89640b5270 0x7f89640c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:55.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 -- 172.21.15.69:0/56877729 >> 172.21.15.69:0/56877729 conn(0x7f89640cfd30 msgr2=0x7f89640ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:55.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 -- 172.21.15.69:0/56877729 shutdown_connections 2023-11-17T06:30:55.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:55.859+0000 7f896aa63700 1 -- 172.21.15.69:0/56877729 wait complete. 2023-11-17T06:30:55.889 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:56.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.063+0000 7fd59ccba700 1 Processor -- start 2023-11-17T06:30:56.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.063+0000 7fd59ccba700 1 -- start start 2023-11-17T06:30:56.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59ccba700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd59815d980 0x7fd5980b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59ccba700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd5980d1e70 0x7fd5980b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59ccba700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5980b6750 con 0x7fd5980b5270 2023-11-17T06:30:56.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59ccba700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5980d2a30 con 0x7fd5980d1e70 2023-11-17T06:30:56.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59ccba700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980b6980 con 0x7fd59815d980 2023-11-17T06:30:56.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd596d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd5980d1e70 0x7fd5980b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59659c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd59815d980 0x7fd5980b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd595d9b700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd5980b5270 0x7fd5980d1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:37498/0 (socket says 172.21.15.69:37498) 2023-11-17T06:30:56.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd595d9b700 1 -- 172.21.15.69:0/2377121992 learned_addr learned my addr 172.21.15.69:0/2377121992 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:56.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd596d9d700 1 -- 172.21.15.69:0/2377121992 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd59815d980 msgr2=0x7fd5980b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:56.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd596d9d700 1 --2- 172.21.15.69:0/2377121992 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd59815d980 0x7fd5980b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd596d9d700 1 -- 172.21.15.69:0/2377121992 >> v1:172.21.15.93:6789/0 conn(0x7fd5980b5270 legacy=0x7fd5980d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd596d9d700 1 -- 172.21.15.69:0/2377121992 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5980b56d0 con 0x7fd5980d1e70 2023-11-17T06:30:56.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd596d9d700 1 --2- 172.21.15.69:0/2377121992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980d1e70 0x7fd5980b7140 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd590009d90 tx=0x7fd59000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58fd17373c4637f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59559a700 1 -- 172.21.15.69:0/2377121992 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000e070 con 0x7fd5980d1e70 2023-11-17T06:30:56.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59559a700 1 -- 172.21.15.69:0/2377121992 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59000bb20 con 0x7fd5980d1e70 2023-11-17T06:30:56.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59559a700 1 -- 172.21.15.69:0/2377121992 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590012430 con 0x7fd5980d1e70 2023-11-17T06:30:56.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59ccba700 1 -- 172.21.15.69:0/2377121992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980d1e70 msgr2=0x7fd5980b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59ccba700 1 --2- 172.21.15.69:0/2377121992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980d1e70 0x7fd5980b7140 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd590009d90 tx=0x7fd59000b330 comp rx=0 tx=0).stop 2023-11-17T06:30:56.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59ccba700 1 -- 172.21.15.69:0/2377121992 shutdown_connections 2023-11-17T06:30:56.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59ccba700 1 --2- 172.21.15.69:0/2377121992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980d1e70 0x7fd5980b7140 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.067+0000 7fd59ccba700 1 --2- 172.21.15.69:0/2377121992 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd59815d980 0x7fd5980b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.071+0000 7fd59ccba700 1 -- 172.21.15.69:0/2377121992 >> 172.21.15.69:0/2377121992 conn(0x7fd5980cfd30 msgr2=0x7fd5980d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:56.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.071+0000 7fd59ccba700 1 -- 172.21.15.69:0/2377121992 shutdown_connections 2023-11-17T06:30:56.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.071+0000 7fd59ccba700 1 -- 172.21.15.69:0/2377121992 wait complete. 2023-11-17T06:30:56.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.071+0000 7fd59ccba700 1 Processor -- start 2023-11-17T06:30:56.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.071+0000 7fd59ccba700 1 -- start start 2023-11-17T06:30:56.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59ccba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980b5270 0x7fd5981f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59ccba700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5980d1e70 0x7fd5980a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59ccba700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd59814fe30 0x7fd5981502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59ccba700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5980aa210 con 0x7fd5980b5270 2023-11-17T06:30:56.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59ccba700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981f6e50 con 0x7fd5980d1e70 2023-11-17T06:30:56.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59ccba700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981f65b0 con 0x7fd59814fe30 2023-11-17T06:30:56.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980b5270 0x7fd5981f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980b5270 0x7fd5981f5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49780/0 (socket says 172.21.15.69:49780) 2023-11-17T06:30:56.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59659c700 1 -- 172.21.15.69:0/1456088536 learned_addr learned my addr 172.21.15.69:0/1456088536 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:56.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd595d9b700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5980d1e70 0x7fd5980a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd596d9d700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd59814fe30 0x7fd5981502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59659c700 1 -- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd59814fe30 msgr2=0x7fd5981502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59659c700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd59814fe30 0x7fd5981502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59659c700 1 -- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5980d1e70 msgr2=0x7fd5980a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59659c700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5980d1e70 0x7fd5980a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59659c700 1 -- 172.21.15.69:0/1456088536 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590009a70 con 0x7fd5980b5270 2023-11-17T06:30:56.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd595d9b700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5980d1e70 0x7fd5980a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:56.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59659c700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980b5270 0x7fd5981f5f40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd58800e9d0 tx=0x7fd58800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd586ffd700 1 -- 172.21.15.69:0/1456088536 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588009720 con 0x7fd5980b5270 2023-11-17T06:30:56.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd586ffd700 1 -- 172.21.15.69:0/1456088536 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58800c850 con 0x7fd5980b5270 2023-11-17T06:30:56.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd586ffd700 1 -- 172.21.15.69:0/1456088536 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58800cbc0 con 0x7fd5980b5270 2023-11-17T06:30:56.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59ccba700 1 -- 172.21.15.69:0/1456088536 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5981f6890 con 0x7fd5980b5270 2023-11-17T06:30:56.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.075+0000 7fd59ccba700 1 -- 172.21.15.69:0/1456088536 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd59815f0c0 con 0x7fd5980b5270 2023-11-17T06:30:56.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.079+0000 7fd59ccba700 1 -- 172.21.15.69:0/1456088536 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd598073f00 con 0x7fd5980b5270 2023-11-17T06:30:56.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.079+0000 7fd586ffd700 1 -- 172.21.15.69:0/1456088536 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd58800cd20 con 0x7fd5980b5270 2023-11-17T06:30:56.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.083+0000 7fd586ffd700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd578066510 0x7fd5780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.083+0000 7fd586ffd700 1 -- 172.21.15.69:0/1456088536 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd588083fe0 con 0x7fd5980b5270 2023-11-17T06:30:56.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.083+0000 7fd595d9b700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd578066510 0x7fd5780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.083+0000 7fd595d9b700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd578066510 0x7fd5780689d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5980c9bd0 tx=0x7fd58c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.091+0000 7fd586ffd700 1 -- 172.21.15.69:0/1456088536 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd588051430 con 0x7fd5980b5270 2023-11-17T06:30:56.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.271+0000 7fd59ccba700 1 -- 172.21.15.69:0/1456088536 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5980cdce0 con 0x7fd5980b5270 2023-11-17T06:30:56.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.271+0000 7fd586ffd700 1 -- 172.21.15.69:0/1456088536 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd588054a50 con 0x7fd5980b5270 2023-11-17T06:30:56.277 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:56.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 -- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd578066510 msgr2=0x7fd5780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd578066510 0x7fd5780689d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5980c9bd0 tx=0x7fd58c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:56.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 -- 172.21.15.69:0/1456088536 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980b5270 msgr2=0x7fd5981f5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980b5270 0x7fd5981f5f40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fd58800e9d0 tx=0x7fd58800ed90 comp rx=0 tx=0).stop 2023-11-17T06:30:56.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 -- 172.21.15.69:0/1456088536 shutdown_connections 2023-11-17T06:30:56.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd578066510 0x7fd5780689d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd59814fe30 0x7fd5981502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd5980d1e70 0x7fd5980a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 --2- 172.21.15.69:0/1456088536 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5980b5270 0x7fd5981f5f40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 -- 172.21.15.69:0/1456088536 >> 172.21.15.69:0/1456088536 conn(0x7fd5980cfd30 msgr2=0x7fd5980b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:56.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 -- 172.21.15.69:0/1456088536 shutdown_connections 2023-11-17T06:30:56.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.275+0000 7fd59ccba700 1 -- 172.21.15.69:0/1456088536 wait complete. 2023-11-17T06:30:56.304 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:56.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.483+0000 7fd12ca39700 1 Processor -- start 2023-11-17T06:30:56.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.483+0000 7fd12ca39700 1 -- start start 2023-11-17T06:30:56.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.483+0000 7fd12ca39700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 0x7fd1280cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.483+0000 7fd12ca39700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd128166040 con 0x7fd1280ce7a0 2023-11-17T06:30:56.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.483+0000 7fd12ca39700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1280cc420 con 0x7fd1280cbfc0 2023-11-17T06:30:56.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.483+0000 7fd12ca39700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280cec10 con 0x7fd1281617a0 2023-11-17T06:30:56.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd126d9d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fd1280ce7a0 0x7fd1280cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42428/0 (socket says 172.21.15.69:42428) 2023-11-17T06:30:56.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd126d9d700 1 -- 172.21.15.69:0/1855860646 learned_addr learned my addr 172.21.15.69:0/1855860646 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:56.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12659c700 1 --2- 172.21.15.69:0/1855860646 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 0x7fd1280cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12559a700 1 -- 172.21.15.69:0/1855860646 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809122808 0 0) 0x7fd128166040 con 0x7fd1280ce7a0 2023-11-17T06:30:56.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12559a700 1 -- 172.21.15.69:0/1855860646 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1100035d0 con 0x7fd1280ce7a0 2023-11-17T06:30:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12559a700 1 -- 172.21.15.69:0/1855860646 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062929357 0 0) 0x7fd1280cc420 con 0x7fd1280cbfc0 2023-11-17T06:30:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12559a700 1 -- 172.21.15.69:0/1855860646 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd128166040 con 0x7fd1280cbfc0 2023-11-17T06:30:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12659c700 1 -- 172.21.15.69:0/1855860646 >> v1:172.21.15.93:6789/0 conn(0x7fd1280cbfc0 legacy=0x7fd1280ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12659c700 1 -- 172.21.15.69:0/1855860646 >> v1:172.21.15.69:6789/0 conn(0x7fd1280ce7a0 legacy=0x7fd1280cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12659c700 1 -- 172.21.15.69:0/1855860646 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128165430 con 0x7fd1281617a0 2023-11-17T06:30:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12659c700 1 --2- 172.21.15.69:0/1855860646 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 0x7fd1280cba80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd118009880 tx=0x7fd118009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=671fcb991461d740 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12559a700 1 -- 172.21.15.69:0/1855860646 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118011830 con 0x7fd1281617a0 2023-11-17T06:30:56.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12559a700 1 -- 172.21.15.69:0/1855860646 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd118011990 con 0x7fd1281617a0 2023-11-17T06:30:56.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12559a700 1 -- 172.21.15.69:0/1855860646 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118011d20 con 0x7fd1281617a0 2023-11-17T06:30:56.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12ca39700 1 -- 172.21.15.69:0/1855860646 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 msgr2=0x7fd1280cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.487+0000 7fd12ca39700 1 --2- 172.21.15.69:0/1855860646 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 0x7fd1280cba80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd118009880 tx=0x7fd118009b90 comp rx=0 tx=0).stop 2023-11-17T06:30:56.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 -- 172.21.15.69:0/1855860646 shutdown_connections 2023-11-17T06:30:56.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 --2- 172.21.15.69:0/1855860646 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 0x7fd1280cba80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 -- 172.21.15.69:0/1855860646 >> 172.21.15.69:0/1855860646 conn(0x7fd12806a480 msgr2=0x7fd12806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:56.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 -- 172.21.15.69:0/1855860646 shutdown_connections 2023-11-17T06:30:56.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 -- 172.21.15.69:0/1855860646 wait complete. 2023-11-17T06:30:56.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 Processor -- start 2023-11-17T06:30:56.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 -- start start 2023-11-17T06:30:56.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1280cbfc0 0x7fd1280b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1280ce7a0 0x7fd1280c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 0x7fd1280c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280b1310 con 0x7fd1280cbfc0 2023-11-17T06:30:56.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280b0d50 con 0x7fd1280ce7a0 2023-11-17T06:30:56.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.491+0000 7fd12ca39700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1280b1030 con 0x7fd1281617a0 2023-11-17T06:30:56.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1280cbfc0 0x7fd1280b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1280cbfc0 0x7fd1280b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49786/0 (socket says 172.21.15.69:49786) 2023-11-17T06:30:56.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12659c700 1 -- 172.21.15.69:0/1844048214 learned_addr learned my addr 172.21.15.69:0/1844048214 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:56.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd125d9b700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1280ce7a0 0x7fd1280c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd126d9d700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 0x7fd1280c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12659c700 1 -- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 msgr2=0x7fd1280c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12659c700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 0x7fd1280c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12659c700 1 -- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1280ce7a0 msgr2=0x7fd1280c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12659c700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1280ce7a0 0x7fd1280c6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12659c700 1 -- 172.21.15.69:0/1844048214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1180094b0 con 0x7fd1280cbfc0 2023-11-17T06:30:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd125d9b700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1280ce7a0 0x7fd1280c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd126d9d700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 0x7fd1280c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:30:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12659c700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1280cbfc0 0x7fd1280b0370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd118013040 tx=0x7fd118004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd116ffd700 1 -- 172.21.15.69:0/1844048214 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1180198d0 con 0x7fd1280cbfc0 2023-11-17T06:30:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd116ffd700 1 -- 172.21.15.69:0/1844048214 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11801e070 con 0x7fd1280cbfc0 2023-11-17T06:30:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12ca39700 1 -- 172.21.15.69:0/1844048214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1280c3b00 con 0x7fd1280cbfc0 2023-11-17T06:30:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd116ffd700 1 -- 172.21.15.69:0/1844048214 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd118019c50 con 0x7fd1280cbfc0 2023-11-17T06:30:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12ca39700 1 -- 172.21.15.69:0/1844048214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12815b6d0 con 0x7fd1280cbfc0 2023-11-17T06:30:56.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.495+0000 7fd12ca39700 1 -- 172.21.15.69:0/1844048214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1280c3960 con 0x7fd1280cbfc0 2023-11-17T06:30:56.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.499+0000 7fd116ffd700 1 -- 172.21.15.69:0/1844048214 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd11802d450 con 0x7fd1280cbfc0 2023-11-17T06:30:56.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.499+0000 7fd116ffd700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd108066510 0x7fd1080689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.499+0000 7fd116ffd700 1 -- 172.21.15.69:0/1844048214 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd118084e30 con 0x7fd1280cbfc0 2023-11-17T06:30:56.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.499+0000 7fd125d9b700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd108066510 0x7fd1080689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.503+0000 7fd125d9b700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd108066510 0x7fd1080689d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd128160590 tx=0x7fd11c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.507+0000 7fd116ffd700 1 -- 172.21.15.69:0/1844048214 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd1280c3960 con 0x7fd1280cbfc0 2023-11-17T06:30:56.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.687+0000 7fd12ca39700 1 -- 172.21.15.69:0/1844048214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd1280c3960 con 0x7fd1280cbfc0 2023-11-17T06:30:56.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd116ffd700 1 -- 172.21.15.69:0/1844048214 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd1280c3960 con 0x7fd1280cbfc0 2023-11-17T06:30:56.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 -- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd108066510 msgr2=0x7fd1080689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd108066510 0x7fd1080689d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd128160590 tx=0x7fd11c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:56.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 -- 172.21.15.69:0/1844048214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1280cbfc0 msgr2=0x7fd1280b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1280cbfc0 0x7fd1280b0370 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd118013040 tx=0x7fd118004770 comp rx=0 tx=0).stop 2023-11-17T06:30:56.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 -- 172.21.15.69:0/1844048214 shutdown_connections 2023-11-17T06:30:56.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd108066510 0x7fd1080689d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd1281617a0 0x7fd1280c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1280ce7a0 0x7fd1280c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 --2- 172.21.15.69:0/1844048214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1280cbfc0 0x7fd1280b0370 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 -- 172.21.15.69:0/1844048214 >> 172.21.15.69:0/1844048214 conn(0x7fd12806a480 msgr2=0x7fd1280ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:56.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 -- 172.21.15.69:0/1844048214 shutdown_connections 2023-11-17T06:30:56.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.691+0000 7fd12ca39700 1 -- 172.21.15.69:0/1844048214 wait complete. 2023-11-17T06:30:56.701 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2023-11-17T06:30:56.719 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:30:56.719 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:56.733 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:56.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.943+0000 7f59decdb700 1 Processor -- start 2023-11-17T06:30:56.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.943+0000 7f59decdb700 1 -- start start 2023-11-17T06:30:56.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59decdb700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f59d815df10 0x7f59d80cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59decdb700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f59d80b0840 0x7f59d80b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59decdb700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59d8159d60 con 0x7f59d8157500 2023-11-17T06:30:56.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59decdb700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d815a980 con 0x7f59d80b0840 2023-11-17T06:30:56.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59decdb700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59d80ca650 con 0x7f59d815df10 2023-11-17T06:30:56.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59dd278700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f59d80b0840 0x7f59d80b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59dd278700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f59d80b0840 0x7f59d80b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49792/0 (socket says 172.21.15.69:49792) 2023-11-17T06:30:56.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59dd278700 1 -- 172.21.15.69:0/3963918583 learned_addr learned my addr 172.21.15.69:0/3963918583 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:56.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59cffff700 1 --2- 172.21.15.69:0/3963918583 >> v2:172.21.15.93:3300/0 conn(0x7f59d815df10 0x7f59d80cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59dd278700 1 -- 172.21.15.69:0/3963918583 >> v2:172.21.15.93:3300/0 conn(0x7f59d815df10 msgr2=0x7f59d80cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:56.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59dd278700 1 --2- 172.21.15.69:0/3963918583 >> v2:172.21.15.93:3300/0 conn(0x7f59d815df10 0x7f59d80cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59dd278700 1 -- 172.21.15.69:0/3963918583 >> v1:172.21.15.93:6789/0 conn(0x7f59d8157500 legacy=0x7f59d80c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.947+0000 7f59dd278700 1 -- 172.21.15.69:0/3963918583 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d8159fe0 con 0x7f59d80b0840 2023-11-17T06:30:56.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59dd278700 1 --2- 172.21.15.69:0/3963918583 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d80b0840 0x7f59d80b0cb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f59d8072250 tx=0x7f59d0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c8f199b7b785865 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59cf7fe700 1 -- 172.21.15.69:0/3963918583 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d000f8a0 con 0x7f59d80b0840 2023-11-17T06:30:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59cf7fe700 1 -- 172.21.15.69:0/3963918583 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d000fa00 con 0x7f59d80b0840 2023-11-17T06:30:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59cf7fe700 1 -- 172.21.15.69:0/3963918583 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d000fd90 con 0x7f59d80b0840 2023-11-17T06:30:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59decdb700 1 -- 172.21.15.69:0/3963918583 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d80b0840 msgr2=0x7f59d80b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59decdb700 1 --2- 172.21.15.69:0/3963918583 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d80b0840 0x7f59d80b0cb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f59d8072250 tx=0x7f59d0009bf0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59decdb700 1 -- 172.21.15.69:0/3963918583 shutdown_connections 2023-11-17T06:30:56.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59decdb700 1 --2- 172.21.15.69:0/3963918583 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d80b0840 0x7f59d80b0cb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59decdb700 1 --2- 172.21.15.69:0/3963918583 >> v2:172.21.15.93:3300/0 conn(0x7f59d815df10 0x7f59d80cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59decdb700 1 -- 172.21.15.69:0/3963918583 >> 172.21.15.69:0/3963918583 conn(0x7f59d806a480 msgr2=0x7f59d806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:56.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59decdb700 1 -- 172.21.15.69:0/3963918583 shutdown_connections 2023-11-17T06:30:56.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.951+0000 7f59decdb700 1 -- 172.21.15.69:0/3963918583 wait complete. 2023-11-17T06:30:56.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59decdb700 1 Processor -- start 2023-11-17T06:30:56.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59decdb700 1 -- start start 2023-11-17T06:30:56.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59decdb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59d80b0840 0x7f59d814b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59decdb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d8157500 0x7f59d80cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59decdb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d815df10 0x7f59d80cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59decdb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d8154960 con 0x7f59d8157500 2023-11-17T06:30:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59decdb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59d814b7b0 con 0x7f59d815df10 2023-11-17T06:30:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59decdb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59d81544d0 con 0x7f59d80b0840 2023-11-17T06:30:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59cffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d8157500 0x7f59d80cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59cffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d8157500 0x7f59d80cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49802/0 (socket says 172.21.15.69:49802) 2023-11-17T06:30:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59cffff700 1 -- 172.21.15.69:0/1612622820 learned_addr learned my addr 172.21.15.69:0/1612622820 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59dd278700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d815df10 0x7f59d80cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59dca77700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59d80b0840 0x7f59d814b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59cffff700 1 -- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59d80b0840 msgr2=0x7f59d814b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59cffff700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59d80b0840 0x7f59d814b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59cffff700 1 -- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d815df10 msgr2=0x7f59d80cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:56.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59cffff700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d815df10 0x7f59d80cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:56.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59cffff700 1 -- 172.21.15.69:0/1612622820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d0009570 con 0x7f59d8157500 2023-11-17T06:30:56.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59dca77700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59d80b0840 0x7f59d814b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:56.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.955+0000 7f59dd278700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d815df10 0x7f59d80cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:30:56.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.959+0000 7f59cffff700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d8157500 0x7f59d80cced0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f59c800e790 tx=0x7f59c800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.959+0000 7f59cd7fa700 1 -- 172.21.15.69:0/1612622820 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c800c070 con 0x7f59d8157500 2023-11-17T06:30:56.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.959+0000 7f59cd7fa700 1 -- 172.21.15.69:0/1612622820 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c8013610 con 0x7f59d8157500 2023-11-17T06:30:56.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.959+0000 7f59cd7fa700 1 -- 172.21.15.69:0/1612622820 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c8013980 con 0x7f59d8157500 2023-11-17T06:30:56.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.959+0000 7f59decdb700 1 -- 172.21.15.69:0/1612622820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d81538c0 con 0x7f59d8157500 2023-11-17T06:30:56.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.959+0000 7f59decdb700 1 -- 172.21.15.69:0/1612622820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59d8153e80 con 0x7f59d8157500 2023-11-17T06:30:56.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.959+0000 7f59decdb700 1 -- 172.21.15.69:0/1612622820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59d8154640 con 0x7f59d8157500 2023-11-17T06:30:56.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.959+0000 7f59cd7fa700 1 -- 172.21.15.69:0/1612622820 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f59c8013ae0 con 0x7f59d8157500 2023-11-17T06:30:56.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.963+0000 7f59cd7fa700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59c4066540 0x7f59c4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:56.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.963+0000 7f59cd7fa700 1 -- 172.21.15.69:0/1612622820 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f59c8083c00 con 0x7f59d8157500 2023-11-17T06:30:56.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.963+0000 7f59dca77700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59c4066540 0x7f59c4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:56.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.963+0000 7f59dca77700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59c4066540 0x7f59c4068a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f59d8158b10 tx=0x7f59d4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:56.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:56.967+0000 7f59cd7fa700 1 -- 172.21.15.69:0/1612622820 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f59c8050fc0 con 0x7f59d8157500 2023-11-17T06:30:57.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.143+0000 7f59decdb700 1 -- 172.21.15.69:0/1612622820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59d8073f00 con 0x7f59d8157500 2023-11-17T06:30:57.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.147+0000 7f59cd7fa700 1 -- 172.21.15.69:0/1612622820 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f59c80545e0 con 0x7f59d8157500 2023-11-17T06:30:57.153 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:57.154 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:57.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 -- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59c4066540 msgr2=0x7f59c4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59c4066540 0x7f59c4068a00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f59d8158b10 tx=0x7f59d4009040 comp rx=0 tx=0).stop 2023-11-17T06:30:57.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 -- 172.21.15.69:0/1612622820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d8157500 msgr2=0x7f59d80cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d8157500 0x7f59d80cced0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f59c800e790 tx=0x7f59c800eaa0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 -- 172.21.15.69:0/1612622820 shutdown_connections 2023-11-17T06:30:57.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f59c4066540 0x7f59c4068a00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59d815df10 0x7f59d80cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59d8157500 0x7f59d80cced0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 --2- 172.21.15.69:0/1612622820 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59d80b0840 0x7f59d814b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 -- 172.21.15.69:0/1612622820 >> 172.21.15.69:0/1612622820 conn(0x7f59d806a480 msgr2=0x7f59d80cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:57.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 -- 172.21.15.69:0/1612622820 shutdown_connections 2023-11-17T06:30:57.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.151+0000 7f59decdb700 1 -- 172.21.15.69:0/1612622820 wait complete. 2023-11-17T06:30:57.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:57.181 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:57.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.351+0000 7fa788d3c700 1 Processor -- start 2023-11-17T06:30:57.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.351+0000 7fa788d3c700 1 -- start start 2023-11-17T06:30:57.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa788d3c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa784161a50 0x7fa784070f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa788d3c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa7840c34a0 0x7fa78406a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa788d3c700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78406ee40 con 0x7fa784161670 2023-11-17T06:30:57.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa788d3c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78406ea20 con 0x7fa784161a50 2023-11-17T06:30:57.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa788d3c700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa784166160 con 0x7fa7840c34a0 2023-11-17T06:30:57.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa781d9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa784161a50 0x7fa784070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa782d9d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa7840c34a0 0x7fa78406a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa782d9d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa7840c34a0 0x7fa78406a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:38472/0 (socket says 172.21.15.69:38472) 2023-11-17T06:30:57.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa782d9d700 1 -- 172.21.15.69:0/3055945240 learned_addr learned my addr 172.21.15.69:0/3055945240 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:57.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa782d9d700 1 -- 172.21.15.69:0/3055945240 >> v2:172.21.15.69:3300/0 conn(0x7fa784161a50 msgr2=0x7fa784070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:57.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa782d9d700 1 --2- 172.21.15.69:0/3055945240 >> v2:172.21.15.69:3300/0 conn(0x7fa784161a50 0x7fa784070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa782d9d700 1 -- 172.21.15.69:0/3055945240 >> v1:172.21.15.93:6789/0 conn(0x7fa784161670 legacy=0x7fa7840cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa782d9d700 1 -- 172.21.15.69:0/3055945240 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7840cf980 con 0x7fa7840c34a0 2023-11-17T06:30:57.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa782d9d700 1 --2- 172.21.15.69:0/3055945240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7840c34a0 0x7fa78406a2a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa7840cc8d0 tx=0x7fa77c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61221bca881653ea server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.355+0000 7fa78159a700 1 -- 172.21.15.69:0/3055945240 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c00e070 con 0x7fa7840c34a0 2023-11-17T06:30:57.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.359+0000 7fa78159a700 1 -- 172.21.15.69:0/3055945240 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c00b910 con 0x7fa7840c34a0 2023-11-17T06:30:57.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.359+0000 7fa78159a700 1 -- 172.21.15.69:0/3055945240 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c00bcc0 con 0x7fa7840c34a0 2023-11-17T06:30:57.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.359+0000 7fa788d3c700 1 -- 172.21.15.69:0/3055945240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7840c34a0 msgr2=0x7fa78406a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.359+0000 7fa788d3c700 1 --2- 172.21.15.69:0/3055945240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7840c34a0 0x7fa78406a2a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa7840cc8d0 tx=0x7fa77c00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:57.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.359+0000 7fa788d3c700 1 -- 172.21.15.69:0/3055945240 shutdown_connections 2023-11-17T06:30:57.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.359+0000 7fa788d3c700 1 --2- 172.21.15.69:0/3055945240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7840c34a0 0x7fa78406a2a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.359+0000 7fa788d3c700 1 --2- 172.21.15.69:0/3055945240 >> v2:172.21.15.69:3300/0 conn(0x7fa784161a50 0x7fa784070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.359+0000 7fa788d3c700 1 -- 172.21.15.69:0/3055945240 >> 172.21.15.69:0/3055945240 conn(0x7fa7840cfea0 msgr2=0x7fa7840d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:57.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.359+0000 7fa788d3c700 1 -- 172.21.15.69:0/3055945240 shutdown_connections 2023-11-17T06:30:57.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.359+0000 7fa788d3c700 1 -- 172.21.15.69:0/3055945240 wait complete. 2023-11-17T06:30:57.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa788d3c700 1 Processor -- start 2023-11-17T06:30:57.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa788d3c700 1 -- start start 2023-11-17T06:30:57.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa788d3c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7840c34a0 0x7fa7841f6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa788d3c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa784161670 0x7fa784158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa788d3c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa784161a50 0x7fa78415f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa788d3c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b4280 con 0x7fa7840c34a0 2023-11-17T06:30:57.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa788d3c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b3670 con 0x7fa784161a50 2023-11-17T06:30:57.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa788d3c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7840b3950 con 0x7fa784161670 2023-11-17T06:30:57.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa78259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7840c34a0 0x7fa7841f6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa78259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7840c34a0 0x7fa7841f6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49820/0 (socket says 172.21.15.69:49820) 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa78259c700 1 -- 172.21.15.69:0/744099455 learned_addr learned my addr 172.21.15.69:0/744099455 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa781d9b700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa784161670 0x7fa784158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa782d9d700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa784161a50 0x7fa78415f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa78259c700 1 -- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa784161670 msgr2=0x7fa784158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa78259c700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa784161670 0x7fa784158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa78259c700 1 -- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa784161a50 msgr2=0x7fa78415f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa78259c700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa784161a50 0x7fa78415f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa78259c700 1 -- 172.21.15.69:0/744099455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c009b30 con 0x7fa7840c34a0 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa781d9b700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa784161670 0x7fa784158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:57.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.363+0000 7fa782d9d700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa784161a50 0x7fa78415f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:57.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.367+0000 7fa78259c700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7840c34a0 0x7fa7841f6a60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa77400c500 tx=0x7fa77400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.367+0000 7fa772ffd700 1 -- 172.21.15.69:0/744099455 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740052d0 con 0x7fa7840c34a0 2023-11-17T06:30:57.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.367+0000 7fa772ffd700 1 -- 172.21.15.69:0/744099455 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa774005430 con 0x7fa7840c34a0 2023-11-17T06:30:57.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.367+0000 7fa772ffd700 1 -- 172.21.15.69:0/744099455 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7740055a0 con 0x7fa7840c34a0 2023-11-17T06:30:57.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.367+0000 7fa788d3c700 1 -- 172.21.15.69:0/744099455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7840b3c30 con 0x7fa7840c34a0 2023-11-17T06:30:57.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.367+0000 7fa788d3c700 1 -- 172.21.15.69:0/744099455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7840b32b0 con 0x7fa7840c34a0 2023-11-17T06:30:57.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.367+0000 7fa788d3c700 1 -- 172.21.15.69:0/744099455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7840686a0 con 0x7fa7840c34a0 2023-11-17T06:30:57.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.371+0000 7fa772ffd700 1 -- 172.21.15.69:0/744099455 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa7740038e0 con 0x7fa7840c34a0 2023-11-17T06:30:57.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.371+0000 7fa772ffd700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa764066510 0x7fa7640689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.371+0000 7fa772ffd700 1 -- 172.21.15.69:0/744099455 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa7740833a0 con 0x7fa7840c34a0 2023-11-17T06:30:57.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.371+0000 7fa781d9b700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa764066510 0x7fa7640689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.371+0000 7fa781d9b700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa764066510 0x7fa7640689d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa784165360 tx=0x7fa778008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.379+0000 7fa772ffd700 1 -- 172.21.15.69:0/744099455 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa774050800 con 0x7fa7840c34a0 2023-11-17T06:30:57.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.555+0000 7fa788d3c700 1 -- 172.21.15.69:0/744099455 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7840cfc30 con 0x7fa7840c34a0 2023-11-17T06:30:57.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.555+0000 7fa772ffd700 1 -- 172.21.15.69:0/744099455 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa774053e20 con 0x7fa7840c34a0 2023-11-17T06:30:57.560 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:57.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.555+0000 7fa788d3c700 1 -- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa764066510 msgr2=0x7fa7640689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.555+0000 7fa788d3c700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa764066510 0x7fa7640689d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa784165360 tx=0x7fa778008040 comp rx=0 tx=0).stop 2023-11-17T06:30:57.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.555+0000 7fa788d3c700 1 -- 172.21.15.69:0/744099455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7840c34a0 msgr2=0x7fa7841f6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.555+0000 7fa788d3c700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7840c34a0 0x7fa7841f6a60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa77400c500 tx=0x7fa77400c8c0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.559+0000 7fa788d3c700 1 -- 172.21.15.69:0/744099455 shutdown_connections 2023-11-17T06:30:57.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.559+0000 7fa788d3c700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa764066510 0x7fa7640689d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.559+0000 7fa788d3c700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa784161a50 0x7fa78415f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.559+0000 7fa788d3c700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa784161670 0x7fa784158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.559+0000 7fa788d3c700 1 --2- 172.21.15.69:0/744099455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7840c34a0 0x7fa7841f6a60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.559+0000 7fa788d3c700 1 -- 172.21.15.69:0/744099455 >> 172.21.15.69:0/744099455 conn(0x7fa7840cfea0 msgr2=0x7fa7840c5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:57.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.559+0000 7fa788d3c700 1 -- 172.21.15.69:0/744099455 shutdown_connections 2023-11-17T06:30:57.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.559+0000 7fa788d3c700 1 -- 172.21.15.69:0/744099455 wait complete. 2023-11-17T06:30:57.585 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:30:57.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.767+0000 7fcd85476700 1 Processor -- start 2023-11-17T06:30:57.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.767+0000 7fcd85476700 1 -- start start 2023-11-17T06:30:57.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.771+0000 7fcd85476700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcd800cfc80 0x7fcd8006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.771+0000 7fcd85476700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8006b7a0 con 0x7fcd8015d6f0 2023-11-17T06:30:57.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.771+0000 7fcd85476700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd800d0180 con 0x7fcd8015d310 2023-11-17T06:30:57.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.771+0000 7fcd85476700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd800d0460 con 0x7fcd800cfc80 2023-11-17T06:30:57.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.771+0000 7fcd77fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcd800cfc80 0x7fcd8006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.771+0000 7fcd7f7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fcd8015d6f0 0x7fcd8006bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42432/0 (socket says 172.21.15.69:42432) 2023-11-17T06:30:57.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.771+0000 7fcd7f7fe700 1 -- 172.21.15.69:0/3173707103 learned_addr learned my addr 172.21.15.69:0/3173707103 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:30:57.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd7e7fc700 1 -- 172.21.15.69:0/3173707103 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968794498 0 0) 0x7fcd800d0180 con 0x7fcd8015d310 2023-11-17T06:30:57.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd7e7fc700 1 -- 172.21.15.69:0/3173707103 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd6c0035d0 con 0x7fcd8015d310 2023-11-17T06:30:57.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd7e7fc700 1 -- 172.21.15.69:0/3173707103 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668522909 0 0) 0x7fcd8006b7a0 con 0x7fcd8015d6f0 2023-11-17T06:30:57.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd7e7fc700 1 -- 172.21.15.69:0/3173707103 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd800d0180 con 0x7fcd8015d6f0 2023-11-17T06:30:57.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd77fff700 1 -- 172.21.15.69:0/3173707103 >> v1:172.21.15.93:6789/0 conn(0x7fcd8015d310 legacy=0x7fcd800d1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd77fff700 1 -- 172.21.15.69:0/3173707103 >> v1:172.21.15.69:6789/0 conn(0x7fcd8015d6f0 legacy=0x7fcd8006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd77fff700 1 -- 172.21.15.69:0/3173707103 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd800d0740 con 0x7fcd800cfc80 2023-11-17T06:30:57.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd77fff700 1 --2- 172.21.15.69:0/3173707103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd800cfc80 0x7fcd8006ea50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009850 tx=0x7fcd68009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e92cbe7f4c810ab server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd7e7fc700 1 -- 172.21.15.69:0/3173707103 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68011830 con 0x7fcd800cfc80 2023-11-17T06:30:57.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd7e7fc700 1 -- 172.21.15.69:0/3173707103 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd68011990 con 0x7fcd800cfc80 2023-11-17T06:30:57.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd7e7fc700 1 -- 172.21.15.69:0/3173707103 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68011d40 con 0x7fcd800cfc80 2023-11-17T06:30:57.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd85476700 1 -- 172.21.15.69:0/3173707103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd800cfc80 msgr2=0x7fcd8006ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd85476700 1 --2- 172.21.15.69:0/3173707103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd800cfc80 0x7fcd8006ea50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009850 tx=0x7fcd68009b60 comp rx=0 tx=0).stop 2023-11-17T06:30:57.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd85476700 1 -- 172.21.15.69:0/3173707103 shutdown_connections 2023-11-17T06:30:57.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd85476700 1 --2- 172.21.15.69:0/3173707103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd800cfc80 0x7fcd8006ea50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd85476700 1 -- 172.21.15.69:0/3173707103 >> 172.21.15.69:0/3173707103 conn(0x7fcd8009a360 msgr2=0x7fcd800d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:57.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd85476700 1 -- 172.21.15.69:0/3173707103 shutdown_connections 2023-11-17T06:30:57.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.775+0000 7fcd85476700 1 -- 172.21.15.69:0/3173707103 wait complete. 2023-11-17T06:30:57.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.779+0000 7fcd85476700 1 Processor -- start 2023-11-17T06:30:57.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.779+0000 7fcd85476700 1 -- start start 2023-11-17T06:30:57.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd85476700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd800cfc80 0x7fcd800c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd85476700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd8015d310 0x7fcd801555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd85476700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcd8015d6f0 0x7fcd800c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd85476700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800b2bf0 con 0x7fcd8015d310 2023-11-17T06:30:57.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd85476700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800b22c0 con 0x7fcd800cfc80 2023-11-17T06:30:57.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd85476700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800b25a0 con 0x7fcd8015d6f0 2023-11-17T06:30:57.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd77fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd8015d310 0x7fcd801555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd77fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd8015d310 0x7fcd801555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49834/0 (socket says 172.21.15.69:49834) 2023-11-17T06:30:57.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd77fff700 1 -- 172.21.15.69:0/488513763 learned_addr learned my addr 172.21.15.69:0/488513763 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:57.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd7f7fe700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcd8015d6f0 0x7fcd800c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd7effd700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd800cfc80 0x7fcd800c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd77fff700 1 -- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcd8015d6f0 msgr2=0x7fcd800c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd77fff700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcd8015d6f0 0x7fcd800c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd77fff700 1 -- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd800cfc80 msgr2=0x7fcd800c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd77fff700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd800cfc80 0x7fcd800c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd77fff700 1 -- 172.21.15.69:0/488513763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd680094b0 con 0x7fcd8015d310 2023-11-17T06:30:57.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd77fff700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd8015d310 0x7fcd801555c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcd8008b880 tx=0x7fcd68004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd777fe700 1 -- 172.21.15.69:0/488513763 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6801aac0 con 0x7fcd8015d310 2023-11-17T06:30:57.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd777fe700 1 -- 172.21.15.69:0/488513763 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6801f070 con 0x7fcd8015d310 2023-11-17T06:30:57.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd85476700 1 -- 172.21.15.69:0/488513763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd800b2880 con 0x7fcd8015d310 2023-11-17T06:30:57.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd777fe700 1 -- 172.21.15.69:0/488513763 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6801ae60 con 0x7fcd8015d310 2023-11-17T06:30:57.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.783+0000 7fcd85476700 1 -- 172.21.15.69:0/488513763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd800c9650 con 0x7fcd8015d310 2023-11-17T06:30:57.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.787+0000 7fcd85476700 1 -- 172.21.15.69:0/488513763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8006b410 con 0x7fcd8015d310 2023-11-17T06:30:57.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.787+0000 7fcd777fe700 1 -- 172.21.15.69:0/488513763 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcd6801b430 con 0x7fcd8015d310 2023-11-17T06:30:57.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.787+0000 7fcd777fe700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd60066540 0x7fcd60068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:57.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.787+0000 7fcd777fe700 1 -- 172.21.15.69:0/488513763 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcd68084f20 con 0x7fcd8015d310 2023-11-17T06:30:57.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.791+0000 7fcd7effd700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd60066540 0x7fcd60068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:57.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.791+0000 7fcd7effd700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd60066540 0x7fcd60068a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd70001230 tx=0x7fcd70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:57.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.795+0000 7fcd777fe700 1 -- 172.21.15.69:0/488513763 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcd8006b410 con 0x7fcd8015d310 2023-11-17T06:30:57.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.967+0000 7fcd85476700 1 -- 172.21.15.69:0/488513763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd8006b410 con 0x7fcd8015d310 2023-11-17T06:30:57.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.967+0000 7fcd777fe700 1 -- 172.21.15.69:0/488513763 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd68015020 con 0x7fcd8015d310 2023-11-17T06:30:57.973 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:30:57.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 -- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd60066540 msgr2=0x7fcd60068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd60066540 0x7fcd60068a00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcd70001230 tx=0x7fcd70009040 comp rx=0 tx=0).stop 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 -- 172.21.15.69:0/488513763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd8015d310 msgr2=0x7fcd801555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd8015d310 0x7fcd801555c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fcd8008b880 tx=0x7fcd68004770 comp rx=0 tx=0).stop 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 -- 172.21.15.69:0/488513763 shutdown_connections 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd60066540 0x7fcd60068a00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcd8015d6f0 0x7fcd800c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcd8015d310 0x7fcd801555c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 --2- 172.21.15.69:0/488513763 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd800cfc80 0x7fcd800c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 -- 172.21.15.69:0/488513763 >> 172.21.15.69:0/488513763 conn(0x7fcd8009a360 msgr2=0x7fcd8006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 -- 172.21.15.69:0/488513763 shutdown_connections 2023-11-17T06:30:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:57.971+0000 7fcd85476700 1 -- 172.21.15.69:0/488513763 wait complete. 2023-11-17T06:30:57.996 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:30:58.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.171+0000 7f2cf79ce700 1 Processor -- start 2023-11-17T06:30:58.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.171+0000 7f2cf79ce700 1 -- start start 2023-11-17T06:30:58.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.171+0000 7f2cf79ce700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2cf00b5440 0x7f2cf00d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.171+0000 7f2cf79ce700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2cf00d1ca0 0x7f2cf00b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.171+0000 7f2cf79ce700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf00b6750 con 0x7f2cf015d980 2023-11-17T06:30:58.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.171+0000 7f2cf79ce700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00d2a30 con 0x7f2cf00b5440 2023-11-17T06:30:58.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.171+0000 7f2cf79ce700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00b6980 con 0x7f2cf00d1ca0 2023-11-17T06:30:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.171+0000 7f2cf4f69700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2cf00b5440 0x7f2cf00d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.171+0000 7f2cf4f69700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2cf00b5440 0x7f2cf00d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:38514/0 (socket says 172.21.15.69:38514) 2023-11-17T06:30:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.171+0000 7f2cf4f69700 1 -- 172.21.15.69:0/3964193482 learned_addr learned my addr 172.21.15.69:0/3964193482 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf5f6b700 1 --2- 172.21.15.69:0/3964193482 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2cf00d1ca0 0x7f2cf00b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf4f69700 1 -- 172.21.15.69:0/3964193482 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2cf00d1ca0 msgr2=0x7f2cf00b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf4f69700 1 --2- 172.21.15.69:0/3964193482 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2cf00d1ca0 0x7f2cf00b7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf4f69700 1 -- 172.21.15.69:0/3964193482 >> v1:172.21.15.93:6789/0 conn(0x7f2cf015d980 legacy=0x7f2cf00b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf4f69700 1 -- 172.21.15.69:0/3964193482 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00d2470 con 0x7f2cf00b5440 2023-11-17T06:30:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf4f69700 1 --2- 172.21.15.69:0/3964193482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2cf00b5440 0x7f2cf00d1760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009910 tx=0x7f2ce0009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a49955cc0b62db0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2ce7fff700 1 -- 172.21.15.69:0/3964193482 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce000ba60 con 0x7f2cf00b5440 2023-11-17T06:30:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2ce7fff700 1 -- 172.21.15.69:0/3964193482 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce000bbc0 con 0x7f2cf00b5440 2023-11-17T06:30:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2ce7fff700 1 -- 172.21.15.69:0/3964193482 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0009e60 con 0x7f2cf00b5440 2023-11-17T06:30:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf79ce700 1 -- 172.21.15.69:0/3964193482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2cf00b5440 msgr2=0x7f2cf00d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf79ce700 1 --2- 172.21.15.69:0/3964193482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2cf00b5440 0x7f2cf00d1760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009910 tx=0x7f2ce0009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf79ce700 1 -- 172.21.15.69:0/3964193482 shutdown_connections 2023-11-17T06:30:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf79ce700 1 --2- 172.21.15.69:0/3964193482 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2cf00d1ca0 0x7f2cf00b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf79ce700 1 --2- 172.21.15.69:0/3964193482 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2cf00b5440 0x7f2cf00d1760 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf79ce700 1 -- 172.21.15.69:0/3964193482 >> 172.21.15.69:0/3964193482 conn(0x7f2cf00cfd30 msgr2=0x7f2cf00d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf79ce700 1 -- 172.21.15.69:0/3964193482 shutdown_connections 2023-11-17T06:30:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.175+0000 7f2cf79ce700 1 -- 172.21.15.69:0/3964193482 wait complete. 2023-11-17T06:30:58.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf79ce700 1 Processor -- start 2023-11-17T06:30:58.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf79ce700 1 -- start start 2023-11-17T06:30:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf79ce700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf00b5440 0x7f2cf00a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf79ce700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2cf00d1ca0 0x7f2cf015f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf79ce700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2cf01f3180 0x7f2cf01f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf79ce700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0157af0 con 0x7f2cf00b5440 2023-11-17T06:30:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf79ce700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf01577c0 con 0x7f2cf01f3180 2023-11-17T06:30:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf79ce700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf0160090 con 0x7f2cf00d1ca0 2023-11-17T06:30:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf576a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf00b5440 0x7f2cf00a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf4f69700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2cf00d1ca0 0x7f2cf015f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf5f6b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2cf01f3180 0x7f2cf01f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf576a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf00b5440 0x7f2cf00a9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49842/0 (socket says 172.21.15.69:49842) 2023-11-17T06:30:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.179+0000 7f2cf576a700 1 -- 172.21.15.69:0/1929303837 learned_addr learned my addr 172.21.15.69:0/1929303837 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2cf5f6b700 1 -- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2cf00d1ca0 msgr2=0x7f2cf015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2cf5f6b700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2cf00d1ca0 0x7f2cf015f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2cf5f6b700 1 -- 172.21.15.69:0/1929303837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf00b5440 msgr2=0x7f2cf00a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2cf5f6b700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf00b5440 0x7f2cf00a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2cf5f6b700 1 -- 172.21.15.69:0/1929303837 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce0009570 con 0x7f2cf01f3180 2023-11-17T06:30:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2cf5f6b700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2cf01f3180 0x7f2cf01f3610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8007d90 tx=0x7f2ce800e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2ce5ffb700 1 -- 172.21.15.69:0/1929303837 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8018070 con 0x7f2cf01f3180 2023-11-17T06:30:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2ce5ffb700 1 -- 172.21.15.69:0/1929303837 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce800eb30 con 0x7f2cf01f3180 2023-11-17T06:30:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2cf79ce700 1 -- 172.21.15.69:0/1929303837 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf0160370 con 0x7f2cf01f3180 2023-11-17T06:30:58.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2ce5ffb700 1 -- 172.21.15.69:0/1929303837 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8003a40 con 0x7f2cf01f3180 2023-11-17T06:30:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2cf79ce700 1 -- 172.21.15.69:0/1929303837 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf015fd50 con 0x7f2cf01f3180 2023-11-17T06:30:58.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.183+0000 7f2cf79ce700 1 -- 172.21.15.69:0/1929303837 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf0157c60 con 0x7f2cf01f3180 2023-11-17T06:30:58.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.187+0000 7f2ce5ffb700 1 -- 172.21.15.69:0/1929303837 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2ce8014420 con 0x7f2cf01f3180 2023-11-17T06:30:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.187+0000 7f2ce5ffb700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2cd4066560 0x7f2cd4068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.187+0000 7f2ce5ffb700 1 -- 172.21.15.69:0/1929303837 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2ce8083d60 con 0x7f2cf01f3180 2023-11-17T06:30:58.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.187+0000 7f2cf576a700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2cd4066560 0x7f2cd4068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.191+0000 7f2cf576a700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2cd4066560 0x7f2cd4068a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0018f0 tx=0x7f2cec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.199+0000 7f2ce5ffb700 1 -- 172.21.15.69:0/1929303837 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2ce8051230 con 0x7f2cf01f3180 2023-11-17T06:30:58.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.383+0000 7f2cf79ce700 1 -- 172.21.15.69:0/1929303837 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2cf0073f00 con 0x7f2cf01f3180 2023-11-17T06:30:58.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.383+0000 7f2ce5ffb700 1 -- 172.21.15.69:0/1929303837 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ce8054850 con 0x7f2cf01f3180 2023-11-17T06:30:58.389 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:30:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 -- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2cd4066560 msgr2=0x7f2cd4068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2cd4066560 0x7f2cd4068a20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0018f0 tx=0x7f2cec009040 comp rx=0 tx=0).stop 2023-11-17T06:30:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 -- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2cf01f3180 msgr2=0x7f2cf01f3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2cf01f3180 0x7f2cf01f3610 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8007d90 tx=0x7f2ce800e3c0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 -- 172.21.15.69:0/1929303837 shutdown_connections 2023-11-17T06:30:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2cd4066560 0x7f2cd4068a20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2cf01f3180 0x7f2cf01f3610 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2cf00d1ca0 0x7f2cf015f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 --2- 172.21.15.69:0/1929303837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf00b5440 0x7f2cf00a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 -- 172.21.15.69:0/1929303837 >> 172.21.15.69:0/1929303837 conn(0x7f2cf00cfd30 msgr2=0x7f2cf00b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 -- 172.21.15.69:0/1929303837 shutdown_connections 2023-11-17T06:30:58.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.387+0000 7f2cf79ce700 1 -- 172.21.15.69:0/1929303837 wait complete. 2023-11-17T06:30:58.412 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:30:58.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.595+0000 7fe6b6251700 1 Processor -- start 2023-11-17T06:30:58.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.595+0000 7fe6b6251700 1 -- start start 2023-11-17T06:30:58.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b6251700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe6b00719e0 0x7fe6b00c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b6251700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b006fc20 con 0x7fe6b00c9960 2023-11-17T06:30:58.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b6251700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6b006fe70 con 0x7fe6b015b980 2023-11-17T06:30:58.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b6251700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6b0070430 con 0x7fe6b00719e0 2023-11-17T06:30:58.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b4a4e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe6b00719e0 0x7fe6b00c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b4a4e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe6b00719e0 0x7fe6b00c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49846/0 (socket says 172.21.15.69:49846) 2023-11-17T06:30:58.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b4a4e700 1 -- 172.21.15.69:0/4289109462 learned_addr learned my addr 172.21.15.69:0/4289109462 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:58.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b4a4e700 1 -- 172.21.15.69:0/4289109462 >> v1:172.21.15.93:6789/0 conn(0x7fe6b015b980 legacy=0x7fe6b015f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:58.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b4a4e700 1 -- 172.21.15.69:0/4289109462 >> v1:172.21.15.69:6789/0 conn(0x7fe6b00c9960 legacy=0x7fe6b015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b4a4e700 1 -- 172.21.15.69:0/4289109462 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b0070150 con 0x7fe6b00719e0 2023-11-17T06:30:58.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6a7fff700 1 -- 172.21.15.69:0/4289109462 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96796188 0 0) 0x7fe6b006fc20 con 0x7fe6b00c9960 2023-11-17T06:30:58.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6b4a4e700 1 --2- 172.21.15.69:0/4289109462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 0x7fe6b00c9420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009910 tx=0x7fe6a0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d32e7ea9d8d3f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6a7fff700 1 -- 172.21.15.69:0/4289109462 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a000ba60 con 0x7fe6b00719e0 2023-11-17T06:30:58.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6a7fff700 1 -- 172.21.15.69:0/4289109462 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6a000bbc0 con 0x7fe6b00719e0 2023-11-17T06:30:58.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.599+0000 7fe6a7fff700 1 -- 172.21.15.69:0/4289109462 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0009e60 con 0x7fe6b00719e0 2023-11-17T06:30:58.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.603+0000 7fe6b6251700 1 -- 172.21.15.69:0/4289109462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 msgr2=0x7fe6b00c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.603+0000 7fe6b6251700 1 --2- 172.21.15.69:0/4289109462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 0x7fe6b00c9420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009910 tx=0x7fe6a0009c20 comp rx=0 tx=0).stop 2023-11-17T06:30:58.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.603+0000 7fe6b6251700 1 -- 172.21.15.69:0/4289109462 shutdown_connections 2023-11-17T06:30:58.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.603+0000 7fe6b6251700 1 --2- 172.21.15.69:0/4289109462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 0x7fe6b00c9420 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.603+0000 7fe6b6251700 1 -- 172.21.15.69:0/4289109462 >> 172.21.15.69:0/4289109462 conn(0x7fe6b00b0900 msgr2=0x7fe6b00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:58.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.603+0000 7fe6b6251700 1 -- 172.21.15.69:0/4289109462 shutdown_connections 2023-11-17T06:30:58.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.603+0000 7fe6b6251700 1 -- 172.21.15.69:0/4289109462 wait complete. 2023-11-17T06:30:58.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.603+0000 7fe6b6251700 1 Processor -- start 2023-11-17T06:30:58.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.603+0000 7fe6b6251700 1 -- start start 2023-11-17T06:30:58.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b6251700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 0x7fe6b01438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b6251700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe6b00c9960 0x7fe6b00c4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b6251700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6b015b980 0x7fe6b0140e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b6251700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b01e4770 con 0x7fe6b00719e0 2023-11-17T06:30:58.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b6251700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b015d980 con 0x7fe6b015b980 2023-11-17T06:30:58.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b6251700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b015dc60 con 0x7fe6b00c9960 2023-11-17T06:30:58.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b524f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 0x7fe6b01438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b524f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 0x7fe6b01438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49852/0 (socket says 172.21.15.69:49852) 2023-11-17T06:30:58.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b524f700 1 -- 172.21.15.69:0/1974467446 learned_addr learned my addr 172.21.15.69:0/1974467446 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:58.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b4a4e700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe6b00c9960 0x7fe6b00c4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b5a50700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6b015b980 0x7fe6b0140e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b524f700 1 -- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe6b00c9960 msgr2=0x7fe6b00c4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b524f700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe6b00c9960 0x7fe6b00c4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b524f700 1 -- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6b015b980 msgr2=0x7fe6b0140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b524f700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6b015b980 0x7fe6b0140e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b524f700 1 -- 172.21.15.69:0/1974467446 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a0009570 con 0x7fe6b00719e0 2023-11-17T06:30:58.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b5a50700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6b015b980 0x7fe6b0140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:58.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b524f700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 0x7fe6b01438c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00c500 tx=0x7fe6ac00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6a5ffb700 1 -- 172.21.15.69:0/1974467446 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0052d0 con 0x7fe6b00719e0 2023-11-17T06:30:58.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6a5ffb700 1 -- 172.21.15.69:0/1974467446 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ac005430 con 0x7fe6b00719e0 2023-11-17T06:30:58.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b6251700 1 -- 172.21.15.69:0/1974467446 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6b015df40 con 0x7fe6b00719e0 2023-11-17T06:30:58.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6a5ffb700 1 -- 172.21.15.69:0/1974467446 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ac0055a0 con 0x7fe6b00719e0 2023-11-17T06:30:58.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.607+0000 7fe6b6251700 1 -- 172.21.15.69:0/1974467446 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6b00c51b0 con 0x7fe6b00719e0 2023-11-17T06:30:58.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.611+0000 7fe6b6251700 1 -- 172.21.15.69:0/1974467446 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6b015d7e0 con 0x7fe6b00719e0 2023-11-17T06:30:58.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.611+0000 7fe6a5ffb700 1 -- 172.21.15.69:0/1974467446 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe6ac0038e0 con 0x7fe6b00719e0 2023-11-17T06:30:58.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.611+0000 7fe6a5ffb700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe694066510 0x7fe6940689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:58.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.611+0000 7fe6a5ffb700 1 -- 172.21.15.69:0/1974467446 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe6ac083270 con 0x7fe6b00719e0 2023-11-17T06:30:58.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.615+0000 7fe6b4a4e700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe694066510 0x7fe6940689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:58.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.615+0000 7fe6b4a4e700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe694066510 0x7fe6940689d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0000c00 tx=0x7fe6a0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:58.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.619+0000 7fe6a5ffb700 1 -- 172.21.15.69:0/1974467446 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe6b015d7e0 con 0x7fe6b00719e0 2023-11-17T06:30:58.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.803+0000 7fe6b6251700 1 -- 172.21.15.69:0/1974467446 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe6b015d7e0 con 0x7fe6b00719e0 2023-11-17T06:30:58.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6a5ffb700 1 -- 172.21.15.69:0/1974467446 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe6b015d7e0 con 0x7fe6b00719e0 2023-11-17T06:30:58.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 -- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe694066510 msgr2=0x7fe6940689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe694066510 0x7fe6940689d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0000c00 tx=0x7fe6a0008030 comp rx=0 tx=0).stop 2023-11-17T06:30:58.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 -- 172.21.15.69:0/1974467446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 msgr2=0x7fe6b01438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:58.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 0x7fe6b01438c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe6ac00c500 tx=0x7fe6ac00c810 comp rx=0 tx=0).stop 2023-11-17T06:30:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 -- 172.21.15.69:0/1974467446 shutdown_connections 2023-11-17T06:30:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe694066510 0x7fe6940689d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6b015b980 0x7fe6b0140e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe6b00c9960 0x7fe6b00c4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 --2- 172.21.15.69:0/1974467446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6b00719e0 0x7fe6b01438c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:58.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 -- 172.21.15.69:0/1974467446 >> 172.21.15.69:0/1974467446 conn(0x7fe6b00b0900 msgr2=0x7fe6b00ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:58.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 -- 172.21.15.69:0/1974467446 shutdown_connections 2023-11-17T06:30:58.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:58.807+0000 7fe6b6251700 1 -- 172.21.15.69:0/1974467446 wait complete. 2023-11-17T06:30:58.816 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2023-11-17T06:30:58.835 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi069.front.sepia.ceph.com... 2023-11-17T06:30:58.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:58.835 DEBUG:teuthology.orchestra.run.smithi069:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-17T06:30:58.874 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:30:58.874 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:30:58.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:30:58.874 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-17T06:30:58.935 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:30:58.935 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:58.956 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:30:58.956 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:30:59.017 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:30:59.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.191+0000 7f325b014700 1 Processor -- start 2023-11-17T06:30:59.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.191+0000 7f325b014700 1 -- start start 2023-11-17T06:30:59.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.191+0000 7f325b014700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f325415b980 0x7f325415f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.191+0000 7f325b014700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f32540c9b30 0x7f325415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.191+0000 7f325b014700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325406fc20 con 0x7f32540719e0 2023-11-17T06:30:59.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.191+0000 7f325b014700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3254070430 con 0x7f32540c9b30 2023-11-17T06:30:59.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.191+0000 7f325b014700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325415ed70 con 0x7f325415b980 2023-11-17T06:30:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325a813700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f32540c9b30 0x7f325415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325a813700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f32540c9b30 0x7f325415bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49866/0 (socket says 172.21.15.69:49866) 2023-11-17T06:30:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325a813700 1 -- 172.21.15.69:0/3443633683 learned_addr learned my addr 172.21.15.69:0/3443633683 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325a012700 1 --2- 172.21.15.69:0/3443633683 >> v2:172.21.15.93:3300/0 conn(0x7f325415b980 0x7f325415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325a813700 1 -- 172.21.15.69:0/3443633683 >> v2:172.21.15.93:3300/0 conn(0x7f325415b980 msgr2=0x7f325415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325a813700 1 --2- 172.21.15.69:0/3443633683 >> v2:172.21.15.93:3300/0 conn(0x7f325415b980 0x7f325415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325a813700 1 -- 172.21.15.69:0/3443633683 >> v1:172.21.15.93:6789/0 conn(0x7f32540719e0 legacy=0x7f32540c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:30:59.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325a813700 1 -- 172.21.15.69:0/3443633683 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325415fcc0 con 0x7f32540c9b30 2023-11-17T06:30:59.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325a813700 1 --2- 172.21.15.69:0/3443633683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32540c9b30 0x7f325415bd60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f32540cec90 tx=0x7f324c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b550930fa48e3827 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f3259010700 1 -- 172.21.15.69:0/3443633683 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c00e070 con 0x7f32540c9b30 2023-11-17T06:30:59.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f3259010700 1 -- 172.21.15.69:0/3443633683 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c003a40 con 0x7f32540c9b30 2023-11-17T06:30:59.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f3259010700 1 -- 172.21.15.69:0/3443633683 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c003df0 con 0x7f32540c9b30 2023-11-17T06:30:59.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325b014700 1 -- 172.21.15.69:0/3443633683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32540c9b30 msgr2=0x7f325415bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325b014700 1 --2- 172.21.15.69:0/3443633683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32540c9b30 0x7f325415bd60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f32540cec90 tx=0x7f324c00b330 comp rx=0 tx=0).stop 2023-11-17T06:30:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325b014700 1 -- 172.21.15.69:0/3443633683 shutdown_connections 2023-11-17T06:30:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325b014700 1 --2- 172.21.15.69:0/3443633683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32540c9b30 0x7f325415bd60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325b014700 1 --2- 172.21.15.69:0/3443633683 >> v2:172.21.15.93:3300/0 conn(0x7f325415b980 0x7f325415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325b014700 1 -- 172.21.15.69:0/3443633683 >> 172.21.15.69:0/3443633683 conn(0x7f32540b0900 msgr2=0x7f32540b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325b014700 1 -- 172.21.15.69:0/3443633683 shutdown_connections 2023-11-17T06:30:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.195+0000 7f325b014700 1 -- 172.21.15.69:0/3443633683 wait complete. 2023-11-17T06:30:59.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325b014700 1 Processor -- start 2023-11-17T06:30:59.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325b014700 1 -- start start 2023-11-17T06:30:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325b014700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32540719e0 0x7f3254154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325b014700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32540c9b30 0x7f32540ad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325b014700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f325415b980 0x7f32541f2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325b014700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32541f39b0 con 0x7f325415b980 2023-11-17T06:30:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325b014700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32540acd90 con 0x7f32540719e0 2023-11-17T06:30:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325b014700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32541f33f0 con 0x7f32540c9b30 2023-11-17T06:30:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325a813700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f325415b980 0x7f32541f2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325a813700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f325415b980 0x7f32541f2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49880/0 (socket says 172.21.15.69:49880) 2023-11-17T06:30:59.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325a813700 1 -- 172.21.15.69:0/2739430358 learned_addr learned my addr 172.21.15.69:0/2739430358 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:59.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f325a012700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32540719e0 0x7f3254154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.199+0000 7f3259811700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32540c9b30 0x7f32540ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f325a813700 1 -- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32540c9b30 msgr2=0x7f32540ad220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f325a813700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32540c9b30 0x7f32540ad220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f325a813700 1 -- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32540719e0 msgr2=0x7f3254154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f325a813700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32540719e0 0x7f3254154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f325a813700 1 -- 172.21.15.69:0/2739430358 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324c009b30 con 0x7f325415b980 2023-11-17T06:30:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f3259811700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32540c9b30 0x7f32540ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f325a012700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32540719e0 0x7f3254154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f325a813700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f325415b980 0x7f32541f2a00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f324c00b370 tx=0x7f324c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f324affd700 1 -- 172.21.15.69:0/2739430358 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c004440 con 0x7f325415b980 2023-11-17T06:30:59.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f324affd700 1 -- 172.21.15.69:0/2739430358 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324c0045c0 con 0x7f325415b980 2023-11-17T06:30:59.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f325b014700 1 -- 172.21.15.69:0/2739430358 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32541f36d0 con 0x7f325415b980 2023-11-17T06:30:59.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f324affd700 1 -- 172.21.15.69:0/2739430358 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324c004970 con 0x7f325415b980 2023-11-17T06:30:59.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f325b014700 1 -- 172.21.15.69:0/2739430358 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32540ad760 con 0x7f325415b980 2023-11-17T06:30:59.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.203+0000 7f325b014700 1 -- 172.21.15.69:0/2739430358 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32540acf00 con 0x7f325415b980 2023-11-17T06:30:59.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.207+0000 7f324affd700 1 -- 172.21.15.69:0/2739430358 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f324c012430 con 0x7f325415b980 2023-11-17T06:30:59.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.207+0000 7f324affd700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3238066510 0x7f32380689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.207+0000 7f324affd700 1 -- 172.21.15.69:0/2739430358 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f324c0852d0 con 0x7f325415b980 2023-11-17T06:30:59.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.207+0000 7f325a012700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3238066510 0x7f32380689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.211+0000 7f325a012700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3238066510 0x7f32380689d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3250007a70 tx=0x7f3250008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.211+0000 7f324affd700 1 -- 172.21.15.69:0/2739430358 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f324c0561b0 con 0x7f325415b980 2023-11-17T06:30:59.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.395+0000 7f325b014700 1 -- 172.21.15.69:0/2739430358 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3254073f00 con 0x7f325415b980 2023-11-17T06:30:59.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.399+0000 7f324affd700 1 -- 172.21.15.69:0/2739430358 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f324c055d40 con 0x7f325415b980 2023-11-17T06:30:59.405 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:30:59.406 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:30:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 -- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3238066510 msgr2=0x7f32380689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3238066510 0x7f32380689d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3250007a70 tx=0x7f3250008040 comp rx=0 tx=0).stop 2023-11-17T06:30:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 -- 172.21.15.69:0/2739430358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f325415b980 msgr2=0x7f32541f2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f325415b980 0x7f32541f2a00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f324c00b370 tx=0x7f324c004af0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 -- 172.21.15.69:0/2739430358 shutdown_connections 2023-11-17T06:30:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3238066510 0x7f32380689d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f325415b980 0x7f32541f2a00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32540c9b30 0x7f32540ad220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 --2- 172.21.15.69:0/2739430358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32540719e0 0x7f3254154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 -- 172.21.15.69:0/2739430358 >> 172.21.15.69:0/2739430358 conn(0x7f32540b0900 msgr2=0x7f32541599b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:59.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 -- 172.21.15.69:0/2739430358 shutdown_connections 2023-11-17T06:30:59.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.403+0000 7f325b014700 1 -- 172.21.15.69:0/2739430358 wait complete. 2023-11-17T06:30:59.431 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:30:59.431 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:30:59.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.599+0000 7f5b82025700 1 Processor -- start 2023-11-17T06:30:59.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.599+0000 7f5b82025700 1 -- start start 2023-11-17T06:30:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b82025700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5b7c0ce4e0 0x7f5b7c167e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b82025700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c0b9000 con 0x7f5b7c15d490 2023-11-17T06:30:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b82025700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c0d1bb0 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b82025700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0d1e90 con 0x7f5b7c0ce4e0 2023-11-17T06:30:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b81824700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5b7c0ce4e0 0x7f5b7c167e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b81824700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5b7c0ce4e0 0x7f5b7c167e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49892/0 (socket says 172.21.15.69:49892) 2023-11-17T06:30:59.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b81824700 1 -- 172.21.15.69:0/569461934 learned_addr learned my addr 172.21.15.69:0/569461934 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:59.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b81824700 1 -- 172.21.15.69:0/569461934 >> v1:172.21.15.93:6789/0 conn(0x7f5b7c0b8bc0 legacy=0x7f5b7c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b81824700 1 -- 172.21.15.69:0/569461934 >> v1:172.21.15.69:6789/0 conn(0x7f5b7c15d490 legacy=0x7f5b7c0d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b81824700 1 -- 172.21.15.69:0/569461934 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0d2170 con 0x7f5b7c0ce4e0 2023-11-17T06:30:59.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b73fff700 1 -- 172.21.15.69:0/569461934 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454272781 0 0) 0x7f5b78001110 con 0x7f5b7c15d490 2023-11-17T06:30:59.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b81824700 1 --2- 172.21.15.69:0/569461934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0ce4e0 0x7f5b7c167e20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009e50 tx=0x7f5b7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2295f45ebd3ec7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b73fff700 1 -- 172.21.15.69:0/569461934 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400e070 con 0x7f5b7c0ce4e0 2023-11-17T06:30:59.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b73fff700 1 -- 172.21.15.69:0/569461934 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7400b9c0 con 0x7f5b7c0ce4e0 2023-11-17T06:30:59.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.603+0000 7f5b73fff700 1 -- 172.21.15.69:0/569461934 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7400bd70 con 0x7f5b7c0ce4e0 2023-11-17T06:30:59.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.607+0000 7f5b82025700 1 -- 172.21.15.69:0/569461934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0ce4e0 msgr2=0x7f5b7c167e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.607+0000 7f5b82025700 1 --2- 172.21.15.69:0/569461934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0ce4e0 0x7f5b7c167e20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009e50 tx=0x7f5b7400b330 comp rx=0 tx=0).stop 2023-11-17T06:30:59.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.607+0000 7f5b82025700 1 -- 172.21.15.69:0/569461934 shutdown_connections 2023-11-17T06:30:59.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.607+0000 7f5b82025700 1 --2- 172.21.15.69:0/569461934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0ce4e0 0x7f5b7c167e20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.607+0000 7f5b82025700 1 -- 172.21.15.69:0/569461934 >> 172.21.15.69:0/569461934 conn(0x7f5b7c06ab40 msgr2=0x7f5b7c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:59.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.607+0000 7f5b82025700 1 -- 172.21.15.69:0/569461934 shutdown_connections 2023-11-17T06:30:59.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.607+0000 7f5b82025700 1 -- 172.21.15.69:0/569461934 wait complete. 2023-11-17T06:30:59.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b82025700 1 Processor -- start 2023-11-17T06:30:59.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b82025700 1 -- start start 2023-11-17T06:30:59.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b82025700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0b8bc0 0x7f5b7c150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b82025700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b7c0ce4e0 0x7f5b7c160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b82025700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b7c15d490 0x7f5b7c0b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b82025700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c15f570 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b82025700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c15e960 con 0x7f5b7c15d490 2023-11-17T06:30:59.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b82025700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c15ec40 con 0x7f5b7c0ce4e0 2023-11-17T06:30:59.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b81023700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0b8bc0 0x7f5b7c150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b81023700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0b8bc0 0x7f5b7c150b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49908/0 (socket says 172.21.15.69:49908) 2023-11-17T06:30:59.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b81023700 1 -- 172.21.15.69:0/2925455622 learned_addr learned my addr 172.21.15.69:0/2925455622 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:30:59.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b81824700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b7c15d490 0x7f5b7c0b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b80822700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b7c0ce4e0 0x7f5b7c160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b81023700 1 -- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b7c0ce4e0 msgr2=0x7f5b7c160130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b81023700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b7c0ce4e0 0x7f5b7c160130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b81023700 1 -- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b7c15d490 msgr2=0x7f5b7c0b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b81023700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b7c15d490 0x7f5b7c0b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b81023700 1 -- 172.21.15.69:0/2925455622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74009b30 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b81824700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b7c15d490 0x7f5b7c0b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:59.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.611+0000 7f5b80822700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b7c0ce4e0 0x7f5b7c160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:30:59.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.615+0000 7f5b81023700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0b8bc0 0x7f5b7c150b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800c450 tx=0x7f5b7800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.615+0000 7f5b71ffb700 1 -- 172.21.15.69:0/2925455622 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b780054e0 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.615+0000 7f5b82025700 1 -- 172.21.15.69:0/2925455622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c15ef20 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.615+0000 7f5b71ffb700 1 -- 172.21.15.69:0/2925455622 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b780036a0 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.615+0000 7f5b71ffb700 1 -- 172.21.15.69:0/2925455622 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78003a50 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.615+0000 7f5b82025700 1 -- 172.21.15.69:0/2925455622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c1510d0 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.615+0000 7f5b82025700 1 -- 172.21.15.69:0/2925455622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c15f6e0 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.615+0000 7f5b71ffb700 1 -- 172.21.15.69:0/2925455622 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5b78003bb0 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.619+0000 7f5b71ffb700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5b60066510 0x7f5b600689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:30:59.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.619+0000 7f5b71ffb700 1 -- 172.21.15.69:0/2925455622 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5b780831e0 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.619+0000 7f5b80822700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5b60066510 0x7f5b600689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:30:59.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.619+0000 7f5b80822700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5b60066510 0x7f5b600689d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c1f5a30 tx=0x7f5b6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:30:59.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.623+0000 7f5b71ffb700 1 -- 172.21.15.69:0/2925455622 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5b780505c0 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.795+0000 7f5b82025700 1 -- 172.21.15.69:0/2925455622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5b7c0b9000 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.795+0000 7f5b71ffb700 1 -- 172.21.15.69:0/2925455622 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5b7c0b9000 con 0x7f5b7c0b8bc0 2023-11-17T06:30:59.802 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:30:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 -- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5b60066510 msgr2=0x7f5b600689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5b60066510 0x7f5b600689d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c1f5a30 tx=0x7f5b6c009040 comp rx=0 tx=0).stop 2023-11-17T06:30:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 -- 172.21.15.69:0/2925455622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0b8bc0 msgr2=0x7f5b7c150b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:30:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0b8bc0 0x7f5b7c150b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b7800c450 tx=0x7f5b7800c810 comp rx=0 tx=0).stop 2023-11-17T06:30:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 -- 172.21.15.69:0/2925455622 shutdown_connections 2023-11-17T06:30:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5b60066510 0x7f5b600689d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b7c15d490 0x7f5b7c0b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f5b7c0ce4e0 0x7f5b7c160130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 --2- 172.21.15.69:0/2925455622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b7c0b8bc0 0x7f5b7c150b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:30:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 -- 172.21.15.69:0/2925455622 >> 172.21.15.69:0/2925455622 conn(0x7f5b7c06ab40 msgr2=0x7f5b7c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:30:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 -- 172.21.15.69:0/2925455622 shutdown_connections 2023-11-17T06:30:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.799+0000 7f5b82025700 1 -- 172.21.15.69:0/2925455622 wait complete. 2023-11-17T06:30:59.827 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:31:00.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.999+0000 7fe259625700 1 Processor -- start 2023-11-17T06:31:00.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:30:59.999+0000 7fe259625700 1 -- start start 2023-11-17T06:31:00.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe259625700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe25415d490 0x7fe2540b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe259625700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2540d13d0 0x7fe2540cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe259625700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540ce770 con 0x7fe2540ce310 2023-11-17T06:31:00.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe259625700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2540d1bb0 con 0x7fe25415d490 2023-11-17T06:31:00.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe259625700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540d1e90 con 0x7fe2540d13d0 2023-11-17T06:31:00.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe253fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe25415d490 0x7fe2540b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe253fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe25415d490 0x7fe2540b8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49920/0 (socket says 172.21.15.69:49920) 2023-11-17T06:31:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe253fff700 1 -- 172.21.15.69:0/3700901620 learned_addr learned my addr 172.21.15.69:0/3700901620 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe24b7fe700 1 --2- 172.21.15.69:0/3700901620 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2540d13d0 0x7fe2540cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe253fff700 1 -- 172.21.15.69:0/3700901620 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2540d13d0 msgr2=0x7fe2540cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe253fff700 1 --2- 172.21.15.69:0/3700901620 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2540d13d0 0x7fe2540cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe253fff700 1 -- 172.21.15.69:0/3700901620 >> v1:172.21.15.93:6789/0 conn(0x7fe2540ce310 legacy=0x7fe2540b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe253fff700 1 -- 172.21.15.69:0/3700901620 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540d2170 con 0x7fe25415d490 2023-11-17T06:31:00.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.003+0000 7fe253fff700 1 --2- 172.21.15.69:0/3700901620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 0x7fe2540b8bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe244009910 tx=0x7fe244009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6105fd1d1c42ad26 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe2537fe700 1 -- 172.21.15.69:0/3700901620 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24400ba60 con 0x7fe25415d490 2023-11-17T06:31:00.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe2537fe700 1 -- 172.21.15.69:0/3700901620 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24400bbc0 con 0x7fe25415d490 2023-11-17T06:31:00.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe2537fe700 1 -- 172.21.15.69:0/3700901620 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244009e60 con 0x7fe25415d490 2023-11-17T06:31:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe259625700 1 -- 172.21.15.69:0/3700901620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 msgr2=0x7fe2540b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe259625700 1 --2- 172.21.15.69:0/3700901620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 0x7fe2540b8bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe244009910 tx=0x7fe244009c20 comp rx=0 tx=0).stop 2023-11-17T06:31:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe259625700 1 -- 172.21.15.69:0/3700901620 shutdown_connections 2023-11-17T06:31:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe259625700 1 --2- 172.21.15.69:0/3700901620 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2540d13d0 0x7fe2540cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe259625700 1 --2- 172.21.15.69:0/3700901620 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 0x7fe2540b8bc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe259625700 1 -- 172.21.15.69:0/3700901620 >> 172.21.15.69:0/3700901620 conn(0x7fe25406ab40 msgr2=0x7fe25406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe259625700 1 -- 172.21.15.69:0/3700901620 shutdown_connections 2023-11-17T06:31:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.007+0000 7fe259625700 1 -- 172.21.15.69:0/3700901620 wait complete. 2023-11-17T06:31:00.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.011+0000 7fe259625700 1 Processor -- start 2023-11-17T06:31:00.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.011+0000 7fe259625700 1 -- start start 2023-11-17T06:31:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.011+0000 7fe259625700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2540ce310 0x7fe2541f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.011+0000 7fe259625700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540d13d0 0x7fe2540cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.011+0000 7fe259625700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 0x7fe2540cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.011+0000 7fe259625700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe25415f570 con 0x7fe25415d490 2023-11-17T06:31:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.011+0000 7fe259625700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe254160530 con 0x7fe2540d13d0 2023-11-17T06:31:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.011+0000 7fe259625700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25415e960 con 0x7fe2540ce310 2023-11-17T06:31:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.011+0000 7fe258e24700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 0x7fe2540cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.011+0000 7fe24b7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540d13d0 0x7fe2540cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe253fff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2540ce310 0x7fe2541f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe258e24700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 0x7fe2540cff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49932/0 (socket says 172.21.15.69:49932) 2023-11-17T06:31:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe258e24700 1 -- 172.21.15.69:0/1068042140 learned_addr learned my addr 172.21.15.69:0/1068042140 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe258e24700 1 -- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2540ce310 msgr2=0x7fe2541f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe258e24700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2540ce310 0x7fe2541f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe258e24700 1 -- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540d13d0 msgr2=0x7fe2540cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe258e24700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540d13d0 0x7fe2540cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe258e24700 1 -- 172.21.15.69:0/1068042140 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244009570 con 0x7fe25415d490 2023-11-17T06:31:00.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe258e24700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 0x7fe2540cff50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00cc50 tx=0x7fe24c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe2517fa700 1 -- 172.21.15.69:0/1068042140 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c003c20 con 0x7fe25415d490 2023-11-17T06:31:00.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe2517fa700 1 -- 172.21.15.69:0/1068042140 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c003d80 con 0x7fe25415d490 2023-11-17T06:31:00.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe2517fa700 1 -- 172.21.15.69:0/1068042140 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c00aab0 con 0x7fe25415d490 2023-11-17T06:31:00.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe259625700 1 -- 172.21.15.69:0/1068042140 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25415ec40 con 0x7fe25415d490 2023-11-17T06:31:00.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe259625700 1 -- 172.21.15.69:0/1068042140 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe25415f200 con 0x7fe25415d490 2023-11-17T06:31:00.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.015+0000 7fe259625700 1 -- 172.21.15.69:0/1068042140 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe25415f6e0 con 0x7fe25415d490 2023-11-17T06:31:00.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.019+0000 7fe2517fa700 1 -- 172.21.15.69:0/1068042140 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe24c00ac10 con 0x7fe25415d490 2023-11-17T06:31:00.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.019+0000 7fe2517fa700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe234066510 0x7fe2340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.019+0000 7fe2517fa700 1 -- 172.21.15.69:0/1068042140 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe24c083ed0 con 0x7fe25415d490 2023-11-17T06:31:00.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.019+0000 7fe253fff700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe234066510 0x7fe2340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.019+0000 7fe253fff700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe234066510 0x7fe2340689d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe244000c00 tx=0x7fe244008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.027+0000 7fe2517fa700 1 -- 172.21.15.69:0/1068042140 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe24c0512b0 con 0x7fe25415d490 2023-11-17T06:31:00.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.203+0000 7fe259625700 1 -- 172.21.15.69:0/1068042140 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe254073f00 con 0x7fe25415d490 2023-11-17T06:31:00.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.203+0000 7fe2517fa700 1 -- 172.21.15.69:0/1068042140 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe24c0548d0 con 0x7fe25415d490 2023-11-17T06:31:00.209 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:31:00.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 -- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe234066510 msgr2=0x7fe2340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe234066510 0x7fe2340689d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe244000c00 tx=0x7fe244008030 comp rx=0 tx=0).stop 2023-11-17T06:31:00.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 -- 172.21.15.69:0/1068042140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 msgr2=0x7fe2540cff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 0x7fe2540cff50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00cc50 tx=0x7fe24c00cf60 comp rx=0 tx=0).stop 2023-11-17T06:31:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 -- 172.21.15.69:0/1068042140 shutdown_connections 2023-11-17T06:31:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe234066510 0x7fe2340689d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25415d490 0x7fe2540cff50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2540d13d0 0x7fe2540cfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 --2- 172.21.15.69:0/1068042140 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe2540ce310 0x7fe2541f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 -- 172.21.15.69:0/1068042140 >> 172.21.15.69:0/1068042140 conn(0x7fe25406ab40 msgr2=0x7fe25415c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 -- 172.21.15.69:0/1068042140 shutdown_connections 2023-11-17T06:31:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.207+0000 7fe259625700 1 -- 172.21.15.69:0/1068042140 wait complete. 2023-11-17T06:31:00.235 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:31:00.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.415+0000 7fc585463700 1 Processor -- start 2023-11-17T06:31:00.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.415+0000 7fc585463700 1 -- start start 2023-11-17T06:31:00.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc585463700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc58015d980 0x7fc5800d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc585463700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5801621b0 con 0x7fc5800d0230 2023-11-17T06:31:00.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc585463700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc580161630 con 0x7fc58015d5a0 2023-11-17T06:31:00.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc585463700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc580161910 con 0x7fc58015d980 2023-11-17T06:31:00.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57f7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc5800d0230 0x7fc5800d1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42460/0 (socket says 172.21.15.69:42460) 2023-11-17T06:31:00.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57f7fe700 1 -- 172.21.15.69:0/3216034988 learned_addr learned my addr 172.21.15.69:0/3216034988 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:00.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57e7fc700 1 --2- 172.21.15.69:0/3216034988 >> v2:172.21.15.93:3300/0 conn(0x7fc58015d980 0x7fc5800d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051282865 0 0) 0x7fc5801621b0 con 0x7fc5800d0230 2023-11-17T06:31:00.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5680035d0 con 0x7fc5800d0230 2023-11-17T06:31:00.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 649487881 0 0) 0x7fc5680035d0 con 0x7fc5800d0230 2023-11-17T06:31:00.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 >> v2:172.21.15.93:3300/0 conn(0x7fc58015d980 msgr2=0x7fc5800d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:00.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 --2- 172.21.15.69:0/3216034988 >> v2:172.21.15.93:3300/0 conn(0x7fc58015d980 0x7fc5800d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 >> v1:172.21.15.93:6789/0 conn(0x7fc58015d5a0 legacy=0x7fc5800cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc580161bf0 con 0x7fc5800d0230 2023-11-17T06:31:00.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7fc5780019f0 con 0x7fc5800d0230 2023-11-17T06:31:00.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 >> v1:172.21.15.69:6789/0 conn(0x7fc5800d0230 legacy=0x7fc5800d1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc568003a20 0x7fc568003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc568004870 0x7fc568004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc568005350 0x7fc56800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc580161910 con 0x7fc568003a20 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56800c220 con 0x7fc568004870 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56800c3e0 con 0x7fc568005350 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57effd700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc568003a20 0x7fc568003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57e7fc700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc568004870 0x7fc568004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57f7fe700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc568005350 0x7fc56800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57effd700 1 -- 172.21.15.69:0/3216034988 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc568005350 msgr2=0x7fc56800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57effd700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc568005350 0x7fc56800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57effd700 1 -- 172.21.15.69:0/3216034988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc568004870 msgr2=0x7fc568004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57effd700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc568004870 0x7fc568004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57effd700 1 -- 172.21.15.69:0/3216034988 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680035d0 con 0x7fc568003a20 2023-11-17T06:31:00.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57e7fc700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc568004870 0x7fc568004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:00.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57f7fe700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc568005350 0x7fc56800ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:00.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.419+0000 7fc57f7fe700 1 -- 172.21.15.69:0/3216034988 reap_dead start 2023-11-17T06:31:00.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc57effd700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc568003a20 0x7fc568003e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc570007fd0 tx=0x7fc5680058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54351d6d85a7add server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700052d0 con 0x7fc568003a20 2023-11-17T06:31:00.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc570005430 con 0x7fc568003a20 2023-11-17T06:31:00.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc57dffb700 1 -- 172.21.15.69:0/3216034988 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700055a0 con 0x7fc568003a20 2023-11-17T06:31:00.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc585463700 1 -- 172.21.15.69:0/3216034988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc568003a20 msgr2=0x7fc568003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc585463700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc568003a20 0x7fc568003e40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc570007fd0 tx=0x7fc5680058a0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc585463700 1 -- 172.21.15.69:0/3216034988 shutdown_connections 2023-11-17T06:31:00.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc585463700 1 --2- 172.21.15.69:0/3216034988 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc568003a20 0x7fc568003e40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc585463700 1 -- 172.21.15.69:0/3216034988 >> 172.21.15.69:0/3216034988 conn(0x7fc58006aca0 msgr2=0x7fc58006b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:00.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc585463700 1 -- 172.21.15.69:0/3216034988 shutdown_connections 2023-11-17T06:31:00.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.423+0000 7fc585463700 1 -- 172.21.15.69:0/3216034988 wait complete. 2023-11-17T06:31:00.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc585463700 1 Processor -- start 2023-11-17T06:31:00.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc585463700 1 -- start start 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc585463700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc568003a20 0x7fc5800cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc585463700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc580150ac0 0x7fc5800ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc585463700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5800ca720 0x7fc5800caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc585463700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58015be30 con 0x7fc580150ac0 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc585463700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58014ed30 con 0x7fc5800ca720 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc585463700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58014e120 con 0x7fc568003a20 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc580150ac0 0x7fc5800ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc580150ac0 0x7fc5800ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49958/0 (socket says 172.21.15.69:49958) 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57e7fc700 1 -- 172.21.15.69:0/3837615932 learned_addr learned my addr 172.21.15.69:0/3837615932 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57effd700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc568003a20 0x7fc5800cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57f7fe700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5800ca720 0x7fc5800caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57e7fc700 1 -- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc568003a20 msgr2=0x7fc5800cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57e7fc700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc568003a20 0x7fc5800cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57e7fc700 1 -- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5800ca720 msgr2=0x7fc5800caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57e7fc700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5800ca720 0x7fc5800caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57e7fc700 1 -- 172.21.15.69:0/3837615932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58014e400 con 0x7fc580150ac0 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.427+0000 7fc57f7fe700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5800ca720 0x7fc5800caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.431+0000 7fc57e7fc700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc580150ac0 0x7fc5800ca1e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5740109f0 tx=0x7fc574010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.431+0000 7fc5677fe700 1 -- 172.21.15.69:0/3837615932 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574004220 con 0x7fc580150ac0 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.431+0000 7fc5677fe700 1 -- 172.21.15.69:0/3837615932 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574004380 con 0x7fc580150ac0 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.431+0000 7fc5677fe700 1 -- 172.21.15.69:0/3837615932 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57400e810 con 0x7fc580150ac0 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.431+0000 7fc585463700 1 -- 172.21.15.69:0/3837615932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58014e6e0 con 0x7fc580150ac0 2023-11-17T06:31:00.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.431+0000 7fc585463700 1 -- 172.21.15.69:0/3837615932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5800cbdf0 con 0x7fc580150ac0 2023-11-17T06:31:00.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.431+0000 7fc585463700 1 -- 172.21.15.69:0/3837615932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5800686a0 con 0x7fc580150ac0 2023-11-17T06:31:00.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.435+0000 7fc5677fe700 1 -- 172.21.15.69:0/3837615932 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fc57400e970 con 0x7fc580150ac0 2023-11-17T06:31:00.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.435+0000 7fc5677fe700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc56c066510 0x7fc56c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.435+0000 7fc5677fe700 1 -- 172.21.15.69:0/3837615932 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc574083f70 con 0x7fc580150ac0 2023-11-17T06:31:00.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.435+0000 7fc57effd700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc56c066510 0x7fc56c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.439+0000 7fc57effd700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc56c066510 0x7fc56c0689d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc570015040 tx=0x7fc570009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.439+0000 7fc5677fe700 1 -- 172.21.15.69:0/3837615932 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fc574051330 con 0x7fc580150ac0 2023-11-17T06:31:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.619+0000 7fc585463700 1 -- 172.21.15.69:0/3837615932 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5800d0e90 con 0x7fc580150ac0 2023-11-17T06:31:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.619+0000 7fc5677fe700 1 -- 172.21.15.69:0/3837615932 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc574054950 con 0x7fc580150ac0 2023-11-17T06:31:00.625 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.623+0000 7fc585463700 1 -- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc56c066510 msgr2=0x7fc56c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.623+0000 7fc585463700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc56c066510 0x7fc56c0689d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc570015040 tx=0x7fc570009030 comp rx=0 tx=0).stop 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.623+0000 7fc585463700 1 -- 172.21.15.69:0/3837615932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc580150ac0 msgr2=0x7fc5800ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.623+0000 7fc585463700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc580150ac0 0x7fc5800ca1e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc5740109f0 tx=0x7fc574010d00 comp rx=0 tx=0).stop 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.623+0000 7fc585463700 1 -- 172.21.15.69:0/3837615932 shutdown_connections 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.623+0000 7fc585463700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fc56c066510 0x7fc56c0689d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.623+0000 7fc585463700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc5800ca720 0x7fc5800caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.623+0000 7fc585463700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc580150ac0 0x7fc5800ca1e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.623+0000 7fc585463700 1 --2- 172.21.15.69:0/3837615932 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fc568003a20 0x7fc5800cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.623+0000 7fc585463700 1 -- 172.21.15.69:0/3837615932 >> 172.21.15.69:0/3837615932 conn(0x7fc58006aca0 msgr2=0x7fc58015c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.627+0000 7fc585463700 1 -- 172.21.15.69:0/3837615932 shutdown_connections 2023-11-17T06:31:00.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.627+0000 7fc585463700 1 -- 172.21.15.69:0/3837615932 wait complete. 2023-11-17T06:31:00.652 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:31:00.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.819+0000 7f1a1e9fe700 1 Processor -- start 2023-11-17T06:31:00.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.819+0000 7f1a1e9fe700 1 -- start start 2023-11-17T06:31:00.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1e9fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1a180c21a0 0x7f1a1806c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1e9fe700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a1806c200 con 0x7f1a180cbef0 2023-11-17T06:31:00.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1e9fe700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a18165d00 con 0x7f1a181652b0 2023-11-17T06:31:00.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1e9fe700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a181662c0 con 0x7f1a180c21a0 2023-11-17T06:31:00.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1e1fd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1a180cbef0 0x7f1a180cc9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42466/0 (socket says 172.21.15.69:42466) 2023-11-17T06:31:00.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1e1fd700 1 -- 172.21.15.69:0/1141028179 learned_addr learned my addr 172.21.15.69:0/1141028179 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:00.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1d9fc700 1 --2- 172.21.15.69:0/1141028179 >> v2:172.21.15.93:3300/0 conn(0x7f1a180c21a0 0x7f1a1806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1c9fa700 1 -- 172.21.15.69:0/1141028179 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075524071 0 0) 0x7f1a1806c200 con 0x7f1a180cbef0 2023-11-17T06:31:00.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1c9fa700 1 -- 172.21.15.69:0/1141028179 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a040035d0 con 0x7f1a180cbef0 2023-11-17T06:31:00.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1c9fa700 1 -- 172.21.15.69:0/1141028179 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844416736 0 0) 0x7f1a18165d00 con 0x7f1a181652b0 2023-11-17T06:31:00.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1c9fa700 1 -- 172.21.15.69:0/1141028179 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a1806c200 con 0x7f1a181652b0 2023-11-17T06:31:00.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1d9fc700 1 -- 172.21.15.69:0/1141028179 >> v1:172.21.15.93:6789/0 conn(0x7f1a181652b0 legacy=0x7f1a180cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1d9fc700 1 -- 172.21.15.69:0/1141028179 >> v1:172.21.15.69:6789/0 conn(0x7f1a180cbef0 legacy=0x7f1a180cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.823+0000 7f1a1d9fc700 1 -- 172.21.15.69:0/1141028179 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a18165fe0 con 0x7f1a180c21a0 2023-11-17T06:31:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1d9fc700 1 --2- 172.21.15.69:0/1141028179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a180c21a0 0x7f1a1806c690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009880 tx=0x7f1a14009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1e83f69a5980443 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1c9fa700 1 -- 172.21.15.69:0/1141028179 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14011830 con 0x7f1a180c21a0 2023-11-17T06:31:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1c9fa700 1 -- 172.21.15.69:0/1141028179 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a14011990 con 0x7f1a180c21a0 2023-11-17T06:31:00.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1c9fa700 1 -- 172.21.15.69:0/1141028179 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14011d20 con 0x7f1a180c21a0 2023-11-17T06:31:00.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/1141028179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a180c21a0 msgr2=0x7f1a1806c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1e9fe700 1 --2- 172.21.15.69:0/1141028179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a180c21a0 0x7f1a1806c690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1a14009880 tx=0x7f1a14009b90 comp rx=0 tx=0).stop 2023-11-17T06:31:00.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/1141028179 shutdown_connections 2023-11-17T06:31:00.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1e9fe700 1 --2- 172.21.15.69:0/1141028179 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a180c21a0 0x7f1a1806c690 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/1141028179 >> 172.21.15.69:0/1141028179 conn(0x7f1a180b0900 msgr2=0x7f1a180b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:00.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/1141028179 shutdown_connections 2023-11-17T06:31:00.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/1141028179 wait complete. 2023-11-17T06:31:00.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1e9fe700 1 Processor -- start 2023-11-17T06:31:00.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.827+0000 7f1a1e9fe700 1 -- start start 2023-11-17T06:31:00.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e9fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a180c21a0 0x7f1a18152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e9fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a180cbef0 0x7f1a18070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e9fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a181652b0 0x7f1a18071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e9fe700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a180c52b0 con 0x7f1a181652b0 2023-11-17T06:31:00.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e9fe700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a181f7b50 con 0x7f1a180c21a0 2023-11-17T06:31:00.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e9fe700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a18152850 con 0x7f1a180cbef0 2023-11-17T06:31:00.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e1fd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a181652b0 0x7f1a18071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e1fd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a181652b0 0x7f1a18071070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49968/0 (socket says 172.21.15.69:49968) 2023-11-17T06:31:00.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e1fd700 1 -- 172.21.15.69:0/3253971395 learned_addr learned my addr 172.21.15.69:0/3253971395 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:00.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1d1fb700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a180cbef0 0x7f1a18070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1d9fc700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a180c21a0 0x7f1a18152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e1fd700 1 -- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a180cbef0 msgr2=0x7f1a18070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e1fd700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a180cbef0 0x7f1a18070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e1fd700 1 -- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a180c21a0 msgr2=0x7f1a18152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:00.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e1fd700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a180c21a0 0x7f1a18152310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:00.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e1fd700 1 -- 172.21.15.69:0/3253971395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a140094b0 con 0x7f1a181652b0 2023-11-17T06:31:00.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e1fd700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a181652b0 0x7f1a18071070 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000cba0 tx=0x7f1a1000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a0e7fc700 1 -- 172.21.15.69:0/3253971395 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10007480 con 0x7f1a181652b0 2023-11-17T06:31:00.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/3253971395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a181f7870 con 0x7f1a181652b0 2023-11-17T06:31:00.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a0e7fc700 1 -- 172.21.15.69:0/3253971395 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100075e0 con 0x7f1a181652b0 2023-11-17T06:31:00.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a0e7fc700 1 -- 172.21.15.69:0/3253971395 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10007970 con 0x7f1a181652b0 2023-11-17T06:31:00.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.831+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/3253971395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a180b1ab0 con 0x7f1a181652b0 2023-11-17T06:31:00.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.835+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/3253971395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a180b1630 con 0x7f1a181652b0 2023-11-17T06:31:00.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.835+0000 7f1a0e7fc700 1 -- 172.21.15.69:0/3253971395 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1a1001b3b0 con 0x7f1a181652b0 2023-11-17T06:31:00.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.839+0000 7f1a0e7fc700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19fc066510 0x7f19fc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:00.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.839+0000 7f1a0e7fc700 1 -- 172.21.15.69:0/3253971395 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1a100838b0 con 0x7f1a181652b0 2023-11-17T06:31:00.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.839+0000 7f1a1d9fc700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19fc066510 0x7f19fc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:00.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.839+0000 7f1a1d9fc700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19fc066510 0x7f19fc0689d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a140090b0 tx=0x7f1a14008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:00.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:00.843+0000 7f1a0e7fc700 1 -- 172.21.15.69:0/3253971395 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1a180b1630 con 0x7f1a181652b0 2023-11-17T06:31:01.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.027+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/3253971395 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1a180b1630 con 0x7f1a181652b0 2023-11-17T06:31:01.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a0e7fc700 1 -- 172.21.15.69:0/3253971395 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1a180b1630 con 0x7f1a181652b0 2023-11-17T06:31:01.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19fc066510 msgr2=0x7f19fc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a1e9fe700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19fc066510 0x7f19fc0689d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1a140090b0 tx=0x7f1a14008030 comp rx=0 tx=0).stop 2023-11-17T06:31:01.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/3253971395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a181652b0 msgr2=0x7f1a18071070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a1e9fe700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a181652b0 0x7f1a18071070 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000cba0 tx=0x7f1a1000cbd0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/3253971395 shutdown_connections 2023-11-17T06:31:01.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a1e9fe700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f19fc066510 0x7f19fc0689d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a1e9fe700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a181652b0 0x7f1a18071070 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a1e9fe700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1a180cbef0 0x7f1a18070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a1e9fe700 1 --2- 172.21.15.69:0/3253971395 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1a180c21a0 0x7f1a18152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.031+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/3253971395 >> 172.21.15.69:0/3253971395 conn(0x7f1a180b0900 msgr2=0x7f1a180c93b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:01.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.035+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/3253971395 shutdown_connections 2023-11-17T06:31:01.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.035+0000 7f1a1e9fe700 1 -- 172.21.15.69:0/3253971395 wait complete. 2023-11-17T06:31:01.041 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2023-11-17T06:31:01.060 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:31:01.060 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:31:01.074 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:01.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.247+0000 7fec11587700 1 Processor -- start 2023-11-17T06:31:01.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.247+0000 7fec11587700 1 -- start start 2023-11-17T06:31:01.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec11587700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fec0c15d3e0 0x7fec0c0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec11587700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fec0c0cbc30 0x7fec0c0ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec11587700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c0c9960 con 0x7fec0c161950 2023-11-17T06:31:01.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec11587700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c06c060 con 0x7fec0c15d3e0 2023-11-17T06:31:01.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec11587700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c06c340 con 0x7fec0c0cbc30 2023-11-17T06:31:01.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fec0c15d3e0 0x7fec0c0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fec0c15d3e0 0x7fec0c0c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49984/0 (socket says 172.21.15.69:49984) 2023-11-17T06:31:01.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0bfff700 1 -- 172.21.15.69:0/1191212758 learned_addr learned my addr 172.21.15.69:0/1191212758 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:01.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec10d86700 1 --2- 172.21.15.69:0/1191212758 >> v2:172.21.15.93:3300/0 conn(0x7fec0c0cbc30 0x7fec0c0ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0bfff700 1 -- 172.21.15.69:0/1191212758 >> v2:172.21.15.93:3300/0 conn(0x7fec0c0cbc30 msgr2=0x7fec0c0ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:01.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0bfff700 1 --2- 172.21.15.69:0/1191212758 >> v2:172.21.15.93:3300/0 conn(0x7fec0c0cbc30 0x7fec0c0ad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0bfff700 1 -- 172.21.15.69:0/1191212758 >> v1:172.21.15.93:6789/0 conn(0x7fec0c161950 legacy=0x7fec0c0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0bfff700 1 -- 172.21.15.69:0/1191212758 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c06c620 con 0x7fec0c15d3e0 2023-11-17T06:31:01.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0bfff700 1 --2- 172.21.15.69:0/1191212758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c15d3e0 0x7fec0c0c9420 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0cb4d0 tx=0x7febfc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3598fd0dc7b80a53 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:01.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0affd700 1 -- 172.21.15.69:0/1191212758 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc011830 con 0x7fec0c15d3e0 2023-11-17T06:31:01.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0affd700 1 -- 172.21.15.69:0/1191212758 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc011990 con 0x7fec0c15d3e0 2023-11-17T06:31:01.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.251+0000 7fec0affd700 1 -- 172.21.15.69:0/1191212758 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc011d20 con 0x7fec0c15d3e0 2023-11-17T06:31:01.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.255+0000 7fec11587700 1 -- 172.21.15.69:0/1191212758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c15d3e0 msgr2=0x7fec0c0c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.255+0000 7fec11587700 1 --2- 172.21.15.69:0/1191212758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c15d3e0 0x7fec0c0c9420 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0cb4d0 tx=0x7febfc009bf0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.255+0000 7fec11587700 1 -- 172.21.15.69:0/1191212758 shutdown_connections 2023-11-17T06:31:01.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.255+0000 7fec11587700 1 --2- 172.21.15.69:0/1191212758 >> v2:172.21.15.93:3300/0 conn(0x7fec0c0cbc30 0x7fec0c0ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.255+0000 7fec11587700 1 --2- 172.21.15.69:0/1191212758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c15d3e0 0x7fec0c0c9420 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.255+0000 7fec11587700 1 -- 172.21.15.69:0/1191212758 >> 172.21.15.69:0/1191212758 conn(0x7fec0c0b0900 msgr2=0x7fec0c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:01.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.255+0000 7fec11587700 1 -- 172.21.15.69:0/1191212758 shutdown_connections 2023-11-17T06:31:01.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.255+0000 7fec11587700 1 -- 172.21.15.69:0/1191212758 wait complete. 2023-11-17T06:31:01.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.255+0000 7fec11587700 1 Processor -- start 2023-11-17T06:31:01.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.255+0000 7fec11587700 1 -- start start 2023-11-17T06:31:01.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec11587700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c0cbc30 0x7fec0c153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec11587700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fec0c15d3e0 0x7fec0c0b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec11587700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fec0c161950 0x7fec0c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec11587700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0b2b70 con 0x7fec0c0cbc30 2023-11-17T06:31:01.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec11587700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0b2e10 con 0x7fec0c15d3e0 2023-11-17T06:31:01.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec11587700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0b30f0 con 0x7fec0c161950 2023-11-17T06:31:01.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec0bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c0cbc30 0x7fec0c153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec0bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c0cbc30 0x7fec0c153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49990/0 (socket says 172.21.15.69:49990) 2023-11-17T06:31:01.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec0bfff700 1 -- 172.21.15.69:0/548404882 learned_addr learned my addr 172.21.15.69:0/548404882 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:01.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec0b7fe700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fec0c15d3e0 0x7fec0c0b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec10d86700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fec0c161950 0x7fec0c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec0bfff700 1 -- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fec0c161950 msgr2=0x7fec0c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec0bfff700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fec0c161950 0x7fec0c0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec0bfff700 1 -- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fec0c15d3e0 msgr2=0x7fec0c0b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec0bfff700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fec0c15d3e0 0x7fec0c0b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec0bfff700 1 -- 172.21.15.69:0/548404882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc009570 con 0x7fec0c0cbc30 2023-11-17T06:31:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec10d86700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fec0c161950 0x7fec0c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec0bfff700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c0cbc30 0x7fec0c153560 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fec0c06b7d0 tx=0x7febfc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec08ff9700 1 -- 172.21.15.69:0/548404882 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc004550 con 0x7fec0c0cbc30 2023-11-17T06:31:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec08ff9700 1 -- 172.21.15.69:0/548404882 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc01f070 con 0x7fec0c0cbc30 2023-11-17T06:31:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec11587700 1 -- 172.21.15.69:0/548404882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c0b33d0 con 0x7fec0c0cbc30 2023-11-17T06:31:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec08ff9700 1 -- 172.21.15.69:0/548404882 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc003900 con 0x7fec0c0cbc30 2023-11-17T06:31:01.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.259+0000 7fec11587700 1 -- 172.21.15.69:0/548404882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c153aa0 con 0x7fec0c0cbc30 2023-11-17T06:31:01.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.263+0000 7fec11587700 1 -- 172.21.15.69:0/548404882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c0b38f0 con 0x7fec0c0cbc30 2023-11-17T06:31:01.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.263+0000 7fec08ff9700 1 -- 172.21.15.69:0/548404882 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7febfc003a60 con 0x7fec0c0cbc30 2023-11-17T06:31:01.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.263+0000 7fec08ff9700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7febf8066510 0x7febf80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.263+0000 7fec08ff9700 1 -- 172.21.15.69:0/548404882 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7febfc021070 con 0x7fec0c0cbc30 2023-11-17T06:31:01.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.267+0000 7fec0b7fe700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7febf8066510 0x7febf80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.267+0000 7fec0b7fe700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7febf8066510 0x7febf80689d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0b02d0 tx=0x7fec00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:01.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.271+0000 7fec08ff9700 1 -- 172.21.15.69:0/548404882 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fec0c0b38f0 con 0x7fec0c0cbc30 2023-11-17T06:31:01.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.443+0000 7fec11587700 1 -- 172.21.15.69:0/548404882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec0c0b38f0 con 0x7fec0c0cbc30 2023-11-17T06:31:01.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.447+0000 7fec08ff9700 1 -- 172.21.15.69:0/548404882 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7fec0c0b38f0 con 0x7fec0c0cbc30 2023-11-17T06:31:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:01.453 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:01.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 -- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7febf8066510 msgr2=0x7febf80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7febf8066510 0x7febf80689d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0b02d0 tx=0x7fec00009040 comp rx=0 tx=0).stop 2023-11-17T06:31:01.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 -- 172.21.15.69:0/548404882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c0cbc30 msgr2=0x7fec0c153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c0cbc30 0x7fec0c153560 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fec0c06b7d0 tx=0x7febfc004770 comp rx=0 tx=0).stop 2023-11-17T06:31:01.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 -- 172.21.15.69:0/548404882 shutdown_connections 2023-11-17T06:31:01.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7febf8066510 0x7febf80689d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fec0c161950 0x7fec0c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fec0c15d3e0 0x7fec0c0b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 --2- 172.21.15.69:0/548404882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec0c0cbc30 0x7fec0c153560 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 -- 172.21.15.69:0/548404882 >> 172.21.15.69:0/548404882 conn(0x7fec0c0b0900 msgr2=0x7fec0c1592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:01.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 -- 172.21.15.69:0/548404882 shutdown_connections 2023-11-17T06:31:01.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.451+0000 7fec11587700 1 -- 172.21.15.69:0/548404882 wait complete. 2023-11-17T06:31:01.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:31:01.479 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:31:01.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.659+0000 7f611359e700 1 Processor -- start 2023-11-17T06:31:01.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.659+0000 7f611359e700 1 -- start start 2023-11-17T06:31:01.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.659+0000 7f611359e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f61140cbc20 0x7f61140ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.659+0000 7f611359e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61140cca40 con 0x7f611415a2b0 2023-11-17T06:31:01.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.659+0000 7f611359e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61140cdf60 con 0x7f6114159ed0 2023-11-17T06:31:01.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.659+0000 7f611359e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61140ccdb0 con 0x7f61140cbc20 2023-11-17T06:31:01.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6111d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f611415a2b0 0x7f61140cb510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42478/0 (socket says 172.21.15.69:42478) 2023-11-17T06:31:01.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6111d9b700 1 -- 172.21.15.69:0/610551909 learned_addr learned my addr 172.21.15.69:0/610551909 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:01.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6112d9d700 1 --2- 172.21.15.69:0/610551909 >> v2:172.21.15.93:3300/0 conn(0x7f61140cbc20 0x7f61140ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789915145 0 0) 0x7f61140cca40 con 0x7f611415a2b0 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61000035d0 con 0x7f611415a2b0 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469507300 0 0) 0x7f61000035d0 con 0x7f611415a2b0 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 >> v2:172.21.15.93:3300/0 conn(0x7f61140cbc20 msgr2=0x7f61140ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 --2- 172.21.15.69:0/610551909 >> v2:172.21.15.93:3300/0 conn(0x7f61140cbc20 0x7f61140ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 >> v1:172.21.15.93:6789/0 conn(0x7f6114159ed0 legacy=0x7f61140706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140ce240 con 0x7f611415a2b0 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f60fc001670 con 0x7f611415a2b0 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 >> v1:172.21.15.69:6789/0 conn(0x7f611415a2b0 legacy=0x7f61140cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6100003a20 0x7f6100003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6100004870 0x7f6100004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6100005230 0x7f610000dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61140ccdb0 con 0x7f6100004870 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610000e3e0 con 0x7f6100003a20 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610000e5a0 con 0x7f6100005230 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6111d9b700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6100004870 0x7f6100004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6112d9d700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6100005230 0x7f610000dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611259c700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6100003a20 0x7f6100003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6111d9b700 1 -- 172.21.15.69:0/610551909 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6100005230 msgr2=0x7f610000dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6111d9b700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6100005230 0x7f610000dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6111d9b700 1 -- 172.21.15.69:0/610551909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6100003a20 msgr2=0x7f6100003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6111d9b700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6100003a20 0x7f6100003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6111d9b700 1 -- 172.21.15.69:0/610551909 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61000035d0 con 0x7f6100004870 2023-11-17T06:31:01.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6112d9d700 1 -- 172.21.15.69:0/610551909 reap_dead start 2023-11-17T06:31:01.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f6111d9b700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6100004870 0x7f6100004cf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00c320 tx=0x7f61000058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d5820edb48b231 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:01.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc007c30 con 0x7f6100004870 2023-11-17T06:31:01.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc00ce00 con 0x7f6100004870 2023-11-17T06:31:01.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.663+0000 7f611159a700 1 -- 172.21.15.69:0/610551909 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc005bc0 con 0x7f6100004870 2023-11-17T06:31:01.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.667+0000 7f611359e700 1 -- 172.21.15.69:0/610551909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6100004870 msgr2=0x7f6100004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.667+0000 7f611359e700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6100004870 0x7f6100004cf0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00c320 tx=0x7f61000058a0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.667+0000 7f611359e700 1 -- 172.21.15.69:0/610551909 shutdown_connections 2023-11-17T06:31:01.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.667+0000 7f611359e700 1 --2- 172.21.15.69:0/610551909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6100004870 0x7f6100004cf0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.667+0000 7f611359e700 1 -- 172.21.15.69:0/610551909 >> 172.21.15.69:0/610551909 conn(0x7f61140b0900 msgr2=0x7f61140b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:01.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.667+0000 7f611359e700 1 -- 172.21.15.69:0/610551909 shutdown_connections 2023-11-17T06:31:01.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.667+0000 7f611359e700 1 -- 172.21.15.69:0/610551909 wait complete. 2023-11-17T06:31:01.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f611359e700 1 Processor -- start 2023-11-17T06:31:01.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f611359e700 1 -- start start 2023-11-17T06:31:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f611359e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6100004870 0x7f61140710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f611359e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f611415c840 0x7f61140c4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f611359e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6114154d80 0x7f6114155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f611359e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61140caef0 con 0x7f6114154d80 2023-11-17T06:31:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f611359e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114155750 con 0x7f6100004870 2023-11-17T06:31:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f611359e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61140c2c00 con 0x7f611415c840 2023-11-17T06:31:01.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f6112d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6114154d80 0x7f6114155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f6112d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6114154d80 0x7f6114155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50004/0 (socket says 172.21.15.69:50004) 2023-11-17T06:31:01.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f6112d9d700 1 -- 172.21.15.69:0/1218521416 learned_addr learned my addr 172.21.15.69:0/1218521416 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:01.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f611259c700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6100004870 0x7f61140710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f6111d9b700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f611415c840 0x7f61140c4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f6112d9d700 1 -- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f611415c840 msgr2=0x7f61140c4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f6112d9d700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f611415c840 0x7f61140c4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f6112d9d700 1 -- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6100004870 msgr2=0x7f61140710a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f6112d9d700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6100004870 0x7f61140710a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f6112d9d700 1 -- 172.21.15.69:0/1218521416 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140c2ee0 con 0x7f6114154d80 2023-11-17T06:31:01.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f6112d9d700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6114154d80 0x7f6114155210 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f61140cfed0 tx=0x7f610c0111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:01.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f610affd700 1 -- 172.21.15.69:0/1218521416 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c00e070 con 0x7f6114154d80 2023-11-17T06:31:01.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f610affd700 1 -- 172.21.15.69:0/1218521416 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610c003d10 con 0x7f6114154d80 2023-11-17T06:31:01.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f611359e700 1 -- 172.21.15.69:0/1218521416 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61140c31c0 con 0x7f6114154d80 2023-11-17T06:31:01.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.671+0000 7f610affd700 1 -- 172.21.15.69:0/1218521416 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c011740 con 0x7f6114154d80 2023-11-17T06:31:01.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.675+0000 7f611359e700 1 -- 172.21.15.69:0/1218521416 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61140c3780 con 0x7f6114154d80 2023-11-17T06:31:01.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.675+0000 7f611359e700 1 -- 172.21.15.69:0/1218521416 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61140c3970 con 0x7f6114154d80 2023-11-17T06:31:01.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.675+0000 7f610affd700 1 -- 172.21.15.69:0/1218521416 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f610c0118a0 con 0x7f6114154d80 2023-11-17T06:31:01.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.679+0000 7f610affd700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60f4066540 0x7f60f4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:01.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.679+0000 7f610affd700 1 -- 172.21.15.69:0/1218521416 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f610c084380 con 0x7f6114154d80 2023-11-17T06:31:01.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.679+0000 7f611259c700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60f4066540 0x7f60f4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:01.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.679+0000 7f611259c700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60f4066540 0x7f60f4068a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6104000c00 tx=0x7f6104009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:01.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.683+0000 7f610affd700 1 -- 172.21.15.69:0/1218521416 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f610c0517d0 con 0x7f6114154d80 2023-11-17T06:31:01.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.859+0000 7f611359e700 1 -- 172.21.15.69:0/1218521416 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6114073f00 con 0x7f6114154d80 2023-11-17T06:31:01.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.863+0000 7f610affd700 1 -- 172.21.15.69:0/1218521416 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f610c054df0 con 0x7f6114154d80 2023-11-17T06:31:01.867 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:31:01.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 -- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60f4066540 msgr2=0x7f60f4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60f4066540 0x7f60f4068a00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6104000c00 tx=0x7f6104009040 comp rx=0 tx=0).stop 2023-11-17T06:31:01.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 -- 172.21.15.69:0/1218521416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6114154d80 msgr2=0x7f6114155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:01.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6114154d80 0x7f6114155210 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f61140cfed0 tx=0x7f610c0111d0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 -- 172.21.15.69:0/1218521416 shutdown_connections 2023-11-17T06:31:01.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f60f4066540 0x7f60f4068a00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6114154d80 0x7f6114155210 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f611415c840 0x7f61140c4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 --2- 172.21.15.69:0/1218521416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6100004870 0x7f61140710a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 -- 172.21.15.69:0/1218521416 >> 172.21.15.69:0/1218521416 conn(0x7f61140b0900 msgr2=0x7f6114159100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 -- 172.21.15.69:0/1218521416 shutdown_connections 2023-11-17T06:31:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:01.867+0000 7f611359e700 1 -- 172.21.15.69:0/1218521416 wait complete. 2023-11-17T06:31:01.896 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:31:02.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.071+0000 7fafb9467700 1 Processor -- start 2023-11-17T06:31:02.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.071+0000 7fafb9467700 1 -- start start 2023-11-17T06:31:02.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb9467700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fafb40b8bc0 0x7fafb40cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb9467700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb40ce310 0x7fafb40b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb9467700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb40b9000 con 0x7fafb415d490 2023-11-17T06:31:02.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb9467700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb40ce7c0 con 0x7fafb40b8bc0 2023-11-17T06:31:02.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb9467700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb40d1bb0 con 0x7fafb40ce310 2023-11-17T06:31:02.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb2ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fafb415d490 0x7fafb40d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42484/0 (socket says 172.21.15.69:42484) 2023-11-17T06:31:02.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb2ffd700 1 -- 172.21.15.69:0/948247461 learned_addr learned my addr 172.21.15.69:0/948247461 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:02.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb27fc700 1 --2- 172.21.15.69:0/948247461 >> v2:172.21.15.93:3300/0 conn(0x7fafb40b8bc0 0x7fafb40cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb37fe700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb40ce310 0x7fafb40b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3651984088 0 0) 0x7fafa4001110 con 0x7fafb415d490 2023-11-17T06:31:02.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf9c0035d0 con 0x7fafb415d490 2023-11-17T06:31:02.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3442769502 0 0) 0x7faf9c0035d0 con 0x7fafb415d490 2023-11-17T06:31:02.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb40ce310 msgr2=0x7fafb40b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:02.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb40ce310 0x7fafb40b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 >> v2:172.21.15.93:3300/0 conn(0x7fafb40b8bc0 msgr2=0x7fafb40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:02.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 --2- 172.21.15.69:0/948247461 >> v2:172.21.15.93:3300/0 conn(0x7fafb40b8bc0 0x7fafb40cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb40d1e90 con 0x7fafb415d490 2023-11-17T06:31:02.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7fafa4001800 con 0x7fafb415d490 2023-11-17T06:31:02.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 >> v1:172.21.15.69:6789/0 conn(0x7fafb415d490 legacy=0x7fafb40d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf9c003a20 0x7faf9c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb40ce310 0x7faf9c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf9c004db0 0x7faf9c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb40ce7c0 con 0x7faf9c003a20 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb40d1bb0 con 0x7faf9c004db0 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c00bb70 con 0x7fafb40ce310 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb27fc700 1 --2- 172.21.15.69:0/948247461 >> v2:172.21.15.93:3300/0 conn(0x7fafb40b8bc0 0x7fafb40cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb2ffd700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf9c003a20 0x7faf9c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb37fe700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf9c004db0 0x7faf9c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb2ffd700 1 -- 172.21.15.69:0/948247461 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb40ce310 msgr2=0x7faf9c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb2ffd700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb40ce310 0x7faf9c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb2ffd700 1 -- 172.21.15.69:0/948247461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf9c004db0 msgr2=0x7faf9c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:02.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb2ffd700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf9c004db0 0x7faf9c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb2ffd700 1 -- 172.21.15.69:0/948247461 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0035d0 con 0x7faf9c003a20 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb2ffd700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf9c003a20 0x7faf9c003e40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c240 tx=0x7faf9c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbb4d6e44c4b21d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4007d20 con 0x7faf9c003a20 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa400cda0 con 0x7faf9c003a20 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.075+0000 7fafb1ffb700 1 -- 172.21.15.69:0/948247461 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4005bc0 con 0x7faf9c003a20 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.079+0000 7fafb9467700 1 -- 172.21.15.69:0/948247461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf9c003a20 msgr2=0x7faf9c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.079+0000 7fafb9467700 1 --2- 172.21.15.69:0/948247461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf9c003a20 0x7faf9c003e40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c240 tx=0x7faf9c0058a0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.079+0000 7fafb37fe700 1 -- 172.21.15.69:0/948247461 reap_dead start 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.079+0000 7fafb9467700 1 -- 172.21.15.69:0/948247461 shutdown_connections 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.079+0000 7fafb9467700 1 -- 172.21.15.69:0/948247461 >> 172.21.15.69:0/948247461 conn(0x7fafb406ab40 msgr2=0x7fafb406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.079+0000 7fafb9467700 1 -- 172.21.15.69:0/948247461 shutdown_connections 2023-11-17T06:31:02.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.079+0000 7fafb9467700 1 -- 172.21.15.69:0/948247461 wait complete. 2023-11-17T06:31:02.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb9467700 1 Processor -- start 2023-11-17T06:31:02.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb9467700 1 -- start start 2023-11-17T06:31:02.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb9467700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf9c003a20 0x7fafb4160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb9467700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb41f5560 0x7fafb415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb9467700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb415e7c0 0x7fafb40cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb9467700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb4160000 con 0x7fafb41f5560 2023-11-17T06:31:02.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb9467700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb415f3f0 con 0x7faf9c003a20 2023-11-17T06:31:02.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb9467700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb415f6d0 con 0x7fafb415e7c0 2023-11-17T06:31:02.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb27fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb41f5560 0x7fafb415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb27fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb41f5560 0x7fafb415e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50030/0 (socket says 172.21.15.69:50030) 2023-11-17T06:31:02.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb27fc700 1 -- 172.21.15.69:0/3294072164 learned_addr learned my addr 172.21.15.69:0/3294072164 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:02.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb2ffd700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf9c003a20 0x7fafb4160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb37fe700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb415e7c0 0x7fafb40cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb27fc700 1 -- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb415e7c0 msgr2=0x7fafb40cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb27fc700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb415e7c0 0x7fafb40cc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb27fc700 1 -- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf9c003a20 msgr2=0x7fafb4160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb27fc700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf9c003a20 0x7fafb4160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb27fc700 1 -- 172.21.15.69:0/3294072164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb415f9b0 con 0x7fafb41f5560 2023-11-17T06:31:02.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.083+0000 7fafb27fc700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb41f5560 0x7fafb415e280 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fafa800e7e0 tx=0x7fafa800eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.087+0000 7faf9b7fe700 1 -- 172.21.15.69:0/3294072164 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa800c070 con 0x7fafb41f5560 2023-11-17T06:31:02.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.087+0000 7faf9b7fe700 1 -- 172.21.15.69:0/3294072164 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa8013610 con 0x7fafb41f5560 2023-11-17T06:31:02.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.087+0000 7fafb9467700 1 -- 172.21.15.69:0/3294072164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb415fc90 con 0x7fafb41f5560 2023-11-17T06:31:02.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.087+0000 7faf9b7fe700 1 -- 172.21.15.69:0/3294072164 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80139c0 con 0x7fafb41f5560 2023-11-17T06:31:02.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.087+0000 7fafb9467700 1 -- 172.21.15.69:0/3294072164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb41437a0 con 0x7fafb41f5560 2023-11-17T06:31:02.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.087+0000 7fafb9467700 1 -- 172.21.15.69:0/3294072164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb4073f00 con 0x7fafb41f5560 2023-11-17T06:31:02.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.087+0000 7faf9b7fe700 1 -- 172.21.15.69:0/3294072164 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fafa8013b20 con 0x7fafb41f5560 2023-11-17T06:31:02.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.091+0000 7faf9b7fe700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafa0066540 0x7fafa0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.091+0000 7faf9b7fe700 1 -- 172.21.15.69:0/3294072164 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fafa8083b20 con 0x7fafb41f5560 2023-11-17T06:31:02.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.091+0000 7fafb2ffd700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafa0066540 0x7fafa0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.091+0000 7fafb2ffd700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafa0066540 0x7fafa0068a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fafa4000c00 tx=0x7fafa400a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.099+0000 7faf9b7fe700 1 -- 172.21.15.69:0/3294072164 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fafa8050ef0 con 0x7fafb41f5560 2023-11-17T06:31:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.275+0000 7fafb9467700 1 -- 172.21.15.69:0/3294072164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafb40d2420 con 0x7fafb41f5560 2023-11-17T06:31:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7faf9b7fe700 1 -- 172.21.15.69:0/3294072164 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafa8054510 con 0x7fafb41f5560 2023-11-17T06:31:02.283 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:31:02.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 -- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafa0066540 msgr2=0x7fafa0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafa0066540 0x7fafa0068a00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fafa4000c00 tx=0x7fafa400a000 comp rx=0 tx=0).stop 2023-11-17T06:31:02.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 -- 172.21.15.69:0/3294072164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb41f5560 msgr2=0x7fafb415e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb41f5560 0x7fafb415e280 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fafa800e7e0 tx=0x7fafa800eaf0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 -- 172.21.15.69:0/3294072164 shutdown_connections 2023-11-17T06:31:02.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fafa0066540 0x7fafa0068a00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fafb415e7c0 0x7fafb40cc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb41f5560 0x7fafb415e280 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 --2- 172.21.15.69:0/3294072164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faf9c003a20 0x7fafb4160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 -- 172.21.15.69:0/3294072164 >> 172.21.15.69:0/3294072164 conn(0x7fafb406ab40 msgr2=0x7fafb40b6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:02.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 -- 172.21.15.69:0/3294072164 shutdown_connections 2023-11-17T06:31:02.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.279+0000 7fafb9467700 1 -- 172.21.15.69:0/3294072164 wait complete. 2023-11-17T06:31:02.307 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:31:02.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.479+0000 7fa4373a6700 1 Processor -- start 2023-11-17T06:31:02.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa4373a6700 1 -- start start 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa4373a6700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa43015b500 0x7fa43015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa4373a6700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa430070120 con 0x7fa4300cb340 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa4373a6700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa43015fb00 con 0x7fa43015b120 2023-11-17T06:31:02.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa4373a6700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43015fd50 con 0x7fa43015b500 2023-11-17T06:31:02.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa434941700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa43015b500 0x7fa43015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa435943700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa4300cb340 0x7fa4300c94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42494/0 (socket says 172.21.15.69:42494) 2023-11-17T06:31:02.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa435943700 1 -- 172.21.15.69:0/1825494997 learned_addr learned my addr 172.21.15.69:0/1825494997 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa434941700 1 -- 172.21.15.69:0/1825494997 >> v1:172.21.15.93:6789/0 conn(0x7fa43015b120 legacy=0x7fa43015eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa434941700 1 -- 172.21.15.69:0/1825494997 >> v1:172.21.15.69:6789/0 conn(0x7fa4300cb340 legacy=0x7fa4300c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa434941700 1 -- 172.21.15.69:0/1825494997 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4300705b0 con 0x7fa43015b500 2023-11-17T06:31:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.483+0000 7fa427fff700 1 -- 172.21.15.69:0/1825494997 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725601633 0 0) 0x7fa430070120 con 0x7fa4300cb340 2023-11-17T06:31:02.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa434941700 1 --2- 172.21.15.69:0/1825494997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43015b500 0x7fa43015f5c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa4200097d0 tx=0x7fa420009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425de3a33aa180ca server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa427fff700 1 -- 172.21.15.69:0/1825494997 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa420004230 con 0x7fa43015b500 2023-11-17T06:31:02.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa427fff700 1 -- 172.21.15.69:0/1825494997 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa420004390 con 0x7fa43015b500 2023-11-17T06:31:02.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa427fff700 1 -- 172.21.15.69:0/1825494997 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4200036c0 con 0x7fa43015b500 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa4373a6700 1 -- 172.21.15.69:0/1825494997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43015b500 msgr2=0x7fa43015f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa4373a6700 1 --2- 172.21.15.69:0/1825494997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43015b500 0x7fa43015f5c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa4200097d0 tx=0x7fa420009ae0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa4373a6700 1 -- 172.21.15.69:0/1825494997 shutdown_connections 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa4373a6700 1 --2- 172.21.15.69:0/1825494997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43015b500 0x7fa43015f5c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa4373a6700 1 -- 172.21.15.69:0/1825494997 >> 172.21.15.69:0/1825494997 conn(0x7fa4300cee80 msgr2=0x7fa4300cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa4373a6700 1 -- 172.21.15.69:0/1825494997 shutdown_connections 2023-11-17T06:31:02.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.487+0000 7fa4373a6700 1 -- 172.21.15.69:0/1825494997 wait complete. 2023-11-17T06:31:02.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.491+0000 7fa4373a6700 1 Processor -- start 2023-11-17T06:31:02.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.491+0000 7fa4373a6700 1 -- start start 2023-11-17T06:31:02.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.491+0000 7fa4373a6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4300cb340 0x7fa4301510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.491+0000 7fa4373a6700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa43015b120 0x7fa430154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.491+0000 7fa4373a6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa43015b500 0x7fa430155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.491+0000 7fa4373a6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4301f0bb0 con 0x7fa4300cb340 2023-11-17T06:31:02.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.491+0000 7fa4373a6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa430152aa0 con 0x7fa43015b500 2023-11-17T06:31:02.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.491+0000 7fa4373a6700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa430144620 con 0x7fa43015b120 2023-11-17T06:31:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.491+0000 7fa435142700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4300cb340 0x7fa4301510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa435142700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4300cb340 0x7fa4301510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50038/0 (socket says 172.21.15.69:50038) 2023-11-17T06:31:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa435142700 1 -- 172.21.15.69:0/2376813964 learned_addr learned my addr 172.21.15.69:0/2376813964 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa435943700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa43015b500 0x7fa430155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa434941700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa43015b120 0x7fa430154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa435142700 1 -- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa43015b120 msgr2=0x7fa430154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa435142700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa43015b120 0x7fa430154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa435142700 1 -- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa43015b500 msgr2=0x7fa430155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa435142700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa43015b500 0x7fa430155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa435142700 1 -- 172.21.15.69:0/2376813964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4200094b0 con 0x7fa4300cb340 2023-11-17T06:31:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa434941700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa43015b120 0x7fa430154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa435142700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4300cb340 0x7fa4301510b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00c750 tx=0x7fa42c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa425ffb700 1 -- 172.21.15.69:0/2376813964 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c0054e0 con 0x7fa4300cb340 2023-11-17T06:31:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa425ffb700 1 -- 172.21.15.69:0/2376813964 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa42c0036a0 con 0x7fa4300cb340 2023-11-17T06:31:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa425ffb700 1 -- 172.21.15.69:0/2376813964 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa42c003a50 con 0x7fa4300cb340 2023-11-17T06:31:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa4373a6700 1 -- 172.21.15.69:0/2376813964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43014fbf0 con 0x7fa4300cb340 2023-11-17T06:31:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.495+0000 7fa4373a6700 1 -- 172.21.15.69:0/2376813964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa430152730 con 0x7fa4300cb340 2023-11-17T06:31:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.499+0000 7fa4373a6700 1 -- 172.21.15.69:0/2376813964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa430150110 con 0x7fa4300cb340 2023-11-17T06:31:02.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.499+0000 7fa425ffb700 1 -- 172.21.15.69:0/2376813964 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa42c003bb0 con 0x7fa4300cb340 2023-11-17T06:31:02.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.499+0000 7fa425ffb700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa414066540 0x7fa414068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.499+0000 7fa425ffb700 1 -- 172.21.15.69:0/2376813964 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fa42c0832f0 con 0x7fa4300cb340 2023-11-17T06:31:02.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.499+0000 7fa434941700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa414066540 0x7fa414068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.503+0000 7fa434941700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa414066540 0x7fa414068a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa4200097d0 tx=0x7fa420010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.503+0000 7fa425ffb700 1 -- 172.21.15.69:0/2376813964 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa430150110 con 0x7fa4300cb340 2023-11-17T06:31:02.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.675+0000 7fa4373a6700 1 -- 172.21.15.69:0/2376813964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa430152590 con 0x7fa4300cb340 2023-11-17T06:31:02.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.675+0000 7fa425ffb700 1 -- 172.21.15.69:0/2376813964 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa42c017020 con 0x7fa4300cb340 2023-11-17T06:31:02.682 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.679+0000 7fa4373a6700 1 -- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa414066540 msgr2=0x7fa414068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.679+0000 7fa4373a6700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa414066540 0x7fa414068a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa4200097d0 tx=0x7fa420010000 comp rx=0 tx=0).stop 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.679+0000 7fa4373a6700 1 -- 172.21.15.69:0/2376813964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4300cb340 msgr2=0x7fa4301510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.679+0000 7fa4373a6700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4300cb340 0x7fa4301510b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00c750 tx=0x7fa42c00ca60 comp rx=0 tx=0).stop 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.679+0000 7fa4373a6700 1 -- 172.21.15.69:0/2376813964 shutdown_connections 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.679+0000 7fa4373a6700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa414066540 0x7fa414068a00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.679+0000 7fa4373a6700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa43015b500 0x7fa430155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.679+0000 7fa4373a6700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa43015b120 0x7fa430154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.679+0000 7fa4373a6700 1 --2- 172.21.15.69:0/2376813964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4300cb340 0x7fa4301510b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.679+0000 7fa4373a6700 1 -- 172.21.15.69:0/2376813964 >> 172.21.15.69:0/2376813964 conn(0x7fa4300cee80 msgr2=0x7fa43015efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.683+0000 7fa4373a6700 1 -- 172.21.15.69:0/2376813964 shutdown_connections 2023-11-17T06:31:02.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.683+0000 7fa4373a6700 1 -- 172.21.15.69:0/2376813964 wait complete. 2023-11-17T06:31:02.710 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:31:02.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.875+0000 7f670c99c700 1 Processor -- start 2023-11-17T06:31:02.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.875+0000 7f670c99c700 1 -- start start 2023-11-17T06:31:02.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.875+0000 7f670c99c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f67080c9b30 0x7f670815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.875+0000 7f670c99c700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670806fc20 con 0x7f67080719e0 2023-11-17T06:31:02.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.875+0000 7f670c99c700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670806fe70 con 0x7f670815b980 2023-11-17T06:31:02.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.875+0000 7f670c99c700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6708070430 con 0x7f67080c9b30 2023-11-17T06:31:02.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f66feffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f67080719e0 0x7f67080c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42496/0 (socket says 172.21.15.69:42496) 2023-11-17T06:31:02.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f66feffd700 1 -- 172.21.15.69:0/2498111149 learned_addr learned my addr 172.21.15.69:0/2498111149 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:02.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6707fff700 1 --2- 172.21.15.69:0/2498111149 >> v2:172.21.15.93:3300/0 conn(0x7f67080c9b30 0x7f670815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6706ffd700 1 -- 172.21.15.69:0/2498111149 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668900724 0 0) 0x7f670806fc20 con 0x7f67080719e0 2023-11-17T06:31:02.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6706ffd700 1 -- 172.21.15.69:0/2498111149 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f40035d0 con 0x7f67080719e0 2023-11-17T06:31:02.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6706ffd700 1 -- 172.21.15.69:0/2498111149 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354510655 0 0) 0x7f670806fe70 con 0x7f670815b980 2023-11-17T06:31:02.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6706ffd700 1 -- 172.21.15.69:0/2498111149 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f670806fc20 con 0x7f670815b980 2023-11-17T06:31:02.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6707fff700 1 -- 172.21.15.69:0/2498111149 >> v1:172.21.15.93:6789/0 conn(0x7f670815b980 legacy=0x7f670815f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6707fff700 1 -- 172.21.15.69:0/2498111149 >> v1:172.21.15.69:6789/0 conn(0x7f67080719e0 legacy=0x7f67080c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6706ffd700 1 -- 172.21.15.69:0/2498111149 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2376185126 0 0) 0x7f66f40035d0 con 0x7f67080719e0 2023-11-17T06:31:02.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6707fff700 1 -- 172.21.15.69:0/2498111149 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708070150 con 0x7f67080c9b30 2023-11-17T06:31:02.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6707fff700 1 --2- 172.21.15.69:0/2498111149 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67080c9b30 0x7f670815bd60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6700009d90 tx=0x7f670000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8b2268a2d3b203e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6706ffd700 1 -- 172.21.15.69:0/2498111149 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670000e070 con 0x7f67080c9b30 2023-11-17T06:31:02.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6706ffd700 1 -- 172.21.15.69:0/2498111149 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700003a40 con 0x7f67080c9b30 2023-11-17T06:31:02.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f6706ffd700 1 -- 172.21.15.69:0/2498111149 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0001670 con 0x7f67080c9b30 2023-11-17T06:31:02.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f670c99c700 1 -- 172.21.15.69:0/2498111149 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67080c9b30 msgr2=0x7f670815bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f670c99c700 1 --2- 172.21.15.69:0/2498111149 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67080c9b30 0x7f670815bd60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6700009d90 tx=0x7f670000b330 comp rx=0 tx=0).stop 2023-11-17T06:31:02.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f670c99c700 1 -- 172.21.15.69:0/2498111149 shutdown_connections 2023-11-17T06:31:02.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f670c99c700 1 --2- 172.21.15.69:0/2498111149 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67080c9b30 0x7f670815bd60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.879+0000 7f670c99c700 1 -- 172.21.15.69:0/2498111149 >> 172.21.15.69:0/2498111149 conn(0x7f67080b0900 msgr2=0x7f67080b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:02.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.883+0000 7f670c99c700 1 -- 172.21.15.69:0/2498111149 shutdown_connections 2023-11-17T06:31:02.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.883+0000 7f670c99c700 1 -- 172.21.15.69:0/2498111149 wait complete. 2023-11-17T06:31:02.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.883+0000 7f670c99c700 1 Processor -- start 2023-11-17T06:31:02.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.883+0000 7f670c99c700 1 -- start start 2023-11-17T06:31:02.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.883+0000 7f670c99c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67080719e0 0x7f67081505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.883+0000 7f670c99c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67080c9b30 0x7f6708151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.883+0000 7f670c99c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f670815b980 0x7f6708151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.883+0000 7f670c99c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67080b4a50 con 0x7f670815b980 2023-11-17T06:31:02.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.883+0000 7f670c99c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67080c5ea0 con 0x7f67080c9b30 2023-11-17T06:31:02.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.883+0000 7f670c99c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67080b4490 con 0x7f67080719e0 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6707fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f670815b980 0x7f6708151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6707fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f670815b980 0x7f6708151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50046/0 (socket says 172.21.15.69:50046) 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6707fff700 1 -- 172.21.15.69:0/2807815790 learned_addr learned my addr 172.21.15.69:0/2807815790 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f67077fe700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67080719e0 0x7f67081505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f66feffd700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67080c9b30 0x7f6708151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6707fff700 1 -- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67080719e0 msgr2=0x7f67081505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6707fff700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67080719e0 0x7f67081505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6707fff700 1 -- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67080c9b30 msgr2=0x7f6708151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6707fff700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67080c9b30 0x7f6708151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:02.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6707fff700 1 -- 172.21.15.69:0/2807815790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700009a70 con 0x7f670815b980 2023-11-17T06:31:02.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6707fff700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f670815b980 0x7f6708151f80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6708068700 tx=0x7f6700004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6704ff9700 1 -- 172.21.15.69:0/2807815790 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700004440 con 0x7f670815b980 2023-11-17T06:31:02.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6704ff9700 1 -- 172.21.15.69:0/2807815790 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67000045a0 con 0x7f670815b980 2023-11-17T06:31:02.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f670c99c700 1 -- 172.21.15.69:0/2807815790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67080b4770 con 0x7f670815b980 2023-11-17T06:31:02.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f6704ff9700 1 -- 172.21.15.69:0/2807815790 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700004910 con 0x7f670815b980 2023-11-17T06:31:02.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.887+0000 7f670c99c700 1 -- 172.21.15.69:0/2807815790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67081e4810 con 0x7f670815b980 2023-11-17T06:31:02.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.891+0000 7f670c99c700 1 -- 172.21.15.69:0/2807815790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67081e4a30 con 0x7f670815b980 2023-11-17T06:31:02.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.891+0000 7f6704ff9700 1 -- 172.21.15.69:0/2807815790 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f670001d470 con 0x7f670815b980 2023-11-17T06:31:02.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.891+0000 7f6704ff9700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f66e8066510 0x7f66e80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:02.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.891+0000 7f6704ff9700 1 -- 172.21.15.69:0/2807815790 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6700085a30 con 0x7f670815b980 2023-11-17T06:31:02.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.891+0000 7f67077fe700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f66e8066510 0x7f66e80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:02.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.891+0000 7f67077fe700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f66e8066510 0x7f66e80689d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f66f80017b0 tx=0x7f66f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:02.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:02.899+0000 7f6704ff9700 1 -- 172.21.15.69:0/2807815790 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6700056a30 con 0x7f670815b980 2023-11-17T06:31:03.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.087+0000 7f670c99c700 1 -- 172.21.15.69:0/2807815790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6708070b70 con 0x7f670815b980 2023-11-17T06:31:03.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.087+0000 7f6704ff9700 1 -- 172.21.15.69:0/2807815790 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f67000565c0 con 0x7f670815b980 2023-11-17T06:31:03.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 -- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f66e8066510 msgr2=0x7f66e80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f66e8066510 0x7f66e80689d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f66f80017b0 tx=0x7f66f8009040 comp rx=0 tx=0).stop 2023-11-17T06:31:03.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 -- 172.21.15.69:0/2807815790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f670815b980 msgr2=0x7f6708151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f670815b980 0x7f6708151f80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6708068700 tx=0x7f6700004af0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 -- 172.21.15.69:0/2807815790 shutdown_connections 2023-11-17T06:31:03.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f66e8066510 0x7f66e80689d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f670815b980 0x7f6708151f80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f67080c9b30 0x7f6708151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 --2- 172.21.15.69:0/2807815790 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f67080719e0 0x7f67081505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 -- 172.21.15.69:0/2807815790 >> 172.21.15.69:0/2807815790 conn(0x7f67080b0900 msgr2=0x7f67081593f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:03.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 -- 172.21.15.69:0/2807815790 shutdown_connections 2023-11-17T06:31:03.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.091+0000 7f670c99c700 1 -- 172.21.15.69:0/2807815790 wait complete. 2023-11-17T06:31:03.100 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2023-11-17T06:31:03.117 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi093.front.sepia.ceph.com... 2023-11-17T06:31:03.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:03.117 DEBUG:teuthology.orchestra.run.smithi093:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-17T06:31:03.156 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:31:03.157 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:31:03.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:03.157 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-17T06:31:03.224 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-17T06:31:03.225 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:03.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.391+0000 7f74e5905700 1 Processor -- start 2023-11-17T06:31:03.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.391+0000 7f74e5905700 1 -- start start 2023-11-17T06:31:03.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5905700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f74e015b980 0x7f74e015f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5905700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00c9b30 0x7f74e015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5905700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e006fc20 con 0x7f74e00719e0 2023-11-17T06:31:03.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5905700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e0070430 con 0x7f74e015b980 2023-11-17T06:31:03.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5905700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e015ed70 con 0x7f74e00c9b30 2023-11-17T06:31:03.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74d7fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f74e00719e0 0x7f74e00c9420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42498/0 (socket says 172.21.15.69:42498) 2023-11-17T06:31:03.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74d7fff700 1 -- 172.21.15.69:0/1601624971 learned_addr learned my addr 172.21.15.69:0/1601624971 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:03.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5104700 1 --2- 172.21.15.69:0/1601624971 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00c9b30 0x7f74e015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e4903700 1 --2- 172.21.15.69:0/1601624971 >> v2:172.21.15.93:3300/0 conn(0x7f74e015b980 0x7f74e015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74d77fe700 1 -- 172.21.15.69:0/1601624971 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 930592002 0 0) 0x7f74e006fc20 con 0x7f74e00719e0 2023-11-17T06:31:03.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74d77fe700 1 -- 172.21.15.69:0/1601624971 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c80035d0 con 0x7f74e00719e0 2023-11-17T06:31:03.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5104700 1 -- 172.21.15.69:0/1601624971 >> v2:172.21.15.93:3300/0 conn(0x7f74e015b980 msgr2=0x7f74e015f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:03.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5104700 1 --2- 172.21.15.69:0/1601624971 >> v2:172.21.15.93:3300/0 conn(0x7f74e015b980 0x7f74e015f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5104700 1 -- 172.21.15.69:0/1601624971 >> v1:172.21.15.69:6789/0 conn(0x7f74e00719e0 legacy=0x7f74e00c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5104700 1 -- 172.21.15.69:0/1601624971 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e015fcc0 con 0x7f74e00c9b30 2023-11-17T06:31:03.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.395+0000 7f74e5104700 1 --2- 172.21.15.69:0/1601624971 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00c9b30 0x7f74e015bd60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009d90 tx=0x7f74d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cda6e7505aa07235 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:03.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74d77fe700 1 -- 172.21.15.69:0/1601624971 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800e070 con 0x7f74e00c9b30 2023-11-17T06:31:03.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74d77fe700 1 -- 172.21.15.69:0/1601624971 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d800bb20 con 0x7f74e00c9b30 2023-11-17T06:31:03.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74d77fe700 1 -- 172.21.15.69:0/1601624971 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8012430 con 0x7f74e00c9b30 2023-11-17T06:31:03.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74e5905700 1 -- 172.21.15.69:0/1601624971 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00c9b30 msgr2=0x7f74e015bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74e5905700 1 --2- 172.21.15.69:0/1601624971 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00c9b30 0x7f74e015bd60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009d90 tx=0x7f74d800b330 comp rx=0 tx=0).stop 2023-11-17T06:31:03.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74e5905700 1 -- 172.21.15.69:0/1601624971 shutdown_connections 2023-11-17T06:31:03.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74e5905700 1 --2- 172.21.15.69:0/1601624971 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00c9b30 0x7f74e015bd60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74e5905700 1 --2- 172.21.15.69:0/1601624971 >> v2:172.21.15.93:3300/0 conn(0x7f74e015b980 0x7f74e015f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74e5905700 1 -- 172.21.15.69:0/1601624971 >> 172.21.15.69:0/1601624971 conn(0x7f74e00b0900 msgr2=0x7f74e00b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:03.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74e5905700 1 -- 172.21.15.69:0/1601624971 shutdown_connections 2023-11-17T06:31:03.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.399+0000 7f74e5905700 1 -- 172.21.15.69:0/1601624971 wait complete. 2023-11-17T06:31:03.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5905700 1 Processor -- start 2023-11-17T06:31:03.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5905700 1 -- start start 2023-11-17T06:31:03.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5905700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00719e0 0x7f74e00c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5905700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74e00c9b30 0x7f74e0150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5905700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74e015b980 0x7f74e015da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5905700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e00b2970 con 0x7f74e015b980 2023-11-17T06:31:03.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5905700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e00b1d60 con 0x7f74e00c9b30 2023-11-17T06:31:03.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5905700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e00b2040 con 0x7f74e00719e0 2023-11-17T06:31:03.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5104700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74e015b980 0x7f74e015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5104700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74e015b980 0x7f74e015da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50048/0 (socket says 172.21.15.69:50048) 2023-11-17T06:31:03.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e5104700 1 -- 172.21.15.69:0/1962769810 learned_addr learned my addr 172.21.15.69:0/1962769810 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:03.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74d7fff700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74e00c9b30 0x7f74e0150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.403+0000 7f74e4903700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00719e0 0x7f74e00c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74e5104700 1 -- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00719e0 msgr2=0x7f74e00c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74e5104700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00719e0 0x7f74e00c2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74e5104700 1 -- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74e00c9b30 msgr2=0x7f74e0150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74e5104700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74e00c9b30 0x7f74e0150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74e5104700 1 -- 172.21.15.69:0/1962769810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8009a70 con 0x7f74e015b980 2023-11-17T06:31:03.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74e5104700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74e015b980 0x7f74e015da20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f74d8014040 tx=0x7f74d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:03.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74d57fa700 1 -- 172.21.15.69:0/1962769810 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8012430 con 0x7f74e015b980 2023-11-17T06:31:03.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74d57fa700 1 -- 172.21.15.69:0/1962769810 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d8020070 con 0x7f74e015b980 2023-11-17T06:31:03.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74e5905700 1 -- 172.21.15.69:0/1962769810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e00b2320 con 0x7f74e015b980 2023-11-17T06:31:03.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74d57fa700 1 -- 172.21.15.69:0/1962769810 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8003e10 con 0x7f74e015b980 2023-11-17T06:31:03.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74e5905700 1 -- 172.21.15.69:0/1962769810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e0150a70 con 0x7f74e015b980 2023-11-17T06:31:03.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.407+0000 7f74e5905700 1 -- 172.21.15.69:0/1962769810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e00b2ae0 con 0x7f74e015b980 2023-11-17T06:31:03.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.411+0000 7f74d57fa700 1 -- 172.21.15.69:0/1962769810 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f74d8004040 con 0x7f74e015b980 2023-11-17T06:31:03.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.411+0000 7f74d57fa700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f74cc066510 0x7f74cc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.411+0000 7f74d57fa700 1 -- 172.21.15.69:0/1962769810 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f74d8022070 con 0x7f74e015b980 2023-11-17T06:31:03.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.415+0000 7f74e4903700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f74cc066510 0x7f74cc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.415+0000 7f74e4903700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f74cc066510 0x7f74cc0689d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009b50 tx=0x7f74dc009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:03.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.419+0000 7f74d57fa700 1 -- 172.21.15.69:0/1962769810 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f74d80533e0 con 0x7f74e015b980 2023-11-17T06:31:03.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.635+0000 7f74e5905700 1 -- 172.21.15.69:0/1962769810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74e0073f00 con 0x7f74e015b980 2023-11-17T06:31:03.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.635+0000 7f74d57fa700 1 -- 172.21.15.69:0/1962769810 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f74d8056a00 con 0x7f74e015b980 2023-11-17T06:31:03.641 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:03.641 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/1178370379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1178370379},{"type":"v1","addr":"172.21.15.93:6835","nonce":1178370379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/2342979080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":2342979080},{"type":"v1","addr":"172.21.15.93:6837","nonce":2342979080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/1839590536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1839590536},{"type":"v1","addr":"172.21.15.69:6833","nonce":1839590536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:56.576603+0000","modified":"2023-11-17T06:29:59.616825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2440982410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2440982410},{"type":"v1","addr":"172.21.15.69:6835","nonce":2440982410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:31:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 -- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f74cc066510 msgr2=0x7f74cc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f74cc066510 0x7f74cc0689d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009b50 tx=0x7f74dc009240 comp rx=0 tx=0).stop 2023-11-17T06:31:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 -- 172.21.15.69:0/1962769810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74e015b980 msgr2=0x7f74e015da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74e015b980 0x7f74e015da20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f74d8014040 tx=0x7f74d8004af0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 -- 172.21.15.69:0/1962769810 shutdown_connections 2023-11-17T06:31:03.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f74cc066510 0x7f74cc0689d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74e015b980 0x7f74e015da20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74e00c9b30 0x7f74e0150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 --2- 172.21.15.69:0/1962769810 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74e00719e0 0x7f74e00c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 -- 172.21.15.69:0/1962769810 >> 172.21.15.69:0/1962769810 conn(0x7f74e00b0900 msgr2=0x7f74e0154590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 -- 172.21.15.69:0/1962769810 shutdown_connections 2023-11-17T06:31:03.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.639+0000 7f74e5905700 1 -- 172.21.15.69:0/1962769810 wait complete. 2023-11-17T06:31:03.649 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-11-17T06:31:03.666 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:03.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.831+0000 7f2fe759e700 1 Processor -- start 2023-11-17T06:31:03.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.831+0000 7f2fe759e700 1 -- start start 2023-11-17T06:31:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe759e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 0x7f2fe806c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe759e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2fe80cbef0 0x7f2fe8165710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe759e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe806c200 con 0x7f2fe81652b0 2023-11-17T06:31:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe759e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe81662c0 con 0x7f2fe80cbef0 2023-11-17T06:31:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe759e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8165d00 con 0x7f2fe80c21a0 2023-11-17T06:31:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe6d9d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2fe80cbef0 0x7f2fe8165710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe659c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 0x7f2fe806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe6d9d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2fe80cbef0 0x7f2fe8165710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:38712/0 (socket says 172.21.15.69:38712) 2023-11-17T06:31:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe6d9d700 1 -- 172.21.15.69:0/711322211 learned_addr learned my addr 172.21.15.69:0/711322211 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:03.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe6d9d700 1 -- 172.21.15.69:0/711322211 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 msgr2=0x7f2fe806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:03.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe6d9d700 1 --2- 172.21.15.69:0/711322211 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 0x7f2fe806c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe6d9d700 1 -- 172.21.15.69:0/711322211 >> v1:172.21.15.93:6789/0 conn(0x7f2fe81652b0 legacy=0x7f2fe80cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe6d9d700 1 -- 172.21.15.69:0/711322211 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8165fe0 con 0x7f2fe80cbef0 2023-11-17T06:31:03.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.835+0000 7f2fe559a700 1 -- 172.21.15.69:0/711322211 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226310559 0 0) 0x7f2fe806c200 con 0x7f2fe81652b0 2023-11-17T06:31:03.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe6d9d700 1 --2- 172.21.15.69:0/711322211 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe80cbef0 0x7f2fe8165710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009e50 tx=0x7f2fe000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f19ad1558fe30d2d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:03.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe559a700 1 -- 172.21.15.69:0/711322211 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000e070 con 0x7f2fe80cbef0 2023-11-17T06:31:03.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe559a700 1 -- 172.21.15.69:0/711322211 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe000b910 con 0x7f2fe80cbef0 2023-11-17T06:31:03.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe559a700 1 -- 172.21.15.69:0/711322211 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000bcc0 con 0x7f2fe80cbef0 2023-11-17T06:31:03.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe759e700 1 -- 172.21.15.69:0/711322211 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe80cbef0 msgr2=0x7f2fe8165710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe759e700 1 --2- 172.21.15.69:0/711322211 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe80cbef0 0x7f2fe8165710 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009e50 tx=0x7f2fe000b330 comp rx=0 tx=0).stop 2023-11-17T06:31:03.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe759e700 1 -- 172.21.15.69:0/711322211 shutdown_connections 2023-11-17T06:31:03.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe759e700 1 --2- 172.21.15.69:0/711322211 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe80cbef0 0x7f2fe8165710 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe759e700 1 --2- 172.21.15.69:0/711322211 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 0x7f2fe806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe759e700 1 -- 172.21.15.69:0/711322211 >> 172.21.15.69:0/711322211 conn(0x7f2fe80b0900 msgr2=0x7f2fe80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:03.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe759e700 1 -- 172.21.15.69:0/711322211 shutdown_connections 2023-11-17T06:31:03.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.839+0000 7f2fe759e700 1 -- 172.21.15.69:0/711322211 wait complete. 2023-11-17T06:31:03.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe759e700 1 Processor -- start 2023-11-17T06:31:03.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe759e700 1 -- start start 2023-11-17T06:31:03.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe759e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 0x7f2fe8152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe759e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe80cbef0 0x7f2fe80cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81652b0 0x7f2fe80cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe759e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80c6b50 con 0x7f2fe81652b0 2023-11-17T06:31:03.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe759e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80c5f40 con 0x7f2fe80cbef0 2023-11-17T06:31:03.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe759e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe80c6220 con 0x7f2fe80c21a0 2023-11-17T06:31:03.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81652b0 0x7f2fe80cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81652b0 0x7f2fe80cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50066/0 (socket says 172.21.15.69:50066) 2023-11-17T06:31:03.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe6d9d700 1 -- 172.21.15.69:0/427030688 learned_addr learned my addr 172.21.15.69:0/427030688 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:03.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe5d9b700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe80cbef0 0x7f2fe80cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe659c700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 0x7f2fe8152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe6d9d700 1 -- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 msgr2=0x7f2fe8152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe6d9d700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 0x7f2fe8152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe6d9d700 1 -- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe80cbef0 msgr2=0x7f2fe80cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:03.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe6d9d700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe80cbef0 0x7f2fe80cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:03.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe6d9d700 1 -- 172.21.15.69:0/427030688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe0009b30 con 0x7f2fe81652b0 2023-11-17T06:31:03.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe659c700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 0x7f2fe8152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:03.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.843+0000 7f2fe6d9d700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81652b0 0x7f2fe80cb720 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2fe806b7d0 tx=0x7f2fe0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:03.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.847+0000 7f2fd6ffd700 1 -- 172.21.15.69:0/427030688 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0004930 con 0x7f2fe81652b0 2023-11-17T06:31:03.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.847+0000 7f2fd6ffd700 1 -- 172.21.15.69:0/427030688 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe00099b0 con 0x7f2fe81652b0 2023-11-17T06:31:03.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.847+0000 7f2fe759e700 1 -- 172.21.15.69:0/427030688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe80c6500 con 0x7f2fe81652b0 2023-11-17T06:31:03.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.847+0000 7f2fd6ffd700 1 -- 172.21.15.69:0/427030688 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe001c680 con 0x7f2fe81652b0 2023-11-17T06:31:03.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.847+0000 7f2fe759e700 1 -- 172.21.15.69:0/427030688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe81527c0 con 0x7f2fe81652b0 2023-11-17T06:31:03.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.847+0000 7f2fe759e700 1 -- 172.21.15.69:0/427030688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe80c6d00 con 0x7f2fe81652b0 2023-11-17T06:31:03.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.851+0000 7f2fd6ffd700 1 -- 172.21.15.69:0/427030688 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2fe001c7e0 con 0x7f2fe81652b0 2023-11-17T06:31:03.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.851+0000 7f2fd6ffd700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2fc8066510 0x7f2fc80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:03.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.851+0000 7f2fd6ffd700 1 -- 172.21.15.69:0/427030688 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2fe0085ad0 con 0x7f2fe81652b0 2023-11-17T06:31:03.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.851+0000 7f2fe659c700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2fc8066510 0x7f2fc80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:03.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.851+0000 7f2fe659c700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2fc8066510 0x7f2fc80689d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009c40 tx=0x7f2fd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:03.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:03.855+0000 7f2fd6ffd700 1 -- 172.21.15.69:0/427030688 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2fe80c6d00 con 0x7f2fe81652b0 2023-11-17T06:31:04.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.031+0000 7f2fe759e700 1 -- 172.21.15.69:0/427030688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fe80cd990 con 0x7f2fe81652b0 2023-11-17T06:31:06.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fd6ffd700 1 -- 172.21.15.69:0/427030688 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f2fe0052f40 con 0x7f2fe81652b0 2023-11-17T06:31:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:06.532 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:06.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 -- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2fc8066510 msgr2=0x7f2fc80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2fc8066510 0x7f2fc80689d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009c40 tx=0x7f2fd8008040 comp rx=0 tx=0).stop 2023-11-17T06:31:06.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 -- 172.21.15.69:0/427030688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81652b0 msgr2=0x7f2fe80cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81652b0 0x7f2fe80cb720 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2fe806b7d0 tx=0x7f2fe0004af0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 -- 172.21.15.69:0/427030688 shutdown_connections 2023-11-17T06:31:06.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2fc8066510 0x7f2fc80689d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fe81652b0 0x7f2fe80cb720 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe80cbef0 0x7f2fe80cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 --2- 172.21.15.69:0/427030688 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2fe80c21a0 0x7f2fe8152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 -- 172.21.15.69:0/427030688 >> 172.21.15.69:0/427030688 conn(0x7f2fe80b0900 msgr2=0x7f2fe80c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:06.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 -- 172.21.15.69:0/427030688 shutdown_connections 2023-11-17T06:31:06.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:04.035+0000 7f2fe759e700 1 -- 172.21.15.69:0/427030688 wait complete. 2023-11-17T06:31:06.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:29:54.503742+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:29:55.601406+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:31:06.621 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:31:06.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.811+0000 7f62324ff700 1 Processor -- start 2023-11-17T06:31:06.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.811+0000 7f62324ff700 1 -- start start 2023-11-17T06:31:06.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.815+0000 7f62324ff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f622c0b8150 0x7f622c0d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.815+0000 7f62324ff700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622c0b6750 con 0x7f622c0b5440 2023-11-17T06:31:06.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.815+0000 7f62324ff700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622c0d2a30 con 0x7f622c15d980 2023-11-17T06:31:06.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.815+0000 7f62324ff700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622c0b6980 con 0x7f622c0b8150 2023-11-17T06:31:06.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.815+0000 7f622b7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f622c0b5440 0x7f622c0d1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53656/0 (socket says 172.21.15.69:53656) 2023-11-17T06:31:06.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.815+0000 7f622b7fe700 1 -- 172.21.15.69:0/1929125324 learned_addr learned my addr 172.21.15.69:0/1929125324 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:06.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.815+0000 7f6230a9c700 1 --2- 172.21.15.69:0/1929125324 >> v2:172.21.15.93:3300/0 conn(0x7f622c0b8150 0x7f622c0d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f6230a9c700 1 -- 172.21.15.69:0/1929125324 >> v1:172.21.15.93:6789/0 conn(0x7f622c15d980 legacy=0x7f622c0b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f622affd700 1 -- 172.21.15.69:0/1929125324 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983753716 0 0) 0x7f622c0b6750 con 0x7f622c0b5440 2023-11-17T06:31:06.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f6230a9c700 1 -- 172.21.15.69:0/1929125324 >> v1:172.21.15.69:6789/0 conn(0x7f622c0b5440 legacy=0x7f622c0d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f6230a9c700 1 -- 172.21.15.69:0/1929125324 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c0d2470 con 0x7f622c0b8150 2023-11-17T06:31:06.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f6230a9c700 1 --2- 172.21.15.69:0/1929125324 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c0b8150 0x7f622c0d1e70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6224009d90 tx=0x7f622400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5064cb80d1472f5a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:06.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f622affd700 1 -- 172.21.15.69:0/1929125324 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622400e070 con 0x7f622c0b8150 2023-11-17T06:31:06.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f622affd700 1 -- 172.21.15.69:0/1929125324 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622400bbd0 con 0x7f622c0b8150 2023-11-17T06:31:06.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f622affd700 1 -- 172.21.15.69:0/1929125324 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224012430 con 0x7f622c0b8150 2023-11-17T06:31:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f62324ff700 1 -- 172.21.15.69:0/1929125324 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c0b8150 msgr2=0x7f622c0d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f62324ff700 1 --2- 172.21.15.69:0/1929125324 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c0b8150 0x7f622c0d1e70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6224009d90 tx=0x7f622400b330 comp rx=0 tx=0).stop 2023-11-17T06:31:06.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f62324ff700 1 -- 172.21.15.69:0/1929125324 shutdown_connections 2023-11-17T06:31:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f62324ff700 1 --2- 172.21.15.69:0/1929125324 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c0b8150 0x7f622c0d1e70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f62324ff700 1 -- 172.21.15.69:0/1929125324 >> 172.21.15.69:0/1929125324 conn(0x7f622c0cfd30 msgr2=0x7f622c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f62324ff700 1 -- 172.21.15.69:0/1929125324 shutdown_connections 2023-11-17T06:31:06.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.819+0000 7f62324ff700 1 -- 172.21.15.69:0/1929125324 wait complete. 2023-11-17T06:31:06.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.823+0000 7f62324ff700 1 Processor -- start 2023-11-17T06:31:06.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.823+0000 7f62324ff700 1 -- start start 2023-11-17T06:31:06.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f62324ff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c0b5440 0x7f622c158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f62324ff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f622c0b8150 0x7f622c0b8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f62324ff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f622c158a40 0x7f622c0b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f62324ff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c151a00 con 0x7f622c158a40 2023-11-17T06:31:06.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f62324ff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c151ca0 con 0x7f622c0b5440 2023-11-17T06:31:06.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f62324ff700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c1530b0 con 0x7f622c0b8150 2023-11-17T06:31:06.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6230a9c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f622c158a40 0x7f622c0b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f622b7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f622c0b8150 0x7f622c0b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6230a9c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f622c158a40 0x7f622c0b8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55214/0 (socket says 172.21.15.69:55214) 2023-11-17T06:31:06.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6230a9c700 1 -- 172.21.15.69:0/3091441538 learned_addr learned my addr 172.21.15.69:0/3091441538 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:06.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f622bfff700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c0b5440 0x7f622c158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6230a9c700 1 -- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f622c0b8150 msgr2=0x7f622c0b8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6230a9c700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f622c0b8150 0x7f622c0b8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6230a9c700 1 -- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c0b5440 msgr2=0x7f622c158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:06.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6230a9c700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c0b5440 0x7f622c158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:06.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6230a9c700 1 -- 172.21.15.69:0/3091441538 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6224009a70 con 0x7f622c158a40 2023-11-17T06:31:06.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f622b7fe700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f622c0b8150 0x7f622c0b8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:06.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6230a9c700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f622c158a40 0x7f622c0b8ac0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6224014040 tx=0x7f6224004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:06.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6228ff9700 1 -- 172.21.15.69:0/3091441538 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622401b810 con 0x7f622c158a40 2023-11-17T06:31:06.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6228ff9700 1 -- 172.21.15.69:0/3091441538 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6224020070 con 0x7f622c158a40 2023-11-17T06:31:06.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f6228ff9700 1 -- 172.21.15.69:0/3091441538 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622401bbb0 con 0x7f622c158a40 2023-11-17T06:31:06.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f62324ff700 1 -- 172.21.15.69:0/3091441538 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622c153390 con 0x7f622c158a40 2023-11-17T06:31:06.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.827+0000 7f62324ff700 1 -- 172.21.15.69:0/3091441538 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c0c9230 con 0x7f622c158a40 2023-11-17T06:31:06.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.831+0000 7f62324ff700 1 -- 172.21.15.69:0/3091441538 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622c073f00 con 0x7f622c158a40 2023-11-17T06:31:06.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.831+0000 7f6228ff9700 1 -- 172.21.15.69:0/3091441538 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f622401bd10 con 0x7f622c158a40 2023-11-17T06:31:06.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.835+0000 7f6228ff9700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6218066510 0x7f62180689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:06.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.835+0000 7f6228ff9700 1 -- 172.21.15.69:0/3091441538 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6224022070 con 0x7f622c158a40 2023-11-17T06:31:06.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.835+0000 7f622bfff700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6218066510 0x7f62180689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:06.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.835+0000 7f622bfff700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6218066510 0x7f62180689d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f621c000f60 tx=0x7f621c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:06.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:06.843+0000 7f6228ff9700 1 -- 172.21.15.69:0/3091441538 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6224053340 con 0x7f622c158a40 2023-11-17T06:31:07.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.019+0000 7f62324ff700 1 -- 172.21.15.69:0/3091441538 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f622c151de0 con 0x7f622c158a40 2023-11-17T06:31:07.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.019+0000 7f6228ff9700 1 -- 172.21.15.69:0/3091441538 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f622402c0a0 con 0x7f622c158a40 2023-11-17T06:31:07.026 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:31:07.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 -- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6218066510 msgr2=0x7f62180689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6218066510 0x7f62180689d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f621c000f60 tx=0x7f621c009040 comp rx=0 tx=0).stop 2023-11-17T06:31:07.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 -- 172.21.15.69:0/3091441538 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f622c158a40 msgr2=0x7f622c0b8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f622c158a40 0x7f622c0b8ac0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6224014040 tx=0x7f6224004af0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 -- 172.21.15.69:0/3091441538 shutdown_connections 2023-11-17T06:31:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6218066510 0x7f62180689d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f622c158a40 0x7f622c0b8ac0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f622c0b8150 0x7f622c0b8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 --2- 172.21.15.69:0/3091441538 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f622c0b5440 0x7f622c158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 -- 172.21.15.69:0/3091441538 >> 172.21.15.69:0/3091441538 conn(0x7f622c0cfd30 msgr2=0x7f622c0d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 -- 172.21.15.69:0/3091441538 shutdown_connections 2023-11-17T06:31:07.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.023+0000 7f62324ff700 1 -- 172.21.15.69:0/3091441538 wait complete. 2023-11-17T06:31:07.053 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:31:07.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.227+0000 7f3cc49e4700 1 Processor -- start 2023-11-17T06:31:07.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.227+0000 7f3cc49e4700 1 -- start start 2023-11-17T06:31:07.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cc49e4700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3cc015b120 0x7f3cc015eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cc49e4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3cc00cb340 0x7f3cc00c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cc49e4700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc0070120 con 0x7f3cc015b500 2023-11-17T06:31:07.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cc49e4700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc015fd50 con 0x7f3cc015b120 2023-11-17T06:31:07.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cc49e4700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc006d830 con 0x7f3cc00cb340 2023-11-17T06:31:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbdd9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f3cc015b500 0x7f3cc015f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53666/0 (socket says 172.21.15.69:53666) 2023-11-17T06:31:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbdd9b700 1 -- 172.21.15.69:0/2263631424 learned_addr learned my addr 172.21.15.69:0/2263631424 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbe59c700 1 --2- 172.21.15.69:0/2263631424 >> v2:172.21.15.69:3300/0 conn(0x7f3cc015b120 0x7f3cc015eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbed9d700 1 --2- 172.21.15.69:0/2263631424 >> v2:172.21.15.93:3300/0 conn(0x7f3cc00cb340 0x7f3cc00c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbd59a700 1 -- 172.21.15.69:0/2263631424 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065968785 0 0) 0x7f3cc0070120 con 0x7f3cc015b500 2023-11-17T06:31:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbe59c700 1 -- 172.21.15.69:0/2263631424 >> v2:172.21.15.93:3300/0 conn(0x7f3cc00cb340 msgr2=0x7f3cc00c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbe59c700 1 --2- 172.21.15.69:0/2263631424 >> v2:172.21.15.93:3300/0 conn(0x7f3cc00cb340 0x7f3cc00c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbe59c700 1 -- 172.21.15.69:0/2263631424 >> v1:172.21.15.69:6789/0 conn(0x7f3cc015b500 legacy=0x7f3cc015f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbe59c700 1 -- 172.21.15.69:0/2263631424 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc015fb00 con 0x7f3cc015b120 2023-11-17T06:31:07.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbe59c700 1 --2- 172.21.15.69:0/2263631424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 0x7f3cc015eeb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00c5f00 tx=0x7f3cb0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28f94b6b69db850 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbd59a700 1 -- 172.21.15.69:0/2263631424 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0011830 con 0x7f3cc015b120 2023-11-17T06:31:07.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbd59a700 1 -- 172.21.15.69:0/2263631424 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb0011990 con 0x7f3cc015b120 2023-11-17T06:31:07.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.231+0000 7f3cbd59a700 1 -- 172.21.15.69:0/2263631424 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0011d20 con 0x7f3cc015b120 2023-11-17T06:31:07.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.235+0000 7f3cc49e4700 1 -- 172.21.15.69:0/2263631424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 msgr2=0x7f3cc015eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.235+0000 7f3cc49e4700 1 --2- 172.21.15.69:0/2263631424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 0x7f3cc015eeb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00c5f00 tx=0x7f3cb0009b30 comp rx=0 tx=0).stop 2023-11-17T06:31:07.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.235+0000 7f3cc49e4700 1 -- 172.21.15.69:0/2263631424 shutdown_connections 2023-11-17T06:31:07.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.235+0000 7f3cc49e4700 1 --2- 172.21.15.69:0/2263631424 >> v2:172.21.15.93:3300/0 conn(0x7f3cc00cb340 0x7f3cc00c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.235+0000 7f3cc49e4700 1 --2- 172.21.15.69:0/2263631424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 0x7f3cc015eeb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.235+0000 7f3cc49e4700 1 -- 172.21.15.69:0/2263631424 >> 172.21.15.69:0/2263631424 conn(0x7f3cc00cee80 msgr2=0x7f3cc00cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:07.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.235+0000 7f3cc49e4700 1 -- 172.21.15.69:0/2263631424 shutdown_connections 2023-11-17T06:31:07.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.235+0000 7f3cc49e4700 1 -- 172.21.15.69:0/2263631424 wait complete. 2023-11-17T06:31:07.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cc49e4700 1 Processor -- start 2023-11-17T06:31:07.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cc49e4700 1 -- start start 2023-11-17T06:31:07.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cc49e4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc00cb340 0x7f3cc014f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cc49e4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 0x7f3cc0153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cc49e4700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cc015b500 0x7f3cc00ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cc49e4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc01f2d30 con 0x7f3cc015b120 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cc49e4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0157c10 con 0x7f3cc00cb340 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cc49e4700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc0154e70 con 0x7f3cc015b500 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbdd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 0x7f3cc0153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbdd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 0x7f3cc0153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55238/0 (socket says 172.21.15.69:55238) 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbdd9b700 1 -- 172.21.15.69:0/4189979457 learned_addr learned my addr 172.21.15.69:0/4189979457 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbe59c700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc00cb340 0x7f3cc014f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbed9d700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cc015b500 0x7f3cc00ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbdd9b700 1 -- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cc015b500 msgr2=0x7f3cc00ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbdd9b700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cc015b500 0x7f3cc00ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbdd9b700 1 -- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc00cb340 msgr2=0x7f3cc014f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbdd9b700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc00cb340 0x7f3cc014f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbdd9b700 1 -- 172.21.15.69:0/4189979457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb00094b0 con 0x7f3cc015b120 2023-11-17T06:31:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbed9d700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cc015b500 0x7f3cc00ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cbdd9b700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 0x7f3cc0153d10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c4b0 tx=0x7f3cb400c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3caeffd700 1 -- 172.21.15.69:0/4189979457 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4004ca0 con 0x7f3cc015b120 2023-11-17T06:31:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3caeffd700 1 -- 172.21.15.69:0/4189979457 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb4004e00 con 0x7f3cc015b120 2023-11-17T06:31:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.239+0000 7f3cc49e4700 1 -- 172.21.15.69:0/4189979457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc0157ed0 con 0x7f3cc015b120 2023-11-17T06:31:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.243+0000 7f3caeffd700 1 -- 172.21.15.69:0/4189979457 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb40072d0 con 0x7f3cc015b120 2023-11-17T06:31:07.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.243+0000 7f3cc49e4700 1 -- 172.21.15.69:0/4189979457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc0154b90 con 0x7f3cc015b120 2023-11-17T06:31:07.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.243+0000 7f3cc49e4700 1 -- 172.21.15.69:0/4189979457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc0073f00 con 0x7f3cc015b120 2023-11-17T06:31:07.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.243+0000 7f3caeffd700 1 -- 172.21.15.69:0/4189979457 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3cb4007430 con 0x7f3cc015b120 2023-11-17T06:31:07.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.243+0000 7f3caeffd700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ca0066510 0x7f3ca00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.247+0000 7f3caeffd700 1 -- 172.21.15.69:0/4189979457 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3cb4083b60 con 0x7f3cc015b120 2023-11-17T06:31:07.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.247+0000 7f3cbe59c700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ca0066510 0x7f3ca00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.247+0000 7f3cbe59c700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ca0066510 0x7f3ca00689d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0000c00 tx=0x7f3cb0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.251+0000 7f3caeffd700 1 -- 172.21.15.69:0/4189979457 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3cb4050fc0 con 0x7f3cc015b120 2023-11-17T06:31:07.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.419+0000 7f3cc49e4700 1 -- 172.21.15.69:0/4189979457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cc00b42f0 con 0x7f3cc015b120 2023-11-17T06:31:07.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.423+0000 7f3caeffd700 1 -- 172.21.15.69:0/4189979457 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3cb40545e0 con 0x7f3cc015b120 2023-11-17T06:31:07.741 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 -- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ca0066510 msgr2=0x7f3ca00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ca0066510 0x7f3ca00689d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0000c00 tx=0x7f3cb0008030 comp rx=0 tx=0).stop 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 -- 172.21.15.69:0/4189979457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 msgr2=0x7f3cc0153d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 0x7f3cc0153d10 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3cb400c4b0 tx=0x7f3cb400c870 comp rx=0 tx=0).stop 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 -- 172.21.15.69:0/4189979457 shutdown_connections 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ca0066510 0x7f3ca00689d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3cc015b500 0x7f3cc00ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3cc015b120 0x7f3cc0153d10 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 --2- 172.21.15.69:0/4189979457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc00cb340 0x7f3cc014f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 -- 172.21.15.69:0/4189979457 >> 172.21.15.69:0/4189979457 conn(0x7f3cc00cee80 msgr2=0x7f3cc015bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 -- 172.21.15.69:0/4189979457 shutdown_connections 2023-11-17T06:31:07.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.427+0000 7f3cc49e4700 1 -- 172.21.15.69:0/4189979457 wait complete. 2023-11-17T06:31:07.744 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:31:07.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.923+0000 7f076b4a8700 1 Processor -- start 2023-11-17T06:31:07.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.923+0000 7f076b4a8700 1 -- start start 2023-11-17T06:31:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.923+0000 7f076b4a8700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f07640cba00 0x7f0764065e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f076b4a8700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07640ca1a0 con 0x7f07640cdb20 2023-11-17T06:31:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f076b4a8700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07640ca480 con 0x7f076415cf50 2023-11-17T06:31:07.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f076b4a8700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076406b3b0 con 0x7f07640cba00 2023-11-17T06:31:07.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f0769a45700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f07640cdb20 0x7f07641644e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53668/0 (socket says 172.21.15.69:53668) 2023-11-17T06:31:07.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f0769a45700 1 -- 172.21.15.69:0/495087019 learned_addr learned my addr 172.21.15.69:0/495087019 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:07.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f0769244700 1 --2- 172.21.15.69:0/495087019 >> v2:172.21.15.93:3300/0 conn(0x7f07640cba00 0x7f0764065e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f075bfff700 1 -- 172.21.15.69:0/495087019 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385076424 0 0) 0x7f07640ca1a0 con 0x7f07640cdb20 2023-11-17T06:31:07.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f075bfff700 1 -- 172.21.15.69:0/495087019 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07500035d0 con 0x7f07640cdb20 2023-11-17T06:31:07.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f0769244700 1 -- 172.21.15.69:0/495087019 >> v1:172.21.15.93:6789/0 conn(0x7f076415cf50 legacy=0x7f07640cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f0769244700 1 -- 172.21.15.69:0/495087019 >> v1:172.21.15.69:6789/0 conn(0x7f07640cdb20 legacy=0x7f07641644e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f0769244700 1 -- 172.21.15.69:0/495087019 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07640ca760 con 0x7f07640cba00 2023-11-17T06:31:07.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f0769244700 1 --2- 172.21.15.69:0/495087019 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07640cba00 0x7f0764065e90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0760009850 tx=0x7f0760009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92e3034ba050f889 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f075bfff700 1 -- 172.21.15.69:0/495087019 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760011830 con 0x7f07640cba00 2023-11-17T06:31:07.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f075bfff700 1 -- 172.21.15.69:0/495087019 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760011990 con 0x7f07640cba00 2023-11-17T06:31:07.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f075bfff700 1 -- 172.21.15.69:0/495087019 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760011d40 con 0x7f07640cba00 2023-11-17T06:31:07.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f076b4a8700 1 -- 172.21.15.69:0/495087019 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07640cba00 msgr2=0x7f0764065e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.927+0000 7f076b4a8700 1 --2- 172.21.15.69:0/495087019 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07640cba00 0x7f0764065e90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0760009850 tx=0x7f0760009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:07.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 -- 172.21.15.69:0/495087019 shutdown_connections 2023-11-17T06:31:07.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 --2- 172.21.15.69:0/495087019 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07640cba00 0x7f0764065e90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 -- 172.21.15.69:0/495087019 >> 172.21.15.69:0/495087019 conn(0x7f07640cc0b0 msgr2=0x7f07640cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:07.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 -- 172.21.15.69:0/495087019 shutdown_connections 2023-11-17T06:31:07.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 -- 172.21.15.69:0/495087019 wait complete. 2023-11-17T06:31:07.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 Processor -- start 2023-11-17T06:31:07.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 -- start start 2023-11-17T06:31:07.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07640cba00 0x7f07641e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07640cdb20 0x7f076414e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f076415cf50 0x7f07640c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07641e3b40 con 0x7f07640cba00 2023-11-17T06:31:07.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07641e2ec0 con 0x7f07640cdb20 2023-11-17T06:31:07.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f076b4a8700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07641e31a0 con 0x7f076415cf50 2023-11-17T06:31:07.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.931+0000 7f0769244700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07640cba00 0x7f07641e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0769244700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07640cba00 0x7f07641e3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55254/0 (socket says 172.21.15.69:55254) 2023-11-17T06:31:07.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0769244700 1 -- 172.21.15.69:0/3759101882 learned_addr learned my addr 172.21.15.69:0/3759101882 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:07.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0769a45700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f076415cf50 0x7f07640c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0768a43700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07640cdb20 0x7f076414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0769244700 1 -- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f076415cf50 msgr2=0x7f07640c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0769244700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f076415cf50 0x7f07640c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0769244700 1 -- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07640cdb20 msgr2=0x7f076414e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0769244700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07640cdb20 0x7f076414e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0769244700 1 -- 172.21.15.69:0/3759101882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600094b0 con 0x7f07640cba00 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0769244700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07640cba00 0x7f07641e3f60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0760000c00 tx=0x7f0760004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0759ffb700 1 -- 172.21.15.69:0/3759101882 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076001aac0 con 0x7f07640cba00 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0759ffb700 1 -- 172.21.15.69:0/3759101882 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076001f070 con 0x7f07640cba00 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f0759ffb700 1 -- 172.21.15.69:0/3759101882 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076001ae60 con 0x7f07640cba00 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f076b4a8700 1 -- 172.21.15.69:0/3759101882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07641e3480 con 0x7f07640cba00 2023-11-17T06:31:07.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f076b4a8700 1 -- 172.21.15.69:0/3759101882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076414eed0 con 0x7f07640cba00 2023-11-17T06:31:07.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.935+0000 7f076b4a8700 1 -- 172.21.15.69:0/3759101882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07640738b0 con 0x7f07640cba00 2023-11-17T06:31:07.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.939+0000 7f0759ffb700 1 -- 172.21.15.69:0/3759101882 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f076001b430 con 0x7f07640cba00 2023-11-17T06:31:07.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.939+0000 7f0759ffb700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0748066510 0x7f07480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:07.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.939+0000 7f0759ffb700 1 -- 172.21.15.69:0/3759101882 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0760085070 con 0x7f07640cba00 2023-11-17T06:31:07.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.939+0000 7f0768a43700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0748066510 0x7f07480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:07.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.939+0000 7f0768a43700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0748066510 0x7f07480689d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07640c9a20 tx=0x7f0754009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:07.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:07.943+0000 7f0759ffb700 1 -- 172.21.15.69:0/3759101882 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f07600b6090 con 0x7f07640cba00 2023-11-17T06:31:08.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.119+0000 7f076b4a8700 1 -- 172.21.15.69:0/3759101882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0764073f00 con 0x7f07640cba00 2023-11-17T06:31:08.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.119+0000 7f0759ffb700 1 -- 172.21.15.69:0/3759101882 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0760015020 con 0x7f07640cba00 2023-11-17T06:31:08.126 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:31:08.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 -- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0748066510 msgr2=0x7f07480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0748066510 0x7f07480689d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07640c9a20 tx=0x7f0754009040 comp rx=0 tx=0).stop 2023-11-17T06:31:08.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 -- 172.21.15.69:0/3759101882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07640cba00 msgr2=0x7f07641e3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07640cba00 0x7f07641e3f60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0760000c00 tx=0x7f0760004770 comp rx=0 tx=0).stop 2023-11-17T06:31:08.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 -- 172.21.15.69:0/3759101882 shutdown_connections 2023-11-17T06:31:08.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0748066510 0x7f07480689d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f076415cf50 0x7f07640c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07640cdb20 0x7f076414e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 --2- 172.21.15.69:0/3759101882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07640cba00 0x7f07641e3f60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 -- 172.21.15.69:0/3759101882 >> 172.21.15.69:0/3759101882 conn(0x7f07640cc0b0 msgr2=0x7f07640ad250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:08.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 -- 172.21.15.69:0/3759101882 shutdown_connections 2023-11-17T06:31:08.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.123+0000 7f076b4a8700 1 -- 172.21.15.69:0/3759101882 wait complete. 2023-11-17T06:31:08.154 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:08.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f796cfdc700 1 Processor -- start 2023-11-17T06:31:08.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f796cfdc700 1 -- start start 2023-11-17T06:31:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f796cfdc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f796815d980 0x7f79680b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f796cfdc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f79680b5270 0x7f79680d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f796cfdc700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79680b6750 con 0x7f79680d1ca0 2023-11-17T06:31:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f796cfdc700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680d2a30 con 0x7f79680b5270 2023-11-17T06:31:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f796cfdc700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680b6980 con 0x7f796815d980 2023-11-17T06:31:08.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f795ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f79680b5270 0x7f79680d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f795ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f79680b5270 0x7f79680d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55258/0 (socket says 172.21.15.69:55258) 2023-11-17T06:31:08.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f795ffff700 1 -- 172.21.15.69:0/2825329563 learned_addr learned my addr 172.21.15.69:0/2825329563 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:08.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.323+0000 7f796659c700 1 --2- 172.21.15.69:0/2825329563 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f796815d980 0x7f79680b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f795ffff700 1 -- 172.21.15.69:0/2825329563 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f796815d980 msgr2=0x7f79680b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:08.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f795ffff700 1 --2- 172.21.15.69:0/2825329563 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f796815d980 0x7f79680b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f795ffff700 1 -- 172.21.15.69:0/2825329563 >> v1:172.21.15.93:6789/0 conn(0x7f79680d1ca0 legacy=0x7f796806ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f795ffff700 1 -- 172.21.15.69:0/2825329563 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680b56d0 con 0x7f79680b5270 2023-11-17T06:31:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f795ffff700 1 --2- 172.21.15.69:0/2825329563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 0x7f79680d1760 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7950009910 tx=0x7f7950009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a592b723f2b8b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f7965d9b700 1 -- 172.21.15.69:0/2825329563 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795000ba60 con 0x7f79680b5270 2023-11-17T06:31:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f7965d9b700 1 -- 172.21.15.69:0/2825329563 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795000bbc0 con 0x7f79680b5270 2023-11-17T06:31:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f7965d9b700 1 -- 172.21.15.69:0/2825329563 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7950009e60 con 0x7f79680b5270 2023-11-17T06:31:08.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f796cfdc700 1 -- 172.21.15.69:0/2825329563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 msgr2=0x7f79680d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f796cfdc700 1 --2- 172.21.15.69:0/2825329563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 0x7f79680d1760 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7950009910 tx=0x7f7950009c20 comp rx=0 tx=0).stop 2023-11-17T06:31:08.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f796cfdc700 1 -- 172.21.15.69:0/2825329563 shutdown_connections 2023-11-17T06:31:08.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f796cfdc700 1 --2- 172.21.15.69:0/2825329563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 0x7f79680d1760 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f796cfdc700 1 --2- 172.21.15.69:0/2825329563 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f796815d980 0x7f79680b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f796cfdc700 1 -- 172.21.15.69:0/2825329563 >> 172.21.15.69:0/2825329563 conn(0x7f79680cfd30 msgr2=0x7f79680d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:08.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f796cfdc700 1 -- 172.21.15.69:0/2825329563 shutdown_connections 2023-11-17T06:31:08.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.327+0000 7f796cfdc700 1 -- 172.21.15.69:0/2825329563 wait complete. 2023-11-17T06:31:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.331+0000 7f796cfdc700 1 Processor -- start 2023-11-17T06:31:08.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.331+0000 7f796cfdc700 1 -- start start 2023-11-17T06:31:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796cfdc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 0x7f79680aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796cfdc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f79680d1ca0 0x7f79681f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796cfdc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79681f2af0 0x7f79680b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796cfdc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680aae50 con 0x7f79680b5270 2023-11-17T06:31:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796cfdc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680ab130 con 0x7f79681f2af0 2023-11-17T06:31:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796cfdc700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680ab410 con 0x7f79680d1ca0 2023-11-17T06:31:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 0x7f79680aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 0x7f79680aa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55266/0 (socket says 172.21.15.69:55266) 2023-11-17T06:31:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796659c700 1 -- 172.21.15.69:0/433177974 learned_addr learned my addr 172.21.15.69:0/433177974 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:08.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f7966d9d700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79681f2af0 0x7f79680b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f795ffff700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f79680d1ca0 0x7f79681f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796659c700 1 -- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f79680d1ca0 msgr2=0x7f79681f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796659c700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f79680d1ca0 0x7f79681f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796659c700 1 -- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79681f2af0 msgr2=0x7f79680b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796659c700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79681f2af0 0x7f79680b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796659c700 1 -- 172.21.15.69:0/433177974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950009570 con 0x7f79680b5270 2023-11-17T06:31:08.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796659c700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 0x7f79680aa5b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f795800e760 tx=0x7f795800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f795effd700 1 -- 172.21.15.69:0/433177974 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795800c070 con 0x7f79680b5270 2023-11-17T06:31:08.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f795effd700 1 -- 172.21.15.69:0/433177974 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7958013610 con 0x7f79680b5270 2023-11-17T06:31:08.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796cfdc700 1 -- 172.21.15.69:0/433177974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79680ab6f0 con 0x7f79680b5270 2023-11-17T06:31:08.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f795effd700 1 -- 172.21.15.69:0/433177974 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7958013980 con 0x7f79680b5270 2023-11-17T06:31:08.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.335+0000 7f796cfdc700 1 -- 172.21.15.69:0/433177974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7968160320 con 0x7f79680b5270 2023-11-17T06:31:08.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.339+0000 7f796cfdc700 1 -- 172.21.15.69:0/433177974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7968160600 con 0x7f79680b5270 2023-11-17T06:31:08.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.339+0000 7f795effd700 1 -- 172.21.15.69:0/433177974 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7958013ae0 con 0x7f79680b5270 2023-11-17T06:31:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.343+0000 7f795effd700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7948066510 0x7f79480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.343+0000 7f795effd700 1 -- 172.21.15.69:0/433177974 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7958083c50 con 0x7f79680b5270 2023-11-17T06:31:08.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.343+0000 7f795ffff700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7948066510 0x7f79480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.343+0000 7f795ffff700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7948066510 0x7f79480689d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7950000c00 tx=0x7f7950008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.347+0000 7f795effd700 1 -- 172.21.15.69:0/433177974 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7958051020 con 0x7f79680b5270 2023-11-17T06:31:08.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.559+0000 7f796cfdc700 1 -- 172.21.15.69:0/433177974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79680b7320 con 0x7f79680b5270 2023-11-17T06:31:08.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f795effd700 1 -- 172.21.15.69:0/433177974 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f7958054640 con 0x7f79680b5270 2023-11-17T06:31:08.568 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:08.568 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/1178370379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1178370379},{"type":"v1","addr":"172.21.15.93:6835","nonce":1178370379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/2342979080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":2342979080},{"type":"v1","addr":"172.21.15.93:6837","nonce":2342979080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/1839590536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1839590536},{"type":"v1","addr":"172.21.15.69:6833","nonce":1839590536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:56.576603+0000","modified":"2023-11-17T06:29:59.616825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2440982410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2440982410},{"type":"v1","addr":"172.21.15.69:6835","nonce":2440982410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:31:08.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 -- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7948066510 msgr2=0x7f79480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7948066510 0x7f79480689d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7950000c00 tx=0x7f7950008030 comp rx=0 tx=0).stop 2023-11-17T06:31:08.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 -- 172.21.15.69:0/433177974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 msgr2=0x7f79680aa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 0x7f79680aa5b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f795800e760 tx=0x7f795800ea70 comp rx=0 tx=0).stop 2023-11-17T06:31:08.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 -- 172.21.15.69:0/433177974 shutdown_connections 2023-11-17T06:31:08.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7948066510 0x7f79480689d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79681f2af0 0x7f79680b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f79680d1ca0 0x7f79681f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 --2- 172.21.15.69:0/433177974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79680b5270 0x7f79680aa5b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 -- 172.21.15.69:0/433177974 >> 172.21.15.69:0/433177974 conn(0x7f79680cfd30 msgr2=0x7f79680b78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:08.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 -- 172.21.15.69:0/433177974 shutdown_connections 2023-11-17T06:31:08.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.563+0000 7f796cfdc700 1 -- 172.21.15.69:0/433177974 wait complete. 2023-11-17T06:31:08.573 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-11-17T06:31:08.596 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:08.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.763+0000 7f787159e700 1 Processor -- start 2023-11-17T06:31:08.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.763+0000 7f787159e700 1 -- start start 2023-11-17T06:31:08.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.763+0000 7f787159e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f786c0b8150 0x7f786c0d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.763+0000 7f787159e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786c0b6750 con 0x7f786c0b5440 2023-11-17T06:31:08.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.763+0000 7f787159e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786c0d2a30 con 0x7f786c15d980 2023-11-17T06:31:08.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.763+0000 7f787159e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c0b6980 con 0x7f786c0b8150 2023-11-17T06:31:08.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.763+0000 7f786a7fc700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f786c0b5440 0x7f786c0d1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53680/0 (socket says 172.21.15.69:53680) 2023-11-17T06:31:08.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.763+0000 7f786a7fc700 1 -- 172.21.15.69:0/3467492715 learned_addr learned my addr 172.21.15.69:0/3467492715 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:08.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.763+0000 7f786b7fe700 1 --2- 172.21.15.69:0/3467492715 >> v2:172.21.15.93:3300/0 conn(0x7f786c0b8150 0x7f786c0d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f7869ffb700 1 -- 172.21.15.69:0/3467492715 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899662114 0 0) 0x7f786c0b6750 con 0x7f786c0b5440 2023-11-17T06:31:08.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f7869ffb700 1 -- 172.21.15.69:0/3467492715 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78540035d0 con 0x7f786c0b5440 2023-11-17T06:31:08.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f7869ffb700 1 -- 172.21.15.69:0/3467492715 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477364552 0 0) 0x7f78540035d0 con 0x7f786c0b5440 2023-11-17T06:31:08.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f786b7fe700 1 -- 172.21.15.69:0/3467492715 >> v1:172.21.15.93:6789/0 conn(0x7f786c15d980 legacy=0x7f786c0b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f786b7fe700 1 -- 172.21.15.69:0/3467492715 >> v1:172.21.15.69:6789/0 conn(0x7f786c0b5440 legacy=0x7f786c0d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f786b7fe700 1 -- 172.21.15.69:0/3467492715 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c0d2470 con 0x7f786c0b8150 2023-11-17T06:31:08.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f786b7fe700 1 --2- 172.21.15.69:0/3467492715 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f786c0b8150 0x7f786c0d1e70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7864009d90 tx=0x7f786400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=188af35b32b285c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f7869ffb700 1 -- 172.21.15.69:0/3467492715 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786400e070 con 0x7f786c0b8150 2023-11-17T06:31:08.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f7869ffb700 1 -- 172.21.15.69:0/3467492715 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7864003a40 con 0x7f786c0b8150 2023-11-17T06:31:08.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f7869ffb700 1 -- 172.21.15.69:0/3467492715 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860001670 con 0x7f786c0b8150 2023-11-17T06:31:08.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f787159e700 1 -- 172.21.15.69:0/3467492715 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f786c0b8150 msgr2=0x7f786c0d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f787159e700 1 --2- 172.21.15.69:0/3467492715 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f786c0b8150 0x7f786c0d1e70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7864009d90 tx=0x7f786400b330 comp rx=0 tx=0).stop 2023-11-17T06:31:08.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f787159e700 1 -- 172.21.15.69:0/3467492715 shutdown_connections 2023-11-17T06:31:08.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f787159e700 1 --2- 172.21.15.69:0/3467492715 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f786c0b8150 0x7f786c0d1e70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f787159e700 1 -- 172.21.15.69:0/3467492715 >> 172.21.15.69:0/3467492715 conn(0x7f786c0cfd30 msgr2=0x7f786c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:08.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f787159e700 1 -- 172.21.15.69:0/3467492715 shutdown_connections 2023-11-17T06:31:08.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.767+0000 7f787159e700 1 -- 172.21.15.69:0/3467492715 wait complete. 2023-11-17T06:31:08.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.771+0000 7f787159e700 1 Processor -- start 2023-11-17T06:31:08.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.771+0000 7f787159e700 1 -- start start 2023-11-17T06:31:08.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f787159e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f786c0b5440 0x7f786c1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f787159e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f786c0b8150 0x7f786c15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f787159e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f786c14d910 0x7f786c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f787159e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c157bf0 con 0x7f786c0b5440 2023-11-17T06:31:08.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f787159e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c0cb480 con 0x7f786c14d910 2023-11-17T06:31:08.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f787159e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c158120 con 0x7f786c0b8150 2023-11-17T06:31:08.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f786c0b5440 0x7f786c1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f786c0b5440 0x7f786c1532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55280/0 (socket says 172.21.15.69:55280) 2023-11-17T06:31:08.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786affd700 1 -- 172.21.15.69:0/2322853492 learned_addr learned my addr 172.21.15.69:0/2322853492 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:08.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786b7fe700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f786c14d910 0x7f786c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786a7fc700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f786c0b8150 0x7f786c15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786affd700 1 -- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f786c0b8150 msgr2=0x7f786c15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786affd700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f786c0b8150 0x7f786c15b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786affd700 1 -- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f786c14d910 msgr2=0x7f786c14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786affd700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f786c14d910 0x7f786c14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786affd700 1 -- 172.21.15.69:0/2322853492 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7864009a70 con 0x7f786c0b5440 2023-11-17T06:31:08.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f786affd700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f786c0b5440 0x7f786c1532c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f785c00c500 tx=0x7f785c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f78537fe700 1 -- 172.21.15.69:0/2322853492 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0052d0 con 0x7f786c0b5440 2023-11-17T06:31:08.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f78537fe700 1 -- 172.21.15.69:0/2322853492 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c005430 con 0x7f786c0b5440 2023-11-17T06:31:08.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f78537fe700 1 -- 172.21.15.69:0/2322853492 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c0055a0 con 0x7f786c0b5440 2023-11-17T06:31:08.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.775+0000 7f787159e700 1 -- 172.21.15.69:0/2322853492 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786c157e40 con 0x7f786c0b5440 2023-11-17T06:31:08.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.779+0000 7f787159e700 1 -- 172.21.15.69:0/2322853492 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c0cb110 con 0x7f786c0b5440 2023-11-17T06:31:08.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.779+0000 7f787159e700 1 -- 172.21.15.69:0/2322853492 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786c073f00 con 0x7f786c0b5440 2023-11-17T06:31:08.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.779+0000 7f78537fe700 1 -- 172.21.15.69:0/2322853492 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f785c0038e0 con 0x7f786c0b5440 2023-11-17T06:31:08.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.783+0000 7f78537fe700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7858066510 0x7f78580689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:08.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.783+0000 7f78537fe700 1 -- 172.21.15.69:0/2322853492 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f785c083180 con 0x7f786c0b5440 2023-11-17T06:31:08.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.783+0000 7f786a7fc700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7858066510 0x7f78580689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:08.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.783+0000 7f786a7fc700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7858066510 0x7f78580689d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f786c0d42b0 tx=0x7f7860001da0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:08.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.787+0000 7f78537fe700 1 -- 172.21.15.69:0/2322853492 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f785c050670 con 0x7f786c0b5440 2023-11-17T06:31:08.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.967+0000 7f787159e700 1 -- 172.21.15.69:0/2322853492 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f786c0c99f0 con 0x7f786c0b5440 2023-11-17T06:31:08.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.971+0000 7f78537fe700 1 -- 172.21.15.69:0/2322853492 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f785c053c90 con 0x7f786c0b5440 2023-11-17T06:31:08.977 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:08.977 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:08.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 -- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7858066510 msgr2=0x7f78580689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7858066510 0x7f78580689d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f786c0d42b0 tx=0x7f7860001da0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 -- 172.21.15.69:0/2322853492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f786c0b5440 msgr2=0x7f786c1532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:08.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f786c0b5440 0x7f786c1532c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f785c00c500 tx=0x7f785c00c810 comp rx=0 tx=0).stop 2023-11-17T06:31:08.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 -- 172.21.15.69:0/2322853492 shutdown_connections 2023-11-17T06:31:08.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7858066510 0x7f78580689d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f786c14d910 0x7f786c14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f786c0b8150 0x7f786c15b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 --2- 172.21.15.69:0/2322853492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f786c0b5440 0x7f786c1532c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:08.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 -- 172.21.15.69:0/2322853492 >> 172.21.15.69:0/2322853492 conn(0x7f786c0cfd30 msgr2=0x7f786c0ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:08.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 -- 172.21.15.69:0/2322853492 shutdown_connections 2023-11-17T06:31:08.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:08.975+0000 7f787159e700 1 -- 172.21.15.69:0/2322853492 wait complete. 2023-11-17T06:31:09.006 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-17T06:31:09.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:09.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.179+0000 7f80b54e5700 1 Processor -- start 2023-11-17T06:31:11.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.179+0000 7f80b54e5700 1 -- start start 2023-11-17T06:31:11.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.183+0000 7f80b54e5700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f80b015d490 0x7f80b00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.183+0000 7f80b54e5700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b00d13d0 0x7f80b00cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.183+0000 7f80b54e5700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b00ce770 con 0x7f80b00ce310 2023-11-17T06:31:11.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.183+0000 7f80b54e5700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b00d1bb0 con 0x7f80b015d490 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.183+0000 7f80b54e5700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b00d1e90 con 0x7f80b00d13d0 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.183+0000 7f80aeffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f80b015d490 0x7f80b00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.183+0000 7f80af7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f80b00ce310 0x7f80b00b4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53690/0 (socket says 172.21.15.69:53690) 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.183+0000 7f80af7fe700 1 -- 172.21.15.69:0/1507006759 learned_addr learned my addr 172.21.15.69:0/1507006759 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.183+0000 7f80a7fff700 1 --2- 172.21.15.69:0/1507006759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b00d13d0 0x7f80b00cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80aeffd700 1 -- 172.21.15.69:0/1507006759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b00d13d0 msgr2=0x7f80b00cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80aeffd700 1 --2- 172.21.15.69:0/1507006759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b00d13d0 0x7f80b00cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80aeffd700 1 -- 172.21.15.69:0/1507006759 >> v1:172.21.15.69:6789/0 conn(0x7f80b00ce310 legacy=0x7f80b00b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80aeffd700 1 -- 172.21.15.69:0/1507006759 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b00d2170 con 0x7f80b015d490 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80a7fff700 1 --2- 172.21.15.69:0/1507006759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b00d13d0 0x7f80b00cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80aeffd700 1 --2- 172.21.15.69:0/1507006759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b015d490 0x7f80b00b8bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009850 tx=0x7f80a0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d7f6e19fc51477 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80ae7fc700 1 -- 172.21.15.69:0/1507006759 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0011830 con 0x7f80b015d490 2023-11-17T06:31:11.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80ae7fc700 1 -- 172.21.15.69:0/1507006759 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a0011990 con 0x7f80b015d490 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80ae7fc700 1 -- 172.21.15.69:0/1507006759 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0011d20 con 0x7f80b015d490 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80b54e5700 1 -- 172.21.15.69:0/1507006759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b015d490 msgr2=0x7f80b00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80b54e5700 1 --2- 172.21.15.69:0/1507006759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b015d490 0x7f80b00b8bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009850 tx=0x7f80a0009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80b54e5700 1 -- 172.21.15.69:0/1507006759 shutdown_connections 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80b54e5700 1 --2- 172.21.15.69:0/1507006759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b00d13d0 0x7f80b00cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80b54e5700 1 --2- 172.21.15.69:0/1507006759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b015d490 0x7f80b00b8bc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80b54e5700 1 -- 172.21.15.69:0/1507006759 >> 172.21.15.69:0/1507006759 conn(0x7f80b006ab40 msgr2=0x7f80b006af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80b54e5700 1 -- 172.21.15.69:0/1507006759 shutdown_connections 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.187+0000 7f80b54e5700 1 -- 172.21.15.69:0/1507006759 wait complete. 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.191+0000 7f80b54e5700 1 Processor -- start 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.191+0000 7f80b54e5700 1 -- start start 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80b54e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b00ce310 0x7f80b0146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80b54e5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80b00d13d0 0x7f80b0152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80b54e5700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b015d490 0x7f80b0153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80b54e5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b015d870 con 0x7f80b00ce310 2023-11-17T06:31:11.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80b54e5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b014fe40 con 0x7f80b00d13d0 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80b54e5700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b015e660 con 0x7f80b015d490 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80aeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b00ce310 0x7f80b0146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80aeffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b00ce310 0x7f80b0146460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55298/0 (socket says 172.21.15.69:55298) 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80aeffd700 1 -- 172.21.15.69:0/2422865294 learned_addr learned my addr 172.21.15.69:0/2422865294 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80af7fe700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b015d490 0x7f80b0153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80a7fff700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80b00d13d0 0x7f80b0152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80aeffd700 1 -- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b015d490 msgr2=0x7f80b0153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80aeffd700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b015d490 0x7f80b0153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80aeffd700 1 -- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80b00d13d0 msgr2=0x7f80b0152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80aeffd700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80b00d13d0 0x7f80b0152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80aeffd700 1 -- 172.21.15.69:0/2422865294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a00094b0 con 0x7f80b00ce310 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80af7fe700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b015d490 0x7f80b0153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80aeffd700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b00ce310 0x7f80b0146460 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f80a0000c00 tx=0x7f80a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80a77fe700 1 -- 172.21.15.69:0/2422865294 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0004570 con 0x7f80b00ce310 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80a77fe700 1 -- 172.21.15.69:0/2422865294 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a001f070 con 0x7f80b00ce310 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80a77fe700 1 -- 172.21.15.69:0/2422865294 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0003900 con 0x7f80b00ce310 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80b54e5700 1 -- 172.21.15.69:0/2422865294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b01f2d70 con 0x7f80b00ce310 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.195+0000 7f80b54e5700 1 -- 172.21.15.69:0/2422865294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b015dd30 con 0x7f80b00ce310 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.199+0000 7f80b54e5700 1 -- 172.21.15.69:0/2422865294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b0073f00 con 0x7f80b00ce310 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.199+0000 7f80a77fe700 1 -- 172.21.15.69:0/2422865294 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f80a0021030 con 0x7f80b00ce310 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.199+0000 7f80a77fe700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8090066510 0x7f80900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.199+0000 7f80a77fe700 1 -- 172.21.15.69:0/2422865294 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f80a0085160 con 0x7f80b00ce310 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.199+0000 7f80a7fff700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8090066510 0x7f80900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.203+0000 7f80a7fff700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8090066510 0x7f80900689d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f80b01538b0 tx=0x7f8098008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.207+0000 7f80a77fe700 1 -- 172.21.15.69:0/2422865294 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f80a0052640 con 0x7f80b00ce310 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.419+0000 7f80b54e5700 1 -- 172.21.15.69:0/2422865294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80b00d00d0 con 0x7f80b00ce310 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.423+0000 7f80a77fe700 1 -- 172.21.15.69:0/2422865294 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f80a0055c60 con 0x7f80b00ce310 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:11.782 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/1178370379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1178370379},{"type":"v1","addr":"172.21.15.93:6835","nonce":1178370379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/2342979080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":2342979080},{"type":"v1","addr":"172.21.15.93:6837","nonce":2342979080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/1839590536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1839590536},{"type":"v1","addr":"172.21.15.69:6833","nonce":1839590536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:56.576603+0000","modified":"2023-11-17T06:29:59.616825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2440982410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2440982410},{"type":"v1","addr":"172.21.15.69:6835","nonce":2440982410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 -- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8090066510 msgr2=0x7f80900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8090066510 0x7f80900689d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f80b01538b0 tx=0x7f8098008040 comp rx=0 tx=0).stop 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 -- 172.21.15.69:0/2422865294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b00ce310 msgr2=0x7f80b0146460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b00ce310 0x7f80b0146460 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f80a0000c00 tx=0x7f80a0004770 comp rx=0 tx=0).stop 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 -- 172.21.15.69:0/2422865294 shutdown_connections 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8090066510 0x7f80900689d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f80b015d490 0x7f80b0153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f80b00d13d0 0x7f80b0152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 --2- 172.21.15.69:0/2422865294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b00ce310 0x7f80b0146460 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:11.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 -- 172.21.15.69:0/2422865294 >> 172.21.15.69:0/2422865294 conn(0x7f80b006ab40 msgr2=0x7f80b015a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:11.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 -- 172.21.15.69:0/2422865294 shutdown_connections 2023-11-17T06:31:11.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:09.427+0000 7f80b54e5700 1 -- 172.21.15.69:0/2422865294 wait complete. 2023-11-17T06:31:11.785 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-11-17T06:31:11.785 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:11.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.955+0000 7f73074c2700 1 Processor -- start 2023-11-17T06:31:11.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.955+0000 7f73074c2700 1 -- start start 2023-11-17T06:31:11.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.955+0000 7f73074c2700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 0x7f73000ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:11.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.955+0000 7f73074c2700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f73000c98c0 0x7f73000cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.955+0000 7f73074c2700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73000cca40 con 0x7f7300159ed0 2023-11-17T06:31:12.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.955+0000 7f73074c2700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73000ccdb0 con 0x7f73000c98c0 2023-11-17T06:31:12.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.955+0000 7f73074c2700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73000caef0 con 0x7f730015a2b0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f7306cc1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f73000c98c0 0x7f73000cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f7306cc1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f73000c98c0 0x7f73000cb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55302/0 (socket says 172.21.15.69:55302) 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f7306cc1700 1 -- 172.21.15.69:0/360780853 learned_addr learned my addr 172.21.15.69:0/360780853 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f7305cbf700 1 --2- 172.21.15.69:0/360780853 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 0x7f73000ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f7306cc1700 1 -- 172.21.15.69:0/360780853 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 msgr2=0x7f73000ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f7306cc1700 1 --2- 172.21.15.69:0/360780853 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 0x7f73000ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f7306cc1700 1 -- 172.21.15.69:0/360780853 >> v1:172.21.15.93:6789/0 conn(0x7f7300159ed0 legacy=0x7f73000706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f7306cc1700 1 -- 172.21.15.69:0/360780853 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000cdf60 con 0x7f73000c98c0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f7306cc1700 1 --2- 172.21.15.69:0/360780853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73000c98c0 0x7f73000cb510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f72f000bbb0 tx=0x7f72f000bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff533a0d64e0aa0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73054be700 1 -- 172.21.15.69:0/360780853 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000dd30 con 0x7f73000c98c0 2023-11-17T06:31:12.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73054be700 1 -- 172.21.15.69:0/360780853 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f000de90 con 0x7f73000c98c0 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73054be700 1 -- 172.21.15.69:0/360780853 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0010690 con 0x7f73000c98c0 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73074c2700 1 -- 172.21.15.69:0/360780853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73000c98c0 msgr2=0x7f73000cb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73074c2700 1 --2- 172.21.15.69:0/360780853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73000c98c0 0x7f73000cb510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f72f000bbb0 tx=0x7f72f000bec0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73074c2700 1 -- 172.21.15.69:0/360780853 shutdown_connections 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73074c2700 1 --2- 172.21.15.69:0/360780853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f73000c98c0 0x7f73000cb510 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73074c2700 1 --2- 172.21.15.69:0/360780853 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 0x7f73000ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73074c2700 1 -- 172.21.15.69:0/360780853 >> 172.21.15.69:0/360780853 conn(0x7f73000b0900 msgr2=0x7f73000b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73074c2700 1 -- 172.21.15.69:0/360780853 shutdown_connections 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.959+0000 7f73074c2700 1 -- 172.21.15.69:0/360780853 wait complete. 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.963+0000 7f73074c2700 1 Processor -- start 2023-11-17T06:31:12.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.963+0000 7f73074c2700 1 -- start start 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f73074c2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73000c98c0 0x7f73000c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f73074c2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7300159ed0 0x7f73001f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f73074c2700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 0x7f73001f30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f73074c2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73000c84d0 con 0x7f7300159ed0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f73074c2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73001f3720 con 0x7f73000c98c0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f73074c2700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73001f3a00 con 0x7f730015a2b0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7305cbf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7300159ed0 0x7f73001f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7305cbf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7300159ed0 0x7f73001f2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55318/0 (socket says 172.21.15.69:55318) 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7305cbf700 1 -- 172.21.15.69:0/2494631425 learned_addr learned my addr 172.21.15.69:0/2494631425 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f73064c0700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73000c98c0 0x7f73000c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7306cc1700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 0x7f73001f30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7305cbf700 1 -- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 msgr2=0x7f73001f30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7305cbf700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 0x7f73001f30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7305cbf700 1 -- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73000c98c0 msgr2=0x7f73000c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7305cbf700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73000c98c0 0x7f73000c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7305cbf700 1 -- 172.21.15.69:0/2494631425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f000b810 con 0x7f7300159ed0 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7306cc1700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 0x7f73001f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f7305cbf700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7300159ed0 0x7f73001f2ba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f72f400e9d0 tx=0x7f72f400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f72feffd700 1 -- 172.21.15.69:0/2494631425 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4009720 con 0x7f7300159ed0 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f72feffd700 1 -- 172.21.15.69:0/2494631425 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f400c850 con 0x7f7300159ed0 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f72feffd700 1 -- 172.21.15.69:0/2494631425 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400cbc0 con 0x7f7300159ed0 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f73074c2700 1 -- 172.21.15.69:0/2494631425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73000c8160 con 0x7f7300159ed0 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.967+0000 7f73074c2700 1 -- 172.21.15.69:0/2494631425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73000c8ea0 con 0x7f7300159ed0 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.971+0000 7f73074c2700 1 -- 172.21.15.69:0/2494631425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7300073f00 con 0x7f7300159ed0 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.971+0000 7f72feffd700 1 -- 172.21.15.69:0/2494631425 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f72f400cd20 con 0x7f7300159ed0 2023-11-17T06:31:12.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.971+0000 7f72feffd700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f72ec066510 0x7f72ec0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.971+0000 7f72feffd700 1 -- 172.21.15.69:0/2494631425 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f72f4083f60 con 0x7f7300159ed0 2023-11-17T06:31:12.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.971+0000 7f73064c0700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f72ec066510 0x7f72ec0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.971+0000 7f73064c0700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f72ec066510 0x7f72ec0689d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72f80012e0 tx=0x7f72f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:11.979+0000 7f72feffd700 1 -- 172.21.15.69:0/2494631425 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f72f40513c0 con 0x7f7300159ed0 2023-11-17T06:31:12.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.191+0000 7f73074c2700 1 -- 172.21.15.69:0/2494631425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73000afea0 con 0x7f7300159ed0 2023-11-17T06:31:12.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f72feffd700 1 -- 172.21.15.69:0/2494631425 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f72f40549e0 con 0x7f7300159ed0 2023-11-17T06:31:12.200 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:12.200 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/1178370379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":1178370379},{"type":"v1","addr":"172.21.15.93:6835","nonce":1178370379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4238,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/2342979080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":2342979080},{"type":"v1","addr":"172.21.15.93:6837","nonce":2342979080}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/1839590536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":1839590536},{"type":"v1","addr":"172.21.15.69:6833","nonce":1839590536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:29:56.576603+0000","modified":"2023-11-17T06:29:59.616825+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.69:6835/2440982410","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2440982410},{"type":"v1","addr":"172.21.15.69:6835","nonce":2440982410}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-17T06:31:12.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 -- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f72ec066510 msgr2=0x7f72ec0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f72ec066510 0x7f72ec0689d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72f80012e0 tx=0x7f72f8009040 comp rx=0 tx=0).stop 2023-11-17T06:31:12.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 -- 172.21.15.69:0/2494631425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7300159ed0 msgr2=0x7f73001f2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7300159ed0 0x7f73001f2ba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f72f400e9d0 tx=0x7f72f400ece0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 -- 172.21.15.69:0/2494631425 shutdown_connections 2023-11-17T06:31:12.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f72ec066510 0x7f72ec0689d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f730015a2b0 0x7f73001f30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7300159ed0 0x7f73001f2ba0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 --2- 172.21.15.69:0/2494631425 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73000c98c0 0x7f73000c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 -- 172.21.15.69:0/2494631425 >> 172.21.15.69:0/2494631425 conn(0x7f73000b0900 msgr2=0x7f730006c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:12.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 -- 172.21.15.69:0/2494631425 shutdown_connections 2023-11-17T06:31:12.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.195+0000 7f73074c2700 1 -- 172.21.15.69:0/2494631425 wait complete. 2023-11-17T06:31:12.204 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-11-17T06:31:12.223 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:12.327 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:31:12.335 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:31:12.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.395+0000 7f76108b0700 1 Processor -- start 2023-11-17T06:31:12.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.395+0000 7f76108b0700 1 -- start start 2023-11-17T06:31:12.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f760c0cf150 0x7f760c15f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f760c0cb4c0 0x7f760c15b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0d04d0 con 0x7f760c158aa0 2023-11-17T06:31:12.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0cfc60 con 0x7f760c0cf150 2023-11-17T06:31:12.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0d0c60 con 0x7f760c0cb4c0 2023-11-17T06:31:12.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760affd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f760c0cf150 0x7f760c15f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760b7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f760c158aa0 0x7f760c0cea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53698/0 (socket says 172.21.15.69:53698) 2023-11-17T06:31:12.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760b7fe700 1 -- 172.21.15.69:0/1126684242 learned_addr learned my addr 172.21.15.69:0/1126684242 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:12.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760bfff700 1 --2- 172.21.15.69:0/1126684242 >> v2:172.21.15.93:3300/0 conn(0x7f760c0cb4c0 0x7f760c15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760affd700 1 -- 172.21.15.69:0/1126684242 >> v2:172.21.15.93:3300/0 conn(0x7f760c0cb4c0 msgr2=0x7f760c15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:12.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760affd700 1 --2- 172.21.15.69:0/1126684242 >> v2:172.21.15.93:3300/0 conn(0x7f760c0cb4c0 0x7f760c15b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760affd700 1 -- 172.21.15.69:0/1126684242 >> v1:172.21.15.69:6789/0 conn(0x7f760c158aa0 legacy=0x7f760c0cea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760affd700 1 -- 172.21.15.69:0/1126684242 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0cfe70 con 0x7f760c0cf150 2023-11-17T06:31:12.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760bfff700 1 --2- 172.21.15.69:0/1126684242 >> v2:172.21.15.93:3300/0 conn(0x7f760c0cb4c0 0x7f760c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:12.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760affd700 1 --2- 172.21.15.69:0/1126684242 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c0cf150 0x7f760c15f550 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f760c06fa40 tx=0x7f7600009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d18099ab5e56a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760a7fc700 1 -- 172.21.15.69:0/1126684242 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600011830 con 0x7f760c0cf150 2023-11-17T06:31:12.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760a7fc700 1 -- 172.21.15.69:0/1126684242 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7600011990 con 0x7f760c0cf150 2023-11-17T06:31:12.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f760a7fc700 1 -- 172.21.15.69:0/1126684242 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600011d40 con 0x7f760c0cf150 2023-11-17T06:31:12.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 -- 172.21.15.69:0/1126684242 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c0cf150 msgr2=0x7f760c15f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 --2- 172.21.15.69:0/1126684242 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c0cf150 0x7f760c15f550 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f760c06fa40 tx=0x7f7600009b30 comp rx=0 tx=0).stop 2023-11-17T06:31:12.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 -- 172.21.15.69:0/1126684242 shutdown_connections 2023-11-17T06:31:12.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 --2- 172.21.15.69:0/1126684242 >> v2:172.21.15.93:3300/0 conn(0x7f760c0cb4c0 0x7f760c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 --2- 172.21.15.69:0/1126684242 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c0cf150 0x7f760c15f550 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.399+0000 7f76108b0700 1 -- 172.21.15.69:0/1126684242 >> 172.21.15.69:0/1126684242 conn(0x7f760c06df60 msgr2=0x7f760c06e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:12.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.403+0000 7f76108b0700 1 -- 172.21.15.69:0/1126684242 shutdown_connections 2023-11-17T06:31:12.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.403+0000 7f76108b0700 1 -- 172.21.15.69:0/1126684242 wait complete. 2023-11-17T06:31:12.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f76108b0700 1 Processor -- start 2023-11-17T06:31:12.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f76108b0700 1 -- start start 2023-11-17T06:31:12.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f76108b0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f760c0cb4c0 0x7f760c0ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f76108b0700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f760c0cf150 0x7f760c158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f76108b0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c158aa0 0x7f760c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f76108b0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0ace30 con 0x7f760c158aa0 2023-11-17T06:31:12.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f76108b0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c158850 con 0x7f760c0cb4c0 2023-11-17T06:31:12.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f76108b0700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0ad0d0 con 0x7f760c0cf150 2023-11-17T06:31:12.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f760bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c158aa0 0x7f760c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f760bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c158aa0 0x7f760c0c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55336/0 (socket says 172.21.15.69:55336) 2023-11-17T06:31:12.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f760bfff700 1 -- 172.21.15.69:0/3249994629 learned_addr learned my addr 172.21.15.69:0/3249994629 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:12.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f760b7fe700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f760c0cb4c0 0x7f760c0ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.407+0000 7f760affd700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f760c0cf150 0x7f760c158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f760bfff700 1 -- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f760c0cf150 msgr2=0x7f760c158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f760bfff700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f760c0cf150 0x7f760c158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f760bfff700 1 -- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f760c0cb4c0 msgr2=0x7f760c0ac8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f760bfff700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f760c0cb4c0 0x7f760c0ac8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f760bfff700 1 -- 172.21.15.69:0/3249994629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76000094b0 con 0x7f760c158aa0 2023-11-17T06:31:12.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f760b7fe700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f760c0cb4c0 0x7f760c0ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:12.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f760bfff700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c158aa0 0x7f760c0c7f40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7604007df0 tx=0x7f760400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f75f3fff700 1 -- 172.21.15.69:0/3249994629 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400dd20 con 0x7f760c158aa0 2023-11-17T06:31:12.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f75f3fff700 1 -- 172.21.15.69:0/3249994629 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400f040 con 0x7f760c158aa0 2023-11-17T06:31:12.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f76108b0700 1 -- 172.21.15.69:0/3249994629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0ad3b0 con 0x7f760c158aa0 2023-11-17T06:31:12.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f75f3fff700 1 -- 172.21.15.69:0/3249994629 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604003c80 con 0x7f760c158aa0 2023-11-17T06:31:12.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f76108b0700 1 -- 172.21.15.69:0/3249994629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c15d0f0 con 0x7f760c158aa0 2023-11-17T06:31:12.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.411+0000 7f76108b0700 1 -- 172.21.15.69:0/3249994629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c06bc60 con 0x7f760c158aa0 2023-11-17T06:31:12.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.415+0000 7f75f3fff700 1 -- 172.21.15.69:0/3249994629 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7604004030 con 0x7f760c158aa0 2023-11-17T06:31:12.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.415+0000 7f75f3fff700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f75f8066510 0x7f75f80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.415+0000 7f75f3fff700 1 -- 172.21.15.69:0/3249994629 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7604083ee0 con 0x7f760c158aa0 2023-11-17T06:31:12.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.415+0000 7f760b7fe700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f75f8066510 0x7f75f80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.419+0000 7f760b7fe700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f75f8066510 0x7f75f80689d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75fc005930 tx=0x7f75fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.423+0000 7f75f3fff700 1 -- 172.21.15.69:0/3249994629 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7604051370 con 0x7f760c158aa0 2023-11-17T06:31:12.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.607+0000 7f76108b0700 1 -- 172.21.15.69:0/3249994629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f760c0686a0 con 0x7f760c158aa0 2023-11-17T06:31:12.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.607+0000 7f75f3fff700 1 -- 172.21.15.69:0/3249994629 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f7604054990 con 0x7f760c158aa0 2023-11-17T06:31:12.615 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:12.616 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:30:40.115510+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:29:54.503742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-17T06:29:55.601406+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.33","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:12.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 -- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f75f8066510 msgr2=0x7f75f80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f75f8066510 0x7f75f80689d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f75fc005930 tx=0x7f75fc009040 comp rx=0 tx=0).stop 2023-11-17T06:31:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 -- 172.21.15.69:0/3249994629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c158aa0 msgr2=0x7f760c0c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c158aa0 0x7f760c0c7f40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7604007df0 tx=0x7f760400d3b0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 -- 172.21.15.69:0/3249994629 shutdown_connections 2023-11-17T06:31:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f75f8066510 0x7f75f80689d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f760c158aa0 0x7f760c0c7f40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f760c0cf150 0x7f760c158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 --2- 172.21.15.69:0/3249994629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f760c0cb4c0 0x7f760c0ac8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 -- 172.21.15.69:0/3249994629 >> 172.21.15.69:0/3249994629 conn(0x7f760c06df60 msgr2=0x7f760c0cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 -- 172.21.15.69:0/3249994629 shutdown_connections 2023-11-17T06:31:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.611+0000 7f76108b0700 1 -- 172.21.15.69:0/3249994629 wait complete. 2023-11-17T06:31:12.640 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-17T06:31:12.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbffcfad700 1 Processor -- start 2023-11-17T06:31:12.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbffcfad700 1 -- start start 2023-11-17T06:31:12.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbffcfad700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb400 0x7fbff815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbffcfad700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbff80cba80 0x7fbff80cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbffcfad700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff80b09e0 con 0x7fbff80cb020 2023-11-17T06:31:12.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbffcfad700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff815fd90 con 0x7fbff80cba80 2023-11-17T06:31:12.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbffcfad700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80b1660 con 0x7fbff80cb400 2023-11-17T06:31:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbff659c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fbff80cb020 0x7fbff806fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53712/0 (socket says 172.21.15.69:53712) 2023-11-17T06:31:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbff659c700 1 -- 172.21.15.69:0/250850387 learned_addr learned my addr 172.21.15.69:0/250850387 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbfeffff700 1 --2- 172.21.15.69:0/250850387 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb400 0x7fbff815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbff6d9d700 1 --2- 172.21.15.69:0/250850387 >> v2:172.21.15.93:3300/0 conn(0x7fbff80cba80 0x7fbff80cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbff5d9b700 1 -- 172.21.15.69:0/250850387 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155834827 0 0) 0x7fbff80b09e0 con 0x7fbff80cb020 2023-11-17T06:31:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbff5d9b700 1 -- 172.21.15.69:0/250850387 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfe40035d0 con 0x7fbff80cb020 2023-11-17T06:31:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbfeffff700 1 -- 172.21.15.69:0/250850387 >> v2:172.21.15.93:3300/0 conn(0x7fbff80cba80 msgr2=0x7fbff80cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbfeffff700 1 --2- 172.21.15.69:0/250850387 >> v2:172.21.15.93:3300/0 conn(0x7fbff80cba80 0x7fbff80cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.859+0000 7fbfeffff700 1 -- 172.21.15.69:0/250850387 >> v1:172.21.15.69:6789/0 conn(0x7fbff80cb020 legacy=0x7fbff806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbfeffff700 1 -- 172.21.15.69:0/250850387 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff80b0cc0 con 0x7fbff80cb400 2023-11-17T06:31:12.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbfeffff700 1 --2- 172.21.15.69:0/250850387 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb400 0x7fbff815ed80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009850 tx=0x7fbfe0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=265f6876ea09c20f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbff5d9b700 1 -- 172.21.15.69:0/250850387 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0011830 con 0x7fbff80cb400 2023-11-17T06:31:12.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbff5d9b700 1 -- 172.21.15.69:0/250850387 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe0011990 con 0x7fbff80cb400 2023-11-17T06:31:12.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbff5d9b700 1 -- 172.21.15.69:0/250850387 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0011d40 con 0x7fbff80cb400 2023-11-17T06:31:12.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbffcfad700 1 -- 172.21.15.69:0/250850387 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb400 msgr2=0x7fbff815ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbffcfad700 1 --2- 172.21.15.69:0/250850387 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb400 0x7fbff815ed80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbfe0009850 tx=0x7fbfe0009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:12.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbffcfad700 1 -- 172.21.15.69:0/250850387 shutdown_connections 2023-11-17T06:31:12.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbffcfad700 1 --2- 172.21.15.69:0/250850387 >> v2:172.21.15.93:3300/0 conn(0x7fbff80cba80 0x7fbff80cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbffcfad700 1 --2- 172.21.15.69:0/250850387 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb400 0x7fbff815ed80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbffcfad700 1 -- 172.21.15.69:0/250850387 >> 172.21.15.69:0/250850387 conn(0x7fbff806a480 msgr2=0x7fbff806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:12.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbffcfad700 1 -- 172.21.15.69:0/250850387 shutdown_connections 2023-11-17T06:31:12.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.863+0000 7fbffcfad700 1 -- 172.21.15.69:0/250850387 wait complete. 2023-11-17T06:31:12.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.867+0000 7fbffcfad700 1 Processor -- start 2023-11-17T06:31:12.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.867+0000 7fbffcfad700 1 -- start start 2023-11-17T06:31:12.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.867+0000 7fbffcfad700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb020 0x7fbff814d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbffcfad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff80cb400 0x7fbff80b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbffcfad700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbff80cba80 0x7fbff80c4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbffcfad700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80b36d0 con 0x7fbff80cb400 2023-11-17T06:31:12.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbffcfad700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff8152420 con 0x7fbff80cba80 2023-11-17T06:31:12.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbffcfad700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff80b23d0 con 0x7fbff80cb020 2023-11-17T06:31:12.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff80cb400 0x7fbff80b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff80cb400 0x7fbff80b3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55350/0 (socket says 172.21.15.69:55350) 2023-11-17T06:31:12.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeffff700 1 -- 172.21.15.69:0/4205313822 learned_addr learned my addr 172.21.15.69:0/4205313822 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:12.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbff6d9d700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbff80cba80 0x7fbff80c4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbff659c700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb020 0x7fbff814d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeffff700 1 -- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb020 msgr2=0x7fbff814d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeffff700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb020 0x7fbff814d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeffff700 1 -- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbff80cba80 msgr2=0x7fbff80c4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:12.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeffff700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbff80cba80 0x7fbff80c4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:12.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeffff700 1 -- 172.21.15.69:0/4205313822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe00094b0 con 0x7fbff80cb400 2023-11-17T06:31:12.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeffff700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff80cb400 0x7fbff80b3190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00090b0 tx=0x7fbfe0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeeffd700 1 -- 172.21.15.69:0/4205313822 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe0004380 con 0x7fbff80cb400 2023-11-17T06:31:12.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeeffd700 1 -- 172.21.15.69:0/4205313822 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe001f070 con 0x7fbff80cb400 2023-11-17T06:31:12.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbffcfad700 1 -- 172.21.15.69:0/4205313822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff80b26b0 con 0x7fbff80cb400 2023-11-17T06:31:12.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbfeeffd700 1 -- 172.21.15.69:0/4205313822 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe00036c0 con 0x7fbff80cb400 2023-11-17T06:31:12.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.871+0000 7fbffcfad700 1 -- 172.21.15.69:0/4205313822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff80b2c70 con 0x7fbff80cb400 2023-11-17T06:31:12.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.875+0000 7fbffcfad700 1 -- 172.21.15.69:0/4205313822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff8073f00 con 0x7fbff80cb400 2023-11-17T06:31:12.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.875+0000 7fbfeeffd700 1 -- 172.21.15.69:0/4205313822 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbfe0021030 con 0x7fbff80cb400 2023-11-17T06:31:12.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.875+0000 7fbfeeffd700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbfd8066510 0x7fbfd80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:12.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.875+0000 7fbfeeffd700 1 -- 172.21.15.69:0/4205313822 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbfe0085190 con 0x7fbff80cb400 2023-11-17T06:31:12.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.879+0000 7fbff659c700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbfd8066510 0x7fbfd80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:12.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.879+0000 7fbff659c700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbfd8066510 0x7fbfd80689d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80011e0 tx=0x7fbfe8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:12.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:12.883+0000 7fbfeeffd700 1 -- 172.21.15.69:0/4205313822 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbfe0052600 con 0x7fbff80cb400 2023-11-17T06:31:13.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.099+0000 7fbffcfad700 1 -- 172.21.15.69:0/4205313822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fbff806c710 con 0x7fbff80cb400 2023-11-17T06:31:13.107 INFO:tasks.ceph.mon.a.smithi069.stderr:2023-11-17T06:31:13.103+0000 7f1481df4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-17T06:31:13.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.107+0000 7fbfeeffd700 1 -- 172.21.15.69:0/4205313822 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fbfe0055c20 con 0x7fbff80cb400 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.107+0000 7fbffcfad700 1 -- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbfd8066510 msgr2=0x7fbfd80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.107+0000 7fbffcfad700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbfd8066510 0x7fbfd80689d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80011e0 tx=0x7fbfe8009040 comp rx=0 tx=0).stop 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.107+0000 7fbffcfad700 1 -- 172.21.15.69:0/4205313822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff80cb400 msgr2=0x7fbff80b3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.107+0000 7fbffcfad700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff80cb400 0x7fbff80b3190 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbfe00090b0 tx=0x7fbfe0004770 comp rx=0 tx=0).stop 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.107+0000 7fbffcfad700 1 -- 172.21.15.69:0/4205313822 shutdown_connections 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.107+0000 7fbffcfad700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbfd8066510 0x7fbfd80689d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.107+0000 7fbffcfad700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbff80cba80 0x7fbff80c4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.107+0000 7fbffcfad700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbff80cb400 0x7fbff80b3190 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.107+0000 7fbffcfad700 1 --2- 172.21.15.69:0/4205313822 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbff80cb020 0x7fbff814d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.111+0000 7fbffcfad700 1 -- 172.21.15.69:0/4205313822 >> 172.21.15.69:0/4205313822 conn(0x7fbff806a480 msgr2=0x7fbff80ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:13.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.111+0000 7fbffcfad700 1 -- 172.21.15.69:0/4205313822 shutdown_connections 2023-11-17T06:31:13.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.111+0000 7fbffcfad700 1 -- 172.21.15.69:0/4205313822 wait complete. 2023-11-17T06:31:13.117 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-17T06:31:13.128 INFO:tasks.ceph.mds.c.smithi069.stderr: -4102> 2023-11-17T06:30:02.740+0000 7f0119ae5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:31:13.136 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-17T06:31:13.186 INFO:tasks.ceph.mds.c.smithi069.stdout:starting mds.c at 2023-11-17T06:31:13.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.311+0000 7f6bb9e63700 1 Processor -- start 2023-11-17T06:31:13.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.311+0000 7f6bb9e63700 1 -- start start 2023-11-17T06:31:13.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb9e63700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 0x7f6bb40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb9e63700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb40d1bb0 con 0x7f6bb40d13d0 2023-11-17T06:31:13.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb9e63700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb40d1e90 con 0x7f6bb40ce4e0 2023-11-17T06:31:13.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb9e63700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40d2170 con 0x7f6bb415d490 2023-11-17T06:31:13.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb2ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6bb40d13d0 0x7f6bb40cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53716/0 (socket says 172.21.15.69:53716) 2023-11-17T06:31:13.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb2ffd700 1 -- 172.21.15.69:0/3836165655 learned_addr learned my addr 172.21.15.69:0/3836165655 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:13.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb37fe700 1 --2- 172.21.15.69:0/3836165655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 0x7f6bb40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb27fc700 1 -- 172.21.15.69:0/3836165655 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236189420 0 0) 0x7f6bb40d1bb0 con 0x7f6bb40d13d0 2023-11-17T06:31:13.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb27fc700 1 -- 172.21.15.69:0/3836165655 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b9c0035d0 con 0x7f6bb40d13d0 2023-11-17T06:31:13.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb27fc700 1 -- 172.21.15.69:0/3836165655 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555807537 0 0) 0x7f6bb40d1e90 con 0x7f6bb40ce4e0 2023-11-17T06:31:13.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb27fc700 1 -- 172.21.15.69:0/3836165655 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bb40d1bb0 con 0x7f6bb40ce4e0 2023-11-17T06:31:13.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb37fe700 1 -- 172.21.15.69:0/3836165655 >> v1:172.21.15.93:6789/0 conn(0x7f6bb40ce4e0 legacy=0x7f6bb40b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb37fe700 1 -- 172.21.15.69:0/3836165655 >> v1:172.21.15.69:6789/0 conn(0x7f6bb40d13d0 legacy=0x7f6bb40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.315+0000 7f6bb37fe700 1 -- 172.21.15.69:0/3836165655 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40d2450 con 0x7f6bb415d490 2023-11-17T06:31:13.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb37fe700 1 --2- 172.21.15.69:0/3836165655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 0x7f6bb40b8bc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009880 tx=0x7f6ba4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1997a13f7d5876c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:13.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb27fc700 1 -- 172.21.15.69:0/3836165655 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011830 con 0x7f6bb415d490 2023-11-17T06:31:13.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb27fc700 1 -- 172.21.15.69:0/3836165655 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4011990 con 0x7f6bb415d490 2023-11-17T06:31:13.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb27fc700 1 -- 172.21.15.69:0/3836165655 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4011d20 con 0x7f6bb415d490 2023-11-17T06:31:13.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb9e63700 1 -- 172.21.15.69:0/3836165655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 msgr2=0x7f6bb40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb9e63700 1 --2- 172.21.15.69:0/3836165655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 0x7f6bb40b8bc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009880 tx=0x7f6ba4009b90 comp rx=0 tx=0).stop 2023-11-17T06:31:13.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb9e63700 1 -- 172.21.15.69:0/3836165655 shutdown_connections 2023-11-17T06:31:13.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb9e63700 1 --2- 172.21.15.69:0/3836165655 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 0x7f6bb40b8bc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb9e63700 1 -- 172.21.15.69:0/3836165655 >> 172.21.15.69:0/3836165655 conn(0x7f6bb406ab40 msgr2=0x7f6bb406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:13.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb9e63700 1 -- 172.21.15.69:0/3836165655 shutdown_connections 2023-11-17T06:31:13.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.319+0000 7f6bb9e63700 1 -- 172.21.15.69:0/3836165655 wait complete. 2023-11-17T06:31:13.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.323+0000 7f6bb9e63700 1 Processor -- start 2023-11-17T06:31:13.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.323+0000 7f6bb9e63700 1 -- start start 2023-11-17T06:31:13.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.323+0000 7f6bb9e63700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb40ce4e0 0x7f6bb4152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.323+0000 7f6bb9e63700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb40d13d0 0x7f6bb41f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.323+0000 7f6bb9e63700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 0x7f6bb40ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.323+0000 7f6bb9e63700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40cde40 con 0x7f6bb40d13d0 2023-11-17T06:31:13.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.323+0000 7f6bb9e63700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40cab20 con 0x7f6bb40ce4e0 2023-11-17T06:31:13.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.323+0000 7f6bb9e63700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb40cae00 con 0x7f6bb415d490 2023-11-17T06:31:13.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb40d13d0 0x7f6bb41f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb40d13d0 0x7f6bb41f24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55388/0 (socket says 172.21.15.69:55388) 2023-11-17T06:31:13.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb2ffd700 1 -- 172.21.15.69:0/346434570 learned_addr learned my addr 172.21.15.69:0/346434570 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:13.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb3fff700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 0x7f6bb40ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb37fe700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb40ce4e0 0x7f6bb4152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb2ffd700 1 -- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 msgr2=0x7f6bb40ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb2ffd700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 0x7f6bb40ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb2ffd700 1 -- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb40ce4e0 msgr2=0x7f6bb4152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:13.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb2ffd700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb40ce4e0 0x7f6bb4152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:13.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb2ffd700 1 -- 172.21.15.69:0/346434570 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba40094b0 con 0x7f6bb40d13d0 2023-11-17T06:31:13.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb2ffd700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb40d13d0 0x7f6bb41f24b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800c560 tx=0x7f6ba800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:13.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6b9bfff700 1 -- 172.21.15.69:0/346434570 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8005d90 con 0x7f6bb40d13d0 2023-11-17T06:31:13.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6b9bfff700 1 -- 172.21.15.69:0/346434570 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba80070d0 con 0x7f6bb40d13d0 2023-11-17T06:31:13.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb9e63700 1 -- 172.21.15.69:0/346434570 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb40cb0e0 con 0x7f6bb40d13d0 2023-11-17T06:31:13.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6b9bfff700 1 -- 172.21.15.69:0/346434570 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8007460 con 0x7f6bb40d13d0 2023-11-17T06:31:13.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb9e63700 1 -- 172.21.15.69:0/346434570 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb40cb6a0 con 0x7f6bb40d13d0 2023-11-17T06:31:13.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.327+0000 7f6bb9e63700 1 -- 172.21.15.69:0/346434570 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb4073f00 con 0x7f6bb40d13d0 2023-11-17T06:31:13.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.331+0000 7f6b9bfff700 1 -- 172.21.15.69:0/346434570 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6ba80075c0 con 0x7f6bb40d13d0 2023-11-17T06:31:13.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.331+0000 7f6b9bfff700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6ba0066540 0x7f6ba0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:13.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.331+0000 7f6b9bfff700 1 -- 172.21.15.69:0/346434570 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f6ba8083300 con 0x7f6bb40d13d0 2023-11-17T06:31:13.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.331+0000 7f6bb37fe700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6ba0066540 0x7f6ba0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:13.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.335+0000 7f6bb37fe700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6ba0066540 0x7f6ba0068a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40090b0 tx=0x7f6ba401c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:13.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.339+0000 7f6b9bfff700 1 -- 172.21.15.69:0/346434570 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6ba8050720 con 0x7f6bb40d13d0 2023-11-17T06:31:13.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:13.551+0000 7f6bb9e63700 1 -- 172.21.15.69:0/346434570 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6bb40b86a0 con 0x7f6bb40d13d0 2023-11-17T06:31:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.111+0000 7f6b9bfff700 1 -- 172.21.15.69:0/346434570 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6ba8053d40 con 0x7f6bb40d13d0 2023-11-17T06:31:14.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 -- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6ba0066540 msgr2=0x7f6ba0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:14.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6ba0066540 0x7f6ba0068a00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6ba40090b0 tx=0x7f6ba401c040 comp rx=0 tx=0).stop 2023-11-17T06:31:14.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 -- 172.21.15.69:0/346434570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb40d13d0 msgr2=0x7f6bb41f24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:14.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb40d13d0 0x7f6bb41f24b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800c560 tx=0x7f6ba800c870 comp rx=0 tx=0).stop 2023-11-17T06:31:14.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 -- 172.21.15.69:0/346434570 shutdown_connections 2023-11-17T06:31:14.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6ba0066540 0x7f6ba0068a00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6bb415d490 0x7f6bb40ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb40d13d0 0x7f6bb41f24b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 --2- 172.21.15.69:0/346434570 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6bb40ce4e0 0x7f6bb4152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 -- 172.21.15.69:0/346434570 >> 172.21.15.69:0/346434570 conn(0x7f6bb406ab40 msgr2=0x7f6bb40cfa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:14.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 -- 172.21.15.69:0/346434570 shutdown_connections 2023-11-17T06:31:14.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.115+0000 7f6bb9e63700 1 -- 172.21.15.69:0/346434570 wait complete. 2023-11-17T06:31:14.144 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-17T06:31:14.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.375+0000 7f6cda9dc700 1 Processor -- start 2023-11-17T06:31:14.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.375+0000 7f6cda9dc700 1 -- start start 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cda9dc700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6cd415b020 0x7f6cd415d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cda9dc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6cd40d03d0 0x7f6cd4161660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cda9dc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6cd4161ba0 0x7f6cd40d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cda9dc700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd415b400 con 0x7f6cd4161ba0 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cda9dc700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd4160f30 con 0x7f6cd415b020 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cda9dc700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd415e170 con 0x7f6cd40d03d0 2023-11-17T06:31:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd8f79700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6cd4161ba0 0x7f6cd40d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd8f79700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6cd4161ba0 0x7f6cd40d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40742/0 (socket says 172.21.15.69:40742) 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd8f79700 1 -- 172.21.15.69:0/2951655908 learned_addr learned my addr 172.21.15.69:0/2951655908 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd37fe700 1 --2- 172.21.15.69:0/2951655908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6cd40d03d0 0x7f6cd4161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:14.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd3fff700 1 --2- 172.21.15.69:0/2951655908 >> v2:172.21.15.93:3300/0 conn(0x7f6cd415b020 0x7f6cd415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd8f79700 1 -- 172.21.15.69:0/2951655908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6cd40d03d0 msgr2=0x7f6cd4161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd8f79700 1 --2- 172.21.15.69:0/2951655908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6cd40d03d0 0x7f6cd4161660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd8f79700 1 -- 172.21.15.69:0/2951655908 >> v2:172.21.15.93:3300/0 conn(0x7f6cd415b020 msgr2=0x7f6cd415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd8f79700 1 --2- 172.21.15.69:0/2951655908 >> v2:172.21.15.93:3300/0 conn(0x7f6cd415b020 0x7f6cd415d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd8f79700 1 -- 172.21.15.69:0/2951655908 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd415e450 con 0x7f6cd4161ba0 2023-11-17T06:31:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.379+0000 7f6cd3fff700 1 --2- 172.21.15.69:0/2951655908 >> v2:172.21.15.93:3300/0 conn(0x7f6cd415b020 0x7f6cd415d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cd8f79700 1 --2- 172.21.15.69:0/2951655908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd4161ba0 0x7f6cd40d1550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6cd406bd10 tx=0x7f6ccc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8813802dd03cacc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cd2ffd700 1 -- 172.21.15.69:0/2951655908 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc00e070 con 0x7f6cd4161ba0 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cd2ffd700 1 -- 172.21.15.69:0/2951655908 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc00b910 con 0x7f6cd4161ba0 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cd2ffd700 1 -- 172.21.15.69:0/2951655908 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc00bcc0 con 0x7f6cd4161ba0 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2951655908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd4161ba0 msgr2=0x7f6cd40d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cda9dc700 1 --2- 172.21.15.69:0/2951655908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd4161ba0 0x7f6cd40d1550 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6cd406bd10 tx=0x7f6ccc00b330 comp rx=0 tx=0).stop 2023-11-17T06:31:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2951655908 shutdown_connections 2023-11-17T06:31:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cda9dc700 1 --2- 172.21.15.69:0/2951655908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd4161ba0 0x7f6cd40d1550 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cda9dc700 1 --2- 172.21.15.69:0/2951655908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6cd40d03d0 0x7f6cd4161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cda9dc700 1 --2- 172.21.15.69:0/2951655908 >> v2:172.21.15.93:3300/0 conn(0x7f6cd415b020 0x7f6cd415d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2951655908 >> 172.21.15.69:0/2951655908 conn(0x7f6cd406acd0 msgr2=0x7f6cd406b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2951655908 shutdown_connections 2023-11-17T06:31:14.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.383+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2951655908 wait complete. 2023-11-17T06:31:14.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.387+0000 7f6cda9dc700 1 Processor -- start 2023-11-17T06:31:14.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.387+0000 7f6cda9dc700 1 -- start start 2023-11-17T06:31:14.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cda9dc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6cd40d03d0 0x7f6cd40b3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:14.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cda9dc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd415b020 0x7f6cd41577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:14.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cda9dc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6cd4161ba0 0x7f6cd40b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:14.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cda9dc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd415ecf0 con 0x7f6cd415b020 2023-11-17T06:31:14.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cda9dc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd40cd1f0 con 0x7f6cd40d03d0 2023-11-17T06:31:14.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cda9dc700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd41f63c0 con 0x7f6cd4161ba0 2023-11-17T06:31:14.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd415b020 0x7f6cd41577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:14.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd415b020 0x7f6cd41577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40756/0 (socket says 172.21.15.69:40756) 2023-11-17T06:31:14.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd37fe700 1 -- 172.21.15.69:0/2787790694 learned_addr learned my addr 172.21.15.69:0/2787790694 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:14.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd8f79700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6cd4161ba0 0x7f6cd40b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:14.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd3fff700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6cd40d03d0 0x7f6cd40b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:14.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd37fe700 1 -- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6cd4161ba0 msgr2=0x7f6cd40b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:14.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd37fe700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6cd4161ba0 0x7f6cd40b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd37fe700 1 -- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6cd40d03d0 msgr2=0x7f6cd40b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:14.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd37fe700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6cd40d03d0 0x7f6cd40b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:14.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd37fe700 1 -- 172.21.15.69:0/2787790694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ccc009b30 con 0x7f6cd415b020 2023-11-17T06:31:14.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd37fe700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd415b020 0x7f6cd41577f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800e870 tx=0x7f6cc800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:14.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd0ff9700 1 -- 172.21.15.69:0/2787790694 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc80095c0 con 0x7f6cd415b020 2023-11-17T06:31:14.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd0ff9700 1 -- 172.21.15.69:0/2787790694 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc8013680 con 0x7f6cd415b020 2023-11-17T06:31:14.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cd0ff9700 1 -- 172.21.15.69:0/2787790694 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8013a10 con 0x7f6cd415b020 2023-11-17T06:31:14.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2787790694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd41f66a0 con 0x7f6cd415b020 2023-11-17T06:31:14.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.391+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2787790694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd41f6c60 con 0x7f6cd415b020 2023-11-17T06:31:14.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.395+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2787790694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd4068330 con 0x7f6cd415b020 2023-11-17T06:31:14.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.395+0000 7f6cd0ff9700 1 -- 172.21.15.69:0/2787790694 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6cc8013b90 con 0x7f6cd415b020 2023-11-17T06:31:14.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.399+0000 7f6cd0ff9700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6cc0066510 0x7f6cc00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:14.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.399+0000 7f6cd0ff9700 1 -- 172.21.15.69:0/2787790694 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f6cc8083d30 con 0x7f6cd415b020 2023-11-17T06:31:14.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.399+0000 7f6cd3fff700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6cc0066510 0x7f6cc00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:14.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.399+0000 7f6cd3fff700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6cc0066510 0x7f6cc00689d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4004430 tx=0x7f6cc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:14.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.403+0000 7f6cd0ff9700 1 -- 172.21.15.69:0/2787790694 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6cc8051140 con 0x7f6cd415b020 2023-11-17T06:31:14.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:14.583+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2787790694 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6cd415ee30 con 0x7f6cd415b020 2023-11-17T06:31:15.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.123+0000 7f6cd0ff9700 1 -- 172.21.15.69:0/2787790694 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6cc80170d0 con 0x7f6cd415b020 2023-11-17T06:31:15.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6cc0066510 msgr2=0x7f6cc00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:15.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6cc0066510 0x7f6cc00689d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4004430 tx=0x7f6cc4008040 comp rx=0 tx=0).stop 2023-11-17T06:31:15.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2787790694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd415b020 msgr2=0x7f6cd41577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:15.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd415b020 0x7f6cd41577f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6cc800e870 tx=0x7f6cc800eb80 comp rx=0 tx=0).stop 2023-11-17T06:31:15.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2787790694 shutdown_connections 2023-11-17T06:31:15.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6cc0066510 0x7f6cc00689d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6cd4161ba0 0x7f6cd40b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cd415b020 0x7f6cd41577f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 --2- 172.21.15.69:0/2787790694 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6cd40d03d0 0x7f6cd40b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2787790694 >> 172.21.15.69:0/2787790694 conn(0x7f6cd406acd0 msgr2=0x7f6cd415ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:15.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2787790694 shutdown_connections 2023-11-17T06:31:15.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.127+0000 7f6cda9dc700 1 -- 172.21.15.69:0/2787790694 wait complete. 2023-11-17T06:31:15.135 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' removed 2023-11-17T06:31:15.163 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-17T06:31:15.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.343+0000 7f3226d5b700 1 Processor -- start 2023-11-17T06:31:15.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.343+0000 7f3226d5b700 1 -- start start 2023-11-17T06:31:15.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f3226d5b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f322015b0a0 0x7f32200ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:15.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f3226d5b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32200ce010 0x7f322015b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:15.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f3226d5b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322006df30 con 0x7f32200cb4e0 2023-11-17T06:31:15.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f3226d5b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322006e180 con 0x7f322015b0a0 2023-11-17T06:31:15.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f3226d5b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322006e460 con 0x7f32200ce010 2023-11-17T06:31:15.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321ffff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f32200cb4e0 0x7f32200cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43480/0 (socket says 172.21.15.69:43480) 2023-11-17T06:31:15.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321ffff700 1 -- 172.21.15.69:0/2669312942 learned_addr learned my addr 172.21.15.69:0/2669312942 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:15.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f3224af7700 1 --2- 172.21.15.69:0/2669312942 >> v2:172.21.15.93:3300/0 conn(0x7f322015b0a0 0x7f32200ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f32252f8700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32200ce010 0x7f322015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697920037 0 0) 0x7f322006df30 con 0x7f32200cb4e0 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32100035d0 con 0x7f32200cb4e0 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3926310410 0 0) 0x7f32100035d0 con 0x7f32200cb4e0 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32200ce010 msgr2=0x7f322015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32200ce010 0x7f322015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 >> v2:172.21.15.93:3300/0 conn(0x7f322015b0a0 msgr2=0x7f32200ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 --2- 172.21.15.69:0/2669312942 >> v2:172.21.15.93:3300/0 conn(0x7f322015b0a0 0x7f32200ccfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322006e740 con 0x7f32200cb4e0 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f320c001670 con 0x7f32200cb4e0 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 >> v1:172.21.15.69:6789/0 conn(0x7f32200cb4e0 legacy=0x7f32200cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:15.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3210003a20 0x7f3210003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:15.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3210004870 0x7f3210004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:15.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210005230 0x7f321000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:15.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322006e180 con 0x7f3210003a20 2023-11-17T06:31:15.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322006e460 con 0x7f3210005230 2023-11-17T06:31:15.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321000bfc0 con 0x7f3210004870 2023-11-17T06:31:15.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f3224af7700 1 --2- 172.21.15.69:0/2669312942 >> v2:172.21.15.93:3300/0 conn(0x7f322015b0a0 0x7f32200ccfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:15.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f32252f8700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32200ce010 0x7f322015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:15.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f3224af7700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3210003a20 0x7f3210003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:15.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f32252f8700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210005230 0x7f321000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:15.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.347+0000 7f321ffff700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3210004870 0x7f3210004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3224af7700 1 -- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3210004870 msgr2=0x7f3210004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3224af7700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3210004870 0x7f3210004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3224af7700 1 -- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210005230 msgr2=0x7f321000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3224af7700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210005230 0x7f321000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3224af7700 1 -- 172.21.15.69:0/2669312942 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32100035d0 con 0x7f3210003a20 2023-11-17T06:31:15.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f32252f8700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210005230 0x7f321000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f321ffff700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3210004870 0x7f3210004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3224af7700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3210003a20 0x7f3210003e40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3214009d50 tx=0x7f32100058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696e3977e146b914 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214009ea0 con 0x7f3210003a20 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321400e9a0 con 0x7f3210003a20 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f321f7fe700 1 -- 172.21.15.69:0/2669312942 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321400ed10 con 0x7f3210003a20 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3226d5b700 1 -- 172.21.15.69:0/2669312942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3210003a20 msgr2=0x7f3210003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3226d5b700 1 --2- 172.21.15.69:0/2669312942 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3210003a20 0x7f3210003e40 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3214009d50 tx=0x7f32100058a0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f32252f8700 1 -- 172.21.15.69:0/2669312942 reap_dead start 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3226d5b700 1 -- 172.21.15.69:0/2669312942 shutdown_connections 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3226d5b700 1 -- 172.21.15.69:0/2669312942 >> 172.21.15.69:0/2669312942 conn(0x7f3220072360 msgr2=0x7f3220065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3226d5b700 1 -- 172.21.15.69:0/2669312942 shutdown_connections 2023-11-17T06:31:15.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.351+0000 7f3226d5b700 1 -- 172.21.15.69:0/2669312942 wait complete. 2023-11-17T06:31:15.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.355+0000 7f3226d5b700 1 Processor -- start 2023-11-17T06:31:15.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.355+0000 7f3226d5b700 1 -- start start 2023-11-17T06:31:15.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f3226d5b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210003a20 0x7f32200b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:15.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f3226d5b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32201585c0 0x7f32200c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:15.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f3226d5b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f322015cf30 0x7f322015d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:15.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f3226d5b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32201f2960 con 0x7f322015cf30 2023-11-17T06:31:15.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f3226d5b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322015d8f0 con 0x7f3210003a20 2023-11-17T06:31:15.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f3226d5b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32201f3780 con 0x7f32201585c0 2023-11-17T06:31:15.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f32252f8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f322015cf30 0x7f322015d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:15.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f32252f8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f322015cf30 0x7f322015d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40778/0 (socket says 172.21.15.69:40778) 2023-11-17T06:31:15.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f3224af7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210003a20 0x7f32200b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:15.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f32252f8700 1 -- 172.21.15.69:0/1734161 learned_addr learned my addr 172.21.15.69:0/1734161 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:15.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f321ffff700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32201585c0 0x7f32200c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:15.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f32252f8700 1 -- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32201585c0 msgr2=0x7f32200c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:15.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f32252f8700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32201585c0 0x7f32200c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f32252f8700 1 -- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210003a20 msgr2=0x7f32200b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:15.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f32252f8700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210003a20 0x7f32200b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:15.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f32252f8700 1 -- 172.21.15.69:0/1734161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32201f2b70 con 0x7f322015cf30 2023-11-17T06:31:15.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f3224af7700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210003a20 0x7f32200b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:15.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f321ffff700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32201585c0 0x7f32200c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:15.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f32252f8700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f322015cf30 0x7f322015d3b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32200b3130 tx=0x7f321800f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:15.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f321d7fa700 1 -- 172.21.15.69:0/1734161 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f321800e040 con 0x7f322015cf30 2023-11-17T06:31:15.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f321d7fa700 1 -- 172.21.15.69:0/1734161 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f321800f040 con 0x7f322015cf30 2023-11-17T06:31:15.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f321d7fa700 1 -- 172.21.15.69:0/1734161 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3218011ee0 con 0x7f322015cf30 2023-11-17T06:31:15.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f3226d5b700 1 -- 172.21.15.69:0/1734161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32201f2e50 con 0x7f322015cf30 2023-11-17T06:31:15.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.359+0000 7f3226d5b700 1 -- 172.21.15.69:0/1734161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32201f3410 con 0x7f322015cf30 2023-11-17T06:31:15.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.363+0000 7f3226d5b700 1 -- 172.21.15.69:0/1734161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3220073f00 con 0x7f322015cf30 2023-11-17T06:31:15.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.363+0000 7f321d7fa700 1 -- 172.21.15.69:0/1734161 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3218003cd0 con 0x7f322015cf30 2023-11-17T06:31:15.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.363+0000 7f321d7fa700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3204066510 0x7f32040689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:15.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.363+0000 7f321d7fa700 1 -- 172.21.15.69:0/1734161 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f3218006e40 con 0x7f322015cf30 2023-11-17T06:31:15.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.367+0000 7f3224af7700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3204066510 0x7f32040689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:15.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.367+0000 7f3224af7700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3204066510 0x7f32040689d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3214009c70 tx=0x7f3214008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:15.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.371+0000 7f321d7fa700 1 -- 172.21.15.69:0/1734161 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3218051990 con 0x7f322015cf30 2023-11-17T06:31:15.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:15.547+0000 7f3226d5b700 1 -- 172.21.15.69:0/1734161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32200b3160 con 0x7f322015cf30 2023-11-17T06:31:16.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.138+0000 7f321d7fa700 1 -- 172.21.15.69:0/1734161 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3218082e60 con 0x7f322015cf30 2023-11-17T06:31:16.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 -- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3204066510 msgr2=0x7f32040689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3204066510 0x7f32040689d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3214009c70 tx=0x7f3214008030 comp rx=0 tx=0).stop 2023-11-17T06:31:16.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 -- 172.21.15.69:0/1734161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f322015cf30 msgr2=0x7f322015d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f322015cf30 0x7f322015d3b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f32200b3130 tx=0x7f321800f6c0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 -- 172.21.15.69:0/1734161 shutdown_connections 2023-11-17T06:31:16.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3204066510 0x7f32040689d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f322015cf30 0x7f322015d3b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f32201585c0 0x7f32200c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 --2- 172.21.15.69:0/1734161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3210003a20 0x7f32200b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 -- 172.21.15.69:0/1734161 >> 172.21.15.69:0/1734161 conn(0x7f3220072360 msgr2=0x7f322015a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:16.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 -- 172.21.15.69:0/1734161 shutdown_connections 2023-11-17T06:31:16.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.142+0000 7f3226d5b700 1 -- 172.21.15.69:0/1734161 wait complete. 2023-11-17T06:31:16.152 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' removed 2023-11-17T06:31:16.176 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-17T06:31:16.176 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-17T06:31:16.176 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-17T06:31:16.176 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:31:16.176 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-17T06:31:16.177 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-17T06:31:16.177 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-17T06:31:16.177 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:31:16.177 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-17T06:31:16.177 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-17T06:31:16.177 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-17T06:31:16.178 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:31:16.178 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-17T06:31:16.178 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-17T06:31:16.178 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-17T06:31:16.178 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:31:16.196 INFO:tasks.ceph.mds.a:Stopped 2023-11-17T06:31:16.196 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-17T06:31:16.197 INFO:tasks.ceph.mds.c:Stopped 2023-11-17T06:31:16.197 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-17T06:31:16.198 INFO:tasks.ceph.mds.d:Stopped 2023-11-17T06:31:16.198 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-17T06:31:16.201 INFO:tasks.ceph.mds.b:Stopped 2023-11-17T06:31:16.201 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-17T06:31:16.242 INFO:tasks.ceph.mds.a:Started 2023-11-17T06:31:16.242 DEBUG:teuthology.parallel:result is None 2023-11-17T06:31:16.246 INFO:tasks.ceph.mds.c:Started 2023-11-17T06:31:16.246 DEBUG:teuthology.parallel:result is None 2023-11-17T06:31:16.252 INFO:tasks.ceph.mds.d:Started 2023-11-17T06:31:16.253 DEBUG:teuthology.parallel:result is None 2023-11-17T06:31:16.256 INFO:tasks.ceph.mds.b:Started 2023-11-17T06:31:16.256 DEBUG:teuthology.parallel:result is None 2023-11-17T06:31:16.256 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-17T06:31:16.351 INFO:tasks.ceph.mds.a.smithi069.stdout:starting mds.a at 2023-11-17T06:31:16.357 INFO:tasks.ceph.mds.c.smithi069.stdout:starting mds.c at 2023-11-17T06:31:16.368 INFO:tasks.ceph.mds.b.smithi093.stdout:starting mds.b at 2023-11-17T06:31:16.376 INFO:tasks.ceph.mds.d.smithi093.stdout:starting mds.d at 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.418+0000 7f92cf59e700 1 Processor -- start 2023-11-17T06:31:16.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.418+0000 7f92cf59e700 1 -- start start 2023-11-17T06:31:16.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.418+0000 7f92cf59e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f92c80e12f0 0x7f92c8007400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.418+0000 7f92cf59e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f92c8038940 0x7f92c803a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.418+0000 7f92cf59e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c8007940 con 0x7f92c8051130 2023-11-17T06:31:16.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.418+0000 7f92cf59e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c8006f70 con 0x7f92c8038940 2023-11-17T06:31:16.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.418+0000 7f92cf59e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c80e16d0 con 0x7f92c80e12f0 2023-11-17T06:31:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cdd9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f92c8038940 0x7f92c803a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92ce59c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f92c80e12f0 0x7f92c8007400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92ced9d700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f92c8051130 0x7f92c804bd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:55936/0 (socket says 172.21.15.69:55936) 2023-11-17T06:31:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92ced9d700 1 -- 172.21.15.69:0/1910987179 learned_addr learned my addr 172.21.15.69:0/1910987179 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cd59a700 1 -- 172.21.15.69:0/1910987179 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461717737 0 0) 0x7f92d004f510 con 0x7f92c8051130 2023-11-17T06:31:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cdd9b700 1 -- 172.21.15.69:0/1910987179 >> v2:172.21.15.93:3300/0 conn(0x7f92c80e12f0 msgr2=0x7f92c8007400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cdd9b700 1 --2- 172.21.15.69:0/1910987179 >> v2:172.21.15.93:3300/0 conn(0x7f92c80e12f0 0x7f92c8007400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cdd9b700 1 -- 172.21.15.69:0/1910987179 >> v1:172.21.15.93:6789/0 conn(0x7f92c8051130 legacy=0x7f92c804bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cdd9b700 1 -- 172.21.15.69:0/1910987179 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8006360 con 0x7f92c8038940 2023-11-17T06:31:16.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cdd9b700 1 --2- 172.21.15.69:0/1910987179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92c8038940 0x7f92c803a090 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f92c800c690 tx=0x7f92c4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5356591347d8b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:16.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cd59a700 1 -- 172.21.15.69:0/1910987179 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4011830 con 0x7f92c8038940 2023-11-17T06:31:16.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cd59a700 1 -- 172.21.15.69:0/1910987179 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c4011990 con 0x7f92c8038940 2023-11-17T06:31:16.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cd59a700 1 -- 172.21.15.69:0/1910987179 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c4011d20 con 0x7f92c8038940 2023-11-17T06:31:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cf59e700 1 -- 172.21.15.69:0/1910987179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92c8038940 msgr2=0x7f92c803a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cf59e700 1 --2- 172.21.15.69:0/1910987179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92c8038940 0x7f92c803a090 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f92c800c690 tx=0x7f92c4009b30 comp rx=0 tx=0).stop 2023-11-17T06:31:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cf59e700 1 -- 172.21.15.69:0/1910987179 shutdown_connections 2023-11-17T06:31:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cf59e700 1 --2- 172.21.15.69:0/1910987179 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92c8038940 0x7f92c803a090 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cf59e700 1 --2- 172.21.15.69:0/1910987179 >> v2:172.21.15.93:3300/0 conn(0x7f92c80e12f0 0x7f92c8007400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cf59e700 1 -- 172.21.15.69:0/1910987179 >> 172.21.15.69:0/1910987179 conn(0x7f92c8054c90 msgr2=0x7f92c80550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cf59e700 1 -- 172.21.15.69:0/1910987179 shutdown_connections 2023-11-17T06:31:16.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.422+0000 7f92cf59e700 1 -- 172.21.15.69:0/1910987179 wait complete. 2023-11-17T06:31:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.426+0000 7f92cf59e700 1 Processor -- start 2023-11-17T06:31:16.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.426+0000 7f92cf59e700 1 -- start start 2023-11-17T06:31:16.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92cf59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f92c8038940 0x7f92c8030dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92cf59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92c8051130 0x7f92c8033120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92cf59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f92c80e12f0 0x7f92c80ded80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92cf59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80320b0 con 0x7f92c8051130 2023-11-17T06:31:16.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92cf59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8032540 con 0x7f92c8038940 2023-11-17T06:31:16.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92cf59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80314a0 con 0x7f92c80e12f0 2023-11-17T06:31:16.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ced9d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f92c80e12f0 0x7f92c80ded80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ce59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f92c8038940 0x7f92c8030dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92cdd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92c8051130 0x7f92c8033120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ced9d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f92c80e12f0 0x7f92c80ded80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:58280/0 (socket says 172.21.15.69:58280) 2023-11-17T06:31:16.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ced9d700 1 -- 172.21.15.69:0/2191227998 learned_addr learned my addr 172.21.15.69:0/2191227998 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:16.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ce59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f92c8038940 0x7f92c8030dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:46826/0 (socket says 172.21.15.69:46826) 2023-11-17T06:31:16.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ced9d700 1 -- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f92c8038940 msgr2=0x7f92c8030dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ced9d700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f92c8038940 0x7f92c8030dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ced9d700 1 -- 172.21.15.69:0/2191227998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92c8051130 msgr2=0x7f92c8033120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ced9d700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92c8051130 0x7f92c8033120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ced9d700 1 -- 172.21.15.69:0/2191227998 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40094b0 con 0x7f92c80e12f0 2023-11-17T06:31:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92ced9d700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f92c80e12f0 0x7f92c80ded80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f92d00689a0 tx=0x7f92d0068250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92beffd700 1 -- 172.21.15.69:0/2191227998 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0072850 con 0x7f92c80e12f0 2023-11-17T06:31:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92beffd700 1 -- 172.21.15.69:0/2191227998 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d008e070 con 0x7f92c80e12f0 2023-11-17T06:31:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92cf59e700 1 -- 172.21.15.69:0/2191227998 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c8031780 con 0x7f92c80e12f0 2023-11-17T06:31:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92beffd700 1 -- 172.21.15.69:0/2191227998 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0067490 con 0x7f92c80e12f0 2023-11-17T06:31:16.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.430+0000 7f92cf59e700 1 -- 172.21.15.69:0/2191227998 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c8031d40 con 0x7f92c80e12f0 2023-11-17T06:31:16.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.434+0000 7f92cf59e700 1 -- 172.21.15.69:0/2191227998 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c8032220 con 0x7f92c80e12f0 2023-11-17T06:31:16.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.434+0000 7f92beffd700 1 -- 172.21.15.69:0/2191227998 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f92d00675f0 con 0x7f92c80e12f0 2023-11-17T06:31:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.434+0000 7f92beffd700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f92b0066510 0x7f92b00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.438+0000 7f92beffd700 1 -- 172.21.15.69:0/2191227998 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f92d00fe8e0 con 0x7f92c80e12f0 2023-11-17T06:31:16.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.438+0000 7f92ce59c700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f92b0066510 0x7f92b00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:16.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.438+0000 7f92ce59c700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f92b0066510 0x7f92b00689d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009b50 tx=0x7f92c0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:16.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.446+0000 7f92beffd700 1 -- 172.21.15.69:0/2191227998 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f92d00cc060 con 0x7f92c80e12f0 2023-11-17T06:31:16.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:16.638+0000 7f92cf59e700 1 -- 172.21.15.69:0/2191227998 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f92c8007940 con 0x7f92c80e12f0 2023-11-17T06:31:18.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.070+0000 7f92beffd700 1 -- 172.21.15.69:0/2191227998 <== mon.2 v2:172.21.15.93:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f92c8007940 con 0x7f92c80e12f0 2023-11-17T06:31:18.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 -- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f92b0066510 msgr2=0x7f92b00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f92b0066510 0x7f92b00689d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009b50 tx=0x7f92c0009240 comp rx=0 tx=0).stop 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 -- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f92c80e12f0 msgr2=0x7f92c80ded80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f92c80e12f0 0x7f92c80ded80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f92d00689a0 tx=0x7f92d0068250 comp rx=0 tx=0).stop 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 -- 172.21.15.69:0/2191227998 shutdown_connections 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f92b0066510 0x7f92b00689d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f92c80e12f0 0x7f92c80ded80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92c8051130 0x7f92c8033120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 --2- 172.21.15.69:0/2191227998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f92c8038940 0x7f92c8030dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 -- 172.21.15.69:0/2191227998 >> 172.21.15.69:0/2191227998 conn(0x7f92c8054c90 msgr2=0x7f92c804d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 -- 172.21.15.69:0/2191227998 shutdown_connections 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.074+0000 7f92cf59e700 1 -- 172.21.15.69:0/2191227998 wait complete. 2023-11-17T06:31:18.674 INFO:teuthology.orchestra.run.smithi069.stderr: removed all blocklist entries 2023-11-17T06:31:18.675 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-17T06:31:18.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.846+0000 7f0d0cd1f700 1 Processor -- start 2023-11-17T06:31:18.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.846+0000 7f0d0cd1f700 1 -- start start 2023-11-17T06:31:18.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0d081617a0 0x7f0d080cba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d08166040 con 0x7f0d080ce7a0 2023-11-17T06:31:18.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d080cebd0 con 0x7f0d080cbfc0 2023-11-17T06:31:18.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d080cc450 con 0x7f0d081617a0 2023-11-17T06:31:18.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0d081617a0 0x7f0d080cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0d081617a0 0x7f0d080cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40844/0 (socket says 172.21.15.69:40844) 2023-11-17T06:31:18.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0659c700 1 -- 172.21.15.69:0/2733306282 learned_addr learned my addr 172.21.15.69:0/2733306282 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:18.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0659c700 1 -- 172.21.15.69:0/2733306282 >> v1:172.21.15.93:6789/0 conn(0x7f0d080cbfc0 legacy=0x7f0d080ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0659c700 1 -- 172.21.15.69:0/2733306282 >> v1:172.21.15.69:6789/0 conn(0x7f0d080ce7a0 legacy=0x7f0d080cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0659c700 1 -- 172.21.15.69:0/2733306282 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08165430 con 0x7f0d081617a0 2023-11-17T06:31:18.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0659c700 1 --2- 172.21.15.69:0/2733306282 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d081617a0 0x7f0d080cba80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009910 tx=0x7f0cf8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e597581dcfda4eaa server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:18.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0559a700 1 -- 172.21.15.69:0/2733306282 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800ba60 con 0x7f0d081617a0 2023-11-17T06:31:18.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0559a700 1 -- 172.21.15.69:0/2733306282 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf800bbc0 con 0x7f0d081617a0 2023-11-17T06:31:18.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0559a700 1 -- 172.21.15.69:0/2733306282 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8009e60 con 0x7f0d081617a0 2023-11-17T06:31:18.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/2733306282 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d081617a0 msgr2=0x7f0d080cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 --2- 172.21.15.69:0/2733306282 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d081617a0 0x7f0d080cba80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009910 tx=0x7f0cf8009c20 comp rx=0 tx=0).stop 2023-11-17T06:31:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/2733306282 shutdown_connections 2023-11-17T06:31:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 --2- 172.21.15.69:0/2733306282 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d081617a0 0x7f0d080cba80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/2733306282 >> 172.21.15.69:0/2733306282 conn(0x7f0d0806a480 msgr2=0x7f0d0806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/2733306282 shutdown_connections 2023-11-17T06:31:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.850+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/2733306282 wait complete. 2023-11-17T06:31:18.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.854+0000 7f0d0cd1f700 1 Processor -- start 2023-11-17T06:31:18.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.854+0000 7f0d0cd1f700 1 -- start start 2023-11-17T06:31:18.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.854+0000 7f0d0cd1f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0d080cbfc0 0x7f0d081f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.854+0000 7f0d0cd1f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d080ce7a0 0x7f0d080c8820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.854+0000 7f0d0cd1f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d081617a0 0x7f0d080cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.854+0000 7f0d0cd1f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080b2780 con 0x7f0d080ce7a0 2023-11-17T06:31:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.854+0000 7f0d0cd1f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080b1920 con 0x7f0d081617a0 2023-11-17T06:31:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.854+0000 7f0d0cd1f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080c6190 con 0x7f0d080cbfc0 2023-11-17T06:31:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d05d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d080ce7a0 0x7f0d080c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d05d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d080ce7a0 0x7f0d080c8820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40860/0 (socket says 172.21.15.69:40860) 2023-11-17T06:31:18.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d05d9b700 1 -- 172.21.15.69:0/1147268487 learned_addr learned my addr 172.21.15.69:0/1147268487 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d06d9d700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d081617a0 0x7f0d080cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d0659c700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0d080cbfc0 0x7f0d081f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d05d9b700 1 -- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0d080cbfc0 msgr2=0x7f0d081f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d05d9b700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0d080cbfc0 0x7f0d081f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d05d9b700 1 -- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d081617a0 msgr2=0x7f0d080cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d05d9b700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d081617a0 0x7f0d080cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d05d9b700 1 -- 172.21.15.69:0/1147268487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf8009570 con 0x7f0d080ce7a0 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d05d9b700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d080ce7a0 0x7f0d080c8820 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c530 tx=0x7f0cfc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0cf6ffd700 1 -- 172.21.15.69:0/1147268487 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc0052d0 con 0x7f0d080ce7a0 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0cf6ffd700 1 -- 172.21.15.69:0/1147268487 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc005430 con 0x7f0d080ce7a0 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0cf6ffd700 1 -- 172.21.15.69:0/1147268487 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc0055a0 con 0x7f0d080ce7a0 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/1147268487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d080b1b70 con 0x7f0d080ce7a0 2023-11-17T06:31:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/1147268487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d080b2130 con 0x7f0d080ce7a0 2023-11-17T06:31:18.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.858+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/1147268487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d08073f00 con 0x7f0d080ce7a0 2023-11-17T06:31:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.862+0000 7f0cf6ffd700 1 -- 172.21.15.69:0/1147268487 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0cfc0038e0 con 0x7f0d080ce7a0 2023-11-17T06:31:18.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.862+0000 7f0cf6ffd700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ce8066510 0x7f0ce80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:18.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.862+0000 7f0cf6ffd700 1 -- 172.21.15.69:0/1147268487 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0cfc082f40 con 0x7f0d080ce7a0 2023-11-17T06:31:18.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.866+0000 7f0d0659c700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ce8066510 0x7f0ce80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:18.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.866+0000 7f0d0659c700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ce8066510 0x7f0ce80689d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8006f80 tx=0x7f0cf8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:18.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:18.870+0000 7f0cf6ffd700 1 -- 172.21.15.69:0/1147268487 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f0cfc050700 con 0x7f0d080ce7a0 2023-11-17T06:31:19.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.098+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/1147268487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0d080b4d40 con 0x7f0d080ce7a0 2023-11-17T06:31:19.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.098+0000 7f0cf6ffd700 1 -- 172.21.15.69:0/1147268487 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f0cfc017090 con 0x7f0d080ce7a0 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_dump": [ 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mds.a", 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDjB1dlgWiBKxAAYEkZfFVMlN9EoWLTr/I8OQ==", 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow *", 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow *", 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.106 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mds.b", 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDkB1dlry3xAxAAtAioA4mdHKGv0QmRrfncpw==", 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow *", 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow *", 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.107 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mds.c", 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDjB1dlRm8QNhAAk54RKTB3LbaY6fcgT34xJQ==", 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow *", 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow *", 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mds.d", 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDkB1dlVPaODxAA0KfAVmrO7mi8bx7Z7jiAxQ==", 2023-11-17T06:31:19.108 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow *", 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow *", 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.0", 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDnB1dl68AhOBAA/lvZStKsbNQgMfnAqWLTLg==", 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-11-17T06:31:19.109 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.1", 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDrB1dl4n1cCxAAXVeFxZezoHlQxvVliJvc1w==", 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.110 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.2", 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDuB1dlL900GRAAxQR349gqXqccX4ZSFpyhMw==", 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.3", 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDxB1dlC8FsJxAAPL93rZ17CfD+hoxcPsX+3A==", 2023-11-17T06:31:19.111 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.4", 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQD4B1dluMs4AxAAxA5eddnCF/gGW0q9vp1eDg==", 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-11-17T06:31:19.112 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.5", 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQD7B1dlPQpxERAAIfGHoNujgdks2lgdMfg+ZA==", 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.113 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.6", 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQACCFdlf9pwHRAAqBa1KwXc2pdd7C3RG1Rg2Q==", 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.7", 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAICFdlP0BwOhAA9EvXUQ3bT9dF2B1b+P3pMQ==", 2023-11-17T06:31:19.114 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.0", 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDkB1dlV8dIFhAARKHRwgoM6K9tEeqTeD4+ug==", 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-11-17T06:31:19.115 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow r", 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow rw", 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow rwx" 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.1", 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDkB1dlC+43IhAAmy4eZy6AEYmjY+Xslw3nNw==", 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow r", 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow rw", 2023-11-17T06:31:19.116 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow rwx" 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.2", 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDkB1dl8fYgHBAA2EObzKig+ezw7cNnl1sUtg==", 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow r", 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow rw", 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow rwx" 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.117 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.3", 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDkB1dlgg4DKBAA9ePiQ3wkehyT/jL3YKiNRA==", 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow r", 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow rw", 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow rwx" 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.admin", 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDjB1dlwm2QABAAHfuAr/htSHlfYNdMdrpb9Q==", 2023-11-17T06:31:19.118 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow *", 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow *", 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow *", 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-mds", 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQCFdlZkkBDBAAgq/faWR0jClxgPn35xKpjQ==", 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-mds" 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.119 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-mgr", 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQCFdlfFoBDBAAs+ZP+wAl9iL4epm8zqF+tQ==", 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-osd", 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQCFdlQ2gBDBAATx9JMEcp1IQq8r0Zr5QchA==", 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-osd" 2023-11-17T06:31:19.120 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.121 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.121 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.121 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-rbd", 2023-11-17T06:31:19.121 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQCFdloXUBDBAAjVphjpPW0OLcyhGLp5d82w==", 2023-11-17T06:31:19.121 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.121 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-17T06:31:19.121 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.121 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.121 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.121 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-17T06:31:19.122 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQCFdljIMBDBAA9livSmBcCxjG0MAb+pt7SA==", 2023-11-17T06:31:19.122 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.122 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-17T06:31:19.122 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.122 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-rgw", 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQCFdlPZEBDBAAL4ZrZ5fIKSZDpZUj/6/u3g==", 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mgr.x", 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDjB1dl0CmwIxAAgToYDDT4yXyijdxApbE1MQ==", 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.123 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow *", 2023-11-17T06:31:19.124 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile mgr", 2023-11-17T06:31:19.124 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.124 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:31:19.124 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:19.124 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mgr.y", 2023-11-17T06:31:19.124 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDjB1dlg/kbHRAAvegnKqn+7AfT+0typysGIw==", 2023-11-17T06:31:19.124 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-11-17T06:31:19.124 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow *", 2023-11-17T06:31:19.125 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile mgr", 2023-11-17T06:31:19.125 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-11-17T06:31:19.125 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.125 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:19.125 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-11-17T06:31:19.125 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:31:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ce8066510 msgr2=0x7f0ce80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ce8066510 0x7f0ce80689d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8006f80 tx=0x7f0cf8008030 comp rx=0 tx=0).stop 2023-11-17T06:31:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/1147268487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d080ce7a0 msgr2=0x7f0d080c8820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d080ce7a0 0x7f0d080c8820 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc00c530 tx=0x7f0cfc00c840 comp rx=0 tx=0).stop 2023-11-17T06:31:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/1147268487 shutdown_connections 2023-11-17T06:31:19.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0ce8066510 0x7f0ce80689d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d081617a0 0x7f0d080cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d080ce7a0 0x7f0d080c8820 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 --2- 172.21.15.69:0/1147268487 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0d080cbfc0 0x7f0d081f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/1147268487 >> 172.21.15.69:0/1147268487 conn(0x7f0d0806a480 msgr2=0x7f0d080cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/1147268487 shutdown_connections 2023-11-17T06:31:19.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.102+0000 7f0d0cd1f700 1 -- 172.21.15.69:0/1147268487 wait complete. 2023-11-17T06:31:19.135 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-17T06:31:19.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.310+0000 7f3ef21b9700 1 Processor -- start 2023-11-17T06:31:19.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.310+0000 7f3ef21b9700 1 -- start start 2023-11-17T06:31:19.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.310+0000 7f3ef21b9700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3eec0719e0 0x7f3eec0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.310+0000 7f3ef21b9700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3eec0c9960 0x7f3eec15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.310+0000 7f3ef21b9700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec06fc20 con 0x7f3eec15b980 2023-11-17T06:31:19.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef21b9700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec070430 con 0x7f3eec0c9960 2023-11-17T06:31:19.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef21b9700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec15ed70 con 0x7f3eec0719e0 2023-11-17T06:31:19.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef11b7700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f3eec15b980 0x7f3eec15f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43524/0 (socket says 172.21.15.69:43524) 2023-11-17T06:31:19.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef11b7700 1 -- 172.21.15.69:0/926607817 learned_addr learned my addr 172.21.15.69:0/926607817 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:19.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef19b8700 1 --2- 172.21.15.69:0/926607817 >> v2:172.21.15.93:3300/0 conn(0x7f3eec0c9960 0x7f3eec15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef09b6700 1 --2- 172.21.15.69:0/926607817 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3eec0719e0 0x7f3eec0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ee3fff700 1 -- 172.21.15.69:0/926607817 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684597164 0 0) 0x7f3eec06fc20 con 0x7f3eec15b980 2023-11-17T06:31:19.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ee3fff700 1 -- 172.21.15.69:0/926607817 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed80035d0 con 0x7f3eec15b980 2023-11-17T06:31:19.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef19b8700 1 -- 172.21.15.69:0/926607817 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3eec0719e0 msgr2=0x7f3eec0c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:19.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef19b8700 1 --2- 172.21.15.69:0/926607817 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3eec0719e0 0x7f3eec0c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef19b8700 1 -- 172.21.15.69:0/926607817 >> v1:172.21.15.69:6789/0 conn(0x7f3eec15b980 legacy=0x7f3eec15f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef19b8700 1 -- 172.21.15.69:0/926607817 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0c9da0 con 0x7f3eec0c9960 2023-11-17T06:31:19.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ef19b8700 1 --2- 172.21.15.69:0/926607817 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3eec0c9960 0x7f3eec15bd60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009d90 tx=0x7f3ee400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf9e308d7695d6db server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ee3fff700 1 -- 172.21.15.69:0/926607817 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400e070 con 0x7f3eec0c9960 2023-11-17T06:31:19.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ee3fff700 1 -- 172.21.15.69:0/926607817 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee400bb20 con 0x7f3eec0c9960 2023-11-17T06:31:19.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.314+0000 7f3ee3fff700 1 -- 172.21.15.69:0/926607817 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4012430 con 0x7f3eec0c9960 2023-11-17T06:31:19.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.318+0000 7f3ef21b9700 1 -- 172.21.15.69:0/926607817 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3eec0c9960 msgr2=0x7f3eec15bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.318+0000 7f3ef21b9700 1 --2- 172.21.15.69:0/926607817 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3eec0c9960 0x7f3eec15bd60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009d90 tx=0x7f3ee400b330 comp rx=0 tx=0).stop 2023-11-17T06:31:19.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.318+0000 7f3ef21b9700 1 -- 172.21.15.69:0/926607817 shutdown_connections 2023-11-17T06:31:19.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.318+0000 7f3ef21b9700 1 --2- 172.21.15.69:0/926607817 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3eec0c9960 0x7f3eec15bd60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.318+0000 7f3ef21b9700 1 --2- 172.21.15.69:0/926607817 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3eec0719e0 0x7f3eec0c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.318+0000 7f3ef21b9700 1 -- 172.21.15.69:0/926607817 >> 172.21.15.69:0/926607817 conn(0x7f3eec0b0900 msgr2=0x7f3eec0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:19.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.318+0000 7f3ef21b9700 1 -- 172.21.15.69:0/926607817 shutdown_connections 2023-11-17T06:31:19.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.318+0000 7f3ef21b9700 1 -- 172.21.15.69:0/926607817 wait complete. 2023-11-17T06:31:19.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.318+0000 7f3ef21b9700 1 Processor -- start 2023-11-17T06:31:19.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.318+0000 7f3ef21b9700 1 -- start start 2023-11-17T06:31:19.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef21b9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3eec0719e0 0x7f3eec0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef21b9700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3eec0c9960 0x7f3eec0c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef21b9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3eec15b980 0x7f3eec1f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef21b9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c67d0 con 0x7f3eec0719e0 2023-11-17T06:31:19.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef21b9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0c86d0 con 0x7f3eec15b980 2023-11-17T06:31:19.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef21b9700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec15bd60 con 0x7f3eec0c9960 2023-11-17T06:31:19.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef11b7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3eec0719e0 0x7f3eec0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef11b7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3eec0719e0 0x7f3eec0b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40866/0 (socket says 172.21.15.69:40866) 2023-11-17T06:31:19.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef11b7700 1 -- 172.21.15.69:0/622452857 learned_addr learned my addr 172.21.15.69:0/622452857 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:19.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef19b8700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3eec15b980 0x7f3eec1f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef09b6700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3eec0c9960 0x7f3eec0c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef11b7700 1 -- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3eec0c9960 msgr2=0x7f3eec0c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef11b7700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3eec0c9960 0x7f3eec0c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef11b7700 1 -- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3eec15b980 msgr2=0x7f3eec1f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef11b7700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3eec15b980 0x7f3eec1f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef11b7700 1 -- 172.21.15.69:0/622452857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4009a70 con 0x7f3eec0719e0 2023-11-17T06:31:19.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef19b8700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3eec15b980 0x7f3eec1f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:19.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef11b7700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3eec0719e0 0x7f3eec0b44e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c4d0 tx=0x7f3ee800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ee1ffb700 1 -- 172.21.15.69:0/622452857 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8005d90 con 0x7f3eec0719e0 2023-11-17T06:31:19.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ee1ffb700 1 -- 172.21.15.69:0/622452857 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee80070d0 con 0x7f3eec0719e0 2023-11-17T06:31:19.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ee1ffb700 1 -- 172.21.15.69:0/622452857 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee8007480 con 0x7f3eec0719e0 2023-11-17T06:31:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.322+0000 7f3ef21b9700 1 -- 172.21.15.69:0/622452857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec0b4a20 con 0x7f3eec0719e0 2023-11-17T06:31:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.326+0000 7f3ef21b9700 1 -- 172.21.15.69:0/622452857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec0c8bc0 con 0x7f3eec0719e0 2023-11-17T06:31:19.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.326+0000 7f3ef21b9700 1 -- 172.21.15.69:0/622452857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec073f00 con 0x7f3eec0719e0 2023-11-17T06:31:19.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.326+0000 7f3ee1ffb700 1 -- 172.21.15.69:0/622452857 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3ee80075e0 con 0x7f3eec0719e0 2023-11-17T06:31:19.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.330+0000 7f3ee1ffb700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ed0066540 0x7f3ed0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.330+0000 7f3ee1ffb700 1 -- 172.21.15.69:0/622452857 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3ee8082ea0 con 0x7f3eec0719e0 2023-11-17T06:31:19.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.330+0000 7f3ef09b6700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ed0066540 0x7f3ed0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.330+0000 7f3ef09b6700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ed0066540 0x7f3ed0068a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3eec1f5cc0 tx=0x7f3edc009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.334+0000 7f3ee1ffb700 1 -- 172.21.15.69:0/622452857 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f3ee8050670 con 0x7f3eec0719e0 2023-11-17T06:31:19.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.574+0000 7f3ef21b9700 1 -- 172.21.15.69:0/622452857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f3eec15bea0 con 0x7f3eec0719e0 2023-11-17T06:31:19.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.578+0000 7f3ee1ffb700 1 -- 172.21.15.69:0/622452857 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3ee80170a0 con 0x7f3eec0719e0 2023-11-17T06:31:19.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 -- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ed0066540 msgr2=0x7f3ed0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ed0066540 0x7f3ed0068a00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3eec1f5cc0 tx=0x7f3edc009240 comp rx=0 tx=0).stop 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 -- 172.21.15.69:0/622452857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3eec0719e0 msgr2=0x7f3eec0b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3eec0719e0 0x7f3eec0b44e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3ee800c4d0 tx=0x7f3ee800c7e0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 -- 172.21.15.69:0/622452857 shutdown_connections 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3ed0066540 0x7f3ed0068a00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3eec15b980 0x7f3eec1f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f3eec0c9960 0x7f3eec0c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 --2- 172.21.15.69:0/622452857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3eec0719e0 0x7f3eec0b44e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 -- 172.21.15.69:0/622452857 >> 172.21.15.69:0/622452857 conn(0x7f3eec0b0900 msgr2=0x7f3eec0cdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 -- 172.21.15.69:0/622452857 shutdown_connections 2023-11-17T06:31:19.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.582+0000 7f3ef21b9700 1 -- 172.21.15.69:0/622452857 wait complete. 2023-11-17T06:31:19.612 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-17T06:31:19.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.778+0000 7f96ccd9e700 1 Processor -- start 2023-11-17T06:31:19.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.778+0000 7f96ccd9e700 1 -- start start 2023-11-17T06:31:19.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96ccd9e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80cb020 0x7f96c815ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96ccd9e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f96c80cb400 0x7f96c806fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96ccd9e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c80b09e0 con 0x7f96c80702e0 2023-11-17T06:31:19.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96ccd9e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c815fd90 con 0x7f96c80cb400 2023-11-17T06:31:19.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96ccd9e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c80b1660 con 0x7f96c80cb020 2023-11-17T06:31:19.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c6d9d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f96c80702e0 0x7f96c80cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43528/0 (socket says 172.21.15.69:43528) 2023-11-17T06:31:19.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c6d9d700 1 -- 172.21.15.69:0/3458371749 learned_addr learned my addr 172.21.15.69:0/3458371749 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:19.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c659c700 1 --2- 172.21.15.69:0/3458371749 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80cb020 0x7f96c815ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c5d9b700 1 --2- 172.21.15.69:0/3458371749 >> v2:172.21.15.93:3300/0 conn(0x7f96c80cb400 0x7f96c806fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c559a700 1 -- 172.21.15.69:0/3458371749 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079158140 0 0) 0x7f96c80b09e0 con 0x7f96c80702e0 2023-11-17T06:31:19.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c559a700 1 -- 172.21.15.69:0/3458371749 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96b00035d0 con 0x7f96c80702e0 2023-11-17T06:31:19.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c659c700 1 -- 172.21.15.69:0/3458371749 >> v2:172.21.15.93:3300/0 conn(0x7f96c80cb400 msgr2=0x7f96c806fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:19.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c659c700 1 --2- 172.21.15.69:0/3458371749 >> v2:172.21.15.93:3300/0 conn(0x7f96c80cb400 0x7f96c806fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c659c700 1 -- 172.21.15.69:0/3458371749 >> v1:172.21.15.69:6789/0 conn(0x7f96c80702e0 legacy=0x7f96c80cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c659c700 1 -- 172.21.15.69:0/3458371749 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c80b0cc0 con 0x7f96c80cb020 2023-11-17T06:31:19.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c659c700 1 --2- 172.21.15.69:0/3458371749 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80cb020 0x7f96c815ed80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009850 tx=0x7f96b8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dba970ccb3b6f411 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c559a700 1 -- 172.21.15.69:0/3458371749 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8011830 con 0x7f96c80cb020 2023-11-17T06:31:19.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c559a700 1 -- 172.21.15.69:0/3458371749 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b8011990 con 0x7f96c80cb020 2023-11-17T06:31:19.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96c559a700 1 -- 172.21.15.69:0/3458371749 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8011d40 con 0x7f96c80cb020 2023-11-17T06:31:19.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96ccd9e700 1 -- 172.21.15.69:0/3458371749 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80cb020 msgr2=0x7f96c815ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.782+0000 7f96ccd9e700 1 --2- 172.21.15.69:0/3458371749 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80cb020 0x7f96c815ed80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009850 tx=0x7f96b8009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:19.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.786+0000 7f96ccd9e700 1 -- 172.21.15.69:0/3458371749 shutdown_connections 2023-11-17T06:31:19.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.786+0000 7f96ccd9e700 1 --2- 172.21.15.69:0/3458371749 >> v2:172.21.15.93:3300/0 conn(0x7f96c80cb400 0x7f96c806fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.786+0000 7f96ccd9e700 1 --2- 172.21.15.69:0/3458371749 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80cb020 0x7f96c815ed80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.786+0000 7f96ccd9e700 1 -- 172.21.15.69:0/3458371749 >> 172.21.15.69:0/3458371749 conn(0x7f96c806a480 msgr2=0x7f96c806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:19.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.786+0000 7f96ccd9e700 1 -- 172.21.15.69:0/3458371749 shutdown_connections 2023-11-17T06:31:19.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.786+0000 7f96ccd9e700 1 -- 172.21.15.69:0/3458371749 wait complete. 2023-11-17T06:31:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96ccd9e700 1 Processor -- start 2023-11-17T06:31:19.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96ccd9e700 1 -- start start 2023-11-17T06:31:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96ccd9e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80702e0 0x7f96c8157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96ccd9e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c80cb020 0x7f96c80c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96ccd9e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96c80cb400 0x7f96c8157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96ccd9e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c8155e50 con 0x7f96c80cb400 2023-11-17T06:31:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96ccd9e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c80cc990 con 0x7f96c80cb020 2023-11-17T06:31:19.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96ccd9e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c815b110 con 0x7f96c80702e0 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96c80cb400 0x7f96c8157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96c80cb400 0x7f96c8157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40876/0 (socket says 172.21.15.69:40876) 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c6d9d700 1 -- 172.21.15.69:0/1253401230 learned_addr learned my addr 172.21.15.69:0/1253401230 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c659c700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80702e0 0x7f96c8157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c5d9b700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c80cb020 0x7f96c80c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c6d9d700 1 -- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80702e0 msgr2=0x7f96c8157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c6d9d700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80702e0 0x7f96c8157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c6d9d700 1 -- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c80cb020 msgr2=0x7f96c80c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c6d9d700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c80cb020 0x7f96c80c4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c6d9d700 1 -- 172.21.15.69:0/1253401230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80094b0 con 0x7f96c80cb400 2023-11-17T06:31:19.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c5d9b700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c80cb020 0x7f96c80c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:19.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c659c700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80702e0 0x7f96c8157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:19.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96c6d9d700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96c80cb400 0x7f96c8157fa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f96c000cbb0 tx=0x7f96c000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96b6ffd700 1 -- 172.21.15.69:0/1253401230 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000a9e0 con 0x7f96c80cb400 2023-11-17T06:31:19.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96b6ffd700 1 -- 172.21.15.69:0/1253401230 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c000ab40 con 0x7f96c80cb400 2023-11-17T06:31:19.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96ccd9e700 1 -- 172.21.15.69:0/1253401230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c815b3f0 con 0x7f96c80cb400 2023-11-17T06:31:19.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.790+0000 7f96b6ffd700 1 -- 172.21.15.69:0/1253401230 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000ce70 con 0x7f96c80cb400 2023-11-17T06:31:19.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.794+0000 7f96ccd9e700 1 -- 172.21.15.69:0/1253401230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c80ccec0 con 0x7f96c80cb400 2023-11-17T06:31:19.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.794+0000 7f96ccd9e700 1 -- 172.21.15.69:0/1253401230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c80cd0b0 con 0x7f96c80cb400 2023-11-17T06:31:19.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.794+0000 7f96b6ffd700 1 -- 172.21.15.69:0/1253401230 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f96c001b3b0 con 0x7f96c80cb400 2023-11-17T06:31:19.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.798+0000 7f96b6ffd700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96a8066510 0x7f96a80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:19.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.798+0000 7f96b6ffd700 1 -- 172.21.15.69:0/1253401230 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96c0083440 con 0x7f96c80cb400 2023-11-17T06:31:19.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.798+0000 7f96c659c700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96a8066510 0x7f96a80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:19.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.798+0000 7f96c659c700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96a8066510 0x7f96a80689d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f96b80090b0 tx=0x7f96b8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:19.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:19.802+0000 7f96b6ffd700 1 -- 172.21.15.69:0/1253401230 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f96c0050cb0 con 0x7f96c80cb400 2023-11-17T06:31:20.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.038+0000 7f96ccd9e700 1 -- 172.21.15.69:0/1253401230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f96c8071fd0 con 0x7f96c80cb400 2023-11-17T06:31:20.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.046+0000 7f96b6ffd700 1 -- 172.21.15.69:0/1253401230 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f96c8071fd0 con 0x7f96c80cb400 2023-11-17T06:31:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 -- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96a8066510 msgr2=0x7f96a80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96a8066510 0x7f96a80689d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f96b80090b0 tx=0x7f96b8008030 comp rx=0 tx=0).stop 2023-11-17T06:31:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 -- 172.21.15.69:0/1253401230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96c80cb400 msgr2=0x7f96c8157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96c80cb400 0x7f96c8157fa0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f96c000cbb0 tx=0x7f96c000cc90 comp rx=0 tx=0).stop 2023-11-17T06:31:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 -- 172.21.15.69:0/1253401230 shutdown_connections 2023-11-17T06:31:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96a8066510 0x7f96a80689d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96c80cb400 0x7f96c8157fa0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f96c80cb020 0x7f96c80c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 --2- 172.21.15.69:0/1253401230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f96c80702e0 0x7f96c8157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 -- 172.21.15.69:0/1253401230 >> 172.21.15.69:0/1253401230 conn(0x7f96c806a480 msgr2=0x7f96c80c28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 -- 172.21.15.69:0/1253401230 shutdown_connections 2023-11-17T06:31:20.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.050+0000 7f96ccd9e700 1 -- 172.21.15.69:0/1253401230 wait complete. 2023-11-17T06:31:20.079 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-17T06:31:20.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.258+0000 7f31eb310700 1 Processor -- start 2023-11-17T06:31:20.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.258+0000 7f31eb310700 1 -- start start 2023-11-17T06:31:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f31e40cb400 0x7f31e415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f31e40cba80 0x7f31e40cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e40b09e0 con 0x7f31e40cb020 2023-11-17T06:31:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e415fd90 con 0x7f31e40cb400 2023-11-17T06:31:20.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e40b1660 con 0x7f31e40cba80 2023-11-17T06:31:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31e88ab700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f31e40cb400 0x7f31e415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31e88ab700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f31e40cb400 0x7f31e415ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40878/0 (socket says 172.21.15.69:40878) 2023-11-17T06:31:20.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31e88ab700 1 -- 172.21.15.69:0/2164731934 learned_addr learned my addr 172.21.15.69:0/2164731934 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31e98ad700 1 --2- 172.21.15.69:0/2164731934 >> v2:172.21.15.93:3300/0 conn(0x7f31e40cba80 0x7f31e40cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31e88ab700 1 -- 172.21.15.69:0/2164731934 >> v2:172.21.15.93:3300/0 conn(0x7f31e40cba80 msgr2=0x7f31e40cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31e88ab700 1 --2- 172.21.15.69:0/2164731934 >> v2:172.21.15.93:3300/0 conn(0x7f31e40cba80 0x7f31e40cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31e88ab700 1 -- 172.21.15.69:0/2164731934 >> v1:172.21.15.93:6789/0 conn(0x7f31e40cb020 legacy=0x7f31e406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31e88ab700 1 -- 172.21.15.69:0/2164731934 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e40b0cc0 con 0x7f31e40cb400 2023-11-17T06:31:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31e98ad700 1 --2- 172.21.15.69:0/2164731934 >> v2:172.21.15.93:3300/0 conn(0x7f31e40cba80 0x7f31e40cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31e88ab700 1 --2- 172.21.15.69:0/2164731934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cb400 0x7f31e415ed80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31e406cd90 tx=0x7f31d4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895826aa4f468390 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31dbfff700 1 -- 172.21.15.69:0/2164731934 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400b8a0 con 0x7f31e40cb400 2023-11-17T06:31:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31dbfff700 1 -- 172.21.15.69:0/2164731934 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d400ba00 con 0x7f31e40cb400 2023-11-17T06:31:20.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31dbfff700 1 -- 172.21.15.69:0/2164731934 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d400bd90 con 0x7f31e40cb400 2023-11-17T06:31:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 -- 172.21.15.69:0/2164731934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cb400 msgr2=0x7f31e415ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 --2- 172.21.15.69:0/2164731934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cb400 0x7f31e415ed80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f31e406cd90 tx=0x7f31d4009bf0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 -- 172.21.15.69:0/2164731934 shutdown_connections 2023-11-17T06:31:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 --2- 172.21.15.69:0/2164731934 >> v2:172.21.15.93:3300/0 conn(0x7f31e40cba80 0x7f31e40cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 --2- 172.21.15.69:0/2164731934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cb400 0x7f31e415ed80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.262+0000 7f31eb310700 1 -- 172.21.15.69:0/2164731934 >> 172.21.15.69:0/2164731934 conn(0x7f31e406a480 msgr2=0x7f31e406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.266+0000 7f31eb310700 1 -- 172.21.15.69:0/2164731934 shutdown_connections 2023-11-17T06:31:20.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.266+0000 7f31eb310700 1 -- 172.21.15.69:0/2164731934 wait complete. 2023-11-17T06:31:20.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.266+0000 7f31eb310700 1 Processor -- start 2023-11-17T06:31:20.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.266+0000 7f31eb310700 1 -- start start 2023-11-17T06:31:20.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31eb310700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31e40cb020 0x7f31e4150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31eb310700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31e40cb400 0x7f31e40b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31eb310700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cba80 0x7f31e40c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31eb310700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e41f4ee0 con 0x7f31e40cba80 2023-11-17T06:31:20.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31eb310700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e40c3150 con 0x7f31e40cb020 2023-11-17T06:31:20.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31eb310700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e41f4c00 con 0x7f31e40cb400 2023-11-17T06:31:20.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e98ad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cba80 0x7f31e40c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e90ac700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31e40cb020 0x7f31e4150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e98ad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cba80 0x7f31e40c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40894/0 (socket says 172.21.15.69:40894) 2023-11-17T06:31:20.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e98ad700 1 -- 172.21.15.69:0/309857974 learned_addr learned my addr 172.21.15.69:0/309857974 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:20.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e88ab700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31e40cb400 0x7f31e40b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e90ac700 1 -- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31e40cb400 msgr2=0x7f31e40b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e90ac700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31e40cb400 0x7f31e40b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e90ac700 1 -- 172.21.15.69:0/309857974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cba80 msgr2=0x7f31e40c4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e90ac700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cba80 0x7f31e40c4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e90ac700 1 -- 172.21.15.69:0/309857974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d4009570 con 0x7f31e40cb020 2023-11-17T06:31:20.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e98ad700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cba80 0x7f31e40c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:20.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31e90ac700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31e40cb020 0x7f31e4150490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f31e000c480 tx=0x7f31e000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31d9ffb700 1 -- 172.21.15.69:0/309857974 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00052d0 con 0x7f31e40cb020 2023-11-17T06:31:20.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31d9ffb700 1 -- 172.21.15.69:0/309857974 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0005430 con 0x7f31e40cb020 2023-11-17T06:31:20.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31eb310700 1 -- 172.21.15.69:0/309857974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e40c2a90 con 0x7f31e40cb020 2023-11-17T06:31:20.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.270+0000 7f31d9ffb700 1 -- 172.21.15.69:0/309857974 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e00055a0 con 0x7f31e40cb020 2023-11-17T06:31:20.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.274+0000 7f31eb310700 1 -- 172.21.15.69:0/309857974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e41509d0 con 0x7f31e40cb020 2023-11-17T06:31:20.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.274+0000 7f31eb310700 1 -- 172.21.15.69:0/309857974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e40c28f0 con 0x7f31e40cb020 2023-11-17T06:31:20.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.274+0000 7f31d9ffb700 1 -- 172.21.15.69:0/309857974 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f31e00038e0 con 0x7f31e40cb020 2023-11-17T06:31:20.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.274+0000 7f31d9ffb700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31c8066510 0x7f31c80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.278+0000 7f31d9ffb700 1 -- 172.21.15.69:0/309857974 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f31e0082e00 con 0x7f31e40cb020 2023-11-17T06:31:20.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.278+0000 7f31e88ab700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31c8066510 0x7f31c80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.278+0000 7f31e88ab700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31c8066510 0x7f31c80689d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f31e406cd90 tx=0x7f31d4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.286+0000 7f31d9ffb700 1 -- 172.21.15.69:0/309857974 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f31e40c28f0 con 0x7f31e40cb020 2023-11-17T06:31:20.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.518+0000 7f31eb310700 1 -- 172.21.15.69:0/309857974 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f31e40c28f0 con 0x7f31e40cb020 2023-11-17T06:31:20.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.526+0000 7f31d9ffb700 1 -- 172.21.15.69:0/309857974 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f31e40c28f0 con 0x7f31e40cb020 2023-11-17T06:31:20.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 -- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31c8066510 msgr2=0x7f31c80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31c8066510 0x7f31c80689d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f31e406cd90 tx=0x7f31d4008030 comp rx=0 tx=0).stop 2023-11-17T06:31:20.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 -- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31e40cb020 msgr2=0x7f31e4150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31e40cb020 0x7f31e4150490 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f31e000c480 tx=0x7f31e000c790 comp rx=0 tx=0).stop 2023-11-17T06:31:20.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 -- 172.21.15.69:0/309857974 shutdown_connections 2023-11-17T06:31:20.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f31c8066510 0x7f31c80689d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31e40cba80 0x7f31e40c4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f31e40cb400 0x7f31e40b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 --2- 172.21.15.69:0/309857974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31e40cb020 0x7f31e4150490 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 -- 172.21.15.69:0/309857974 >> 172.21.15.69:0/309857974 conn(0x7f31e406a480 msgr2=0x7f31e415b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:20.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 -- 172.21.15.69:0/309857974 shutdown_connections 2023-11-17T06:31:20.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.530+0000 7f31eb310700 1 -- 172.21.15.69:0/309857974 wait complete. 2023-11-17T06:31:20.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-17T06:31:20.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.730+0000 7f39c759e700 1 Processor -- start 2023-11-17T06:31:20.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.730+0000 7f39c759e700 1 -- start start 2023-11-17T06:31:20.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c759e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f39c8159750 0x7f39c806b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c759e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c815d250 0x7f39c815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c759e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c8159b30 con 0x7f39c80cd5a0 2023-11-17T06:31:20.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c759e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c815dc20 con 0x7f39c8159750 2023-11-17T06:31:20.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c759e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80cf2c0 con 0x7f39c815d250 2023-11-17T06:31:20.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f39c8159750 0x7f39c806b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f39c8159750 0x7f39c806b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40898/0 (socket says 172.21.15.69:40898) 2023-11-17T06:31:20.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c659c700 1 -- 172.21.15.69:0/773566341 learned_addr learned my addr 172.21.15.69:0/773566341 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:20.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c6d9d700 1 --2- 172.21.15.69:0/773566341 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c815d250 0x7f39c815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c659c700 1 -- 172.21.15.69:0/773566341 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c815d250 msgr2=0x7f39c815d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:20.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c659c700 1 --2- 172.21.15.69:0/773566341 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c815d250 0x7f39c815d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c659c700 1 -- 172.21.15.69:0/773566341 >> v1:172.21.15.69:6789/0 conn(0x7f39c80cd5a0 legacy=0x7f39c80cebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c659c700 1 -- 172.21.15.69:0/773566341 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c80cdb10 con 0x7f39c8159750 2023-11-17T06:31:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c6d9d700 1 --2- 172.21.15.69:0/773566341 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c815d250 0x7f39c815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c659c700 1 --2- 172.21.15.69:0/773566341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c8159750 0x7f39c806b5e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f39b800aab0 tx=0x7f39b800adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bffd64d429e5bbf server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c559a700 1 -- 172.21.15.69:0/773566341 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b800cb70 con 0x7f39c8159750 2023-11-17T06:31:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c559a700 1 -- 172.21.15.69:0/773566341 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b800ccd0 con 0x7f39c8159750 2023-11-17T06:31:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c559a700 1 -- 172.21.15.69:0/773566341 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8018620 con 0x7f39c8159750 2023-11-17T06:31:20.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c759e700 1 -- 172.21.15.69:0/773566341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c8159750 msgr2=0x7f39c806b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.734+0000 7f39c759e700 1 --2- 172.21.15.69:0/773566341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c8159750 0x7f39c806b5e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f39b800aab0 tx=0x7f39b800adc0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.738+0000 7f39c759e700 1 -- 172.21.15.69:0/773566341 shutdown_connections 2023-11-17T06:31:20.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.738+0000 7f39c759e700 1 --2- 172.21.15.69:0/773566341 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c815d250 0x7f39c815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.738+0000 7f39c759e700 1 --2- 172.21.15.69:0/773566341 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c8159750 0x7f39c806b5e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.738+0000 7f39c759e700 1 -- 172.21.15.69:0/773566341 >> 172.21.15.69:0/773566341 conn(0x7f39c80cf5d0 msgr2=0x7f39c80cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.738+0000 7f39c759e700 1 -- 172.21.15.69:0/773566341 shutdown_connections 2023-11-17T06:31:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.738+0000 7f39c759e700 1 -- 172.21.15.69:0/773566341 wait complete. 2023-11-17T06:31:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.738+0000 7f39c759e700 1 Processor -- start 2023-11-17T06:31:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.738+0000 7f39c759e700 1 -- start start 2023-11-17T06:31:20.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c759e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39c80cd5a0 0x7f39c80c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c759e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c8159750 0x7f39c80c3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c815d250 0x7f39c8157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c759e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80c9c20 con 0x7f39c815d250 2023-11-17T06:31:20.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c759e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c80c3640 con 0x7f39c80cd5a0 2023-11-17T06:31:20.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c759e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c81584f0 con 0x7f39c8159750 2023-11-17T06:31:20.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c815d250 0x7f39c8157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c815d250 0x7f39c8157fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40910/0 (socket says 172.21.15.69:40910) 2023-11-17T06:31:20.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c6d9d700 1 -- 172.21.15.69:0/3333992709 learned_addr learned my addr 172.21.15.69:0/3333992709 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:20.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c659c700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39c80cd5a0 0x7f39c80c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c5d9b700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c8159750 0x7f39c80c3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c6d9d700 1 -- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c8159750 msgr2=0x7f39c80c3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c6d9d700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c8159750 0x7f39c80c3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c6d9d700 1 -- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39c80cd5a0 msgr2=0x7f39c80c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c6d9d700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39c80cd5a0 0x7f39c80c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c6d9d700 1 -- 172.21.15.69:0/3333992709 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b800a710 con 0x7f39c815d250 2023-11-17T06:31:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.742+0000 7f39c6d9d700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c815d250 0x7f39c8157fb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f39c000cd50 tx=0x7f39c000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.746+0000 7f39b6ffd700 1 -- 172.21.15.69:0/3333992709 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000cea0 con 0x7f39c815d250 2023-11-17T06:31:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.746+0000 7f39b6ffd700 1 -- 172.21.15.69:0/3333992709 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c000f480 con 0x7f39c815d250 2023-11-17T06:31:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.746+0000 7f39b6ffd700 1 -- 172.21.15.69:0/3333992709 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000f830 con 0x7f39c815d250 2023-11-17T06:31:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.746+0000 7f39c759e700 1 -- 172.21.15.69:0/3333992709 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c815a9f0 con 0x7f39c815d250 2023-11-17T06:31:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.746+0000 7f39c759e700 1 -- 172.21.15.69:0/3333992709 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c80c3b00 con 0x7f39c815d250 2023-11-17T06:31:20.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.746+0000 7f39c759e700 1 -- 172.21.15.69:0/3333992709 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c8067330 con 0x7f39c815d250 2023-11-17T06:31:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.746+0000 7f39b6ffd700 1 -- 172.21.15.69:0/3333992709 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f39c000b040 con 0x7f39c815d250 2023-11-17T06:31:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.750+0000 7f39b6ffd700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f39a8066510 0x7f39a80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.750+0000 7f39b6ffd700 1 -- 172.21.15.69:0/3333992709 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f39c00841b0 con 0x7f39c815d250 2023-11-17T06:31:20.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.750+0000 7f39c659c700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f39a8066510 0x7f39a80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:20.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.750+0000 7f39c659c700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f39a8066510 0x7f39a80689d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f39b8000c00 tx=0x7f39b801b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:20.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.758+0000 7f39b6ffd700 1 -- 172.21.15.69:0/3333992709 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f39c0051980 con 0x7f39c815d250 2023-11-17T06:31:20.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.990+0000 7f39c759e700 1 -- 172.21.15.69:0/3333992709 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f39c8073f00 con 0x7f39c815d250 2023-11-17T06:31:21.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.994+0000 7f39b6ffd700 1 -- 172.21.15.69:0/3333992709 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f39c0054fa0 con 0x7f39c815d250 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 -- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f39a8066510 msgr2=0x7f39a80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f39a8066510 0x7f39a80689d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f39b8000c00 tx=0x7f39b801b040 comp rx=0 tx=0).stop 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 -- 172.21.15.69:0/3333992709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c815d250 msgr2=0x7f39c8157fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c815d250 0x7f39c8157fb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f39c000cd50 tx=0x7f39c000a560 comp rx=0 tx=0).stop 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 -- 172.21.15.69:0/3333992709 shutdown_connections 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f39a8066510 0x7f39a80689d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c815d250 0x7f39c8157fb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39c8159750 0x7f39c80c3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 --2- 172.21.15.69:0/3333992709 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39c80cd5a0 0x7f39c80c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 -- 172.21.15.69:0/3333992709 >> 172.21.15.69:0/3333992709 conn(0x7f39c80cf5d0 msgr2=0x7f39c8158880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:21.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 -- 172.21.15.69:0/3333992709 shutdown_connections 2023-11-17T06:31:21.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:20.998+0000 7f39c759e700 1 -- 172.21.15.69:0/3333992709 wait complete. 2023-11-17T06:31:21.024 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-17T06:31:21.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c1a7c700 1 Processor -- start 2023-11-17T06:31:21.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c1a7c700 1 -- start start 2023-11-17T06:31:21.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c1a7c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0b47e0 0x7f82bc0d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c1a7c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f82bc0d0f00 0x7f82bc0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c1a7c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f82bc0d01f0 0x7f82bc0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c1a7c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc0c76b0 con 0x7f82bc0d01f0 2023-11-17T06:31:21.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c1a7c700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc0c6d10 con 0x7f82bc0d0f00 2023-11-17T06:31:21.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c1a7c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc0c6ff0 con 0x7f82bc0b47e0 2023-11-17T06:31:21.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c0a7a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0b47e0 0x7f82bc0d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82bbfff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f82bc0d0f00 0x7f82bc0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c127b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f82bc0d01f0 0x7f82bc0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c0a7a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0b47e0 0x7f82bc0d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:58372/0 (socket says 172.21.15.69:58372) 2023-11-17T06:31:21.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82bbfff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f82bc0d0f00 0x7f82bc0d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:46878/0 (socket says 172.21.15.69:46878) 2023-11-17T06:31:21.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c0a7a700 1 -- 172.21.15.69:0/3268766223 learned_addr learned my addr 172.21.15.69:0/3268766223 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:21.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82bbfff700 1 -- 172.21.15.69:0/3268766223 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0b47e0 msgr2=0x7f82bc0d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:21.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82bbfff700 1 --2- 172.21.15.69:0/3268766223 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0b47e0 0x7f82bc0d1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82bbfff700 1 -- 172.21.15.69:0/3268766223 >> v2:172.21.15.69:3300/0 conn(0x7f82bc0d01f0 msgr2=0x7f82bc0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:21.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82bbfff700 1 --2- 172.21.15.69:0/3268766223 >> v2:172.21.15.69:3300/0 conn(0x7f82bc0d01f0 0x7f82bc0cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82bbfff700 1 -- 172.21.15.69:0/3268766223 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0c72d0 con 0x7f82bc0d0f00 2023-11-17T06:31:21.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c0a7a700 1 --2- 172.21.15.69:0/3268766223 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0b47e0 0x7f82bc0d1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:21.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82c127b700 1 --2- 172.21.15.69:0/3268766223 >> v2:172.21.15.69:3300/0 conn(0x7f82bc0d01f0 0x7f82bc0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:21.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.190+0000 7f82bbfff700 1 --2- 172.21.15.69:0/3268766223 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82bc0d0f00 0x7f82bc0d1c40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f82bc08b650 tx=0x7f82a8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbdaf8735a72c05d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82bb7fe700 1 -- 172.21.15.69:0/3268766223 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8011830 con 0x7f82bc0d0f00 2023-11-17T06:31:21.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82bb7fe700 1 -- 172.21.15.69:0/3268766223 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a8011990 con 0x7f82bc0d0f00 2023-11-17T06:31:21.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82bb7fe700 1 -- 172.21.15.69:0/3268766223 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8011d20 con 0x7f82bc0d0f00 2023-11-17T06:31:21.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3268766223 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82bc0d0f00 msgr2=0x7f82bc0d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 --2- 172.21.15.69:0/3268766223 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82bc0d0f00 0x7f82bc0d1c40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f82bc08b650 tx=0x7f82a8009b30 comp rx=0 tx=0).stop 2023-11-17T06:31:21.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3268766223 shutdown_connections 2023-11-17T06:31:21.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 --2- 172.21.15.69:0/3268766223 >> v2:172.21.15.69:3300/0 conn(0x7f82bc0d01f0 0x7f82bc0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 --2- 172.21.15.69:0/3268766223 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82bc0d0f00 0x7f82bc0d1c40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 --2- 172.21.15.69:0/3268766223 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0b47e0 0x7f82bc0d1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3268766223 >> 172.21.15.69:0/3268766223 conn(0x7f82bc0d3120 msgr2=0x7f82bc0d3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:21.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3268766223 shutdown_connections 2023-11-17T06:31:21.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3268766223 wait complete. 2023-11-17T06:31:21.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 Processor -- start 2023-11-17T06:31:21.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.194+0000 7f82c1a7c700 1 -- start start 2023-11-17T06:31:21.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c1a7c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82bc0b47e0 0x7f82bc1f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c1a7c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0d01f0 0x7f82bc14d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c1a7c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82bc0d0f00 0x7f82bc0c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c1a7c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc15b820 con 0x7f82bc0d0f00 2023-11-17T06:31:21.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c1a7c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc1f2e20 con 0x7f82bc0b47e0 2023-11-17T06:31:21.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c1a7c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc15ac30 con 0x7f82bc0d01f0 2023-11-17T06:31:21.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c127b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82bc0d0f00 0x7f82bc0c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c127b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82bc0d0f00 0x7f82bc0c8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40934/0 (socket says 172.21.15.69:40934) 2023-11-17T06:31:21.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c127b700 1 -- 172.21.15.69:0/3910395024 learned_addr learned my addr 172.21.15.69:0/3910395024 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:21.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c0a7a700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82bc0b47e0 0x7f82bc1f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82bbfff700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0d01f0 0x7f82bc14d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c127b700 1 -- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0d01f0 msgr2=0x7f82bc14d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c127b700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0d01f0 0x7f82bc14d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c127b700 1 -- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82bc0b47e0 msgr2=0x7f82bc1f28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c127b700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82bc0b47e0 0x7f82bc1f28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c127b700 1 -- 172.21.15.69:0/3910395024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b0009570 con 0x7f82bc0d0f00 2023-11-17T06:31:21.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c127b700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82bc0d0f00 0x7f82bc0c8280 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f82b400efc0 tx=0x7f82b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82b97fa700 1 -- 172.21.15.69:0/3910395024 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b400cb40 con 0x7f82bc0d0f00 2023-11-17T06:31:21.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3910395024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b4009a70 con 0x7f82bc0d0f00 2023-11-17T06:31:21.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82b97fa700 1 -- 172.21.15.69:0/3910395024 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b400f040 con 0x7f82bc0d0f00 2023-11-17T06:31:21.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82b97fa700 1 -- 172.21.15.69:0/3910395024 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4003a40 con 0x7f82bc0d0f00 2023-11-17T06:31:21.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.198+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3910395024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a80094b0 con 0x7f82bc0d0f00 2023-11-17T06:31:21.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.202+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3910395024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc15b960 con 0x7f82bc0d0f00 2023-11-17T06:31:21.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.202+0000 7f82b97fa700 1 -- 172.21.15.69:0/3910395024 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f82b4014480 con 0x7f82bc0d0f00 2023-11-17T06:31:21.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.202+0000 7f82b97fa700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f82a0066510 0x7f82a00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.202+0000 7f82b97fa700 1 -- 172.21.15.69:0/3910395024 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f82b4084420 con 0x7f82bc0d0f00 2023-11-17T06:31:21.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.202+0000 7f82c0a7a700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f82a0066510 0x7f82a00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.206+0000 7f82c0a7a700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f82a0066510 0x7f82a00689d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009d10 tx=0x7f82b00092e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.210+0000 7f82b97fa700 1 -- 172.21.15.69:0/3910395024 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f82bc15b960 con 0x7f82bc0d0f00 2023-11-17T06:31:21.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.446+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3910395024 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f82bc15b960 con 0x7f82bc0d0f00 2023-11-17T06:31:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82b97fa700 1 -- 172.21.15.69:0/3910395024 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f82bc15b960 con 0x7f82bc0d0f00 2023-11-17T06:31:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f82a0066510 msgr2=0x7f82a00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f82a0066510 0x7f82a00689d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009d10 tx=0x7f82b00092e0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3910395024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82bc0d0f00 msgr2=0x7f82bc0c8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82bc0d0f00 0x7f82bc0c8280 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f82b400efc0 tx=0x7f82b400c3a0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3910395024 shutdown_connections 2023-11-17T06:31:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f82a0066510 0x7f82a00689d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f82bc0d0f00 0x7f82bc0c8280 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f82bc0d01f0 0x7f82bc14d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 --2- 172.21.15.69:0/3910395024 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f82bc0b47e0 0x7f82bc1f28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3910395024 >> 172.21.15.69:0/3910395024 conn(0x7f82bc0d3120 msgr2=0x7f82bc0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.454+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3910395024 shutdown_connections 2023-11-17T06:31:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.458+0000 7f82c1a7c700 1 -- 172.21.15.69:0/3910395024 wait complete. 2023-11-17T06:31:21.485 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-17T06:31:21.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.670+0000 7fa4898fd700 1 Processor -- start 2023-11-17T06:31:21.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.670+0000 7fa4898fd700 1 -- start start 2023-11-17T06:31:21.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.670+0000 7fa4898fd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa48415d490 0x7fa4840b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa4898fd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa4840d13d0 0x7fa4840cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa4898fd700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4840d1bb0 con 0x7fa4840ce310 2023-11-17T06:31:21.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa4898fd700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4840ce7a0 con 0x7fa48415d490 2023-11-17T06:31:21.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa4898fd700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4840d1e90 con 0x7fa4840d13d0 2023-11-17T06:31:21.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa4837fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa4840ce310 0x7fa4840b4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43544/0 (socket says 172.21.15.69:43544) 2023-11-17T06:31:21.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa4837fe700 1 -- 172.21.15.69:0/161735624 learned_addr learned my addr 172.21.15.69:0/161735624 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:21.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa482ffd700 1 --2- 172.21.15.69:0/161735624 >> v2:172.21.15.69:3300/0 conn(0x7fa48415d490 0x7fa4840b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa4827fc700 1 --2- 172.21.15.69:0/161735624 >> v2:172.21.15.93:3300/0 conn(0x7fa4840d13d0 0x7fa4840cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa482ffd700 1 -- 172.21.15.69:0/161735624 >> v2:172.21.15.93:3300/0 conn(0x7fa4840d13d0 msgr2=0x7fa4840cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:21.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa482ffd700 1 --2- 172.21.15.69:0/161735624 >> v2:172.21.15.93:3300/0 conn(0x7fa4840d13d0 0x7fa4840cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa482ffd700 1 -- 172.21.15.69:0/161735624 >> v1:172.21.15.69:6789/0 conn(0x7fa4840ce310 legacy=0x7fa4840b4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa482ffd700 1 -- 172.21.15.69:0/161735624 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840d2170 con 0x7fa48415d490 2023-11-17T06:31:21.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa482ffd700 1 --2- 172.21.15.69:0/161735624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa48415d490 0x7fa4840b8bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa48406bbc0 tx=0x7fa474009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d0d0f1dd4bba3a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa481ffb700 1 -- 172.21.15.69:0/161735624 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474011830 con 0x7fa48415d490 2023-11-17T06:31:21.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa481ffb700 1 -- 172.21.15.69:0/161735624 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa474011990 con 0x7fa48415d490 2023-11-17T06:31:21.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.674+0000 7fa481ffb700 1 -- 172.21.15.69:0/161735624 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa474011d20 con 0x7fa48415d490 2023-11-17T06:31:21.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.678+0000 7fa4898fd700 1 -- 172.21.15.69:0/161735624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa48415d490 msgr2=0x7fa4840b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.678+0000 7fa4898fd700 1 --2- 172.21.15.69:0/161735624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa48415d490 0x7fa4840b8bc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa48406bbc0 tx=0x7fa474009b30 comp rx=0 tx=0).stop 2023-11-17T06:31:21.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.678+0000 7fa4898fd700 1 -- 172.21.15.69:0/161735624 shutdown_connections 2023-11-17T06:31:21.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.678+0000 7fa4898fd700 1 --2- 172.21.15.69:0/161735624 >> v2:172.21.15.93:3300/0 conn(0x7fa4840d13d0 0x7fa4840cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.678+0000 7fa4898fd700 1 --2- 172.21.15.69:0/161735624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa48415d490 0x7fa4840b8bc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.678+0000 7fa4898fd700 1 -- 172.21.15.69:0/161735624 >> 172.21.15.69:0/161735624 conn(0x7fa48406ab40 msgr2=0x7fa48406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:21.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.678+0000 7fa4898fd700 1 -- 172.21.15.69:0/161735624 shutdown_connections 2023-11-17T06:31:21.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.678+0000 7fa4898fd700 1 -- 172.21.15.69:0/161735624 wait complete. 2023-11-17T06:31:21.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.678+0000 7fa4898fd700 1 Processor -- start 2023-11-17T06:31:21.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.678+0000 7fa4898fd700 1 -- start start 2023-11-17T06:31:21.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4898fd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4840ce310 0x7fa484147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4898fd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4840d13d0 0x7fa48415c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4898fd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa48415d490 0x7fa48415c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4898fd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa484148000 con 0x7fa4840d13d0 2023-11-17T06:31:21.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4898fd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa484142290 con 0x7fa4840ce310 2023-11-17T06:31:21.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4898fd700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48415f540 con 0x7fa48415d490 2023-11-17T06:31:21.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4827fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4840d13d0 0x7fa48415c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4827fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4840d13d0 0x7fa48415c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40958/0 (socket says 172.21.15.69:40958) 2023-11-17T06:31:21.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4827fc700 1 -- 172.21.15.69:0/1512816843 learned_addr learned my addr 172.21.15.69:0/1512816843 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:21.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa482ffd700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4840ce310 0x7fa484147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4837fe700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa48415d490 0x7fa48415c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4827fc700 1 -- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa48415d490 msgr2=0x7fa48415c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4827fc700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa48415d490 0x7fa48415c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4827fc700 1 -- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4840ce310 msgr2=0x7fa484147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4827fc700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4840ce310 0x7fa484147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4827fc700 1 -- 172.21.15.69:0/1512816843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4740094b0 con 0x7fa4840d13d0 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4837fe700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa48415d490 0x7fa48415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4827fc700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4840d13d0 0x7fa48415c270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa47800e9d0 tx=0x7fa47800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa46bfff700 1 -- 172.21.15.69:0/1512816843 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa478009720 con 0x7fa4840d13d0 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa46bfff700 1 -- 172.21.15.69:0/1512816843 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47800c850 con 0x7fa4840d13d0 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4898fd700 1 -- 172.21.15.69:0/1512816843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48415f820 con 0x7fa4840d13d0 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa46bfff700 1 -- 172.21.15.69:0/1512816843 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47800cbc0 con 0x7fa4840d13d0 2023-11-17T06:31:21.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4898fd700 1 -- 172.21.15.69:0/1512816843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa484141f20 con 0x7fa4840d13d0 2023-11-17T06:31:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.682+0000 7fa4898fd700 1 -- 172.21.15.69:0/1512816843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa484073f00 con 0x7fa4840d13d0 2023-11-17T06:31:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.686+0000 7fa46bfff700 1 -- 172.21.15.69:0/1512816843 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa47800cd20 con 0x7fa4840d13d0 2023-11-17T06:31:21.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.686+0000 7fa46bfff700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa470066510 0x7fa4700689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:21.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.686+0000 7fa46bfff700 1 -- 172.21.15.69:0/1512816843 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa4780841a0 con 0x7fa4840d13d0 2023-11-17T06:31:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.686+0000 7fa482ffd700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa470066510 0x7fa4700689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:21.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.690+0000 7fa482ffd700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa470066510 0x7fa4700689d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa474009fd0 tx=0x7fa474008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:21.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.694+0000 7fa46bfff700 1 -- 172.21.15.69:0/1512816843 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa4780517c0 con 0x7fa4840d13d0 2023-11-17T06:31:21.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.930+0000 7fa4898fd700 1 -- 172.21.15.69:0/1512816843 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fa48406b170 con 0x7fa4840d13d0 2023-11-17T06:31:21.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.938+0000 7fa46bfff700 1 -- 172.21.15.69:0/1512816843 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa478054de0 con 0x7fa4840d13d0 2023-11-17T06:31:21.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 -- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa470066510 msgr2=0x7fa4700689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa470066510 0x7fa4700689d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa474009fd0 tx=0x7fa474008030 comp rx=0 tx=0).stop 2023-11-17T06:31:21.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 -- 172.21.15.69:0/1512816843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4840d13d0 msgr2=0x7fa48415c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:21.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4840d13d0 0x7fa48415c270 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa47800e9d0 tx=0x7fa47800ed90 comp rx=0 tx=0).stop 2023-11-17T06:31:21.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 -- 172.21.15.69:0/1512816843 shutdown_connections 2023-11-17T06:31:21.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa470066510 0x7fa4700689d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa48415d490 0x7fa48415c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa4840d13d0 0x7fa48415c270 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 --2- 172.21.15.69:0/1512816843 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4840ce310 0x7fa484147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:21.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 -- 172.21.15.69:0/1512816843 >> 172.21.15.69:0/1512816843 conn(0x7fa48406ab40 msgr2=0x7fa48415ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:21.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 -- 172.21.15.69:0/1512816843 shutdown_connections 2023-11-17T06:31:21.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:21.942+0000 7fa4898fd700 1 -- 172.21.15.69:0/1512816843 wait complete. 2023-11-17T06:31:21.969 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:22.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.134+0000 7fba18e14700 1 Processor -- start 2023-11-17T06:31:22.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.134+0000 7fba18e14700 1 -- start start 2023-11-17T06:31:22.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba18e14700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fba140b8bc0 0x7fba140cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba18e14700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba140b9000 con 0x7fba1415d490 2023-11-17T06:31:22.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba18e14700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba140d1bb0 con 0x7fba140ce310 2023-11-17T06:31:22.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba18e14700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba140ce7c0 con 0x7fba140b8bc0 2023-11-17T06:31:22.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba137fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fba1415d490 0x7fba140d13d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43558/0 (socket says 172.21.15.69:43558) 2023-11-17T06:31:22.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba137fe700 1 -- 172.21.15.69:0/1934046610 learned_addr learned my addr 172.21.15.69:0/1934046610 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:22.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba0bfff700 1 --2- 172.21.15.69:0/1934046610 >> v2:172.21.15.69:3300/0 conn(0x7fba140b8bc0 0x7fba140cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba12ffd700 1 -- 172.21.15.69:0/1934046610 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059590417 0 0) 0x7fba04001110 con 0x7fba1415d490 2023-11-17T06:31:22.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba0bfff700 1 -- 172.21.15.69:0/1934046610 >> v1:172.21.15.93:6789/0 conn(0x7fba140ce310 legacy=0x7fba140b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba0bfff700 1 -- 172.21.15.69:0/1934046610 >> v1:172.21.15.69:6789/0 conn(0x7fba1415d490 legacy=0x7fba140d13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba0bfff700 1 -- 172.21.15.69:0/1934046610 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140d1e90 con 0x7fba140b8bc0 2023-11-17T06:31:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba0bfff700 1 --2- 172.21.15.69:0/1934046610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba140b8bc0 0x7fba140cddd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0097d0 tx=0x7fb9fc009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49fd237dec7e098 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.138+0000 7fba12ffd700 1 -- 172.21.15.69:0/1934046610 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc004230 con 0x7fba140b8bc0 2023-11-17T06:31:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba12ffd700 1 -- 172.21.15.69:0/1934046610 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc004390 con 0x7fba140b8bc0 2023-11-17T06:31:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba12ffd700 1 -- 172.21.15.69:0/1934046610 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0036c0 con 0x7fba140b8bc0 2023-11-17T06:31:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba18e14700 1 -- 172.21.15.69:0/1934046610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba140b8bc0 msgr2=0x7fba140cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba18e14700 1 --2- 172.21.15.69:0/1934046610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba140b8bc0 0x7fba140cddd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0097d0 tx=0x7fb9fc009ae0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba18e14700 1 -- 172.21.15.69:0/1934046610 shutdown_connections 2023-11-17T06:31:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba18e14700 1 --2- 172.21.15.69:0/1934046610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba140b8bc0 0x7fba140cddd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba18e14700 1 -- 172.21.15.69:0/1934046610 >> 172.21.15.69:0/1934046610 conn(0x7fba1406ab40 msgr2=0x7fba1406af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba18e14700 1 -- 172.21.15.69:0/1934046610 shutdown_connections 2023-11-17T06:31:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba18e14700 1 -- 172.21.15.69:0/1934046610 wait complete. 2023-11-17T06:31:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba18e14700 1 Processor -- start 2023-11-17T06:31:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.142+0000 7fba18e14700 1 -- start start 2023-11-17T06:31:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba18e14700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba140b8bc0 0x7fba141551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba18e14700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba140ce310 0x7fba1414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba18e14700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba1415d490 0x7fba14157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba18e14700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba141f2850 con 0x7fba1415d490 2023-11-17T06:31:22.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba18e14700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1414eb90 con 0x7fba140b8bc0 2023-11-17T06:31:22.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba18e14700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba14158290 con 0x7fba140ce310 2023-11-17T06:31:22.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba13fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba1415d490 0x7fba14157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba13fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba1415d490 0x7fba14157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40972/0 (socket says 172.21.15.69:40972) 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba13fff700 1 -- 172.21.15.69:0/3339727797 learned_addr learned my addr 172.21.15.69:0/3339727797 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba137fe700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba140b8bc0 0x7fba141551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba0bfff700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba140ce310 0x7fba1414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba13fff700 1 -- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba140ce310 msgr2=0x7fba1414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba13fff700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba140ce310 0x7fba1414e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba13fff700 1 -- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba140b8bc0 msgr2=0x7fba141551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba13fff700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba140b8bc0 0x7fba141551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba13fff700 1 -- 172.21.15.69:0/3339727797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0094b0 con 0x7fba1415d490 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba13fff700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba1415d490 0x7fba14157680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001fd0 tx=0x7fba0c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba10ff9700 1 -- 172.21.15.69:0/3339727797 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c003e50 con 0x7fba1415d490 2023-11-17T06:31:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba10ff9700 1 -- 172.21.15.69:0/3339727797 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c00a8c0 con 0x7fba1415d490 2023-11-17T06:31:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba10ff9700 1 -- 172.21.15.69:0/3339727797 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00ac70 con 0x7fba1415d490 2023-11-17T06:31:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba18e14700 1 -- 172.21.15.69:0/3339727797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba14157fb0 con 0x7fba1415d490 2023-11-17T06:31:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.146+0000 7fba18e14700 1 -- 172.21.15.69:0/3339727797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba141f2d20 con 0x7fba1415d490 2023-11-17T06:31:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.150+0000 7fba18e14700 1 -- 172.21.15.69:0/3339727797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba14073f00 con 0x7fba1415d490 2023-11-17T06:31:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.150+0000 7fba10ff9700 1 -- 172.21.15.69:0/3339727797 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fba0c005070 con 0x7fba1415d490 2023-11-17T06:31:22.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.150+0000 7fba10ff9700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb9f4066510 0x7fb9f40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.150+0000 7fba10ff9700 1 -- 172.21.15.69:0/3339727797 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fba0c083c40 con 0x7fba1415d490 2023-11-17T06:31:22.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.154+0000 7fba137fe700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb9f4066510 0x7fb9f40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.154+0000 7fba137fe700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb9f4066510 0x7fb9f40689d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba04000f60 tx=0x7fba04007d00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.158+0000 7fba10ff9700 1 -- 172.21.15.69:0/3339727797 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fba0c051370 con 0x7fba1415d490 2023-11-17T06:31:22.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.334+0000 7fba18e14700 1 -- 172.21.15.69:0/3339727797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba140d2420 con 0x7fba1415d490 2023-11-17T06:31:22.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.334+0000 7fba10ff9700 1 -- 172.21.15.69:0/3339727797 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+12773 (secure 0 0 0) 0x7fba0c054990 con 0x7fba1415d490 2023-11-17T06:31:22.342 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:22.342 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":33,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:31:18.064397+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 -- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb9f4066510 msgr2=0x7fb9f40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb9f4066510 0x7fb9f40689d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fba04000f60 tx=0x7fba04007d00 comp rx=0 tx=0).stop 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 -- 172.21.15.69:0/3339727797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba1415d490 msgr2=0x7fba14157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba1415d490 0x7fba14157680 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fba0c001fd0 tx=0x7fba0c00a340 comp rx=0 tx=0).stop 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 -- 172.21.15.69:0/3339727797 shutdown_connections 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb9f4066510 0x7fb9f40689d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba1415d490 0x7fba14157680 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fba140ce310 0x7fba1414e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 --2- 172.21.15.69:0/3339727797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba140b8bc0 0x7fba141551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 -- 172.21.15.69:0/3339727797 >> 172.21.15.69:0/3339727797 conn(0x7fba1406ab40 msgr2=0x7fba1415ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:22.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 -- 172.21.15.69:0/3339727797 shutdown_connections 2023-11-17T06:31:22.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.338+0000 7fba18e14700 1 -- 172.21.15.69:0/3339727797 wait complete. 2023-11-17T06:31:22.367 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:31:22.368 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:31:22.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1ce544700 1 Processor -- start 2023-11-17T06:31:22.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1ce544700 1 -- start start 2023-11-17T06:31:22.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1ce544700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa1c80b8150 0x7fa1c80d1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1ce544700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c80b6750 con 0x7fa1c815d980 2023-11-17T06:31:22.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1ce544700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1c80d2a30 con 0x7fa1c80b5440 2023-11-17T06:31:22.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1ce544700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1c80b6980 con 0x7fa1c80b8150 2023-11-17T06:31:22.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1ccae1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa1c80b8150 0x7fa1c80d1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1c7fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa1c815d980 0x7fa1c80b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43574/0 (socket says 172.21.15.69:43574) 2023-11-17T06:31:22.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1c7fff700 1 -- 172.21.15.69:0/314209515 learned_addr learned my addr 172.21.15.69:0/314209515 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:22.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1ccae1700 1 -- 172.21.15.69:0/314209515 >> v1:172.21.15.93:6789/0 conn(0x7fa1c80b5440 legacy=0x7fa1c80d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:22.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.550+0000 7fa1ccae1700 1 -- 172.21.15.69:0/314209515 >> v1:172.21.15.69:6789/0 conn(0x7fa1c815d980 legacy=0x7fa1c80b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1ccae1700 1 -- 172.21.15.69:0/314209515 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c80d2470 con 0x7fa1c80b8150 2023-11-17T06:31:22.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1c6ffd700 1 -- 172.21.15.69:0/314209515 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349311264 0 0) 0x7fa1c80b6750 con 0x7fa1c815d980 2023-11-17T06:31:22.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1ccae1700 1 --2- 172.21.15.69:0/314209515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b8150 0x7fa1c80d1e70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009d90 tx=0x7fa1c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f7abb8d879c12f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1c6ffd700 1 -- 172.21.15.69:0/314209515 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c000e070 con 0x7fa1c80b8150 2023-11-17T06:31:22.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1c6ffd700 1 -- 172.21.15.69:0/314209515 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c000bbd0 con 0x7fa1c80b8150 2023-11-17T06:31:22.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1c6ffd700 1 -- 172.21.15.69:0/314209515 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0012430 con 0x7fa1c80b8150 2023-11-17T06:31:22.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1ce544700 1 -- 172.21.15.69:0/314209515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b8150 msgr2=0x7fa1c80d1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1ce544700 1 --2- 172.21.15.69:0/314209515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b8150 0x7fa1c80d1e70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009d90 tx=0x7fa1c000b330 comp rx=0 tx=0).stop 2023-11-17T06:31:22.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1ce544700 1 -- 172.21.15.69:0/314209515 shutdown_connections 2023-11-17T06:31:22.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1ce544700 1 --2- 172.21.15.69:0/314209515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b8150 0x7fa1c80d1e70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1ce544700 1 -- 172.21.15.69:0/314209515 >> 172.21.15.69:0/314209515 conn(0x7fa1c80cfd30 msgr2=0x7fa1c80d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:22.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1ce544700 1 -- 172.21.15.69:0/314209515 shutdown_connections 2023-11-17T06:31:22.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.554+0000 7fa1ce544700 1 -- 172.21.15.69:0/314209515 wait complete. 2023-11-17T06:31:22.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.558+0000 7fa1ce544700 1 Processor -- start 2023-11-17T06:31:22.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.558+0000 7fa1ce544700 1 -- start start 2023-11-17T06:31:22.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.558+0000 7fa1ce544700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b5440 0x7fa1c8156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.558+0000 7fa1ce544700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa1c80b8150 0x7fa1c814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1ce544700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1c80c9190 0x7fa1c8154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1ce544700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8156c70 con 0x7fa1c80b5440 2023-11-17T06:31:22.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1ce544700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c80c9920 con 0x7fa1c80c9190 2023-11-17T06:31:22.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1ce544700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1c8156e90 con 0x7fa1c80b8150 2023-11-17T06:31:22.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b5440 0x7fa1c8156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b5440 0x7fa1c8156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40996/0 (socket says 172.21.15.69:40996) 2023-11-17T06:31:22.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c7fff700 1 -- 172.21.15.69:0/450183607 learned_addr learned my addr 172.21.15.69:0/450183607 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:22.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c7fff700 1 -- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa1c80b8150 msgr2=0x7fa1c814a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c7fff700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa1c80b8150 0x7fa1c814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c7fff700 1 -- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1c80c9190 msgr2=0x7fa1c8154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c7fff700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1c80c9190 0x7fa1c8154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c7fff700 1 -- 172.21.15.69:0/450183607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c0009a70 con 0x7fa1c80b5440 2023-11-17T06:31:22.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c7fff700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b5440 0x7fa1c8156730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800c550 tx=0x7fa1b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c4ff9700 1 -- 172.21.15.69:0/450183607 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8004ca0 con 0x7fa1c80b5440 2023-11-17T06:31:22.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c4ff9700 1 -- 172.21.15.69:0/450183607 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b8004e00 con 0x7fa1c80b5440 2023-11-17T06:31:22.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1c4ff9700 1 -- 172.21.15.69:0/450183607 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8007310 con 0x7fa1c80b5440 2023-11-17T06:31:22.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1ce544700 1 -- 172.21.15.69:0/450183607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1c80ca500 con 0x7fa1c80b5440 2023-11-17T06:31:22.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1ce544700 1 -- 172.21.15.69:0/450183607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1c80caac0 con 0x7fa1c80b5440 2023-11-17T06:31:22.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.562+0000 7fa1ce544700 1 -- 172.21.15.69:0/450183607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1c80ca360 con 0x7fa1c80b5440 2023-11-17T06:31:22.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.566+0000 7fa1c4ff9700 1 -- 172.21.15.69:0/450183607 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa1b8007470 con 0x7fa1c80b5440 2023-11-17T06:31:22.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.566+0000 7fa1c4ff9700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa1b4066510 0x7fa1b40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.566+0000 7fa1c4ff9700 1 -- 172.21.15.69:0/450183607 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa1b80838e0 con 0x7fa1c80b5440 2023-11-17T06:31:22.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.570+0000 7fa1c77fe700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa1b4066510 0x7fa1b40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.570+0000 7fa1c77fe700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa1b4066510 0x7fa1b40689d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc000f60 tx=0x7fa1bc007a60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.574+0000 7fa1c4ff9700 1 -- 172.21.15.69:0/450183607 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa1c80ca360 con 0x7fa1c80b5440 2023-11-17T06:31:22.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.746+0000 7fa1ce544700 1 -- 172.21.15.69:0/450183607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa1c80ca360 con 0x7fa1c80b5440 2023-11-17T06:31:22.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.746+0000 7fa1c4ff9700 1 -- 172.21.15.69:0/450183607 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1c80ca360 con 0x7fa1c80b5440 2023-11-17T06:31:22.754 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:31:22.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 -- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa1b4066510 msgr2=0x7fa1b40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa1b4066510 0x7fa1b40689d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc000f60 tx=0x7fa1bc007a60 comp rx=0 tx=0).stop 2023-11-17T06:31:22.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 -- 172.21.15.69:0/450183607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b5440 msgr2=0x7fa1c8156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b5440 0x7fa1c8156730 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800c550 tx=0x7fa1b800c910 comp rx=0 tx=0).stop 2023-11-17T06:31:22.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 -- 172.21.15.69:0/450183607 shutdown_connections 2023-11-17T06:31:22.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa1b4066510 0x7fa1b40689d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1c80c9190 0x7fa1c8154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa1c80b8150 0x7fa1c814a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 --2- 172.21.15.69:0/450183607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1c80b5440 0x7fa1c8156730 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 -- 172.21.15.69:0/450183607 >> 172.21.15.69:0/450183607 conn(0x7fa1c80cfd30 msgr2=0x7fa1c80d3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:22.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 -- 172.21.15.69:0/450183607 shutdown_connections 2023-11-17T06:31:22.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.750+0000 7fa1ce544700 1 -- 172.21.15.69:0/450183607 wait complete. 2023-11-17T06:31:22.777 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-17T06:31:22.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.946+0000 7f24c9ca8700 1 Processor -- start 2023-11-17T06:31:22.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24c9ca8700 1 -- start start 2023-11-17T06:31:22.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24c9ca8700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f24c40cb400 0x7f24c415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24c9ca8700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c40b09e0 con 0x7f24c40cb020 2023-11-17T06:31:22.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24c9ca8700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c40b0cc0 con 0x7f24c40cba80 2023-11-17T06:31:22.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24c9ca8700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c415fd90 con 0x7f24c40cb400 2023-11-17T06:31:22.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24c37fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f24c40cb020 0x7f24c406fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43590/0 (socket says 172.21.15.69:43590) 2023-11-17T06:31:22.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24c37fe700 1 -- 172.21.15.69:0/3973686112 learned_addr learned my addr 172.21.15.69:0/3973686112 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:22.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24bbfff700 1 --2- 172.21.15.69:0/3973686112 >> v2:172.21.15.93:3300/0 conn(0x7f24c40cb400 0x7f24c415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24c2ffd700 1 -- 172.21.15.69:0/3973686112 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697861557 0 0) 0x7f24c40b09e0 con 0x7f24c40cb020 2023-11-17T06:31:22.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24c2ffd700 1 -- 172.21.15.69:0/3973686112 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24b00035d0 con 0x7f24c40cb020 2023-11-17T06:31:22.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24bbfff700 1 -- 172.21.15.69:0/3973686112 >> v1:172.21.15.93:6789/0 conn(0x7f24c40cba80 legacy=0x7f24c41519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24bbfff700 1 -- 172.21.15.69:0/3973686112 >> v1:172.21.15.69:6789/0 conn(0x7f24c40cb020 legacy=0x7f24c406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.950+0000 7f24bbfff700 1 -- 172.21.15.69:0/3973686112 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c40b0fa0 con 0x7f24c40cb400 2023-11-17T06:31:22.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24bbfff700 1 --2- 172.21.15.69:0/3973686112 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24c40cb400 0x7f24c415ed80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009850 tx=0x7f24ac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f237e59d9eabc29e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24c2ffd700 1 -- 172.21.15.69:0/3973686112 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac011830 con 0x7f24c40cb400 2023-11-17T06:31:22.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24c2ffd700 1 -- 172.21.15.69:0/3973686112 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac011990 con 0x7f24c40cb400 2023-11-17T06:31:22.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24c2ffd700 1 -- 172.21.15.69:0/3973686112 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac011d40 con 0x7f24c40cb400 2023-11-17T06:31:22.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24c9ca8700 1 -- 172.21.15.69:0/3973686112 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24c40cb400 msgr2=0x7f24c415ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24c9ca8700 1 --2- 172.21.15.69:0/3973686112 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24c40cb400 0x7f24c415ed80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f24ac009850 tx=0x7f24ac009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:22.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24c9ca8700 1 -- 172.21.15.69:0/3973686112 shutdown_connections 2023-11-17T06:31:22.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24c9ca8700 1 --2- 172.21.15.69:0/3973686112 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24c40cb400 0x7f24c415ed80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24c9ca8700 1 -- 172.21.15.69:0/3973686112 >> 172.21.15.69:0/3973686112 conn(0x7f24c406a480 msgr2=0x7f24c406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:22.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24c9ca8700 1 -- 172.21.15.69:0/3973686112 shutdown_connections 2023-11-17T06:31:22.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.954+0000 7f24c9ca8700 1 -- 172.21.15.69:0/3973686112 wait complete. 2023-11-17T06:31:22.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.958+0000 7f24c9ca8700 1 Processor -- start 2023-11-17T06:31:22.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.958+0000 7f24c9ca8700 1 -- start start 2023-11-17T06:31:22.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.958+0000 7f24c9ca8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24c40cb020 0x7f24c4156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.958+0000 7f24c9ca8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24c40cb400 0x7f24c41f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.958+0000 7f24c9ca8700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24c40cba80 0x7f24c40b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.958+0000 7f24c9ca8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c40b1660 con 0x7f24c40cb400 2023-11-17T06:31:22.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.958+0000 7f24c9ca8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c4155e50 con 0x7f24c40cb020 2023-11-17T06:31:22.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.958+0000 7f24c9ca8700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c41f6eb0 con 0x7f24c40cba80 2023-11-17T06:31:22.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24bbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24c40cb400 0x7f24c41f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24bbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24c40cb400 0x7f24c41f2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41000/0 (socket says 172.21.15.69:41000) 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24bbfff700 1 -- 172.21.15.69:0/914950355 learned_addr learned my addr 172.21.15.69:0/914950355 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24c37fe700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24c40cb020 0x7f24c4156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24c3fff700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24c40cba80 0x7f24c40b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24bbfff700 1 -- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24c40cba80 msgr2=0x7f24c40b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24bbfff700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24c40cba80 0x7f24c40b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24bbfff700 1 -- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24c40cb020 msgr2=0x7f24c4156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24bbfff700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24c40cb020 0x7f24c4156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24bbfff700 1 -- 172.21.15.69:0/914950355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0094b0 con 0x7f24c40cb400 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24c37fe700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24c40cb020 0x7f24c4156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:22.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24c3fff700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24c40cba80 0x7f24c40b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:22.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24bbfff700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24c40cb400 0x7f24c41f2380 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0090b0 tx=0x7f24ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24c0ff9700 1 -- 172.21.15.69:0/914950355 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac01aac0 con 0x7f24c40cb400 2023-11-17T06:31:22.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24c0ff9700 1 -- 172.21.15.69:0/914950355 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ac01f070 con 0x7f24c40cb400 2023-11-17T06:31:22.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24c9ca8700 1 -- 172.21.15.69:0/914950355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c41560a0 con 0x7f24c40cb400 2023-11-17T06:31:22.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24c0ff9700 1 -- 172.21.15.69:0/914950355 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac01ae60 con 0x7f24c40cb400 2023-11-17T06:31:22.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24c9ca8700 1 -- 172.21.15.69:0/914950355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c4156660 con 0x7f24c40cb400 2023-11-17T06:31:22.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.962+0000 7f24c9ca8700 1 -- 172.21.15.69:0/914950355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c4071fd0 con 0x7f24c40cb400 2023-11-17T06:31:22.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.966+0000 7f24c0ff9700 1 -- 172.21.15.69:0/914950355 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f24ac01b430 con 0x7f24c40cb400 2023-11-17T06:31:22.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.966+0000 7f24c0ff9700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f24a4066510 0x7f24a40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:22.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.966+0000 7f24c0ff9700 1 -- 172.21.15.69:0/914950355 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f24ac084ca0 con 0x7f24c40cb400 2023-11-17T06:31:22.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.966+0000 7f24c37fe700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f24a4066510 0x7f24a40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:22.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.970+0000 7f24c37fe700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f24a4066510 0x7f24a40689d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f24b40011e0 tx=0x7f24b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:22.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:22.974+0000 7f24c0ff9700 1 -- 172.21.15.69:0/914950355 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f24c4071fd0 con 0x7f24c40cb400 2023-11-17T06:31:23.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.146+0000 7f24c9ca8700 1 -- 172.21.15.69:0/914950355 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f24c4071fd0 con 0x7f24c40cb400 2023-11-17T06:31:23.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c0ff9700 1 -- 172.21.15.69:0/914950355 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+65 (secure 0 0 0) 0x7f24c4071fd0 con 0x7f24c40cb400 2023-11-17T06:31:23.155 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:23.156 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2023-11-17T06:31:23.156 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-11-17T06:31:23.156 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 1, 2023-11-17T06:31:23.156 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": ".mgr" 2023-11-17T06:31:23.156 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:31:23.157 INFO:teuthology.orchestra.run.smithi069.stdout:] 2023-11-17T06:31:23.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 -- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f24a4066510 msgr2=0x7f24a40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:23.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f24a4066510 0x7f24a40689d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f24b40011e0 tx=0x7f24b4009040 comp rx=0 tx=0).stop 2023-11-17T06:31:23.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 -- 172.21.15.69:0/914950355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24c40cb400 msgr2=0x7f24c41f2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:23.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24c40cb400 0x7f24c41f2380 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0090b0 tx=0x7f24ac004770 comp rx=0 tx=0).stop 2023-11-17T06:31:23.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 -- 172.21.15.69:0/914950355 shutdown_connections 2023-11-17T06:31:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f24a4066510 0x7f24a40689d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24c40cba80 0x7f24c40b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24c40cb400 0x7f24c41f2380 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 --2- 172.21.15.69:0/914950355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24c40cb020 0x7f24c4156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:23.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 -- 172.21.15.69:0/914950355 >> 172.21.15.69:0/914950355 conn(0x7f24c406a480 msgr2=0x7f24c40cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:23.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 -- 172.21.15.69:0/914950355 shutdown_connections 2023-11-17T06:31:23.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.150+0000 7f24c9ca8700 1 -- 172.21.15.69:0/914950355 wait complete. 2023-11-17T06:31:23.179 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-17T06:31:23.179 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-17T06:31:23.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.350+0000 7f6870e91700 1 Processor -- start 2023-11-17T06:31:23.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.350+0000 7f6870e91700 1 -- start start 2023-11-17T06:31:23.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f6870e91700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f686c15b1d0 0x7f686c161bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:23.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f6870e91700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f686c0ce570 0x7f686c15e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:23.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f6870e91700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f686c1611a0 con 0x7f686c15dbb0 2023-11-17T06:31:23.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f6870e91700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686c0d2ef0 con 0x7f686c15b1d0 2023-11-17T06:31:23.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f6870e91700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c162110 con 0x7f686c0ce570 2023-11-17T06:31:23.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f686b7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f686c15b1d0 0x7f686c161bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:23.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f6862ffd700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f686c15dbb0 0x7f686c0cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:55992/0 (socket says 172.21.15.69:55992) 2023-11-17T06:31:23.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f6862ffd700 1 -- 172.21.15.69:0/2555942668 learned_addr learned my addr 172.21.15.69:0/2555942668 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:23.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f686bfff700 1 --2- 172.21.15.69:0/2555942668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f686c0ce570 0x7f686c15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:23.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f686affd700 1 -- 172.21.15.69:0/2555942668 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654277742 0 0) 0x7f686c1611a0 con 0x7f686c15dbb0 2023-11-17T06:31:23.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f686b7fe700 1 -- 172.21.15.69:0/2555942668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f686c0ce570 msgr2=0x7f686c15e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:23.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f686b7fe700 1 --2- 172.21.15.69:0/2555942668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f686c0ce570 0x7f686c15e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:23.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f686b7fe700 1 -- 172.21.15.69:0/2555942668 >> v1:172.21.15.93:6789/0 conn(0x7f686c15dbb0 legacy=0x7f686c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:23.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.354+0000 7f686b7fe700 1 -- 172.21.15.69:0/2555942668 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c15b5b0 con 0x7f686c15b1d0 2023-11-17T06:31:23.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f686b7fe700 1 --2- 172.21.15.69:0/2555942668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f686c15b1d0 0x7f686c161bd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f685c009850 tx=0x7f685c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=327d94505b32c7dc server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:23.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f686affd700 1 -- 172.21.15.69:0/2555942668 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c011830 con 0x7f686c15b1d0 2023-11-17T06:31:23.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f686affd700 1 -- 172.21.15.69:0/2555942668 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c011990 con 0x7f686c15b1d0 2023-11-17T06:31:23.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f686affd700 1 -- 172.21.15.69:0/2555942668 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c011d40 con 0x7f686c15b1d0 2023-11-17T06:31:23.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f6870e91700 1 -- 172.21.15.69:0/2555942668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f686c15b1d0 msgr2=0x7f686c161bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:23.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f6870e91700 1 --2- 172.21.15.69:0/2555942668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f686c15b1d0 0x7f686c161bd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f685c009850 tx=0x7f685c009b60 comp rx=0 tx=0).stop 2023-11-17T06:31:23.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f6870e91700 1 -- 172.21.15.69:0/2555942668 shutdown_connections 2023-11-17T06:31:23.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f6870e91700 1 --2- 172.21.15.69:0/2555942668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f686c0ce570 0x7f686c15e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:23.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f6870e91700 1 --2- 172.21.15.69:0/2555942668 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f686c15b1d0 0x7f686c161bd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:23.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f6870e91700 1 -- 172.21.15.69:0/2555942668 >> 172.21.15.69:0/2555942668 conn(0x7f686c06ac60 msgr2=0x7f686c06b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:23.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f6870e91700 1 -- 172.21.15.69:0/2555942668 shutdown_connections 2023-11-17T06:31:23.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.358+0000 7f6870e91700 1 -- 172.21.15.69:0/2555942668 wait complete. 2023-11-17T06:31:23.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f6870e91700 1 Processor -- start 2023-11-17T06:31:23.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f6870e91700 1 -- start start 2023-11-17T06:31:23.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f6870e91700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f686c0ce570 0x7f686c0cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:23.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f6870e91700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f686c15b1d0 0x7f686c0b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:23.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f6870e91700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f686c15dbb0 0x7f686c1f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:23.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f6870e91700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c1f5f80 con 0x7f686c15dbb0 2023-11-17T06:31:23.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f6870e91700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f686c0c9430 con 0x7f686c0ce570 2023-11-17T06:31:23.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f6870e91700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f686c0c9710 con 0x7f686c15b1d0 2023-11-17T06:31:23.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f686bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f686c15dbb0 0x7f686c1f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:23.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f686bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f686c15dbb0 0x7f686c1f6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41004/0 (socket says 172.21.15.69:41004) 2023-11-17T06:31:23.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f686bfff700 1 -- 172.21.15.69:0/1358371275 learned_addr learned my addr 172.21.15.69:0/1358371275 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:23.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f6862ffd700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f686c15b1d0 0x7f686c0b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:23.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f686b7fe700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f686c0ce570 0x7f686c0cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:23.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f686bfff700 1 -- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f686c15b1d0 msgr2=0x7f686c0b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:23.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f686bfff700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f686c15b1d0 0x7f686c0b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:23.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f686bfff700 1 -- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f686c0ce570 msgr2=0x7f686c0cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:23.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f686bfff700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f686c0ce570 0x7f686c0cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:23.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f686bfff700 1 -- 172.21.15.69:0/1358371275 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0094b0 con 0x7f686c15dbb0 2023-11-17T06:31:23.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.362+0000 7f686bfff700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f686c15dbb0 0x7f686c1f6710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f686400efc0 tx=0x7f686400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:23.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.366+0000 7f6868ff9700 1 -- 172.21.15.69:0/1358371275 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686400cad0 con 0x7f686c15dbb0 2023-11-17T06:31:23.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.366+0000 7f6868ff9700 1 -- 172.21.15.69:0/1358371275 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686400f040 con 0x7f686c15dbb0 2023-11-17T06:31:23.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.366+0000 7f6868ff9700 1 -- 172.21.15.69:0/1358371275 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686400ce70 con 0x7f686c15dbb0 2023-11-17T06:31:23.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.366+0000 7f6870e91700 1 -- 172.21.15.69:0/1358371275 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686c1f61f0 con 0x7f686c15dbb0 2023-11-17T06:31:23.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.366+0000 7f6870e91700 1 -- 172.21.15.69:0/1358371275 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f686c158d80 con 0x7f686c15dbb0 2023-11-17T06:31:23.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.366+0000 7f6870e91700 1 -- 172.21.15.69:0/1358371275 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f686c0686a0 con 0x7f686c15dbb0 2023-11-17T06:31:23.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.370+0000 7f6868ff9700 1 -- 172.21.15.69:0/1358371275 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6864014480 con 0x7f686c15dbb0 2023-11-17T06:31:23.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.370+0000 7f6868ff9700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f684c066510 0x7f684c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:23.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.370+0000 7f6868ff9700 1 -- 172.21.15.69:0/1358371275 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68640841b0 con 0x7f686c15dbb0 2023-11-17T06:31:23.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.370+0000 7f686b7fe700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f684c066510 0x7f684c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:23.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.370+0000 7f686b7fe700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f684c066510 0x7f684c0689d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f685c0090b0 tx=0x7f685c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:23.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.374+0000 7f6868ff9700 1 -- 172.21.15.69:0/1358371275 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6864051ac0 con 0x7f686c15dbb0 2023-11-17T06:31:23.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:23.550+0000 7f6870e91700 1 -- 172.21.15.69:0/1358371275 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f686c0d0e30 con 0x7f686c15dbb0 2023-11-17T06:31:24.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.206+0000 7f6868ff9700 1 -- 172.21.15.69:0/1358371275 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7f68640550e0 con 0x7f686c15dbb0 2023-11-17T06:31:24.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 -- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f684c066510 msgr2=0x7f684c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:24.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f684c066510 0x7f684c0689d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f685c0090b0 tx=0x7f685c008030 comp rx=0 tx=0).stop 2023-11-17T06:31:24.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 -- 172.21.15.69:0/1358371275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f686c15dbb0 msgr2=0x7f686c1f6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:24.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f686c15dbb0 0x7f686c1f6710 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f686400efc0 tx=0x7f686400c0c0 comp rx=0 tx=0).stop 2023-11-17T06:31:24.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 -- 172.21.15.69:0/1358371275 shutdown_connections 2023-11-17T06:31:24.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f684c066510 0x7f684c0689d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:24.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f686c15dbb0 0x7f686c1f6710 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:24.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f686c15b1d0 0x7f686c0b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:24.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 --2- 172.21.15.69:0/1358371275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f686c0ce570 0x7f686c0cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:24.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 -- 172.21.15.69:0/1358371275 >> 172.21.15.69:0/1358371275 conn(0x7f686c06ac60 msgr2=0x7f686c15ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:24.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 -- 172.21.15.69:0/1358371275 shutdown_connections 2023-11-17T06:31:24.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.210+0000 7f6870e91700 1 -- 172.21.15.69:0/1358371275 wait complete. 2023-11-17T06:31:24.221 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' created 2023-11-17T06:31:24.243 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-17T06:31:24.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.442+0000 7f584c448700 1 Processor -- start 2023-11-17T06:31:24.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.442+0000 7f584c448700 1 -- start start 2023-11-17T06:31:24.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f584c448700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f584415d980 0x7f58440b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:24.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f584c448700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f58440b5270 0x7f58440d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:24.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f584c448700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58440b6750 con 0x7f58440d1ca0 2023-11-17T06:31:24.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f584c448700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58440d2a30 con 0x7f58440b5270 2023-11-17T06:31:24.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f584c448700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58440b6980 con 0x7f584415d980 2023-11-17T06:31:24.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f58499e3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f58440b5270 0x7f58440d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:24.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f58499e3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f58440b5270 0x7f58440d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60982/0 (socket says 172.21.15.69:60982) 2023-11-17T06:31:24.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f58499e3700 1 -- 172.21.15.69:0/3166344605 learned_addr learned my addr 172.21.15.69:0/3166344605 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:24.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f584a1e4700 1 --2- 172.21.15.69:0/3166344605 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f584415d980 0x7f58440b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:24.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f58499e3700 1 -- 172.21.15.69:0/3166344605 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f584415d980 msgr2=0x7f58440b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:24.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f58499e3700 1 --2- 172.21.15.69:0/3166344605 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f584415d980 0x7f58440b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:24.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f58499e3700 1 -- 172.21.15.69:0/3166344605 >> v1:172.21.15.93:6789/0 conn(0x7f58440d1ca0 legacy=0x7f584406ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:24.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f58499e3700 1 -- 172.21.15.69:0/3166344605 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440b56d0 con 0x7f58440b5270 2023-11-17T06:31:24.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.446+0000 7f584a1e4700 1 --2- 172.21.15.69:0/3166344605 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f584415d980 0x7f58440b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:24.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f58499e3700 1 --2- 172.21.15.69:0/3166344605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58440b5270 0x7f58440d1760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5834009910 tx=0x7f5834009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef7b9bdd7a9a4fe server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:24.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f58491e2700 1 -- 172.21.15.69:0/3166344605 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583400ba60 con 0x7f58440b5270 2023-11-17T06:31:24.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f58491e2700 1 -- 172.21.15.69:0/3166344605 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583400bbc0 con 0x7f58440b5270 2023-11-17T06:31:24.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f58491e2700 1 -- 172.21.15.69:0/3166344605 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5834009e60 con 0x7f58440b5270 2023-11-17T06:31:24.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f584c448700 1 -- 172.21.15.69:0/3166344605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58440b5270 msgr2=0x7f58440d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:24.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f584c448700 1 --2- 172.21.15.69:0/3166344605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58440b5270 0x7f58440d1760 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5834009910 tx=0x7f5834009c20 comp rx=0 tx=0).stop 2023-11-17T06:31:24.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f584c448700 1 -- 172.21.15.69:0/3166344605 shutdown_connections 2023-11-17T06:31:24.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f584c448700 1 --2- 172.21.15.69:0/3166344605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58440b5270 0x7f58440d1760 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:24.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f584c448700 1 --2- 172.21.15.69:0/3166344605 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f584415d980 0x7f58440b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:24.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f584c448700 1 -- 172.21.15.69:0/3166344605 >> 172.21.15.69:0/3166344605 conn(0x7f58440cfd30 msgr2=0x7f58440d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:24.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f584c448700 1 -- 172.21.15.69:0/3166344605 shutdown_connections 2023-11-17T06:31:24.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.450+0000 7f584c448700 1 -- 172.21.15.69:0/3166344605 wait complete. 2023-11-17T06:31:24.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.454+0000 7f584c448700 1 Processor -- start 2023-11-17T06:31:24.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.454+0000 7f584c448700 1 -- start start 2023-11-17T06:31:24.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.454+0000 7f584c448700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58440b5270 0x7f58440aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:24.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584c448700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58440d1ca0 0x7f58441f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:24.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584c448700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441f2af0 0x7f58440b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:24.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584c448700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58440aae50 con 0x7f58441f2af0 2023-11-17T06:31:24.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584c448700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58440ab130 con 0x7f58440b5270 2023-11-17T06:31:24.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584c448700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58440ab410 con 0x7f58440d1ca0 2023-11-17T06:31:24.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584a9e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441f2af0 0x7f58440b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:24.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584a9e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441f2af0 0x7f58440b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60998/0 (socket says 172.21.15.69:60998) 2023-11-17T06:31:24.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584a9e5700 1 -- 172.21.15.69:0/4145329722 learned_addr learned my addr 172.21.15.69:0/4145329722 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:24.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f58499e3700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58440d1ca0 0x7f58441f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:24.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584a1e4700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58440b5270 0x7f58440aa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:24.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584a9e5700 1 -- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58440d1ca0 msgr2=0x7f58441f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:24.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584a9e5700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58440d1ca0 0x7f58441f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:24.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584a9e5700 1 -- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58440b5270 msgr2=0x7f58440aa5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:24.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584a9e5700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58440b5270 0x7f58440aa5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:24.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584a9e5700 1 -- 172.21.15.69:0/4145329722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5834009570 con 0x7f58441f2af0 2023-11-17T06:31:24.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584a9e5700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441f2af0 0x7f58440b40d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f583c00cb50 tx=0x7f583c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:24.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f583affd700 1 -- 172.21.15.69:0/4145329722 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c003c20 con 0x7f58441f2af0 2023-11-17T06:31:24.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f583affd700 1 -- 172.21.15.69:0/4145329722 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c003d80 con 0x7f58441f2af0 2023-11-17T06:31:24.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584c448700 1 -- 172.21.15.69:0/4145329722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58440ab6f0 con 0x7f58441f2af0 2023-11-17T06:31:24.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f583affd700 1 -- 172.21.15.69:0/4145329722 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c00aa20 con 0x7f58441f2af0 2023-11-17T06:31:24.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.458+0000 7f584c448700 1 -- 172.21.15.69:0/4145329722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5844160320 con 0x7f58441f2af0 2023-11-17T06:31:24.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.462+0000 7f584c448700 1 -- 172.21.15.69:0/4145329722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58441f2f90 con 0x7f58441f2af0 2023-11-17T06:31:24.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.462+0000 7f583affd700 1 -- 172.21.15.69:0/4145329722 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f583c00ab80 con 0x7f58441f2af0 2023-11-17T06:31:24.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.466+0000 7f583affd700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5828066510 0x7f58280689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:24.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.466+0000 7f583affd700 1 -- 172.21.15.69:0/4145329722 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f583c0845d0 con 0x7f58441f2af0 2023-11-17T06:31:24.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.466+0000 7f584a1e4700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5828066510 0x7f58280689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:24.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.466+0000 7f584a1e4700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5828066510 0x7f58280689d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58400099f0 tx=0x7f5840008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:24.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.470+0000 7f583affd700 1 -- 172.21.15.69:0/4145329722 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f583c0556b0 con 0x7f58441f2af0 2023-11-17T06:31:24.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:24.646+0000 7f584c448700 1 -- 172.21.15.69:0/4145329722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f58441f2f90 con 0x7f58441f2af0 2023-11-17T06:31:25.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.210+0000 7f583affd700 1 -- 172.21.15.69:0/4145329722 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7f58441f2f90 con 0x7f58441f2af0 2023-11-17T06:31:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.214+0000 7f584c448700 1 -- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5828066510 msgr2=0x7f58280689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.214+0000 7f584c448700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5828066510 0x7f58280689d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f58400099f0 tx=0x7f5840008040 comp rx=0 tx=0).stop 2023-11-17T06:31:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.214+0000 7f584c448700 1 -- 172.21.15.69:0/4145329722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441f2af0 msgr2=0x7f58440b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.214+0000 7f584c448700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441f2af0 0x7f58440b40d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f583c00cb50 tx=0x7f583c00ce60 comp rx=0 tx=0).stop 2023-11-17T06:31:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.218+0000 7f584c448700 1 -- 172.21.15.69:0/4145329722 shutdown_connections 2023-11-17T06:31:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.218+0000 7f584c448700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5828066510 0x7f58280689d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.218+0000 7f584c448700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441f2af0 0x7f58440b40d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.218+0000 7f584c448700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f58440d1ca0 0x7f58441f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.218+0000 7f584c448700 1 --2- 172.21.15.69:0/4145329722 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f58440b5270 0x7f58440aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.218+0000 7f584c448700 1 -- 172.21.15.69:0/4145329722 >> 172.21.15.69:0/4145329722 conn(0x7f58440cfd30 msgr2=0x7f58440b78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.218+0000 7f584c448700 1 -- 172.21.15.69:0/4145329722 shutdown_connections 2023-11-17T06:31:25.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.218+0000 7f584c448700 1 -- 172.21.15.69:0/4145329722 wait complete. 2023-11-17T06:31:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' created 2023-11-17T06:31:25.265 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-17T06:31:25.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.438+0000 7f6600f05700 1 Processor -- start 2023-11-17T06:31:25.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.438+0000 7f6600f05700 1 -- start start 2023-11-17T06:31:25.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f6600f05700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f65fc15d490 0x7f65fc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:25.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f6600f05700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc0ce4e0 0x7f65fc0b6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:25.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f6600f05700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc0d1bb0 con 0x7f65fc0d13d0 2023-11-17T06:31:25.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f6600f05700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc0d1e90 con 0x7f65fc15d490 2023-11-17T06:31:25.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f6600f05700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0d2170 con 0x7f65fc0ce4e0 2023-11-17T06:31:25.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f65fb7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f65fc15d490 0x7f65fc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:25.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f65fbfff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc0ce4e0 0x7f65fc0b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:25.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f65faffd700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f65fc0d13d0 0x7f65fc0cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:33298/0 (socket says 172.21.15.69:33298) 2023-11-17T06:31:25.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f65faffd700 1 -- 172.21.15.69:0/494980987 learned_addr learned my addr 172.21.15.69:0/494980987 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:25.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f65fbfff700 1 -- 172.21.15.69:0/494980987 >> v2:172.21.15.93:3300/0 conn(0x7f65fc15d490 msgr2=0x7f65fc0b8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:25.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f65fbfff700 1 --2- 172.21.15.69:0/494980987 >> v2:172.21.15.93:3300/0 conn(0x7f65fc15d490 0x7f65fc0b8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:25.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f65fa7fc700 1 -- 172.21.15.69:0/494980987 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426618709 0 0) 0x7f65fc0d1bb0 con 0x7f65fc0d13d0 2023-11-17T06:31:25.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f65fbfff700 1 -- 172.21.15.69:0/494980987 >> v1:172.21.15.93:6789/0 conn(0x7f65fc0d13d0 legacy=0x7f65fc0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f65fbfff700 1 -- 172.21.15.69:0/494980987 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc0d2450 con 0x7f65fc0ce4e0 2023-11-17T06:31:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.442+0000 7f65fbfff700 1 --2- 172.21.15.69:0/494980987 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc0ce4e0 0x7f65fc0b6130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009d90 tx=0x7f65f400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0647017e26877a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f65fa7fc700 1 -- 172.21.15.69:0/494980987 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f400e070 con 0x7f65fc0ce4e0 2023-11-17T06:31:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f65fa7fc700 1 -- 172.21.15.69:0/494980987 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f400bb20 con 0x7f65fc0ce4e0 2023-11-17T06:31:25.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f65fa7fc700 1 -- 172.21.15.69:0/494980987 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4012430 con 0x7f65fc0ce4e0 2023-11-17T06:31:25.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f6600f05700 1 -- 172.21.15.69:0/494980987 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc0ce4e0 msgr2=0x7f65fc0b6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:25.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f6600f05700 1 --2- 172.21.15.69:0/494980987 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc0ce4e0 0x7f65fc0b6130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009d90 tx=0x7f65f400b330 comp rx=0 tx=0).stop 2023-11-17T06:31:25.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f6600f05700 1 -- 172.21.15.69:0/494980987 shutdown_connections 2023-11-17T06:31:25.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f6600f05700 1 --2- 172.21.15.69:0/494980987 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc0ce4e0 0x7f65fc0b6130 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:25.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f6600f05700 1 --2- 172.21.15.69:0/494980987 >> v2:172.21.15.93:3300/0 conn(0x7f65fc15d490 0x7f65fc0b8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:25.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f6600f05700 1 -- 172.21.15.69:0/494980987 >> 172.21.15.69:0/494980987 conn(0x7f65fc06ab40 msgr2=0x7f65fc06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:25.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f6600f05700 1 -- 172.21.15.69:0/494980987 shutdown_connections 2023-11-17T06:31:25.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.446+0000 7f6600f05700 1 -- 172.21.15.69:0/494980987 wait complete. 2023-11-17T06:31:25.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f6600f05700 1 Processor -- start 2023-11-17T06:31:25.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f6600f05700 1 -- start start 2023-11-17T06:31:25.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f6600f05700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65fc0ce4e0 0x7f65fc0c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:25.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f6600f05700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65fc0d13d0 0x7f65fc0b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:25.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f6600f05700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc15d490 0x7f65fc151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:25.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f6600f05700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc155df0 con 0x7f65fc0d13d0 2023-11-17T06:31:25.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f6600f05700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0b7450 con 0x7f65fc0ce4e0 2023-11-17T06:31:25.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f6600f05700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0b76f0 con 0x7f65fc15d490 2023-11-17T06:31:25.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f65faffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65fc0d13d0 0x7f65fc0b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:25.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f65faffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65fc0d13d0 0x7f65fc0b6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32774/0 (socket says 172.21.15.69:32774) 2023-11-17T06:31:25.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.450+0000 7f65faffd700 1 -- 172.21.15.69:0/1398741804 learned_addr learned my addr 172.21.15.69:0/1398741804 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:25.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65fbfff700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc15d490 0x7f65fc151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:25.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65fb7fe700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65fc0ce4e0 0x7f65fc0c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:25.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65faffd700 1 -- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc15d490 msgr2=0x7f65fc151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:25.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65faffd700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc15d490 0x7f65fc151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65faffd700 1 -- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65fc0ce4e0 msgr2=0x7f65fc0c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65faffd700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65fc0ce4e0 0x7f65fc0c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65faffd700 1 -- 172.21.15.69:0/1398741804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f4009a70 con 0x7f65fc0d13d0 2023-11-17T06:31:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65faffd700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65fc0d13d0 0x7f65fc0b6f10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f65f000c580 tx=0x7f65f000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65e3fff700 1 -- 172.21.15.69:0/1398741804 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f0004ca0 con 0x7f65fc0d13d0 2023-11-17T06:31:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65e3fff700 1 -- 172.21.15.69:0/1398741804 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f0004e20 con 0x7f65fc0d13d0 2023-11-17T06:31:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f6600f05700 1 -- 172.21.15.69:0/1398741804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65fc15d8b0 con 0x7f65fc0d13d0 2023-11-17T06:31:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f65e3fff700 1 -- 172.21.15.69:0/1398741804 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f0007310 con 0x7f65fc0d13d0 2023-11-17T06:31:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.454+0000 7f6600f05700 1 -- 172.21.15.69:0/1398741804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65fc155030 con 0x7f65fc0d13d0 2023-11-17T06:31:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.458+0000 7f6600f05700 1 -- 172.21.15.69:0/1398741804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65fc073f00 con 0x7f65fc0d13d0 2023-11-17T06:31:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.458+0000 7f65e3fff700 1 -- 172.21.15.69:0/1398741804 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f65f0007470 con 0x7f65fc0d13d0 2023-11-17T06:31:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.458+0000 7f65e3fff700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f65e8066510 0x7f65e80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.458+0000 7f65e3fff700 1 -- 172.21.15.69:0/1398741804 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f65f0083a20 con 0x7f65fc0d13d0 2023-11-17T06:31:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.458+0000 7f65fb7fe700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f65e8066510 0x7f65e80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:25.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.462+0000 7f65fb7fe700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f65e8066510 0x7f65e80689d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0b5b80 tx=0x7f65ec009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:25.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.466+0000 7f65e3fff700 1 -- 172.21.15.69:0/1398741804 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f65f0050f10 con 0x7f65fc0d13d0 2023-11-17T06:31:25.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:25.674+0000 7f6600f05700 1 -- 172.21.15.69:0/1398741804 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f65fc153dc0 con 0x7f65fc0d13d0 2023-11-17T06:31:26.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.278+0000 7f65e3fff700 1 -- 172.21.15.69:0/1398741804 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f65f0007720 con 0x7f65fc0d13d0 2023-11-17T06:31:26.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.286+0000 7f6600f05700 1 -- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f65e8066510 msgr2=0x7f65e80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.286+0000 7f6600f05700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f65e8066510 0x7f65e80689d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0b5b80 tx=0x7f65ec009240 comp rx=0 tx=0).stop 2023-11-17T06:31:26.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.286+0000 7f6600f05700 1 -- 172.21.15.69:0/1398741804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65fc0d13d0 msgr2=0x7f65fc0b6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.286+0000 7f6600f05700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65fc0d13d0 0x7f65fc0b6f10 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f65f000c580 tx=0x7f65f000c890 comp rx=0 tx=0).stop 2023-11-17T06:31:26.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.286+0000 7f6600f05700 1 -- 172.21.15.69:0/1398741804 shutdown_connections 2023-11-17T06:31:26.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.286+0000 7f6600f05700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f65e8066510 0x7f65e80689d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.286+0000 7f6600f05700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f65fc15d490 0x7f65fc151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.286+0000 7f6600f05700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f65fc0d13d0 0x7f65fc0b6f10 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.286+0000 7f6600f05700 1 --2- 172.21.15.69:0/1398741804 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f65fc0ce4e0 0x7f65fc0c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.286+0000 7f6600f05700 1 -- 172.21.15.69:0/1398741804 >> 172.21.15.69:0/1398741804 conn(0x7f65fc06ab40 msgr2=0x7f65fc0b6080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:26.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.290+0000 7f6600f05700 1 -- 172.21.15.69:0/1398741804 shutdown_connections 2023-11-17T06:31:26.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.290+0000 7f6600f05700 1 -- 172.21.15.69:0/1398741804 wait complete. 2023-11-17T06:31:26.304 INFO:teuthology.orchestra.run.smithi069.stderr:new fs with metadata pool 4 and data pool 5 2023-11-17T06:31:26.326 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:26.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.490+0000 7f4e6e36e700 1 Processor -- start 2023-11-17T06:31:26.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.490+0000 7f4e6e36e700 1 -- start start 2023-11-17T06:31:26.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.490+0000 7f4e6e36e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680cc190 0x7f4e680716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.490+0000 7f4e6e36e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e68071c10 con 0x7f4e6815d6d0 2023-11-17T06:31:26.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.490+0000 7f4e6e36e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e68070980 con 0x7f4e6815dd10 2023-11-17T06:31:26.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.490+0000 7f4e6e36e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680cb490 con 0x7f4e680cc190 2023-11-17T06:31:26.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.490+0000 7f4e67fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f4e6815d6d0 0x7f4e680cba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40522/0 (socket says 172.21.15.69:40522) 2023-11-17T06:31:26.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.490+0000 7f4e67fff700 1 -- 172.21.15.69:0/342709308 learned_addr learned my addr 172.21.15.69:0/342709308 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:26.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e677fe700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680cc190 0x7f4e680716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3921614959 0 0) 0x7f4e58001110 con 0x7f4e6815d6d0 2023-11-17T06:31:26.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e500035d0 con 0x7f4e6815d6d0 2023-11-17T06:31:26.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3177184734 0 0) 0x7f4e500035d0 con 0x7f4e6815d6d0 2023-11-17T06:31:26.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680cc190 msgr2=0x7f4e680716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:26.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680cc190 0x7f4e680716d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 >> v1:172.21.15.93:6789/0 conn(0x7f4e6815dd10 legacy=0x7f4e6815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e68070bf0 con 0x7f4e6815d6d0 2023-11-17T06:31:26.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f4e58001800 con 0x7f4e6815d6d0 2023-11-17T06:31:26.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 >> v1:172.21.15.69:6789/0 conn(0x7f4e6815d6d0 legacy=0x7f4e680cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e50003a50 0x7f4e50003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e50004400 0x7f4e500048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 0x7f4e5000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5000bfc0 con 0x7f4e500050d0 2023-11-17T06:31:26.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5000c130 con 0x7f4e50004400 2023-11-17T06:31:26.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5000c2f0 con 0x7f4e50003a50 2023-11-17T06:31:26.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e677fe700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680cc190 0x7f4e680716d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:31:26.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e6c90b700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 0x7f4e5000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e67fff700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e50003a50 0x7f4e50003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e677fe700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e50004400 0x7f4e500048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e6c90b700 1 -- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e50003a50 msgr2=0x7f4e50003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:26.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e6c90b700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e50003a50 0x7f4e50003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e6c90b700 1 -- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e50004400 msgr2=0x7f4e500048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:26.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e6c90b700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e50004400 0x7f4e500048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e6c90b700 1 -- 172.21.15.69:0/342709308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e500035d0 con 0x7f4e500050d0 2023-11-17T06:31:26.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e677fe700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e50004400 0x7f4e500048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:26.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.494+0000 7f4e6c90b700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 0x7f4e5000ba30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c290 tx=0x7f4e500058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3982ce2d0f515e4c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:26.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.498+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60001e70 con 0x7f4e500050d0 2023-11-17T06:31:26.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.498+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6000ce50 con 0x7f4e500050d0 2023-11-17T06:31:26.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.498+0000 7f4e66ffd700 1 -- 172.21.15.69:0/342709308 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60012660 con 0x7f4e500050d0 2023-11-17T06:31:26.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.498+0000 7f4e6e36e700 1 -- 172.21.15.69:0/342709308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 msgr2=0x7f4e5000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.498+0000 7f4e6e36e700 1 --2- 172.21.15.69:0/342709308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 0x7f4e5000ba30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c290 tx=0x7f4e500058a0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.498+0000 7f4e6c90b700 1 -- 172.21.15.69:0/342709308 reap_dead start 2023-11-17T06:31:26.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.498+0000 7f4e6e36e700 1 -- 172.21.15.69:0/342709308 shutdown_connections 2023-11-17T06:31:26.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.498+0000 7f4e6e36e700 1 -- 172.21.15.69:0/342709308 >> 172.21.15.69:0/342709308 conn(0x7f4e6806a480 msgr2=0x7f4e6806a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:26.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.498+0000 7f4e6e36e700 1 -- 172.21.15.69:0/342709308 shutdown_connections 2023-11-17T06:31:26.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.498+0000 7f4e6e36e700 1 -- 172.21.15.69:0/342709308 wait complete. 2023-11-17T06:31:26.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e6e36e700 1 Processor -- start 2023-11-17T06:31:26.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e6e36e700 1 -- start start 2023-11-17T06:31:26.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e6e36e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 0x7f4e680ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e6e36e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e680c7560 0x7f4e680acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e6e36e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680c79e0 0x7f4e6814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e6e36e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e681f2b50 con 0x7f4e500050d0 2023-11-17T06:31:26.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e6e36e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e681f2e30 con 0x7f4e680c7560 2023-11-17T06:31:26.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e6e36e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e681f3110 con 0x7f4e680c79e0 2023-11-17T06:31:26.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e67fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 0x7f4e680ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e67fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 0x7f4e680ae830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32788/0 (socket says 172.21.15.69:32788) 2023-11-17T06:31:26.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e67fff700 1 -- 172.21.15.69:0/719345953 learned_addr learned my addr 172.21.15.69:0/719345953 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:26.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e6c90b700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680c79e0 0x7f4e6814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e677fe700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e680c7560 0x7f4e680acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.502+0000 7f4e67fff700 1 -- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680c79e0 msgr2=0x7f4e6814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e67fff700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680c79e0 0x7f4e6814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e67fff700 1 -- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e680c7560 msgr2=0x7f4e680acc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e67fff700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e680c7560 0x7f4e680acc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e67fff700 1 -- 172.21.15.69:0/719345953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e681f33f0 con 0x7f4e500050d0 2023-11-17T06:31:26.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e677fe700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e680c7560 0x7f4e680acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:26.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e6c90b700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680c79e0 0x7f4e6814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:26.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e67fff700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 0x7f4e680ae830 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4e58001270 tx=0x7f4e58007990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:26.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e64ff9700 1 -- 172.21.15.69:0/719345953 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800f870 con 0x7f4e500050d0 2023-11-17T06:31:26.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e64ff9700 1 -- 172.21.15.69:0/719345953 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5800f9d0 con 0x7f4e500050d0 2023-11-17T06:31:26.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e6e36e700 1 -- 172.21.15.69:0/719345953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e680aed70 con 0x7f4e500050d0 2023-11-17T06:31:26.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e64ff9700 1 -- 172.21.15.69:0/719345953 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800fd80 con 0x7f4e500050d0 2023-11-17T06:31:26.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e6e36e700 1 -- 172.21.15.69:0/719345953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e681f2900 con 0x7f4e500050d0 2023-11-17T06:31:26.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.506+0000 7f4e6e36e700 1 -- 172.21.15.69:0/719345953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e68073f00 con 0x7f4e500050d0 2023-11-17T06:31:26.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.510+0000 7f4e64ff9700 1 -- 172.21.15.69:0/719345953 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4e5801d460 con 0x7f4e500050d0 2023-11-17T06:31:26.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.510+0000 7f4e64ff9700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e54066510 0x7f4e540689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.510+0000 7f4e64ff9700 1 -- 172.21.15.69:0/719345953 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e58083d90 con 0x7f4e500050d0 2023-11-17T06:31:26.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.510+0000 7f4e677fe700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e54066510 0x7f4e540689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.514+0000 7f4e677fe700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e54066510 0x7f4e540689d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4e6815ce00 tx=0x7f4e5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:26.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.518+0000 7f4e64ff9700 1 -- 172.21.15.69:0/719345953 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e58051200 con 0x7f4e500050d0 2023-11-17T06:31:26.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.690+0000 7f4e6e36e700 1 -- 172.21.15.69:0/719345953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e68071c10 con 0x7f4e500050d0 2023-11-17T06:31:26.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.690+0000 7f4e64ff9700 1 -- 172.21.15.69:0/719345953 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16438 (secure 0 0 0) 0x7f4e68071c10 con 0x7f4e500050d0 2023-11-17T06:31:26.699 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:26.699 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":36,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:31:25.682744+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:26.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 -- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e54066510 msgr2=0x7f4e540689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e54066510 0x7f4e540689d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4e6815ce00 tx=0x7f4e5c008040 comp rx=0 tx=0).stop 2023-11-17T06:31:26.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 -- 172.21.15.69:0/719345953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 msgr2=0x7f4e680ae830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 0x7f4e680ae830 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4e58001270 tx=0x7f4e58007990 comp rx=0 tx=0).stop 2023-11-17T06:31:26.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 -- 172.21.15.69:0/719345953 shutdown_connections 2023-11-17T06:31:26.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e54066510 0x7f4e540689d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e680c79e0 0x7f4e6814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e680c7560 0x7f4e680acc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 --2- 172.21.15.69:0/719345953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e500050d0 0x7f4e680ae830 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 -- 172.21.15.69:0/719345953 >> 172.21.15.69:0/719345953 conn(0x7f4e6806a480 msgr2=0x7f4e680c9630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:26.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 -- 172.21.15.69:0/719345953 shutdown_connections 2023-11-17T06:31:26.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.694+0000 7f4e6e36e700 1 -- 172.21.15.69:0/719345953 wait complete. 2023-11-17T06:31:26.726 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:26.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb579e9d700 1 Processor -- start 2023-11-17T06:31:26.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb579e9d700 1 -- start start 2023-11-17T06:31:26.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb579e9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb574159bd0 0x7fb5740ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb579e9d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb57406c6d0 0x7fb5740c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb579e9d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5740cd290 con 0x7fb5741597f0 2023-11-17T06:31:26.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb579e9d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5740cec10 con 0x7fb574159bd0 2023-11-17T06:31:26.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb579e9d700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5740cc9a0 con 0x7fb57406c6d0 2023-11-17T06:31:26.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb56bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb574159bd0 0x7fb5740ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb56bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb574159bd0 0x7fb5740ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32790/0 (socket says 172.21.15.69:32790) 2023-11-17T06:31:26.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb56bfff700 1 -- 172.21.15.69:0/1316333521 learned_addr learned my addr 172.21.15.69:0/1316333521 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:26.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb57969c700 1 --2- 172.21.15.69:0/1316333521 >> v2:172.21.15.93:3300/0 conn(0x7fb57406c6d0 0x7fb5740c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb56bfff700 1 -- 172.21.15.69:0/1316333521 >> v2:172.21.15.93:3300/0 conn(0x7fb57406c6d0 msgr2=0x7fb5740c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb56bfff700 1 --2- 172.21.15.69:0/1316333521 >> v2:172.21.15.93:3300/0 conn(0x7fb57406c6d0 0x7fb5740c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb56bfff700 1 -- 172.21.15.69:0/1316333521 >> v1:172.21.15.93:6789/0 conn(0x7fb5741597f0 legacy=0x7fb5740cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.902+0000 7fb56bfff700 1 -- 172.21.15.69:0/1316333521 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57406ce00 con 0x7fb574159bd0 2023-11-17T06:31:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb56bfff700 1 --2- 172.21.15.69:0/1316333521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb574159bd0 0x7fb5740ce190 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb5740ce890 tx=0x7fb564009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad33ac3482116387 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb56b7fe700 1 -- 172.21.15.69:0/1316333521 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400b8a0 con 0x7fb574159bd0 2023-11-17T06:31:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb56b7fe700 1 -- 172.21.15.69:0/1316333521 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56400ba00 con 0x7fb574159bd0 2023-11-17T06:31:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb56b7fe700 1 -- 172.21.15.69:0/1316333521 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400bd90 con 0x7fb574159bd0 2023-11-17T06:31:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb579e9d700 1 -- 172.21.15.69:0/1316333521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb574159bd0 msgr2=0x7fb5740ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb579e9d700 1 --2- 172.21.15.69:0/1316333521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb574159bd0 0x7fb5740ce190 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fb5740ce890 tx=0x7fb564009bf0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb579e9d700 1 -- 172.21.15.69:0/1316333521 shutdown_connections 2023-11-17T06:31:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb579e9d700 1 --2- 172.21.15.69:0/1316333521 >> v2:172.21.15.93:3300/0 conn(0x7fb57406c6d0 0x7fb5740c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb579e9d700 1 --2- 172.21.15.69:0/1316333521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb574159bd0 0x7fb5740ce190 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb579e9d700 1 -- 172.21.15.69:0/1316333521 >> 172.21.15.69:0/1316333521 conn(0x7fb5740b0900 msgr2=0x7fb5740b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb579e9d700 1 -- 172.21.15.69:0/1316333521 shutdown_connections 2023-11-17T06:31:26.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.906+0000 7fb579e9d700 1 -- 172.21.15.69:0/1316333521 wait complete. 2023-11-17T06:31:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.910+0000 7fb579e9d700 1 Processor -- start 2023-11-17T06:31:26.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.910+0000 7fb579e9d700 1 -- start start 2023-11-17T06:31:26.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.910+0000 7fb579e9d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb57406c6d0 0x7fb5740b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.910+0000 7fb579e9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5741597f0 0x7fb5740c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.910+0000 7fb579e9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb574159bd0 0x7fb574146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.910+0000 7fb579e9d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740c3dd0 con 0x7fb5741597f0 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.910+0000 7fb579e9d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5741470b0 con 0x7fb574159bd0 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.910+0000 7fb579e9d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5740c3150 con 0x7fb57406c6d0 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.910+0000 7fb56bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5741597f0 0x7fb5740c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb56bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5741597f0 0x7fb5740c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32792/0 (socket says 172.21.15.69:32792) 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb56bfff700 1 -- 172.21.15.69:0/3688723234 learned_addr learned my addr 172.21.15.69:0/3688723234 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb578e9b700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb57406c6d0 0x7fb5740b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb57969c700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb574159bd0 0x7fb574146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb56bfff700 1 -- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb57406c6d0 msgr2=0x7fb5740b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb56bfff700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb57406c6d0 0x7fb5740b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb56bfff700 1 -- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb574159bd0 msgr2=0x7fb574146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:26.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb56bfff700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb574159bd0 0x7fb574146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:26.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb56bfff700 1 -- 172.21.15.69:0/3688723234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564009570 con 0x7fb5741597f0 2023-11-17T06:31:26.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb56bfff700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5741597f0 0x7fb5740c41f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb57406b7d0 tx=0x7fb564004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:26.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb5697fa700 1 -- 172.21.15.69:0/3688723234 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640038c0 con 0x7fb5741597f0 2023-11-17T06:31:26.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb5697fa700 1 -- 172.21.15.69:0/3688723234 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56401e070 con 0x7fb5741597f0 2023-11-17T06:31:26.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb5697fa700 1 -- 172.21.15.69:0/3688723234 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564003c80 con 0x7fb5741597f0 2023-11-17T06:31:26.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb579e9d700 1 -- 172.21.15.69:0/3688723234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5740c3430 con 0x7fb5741597f0 2023-11-17T06:31:26.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb579e9d700 1 -- 172.21.15.69:0/3688723234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5740c39f0 con 0x7fb5741597f0 2023-11-17T06:31:26.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.914+0000 7fb579e9d700 1 -- 172.21.15.69:0/3688723234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb574073f00 con 0x7fb5741597f0 2023-11-17T06:31:26.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.918+0000 7fb5697fa700 1 -- 172.21.15.69:0/3688723234 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb564011420 con 0x7fb5741597f0 2023-11-17T06:31:26.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.918+0000 7fb5697fa700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb560066540 0x7fb560068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.918+0000 7fb5697fa700 1 -- 172.21.15.69:0/3688723234 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb564020070 con 0x7fb5741597f0 2023-11-17T06:31:26.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.918+0000 7fb578e9b700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb560066540 0x7fb560068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:26.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.918+0000 7fb578e9b700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb560066540 0x7fb560068a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb57000f290 tx=0x7fb570009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:26.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:26.926+0000 7fb5697fa700 1 -- 172.21.15.69:0/3688723234 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb5640529d0 con 0x7fb5741597f0 2023-11-17T06:31:27.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.102+0000 7fb579e9d700 1 -- 172.21.15.69:0/3688723234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5740b4d50 con 0x7fb5741597f0 2023-11-17T06:31:27.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.106+0000 7fb5697fa700 1 -- 172.21.15.69:0/3688723234 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+16438 (secure 0 0 0) 0x7fb564055ff0 con 0x7fb5741597f0 2023-11-17T06:31:27.112 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:27.113 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":36,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:31:25.682744+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:27.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.106+0000 7fb579e9d700 1 -- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb560066540 msgr2=0x7fb560068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:27.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.106+0000 7fb579e9d700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb560066540 0x7fb560068a00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb57000f290 tx=0x7fb570009040 comp rx=0 tx=0).stop 2023-11-17T06:31:27.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.106+0000 7fb579e9d700 1 -- 172.21.15.69:0/3688723234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5741597f0 msgr2=0x7fb5740c41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:27.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.106+0000 7fb579e9d700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5741597f0 0x7fb5740c41f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb57406b7d0 tx=0x7fb564004770 comp rx=0 tx=0).stop 2023-11-17T06:31:27.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.110+0000 7fb579e9d700 1 -- 172.21.15.69:0/3688723234 shutdown_connections 2023-11-17T06:31:27.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.110+0000 7fb579e9d700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb560066540 0x7fb560068a00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:27.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.110+0000 7fb579e9d700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb574159bd0 0x7fb574146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:27.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.110+0000 7fb579e9d700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5741597f0 0x7fb5740c41f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:27.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.110+0000 7fb579e9d700 1 --2- 172.21.15.69:0/3688723234 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb57406c6d0 0x7fb5740b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:27.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.110+0000 7fb579e9d700 1 -- 172.21.15.69:0/3688723234 >> 172.21.15.69:0/3688723234 conn(0x7fb5740b0900 msgr2=0x7fb5740b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:27.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.110+0000 7fb579e9d700 1 -- 172.21.15.69:0/3688723234 shutdown_connections 2023-11-17T06:31:27.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.110+0000 7fb579e9d700 1 -- 172.21.15.69:0/3688723234 wait complete. 2023-11-17T06:31:27.139 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-17T06:31:27.163 INFO:tasks.ceph.mds.d.smithi093.stderr:2023-11-17T06:31:27.160+0000 7f46d5b13700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:31:27.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.314+0000 7ff43723e700 1 Processor -- start 2023-11-17T06:31:27.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.314+0000 7ff43723e700 1 -- start start 2023-11-17T06:31:27.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.314+0000 7ff43723e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff430159ed0 0x7ff4300ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:27.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.314+0000 7ff43723e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff43015a2b0 0x7ff4300c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:27.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.314+0000 7ff43723e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4300cca40 con 0x7ff4300706f0 2023-11-17T06:31:27.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.314+0000 7ff43723e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4300ccdb0 con 0x7ff430159ed0 2023-11-17T06:31:27.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.314+0000 7ff43723e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4300caef0 con 0x7ff43015a2b0 2023-11-17T06:31:27.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff435a3b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff43015a2b0 0x7ff4300c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:27.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff436a3d700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff4300706f0 0x7ff4300cb510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:33316/0 (socket says 172.21.15.69:33316) 2023-11-17T06:31:27.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff43623c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff430159ed0 0x7ff4300ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:27.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff436a3d700 1 -- 172.21.15.69:0/1133830359 learned_addr learned my addr 172.21.15.69:0/1133830359 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:27.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff435a3b700 1 -- 172.21.15.69:0/1133830359 >> v2:172.21.15.69:3300/0 conn(0x7ff430159ed0 msgr2=0x7ff4300ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:27.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff435a3b700 1 --2- 172.21.15.69:0/1133830359 >> v2:172.21.15.69:3300/0 conn(0x7ff430159ed0 0x7ff4300ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:27.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff435a3b700 1 -- 172.21.15.69:0/1133830359 >> v1:172.21.15.93:6789/0 conn(0x7ff4300706f0 legacy=0x7ff4300cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:27.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff435a3b700 1 -- 172.21.15.69:0/1133830359 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4300cdf60 con 0x7ff43015a2b0 2023-11-17T06:31:27.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff435a3b700 1 --2- 172.21.15.69:0/1133830359 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff43015a2b0 0x7ff4300c98c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff430071e40 tx=0x7ff420009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c6213fc2494bdba server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:27.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff43523a700 1 -- 172.21.15.69:0/1133830359 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420011830 con 0x7ff43015a2b0 2023-11-17T06:31:27.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff43523a700 1 -- 172.21.15.69:0/1133830359 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff420011990 con 0x7ff43015a2b0 2023-11-17T06:31:27.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff43523a700 1 -- 172.21.15.69:0/1133830359 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420011d20 con 0x7ff43015a2b0 2023-11-17T06:31:27.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff43723e700 1 -- 172.21.15.69:0/1133830359 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff43015a2b0 msgr2=0x7ff4300c98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:27.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.318+0000 7ff43723e700 1 --2- 172.21.15.69:0/1133830359 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff43015a2b0 0x7ff4300c98c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff430071e40 tx=0x7ff420009b30 comp rx=0 tx=0).stop 2023-11-17T06:31:27.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.322+0000 7ff43723e700 1 -- 172.21.15.69:0/1133830359 shutdown_connections 2023-11-17T06:31:27.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.322+0000 7ff43723e700 1 --2- 172.21.15.69:0/1133830359 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff43015a2b0 0x7ff4300c98c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:27.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.322+0000 7ff43723e700 1 --2- 172.21.15.69:0/1133830359 >> v2:172.21.15.69:3300/0 conn(0x7ff430159ed0 0x7ff4300ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:27.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.322+0000 7ff43723e700 1 -- 172.21.15.69:0/1133830359 >> 172.21.15.69:0/1133830359 conn(0x7ff4300b0900 msgr2=0x7ff4300b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:27.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.322+0000 7ff43723e700 1 -- 172.21.15.69:0/1133830359 shutdown_connections 2023-11-17T06:31:27.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.322+0000 7ff43723e700 1 -- 172.21.15.69:0/1133830359 wait complete. 2023-11-17T06:31:27.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.322+0000 7ff43723e700 1 Processor -- start 2023-11-17T06:31:27.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.322+0000 7ff43723e700 1 -- start start 2023-11-17T06:31:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43723e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4300706f0 0x7ff4301f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43723e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff430159ed0 0x7ff430158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43723e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff43015a2b0 0x7ff43015b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43723e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4301591d0 con 0x7ff4300706f0 2023-11-17T06:31:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43723e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300c91f0 con 0x7ff430159ed0 2023-11-17T06:31:27.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43723e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300c85e0 con 0x7ff43015a2b0 2023-11-17T06:31:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43623c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4300706f0 0x7ff4301f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43623c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4300706f0 0x7ff4301f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32804/0 (socket says 172.21.15.69:32804) 2023-11-17T06:31:27.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43623c700 1 -- 172.21.15.69:0/4136606043 learned_addr learned my addr 172.21.15.69:0/4136606043 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff435a3b700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff430159ed0 0x7ff430158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff436a3d700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff43015a2b0 0x7ff43015b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43623c700 1 -- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff43015a2b0 msgr2=0x7ff43015b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43623c700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff43015a2b0 0x7ff43015b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:27.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43623c700 1 -- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff430159ed0 msgr2=0x7ff430158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43623c700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff430159ed0 0x7ff430158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43623c700 1 -- 172.21.15.69:0/4136606043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4200094b0 con 0x7ff4300706f0 2023-11-17T06:31:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff435a3b700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff430159ed0 0x7ff430158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff436a3d700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff43015a2b0 0x7ff43015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:31:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43623c700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4300706f0 0x7ff4301f2540 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00e9d0 tx=0x7ff42c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff426ffd700 1 -- 172.21.15.69:0/4136606043 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c009720 con 0x7ff4300706f0 2023-11-17T06:31:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff426ffd700 1 -- 172.21.15.69:0/4136606043 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c00c850 con 0x7ff4300706f0 2023-11-17T06:31:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43723e700 1 -- 172.21.15.69:0/4136606043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4300c88c0 con 0x7ff4300706f0 2023-11-17T06:31:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff426ffd700 1 -- 172.21.15.69:0/4136606043 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00cbc0 con 0x7ff4300706f0 2023-11-17T06:31:27.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.326+0000 7ff43723e700 1 -- 172.21.15.69:0/4136606043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4300c8e80 con 0x7ff4300706f0 2023-11-17T06:31:27.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.330+0000 7ff43723e700 1 -- 172.21.15.69:0/4136606043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff430073f00 con 0x7ff4300706f0 2023-11-17T06:31:27.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.330+0000 7ff426ffd700 1 -- 172.21.15.69:0/4136606043 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff42c00cd20 con 0x7ff4300706f0 2023-11-17T06:31:27.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.330+0000 7ff426ffd700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff414066510 0x7ff4140689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:27.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.334+0000 7ff426ffd700 1 -- 172.21.15.69:0/4136606043 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff42c083ff0 con 0x7ff4300706f0 2023-11-17T06:31:27.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.334+0000 7ff435a3b700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff414066510 0x7ff4140689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:27.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.334+0000 7ff435a3b700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff414066510 0x7ff4140689d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff420000c00 tx=0x7ff420008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:27.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.338+0000 7ff426ffd700 1 -- 172.21.15.69:0/4136606043 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff42c051430 con 0x7ff4300706f0 2023-11-17T06:31:27.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:27.546+0000 7ff43723e700 1 -- 172.21.15.69:0/4136606043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff4300b4d50 con 0x7ff4300706f0 2023-11-17T06:31:28.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.282+0000 7ff426ffd700 1 -- 172.21.15.69:0/4136606043 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff42c054a50 con 0x7ff4300706f0 2023-11-17T06:31:28.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 -- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff414066510 msgr2=0x7ff4140689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:28.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff414066510 0x7ff4140689d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff420000c00 tx=0x7ff420008030 comp rx=0 tx=0).stop 2023-11-17T06:31:28.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 -- 172.21.15.69:0/4136606043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4300706f0 msgr2=0x7ff4301f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:28.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4300706f0 0x7ff4301f2540 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff42c00e9d0 tx=0x7ff42c00ed90 comp rx=0 tx=0).stop 2023-11-17T06:31:28.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 -- 172.21.15.69:0/4136606043 shutdown_connections 2023-11-17T06:31:28.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff414066510 0x7ff4140689d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff43015a2b0 0x7ff43015b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff430159ed0 0x7ff430158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 --2- 172.21.15.69:0/4136606043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4300706f0 0x7ff4301f2540 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 -- 172.21.15.69:0/4136606043 >> 172.21.15.69:0/4136606043 conn(0x7ff4300b0900 msgr2=0x7ff43006bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:28.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 -- 172.21.15.69:0/4136606043 shutdown_connections 2023-11-17T06:31:28.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.286+0000 7ff43723e700 1 -- 172.21.15.69:0/4136606043 wait complete. 2023-11-17T06:31:28.315 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-17T06:31:28.315 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-17T06:31:28.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.498+0000 7f424d1fe700 1 Processor -- start 2023-11-17T06:31:28.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.498+0000 7f424d1fe700 1 -- start start 2023-11-17T06:31:28.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.498+0000 7f424d1fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f42480c21a0 0x7f424806c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:28.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.498+0000 7f424d1fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f42481652b0 0x7f42480cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:28.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.498+0000 7f424d1fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4248165740 0x7f42480cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:28.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.498+0000 7f424d1fe700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42481662c0 con 0x7f42481652b0 2023-11-17T06:31:28.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.498+0000 7f424d1fe700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f424806c200 con 0x7f42480c21a0 2023-11-17T06:31:28.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f424d1fe700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4248165d00 con 0x7f4248165740 2023-11-17T06:31:28.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f42477fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f42481652b0 0x7f42480cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:28.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f42477fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f42481652b0 0x7f42480cb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32812/0 (socket says 172.21.15.69:32812) 2023-11-17T06:31:28.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f42477fe700 1 -- 172.21.15.69:0/2608538906 learned_addr learned my addr 172.21.15.69:0/2608538906 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:28.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f4247fff700 1 --2- 172.21.15.69:0/2608538906 >> v2:172.21.15.93:3300/0 conn(0x7f42480c21a0 0x7f424806c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:28.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f424c9fd700 1 --2- 172.21.15.69:0/2608538906 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4248165740 0x7f42480cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:28.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f42477fe700 1 -- 172.21.15.69:0/2608538906 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4248165740 msgr2=0x7f42480cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:28.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f42477fe700 1 --2- 172.21.15.69:0/2608538906 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4248165740 0x7f42480cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f42477fe700 1 -- 172.21.15.69:0/2608538906 >> v2:172.21.15.93:3300/0 conn(0x7f42480c21a0 msgr2=0x7f424806c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:28.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f42477fe700 1 --2- 172.21.15.69:0/2608538906 >> v2:172.21.15.93:3300/0 conn(0x7f42480c21a0 0x7f424806c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f42477fe700 1 -- 172.21.15.69:0/2608538906 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4248165fe0 con 0x7f42481652b0 2023-11-17T06:31:28.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f42477fe700 1 --2- 172.21.15.69:0/2608538906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42481652b0 0x7f42480cb7e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f42480cb7b0 tx=0x7f423c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e834ddccaccb82ef server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:28.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f4246ffd700 1 -- 172.21.15.69:0/2608538906 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c011830 con 0x7f42481652b0 2023-11-17T06:31:28.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f4246ffd700 1 -- 172.21.15.69:0/2608538906 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c011990 con 0x7f42481652b0 2023-11-17T06:31:28.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f4246ffd700 1 -- 172.21.15.69:0/2608538906 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c011d20 con 0x7f42481652b0 2023-11-17T06:31:28.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f424d1fe700 1 -- 172.21.15.69:0/2608538906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42481652b0 msgr2=0x7f42480cb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:28.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f424d1fe700 1 --2- 172.21.15.69:0/2608538906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42481652b0 0x7f42480cb7e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f42480cb7b0 tx=0x7f423c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f424d1fe700 1 -- 172.21.15.69:0/2608538906 shutdown_connections 2023-11-17T06:31:28.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f424d1fe700 1 --2- 172.21.15.69:0/2608538906 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4248165740 0x7f42480cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f424d1fe700 1 --2- 172.21.15.69:0/2608538906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42481652b0 0x7f42480cb7e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f424d1fe700 1 --2- 172.21.15.69:0/2608538906 >> v2:172.21.15.93:3300/0 conn(0x7f42480c21a0 0x7f424806c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f424d1fe700 1 -- 172.21.15.69:0/2608538906 >> 172.21.15.69:0/2608538906 conn(0x7f42480b0900 msgr2=0x7f42480b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:28.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.502+0000 7f424d1fe700 1 -- 172.21.15.69:0/2608538906 shutdown_connections 2023-11-17T06:31:28.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.506+0000 7f424d1fe700 1 -- 172.21.15.69:0/2608538906 wait complete. 2023-11-17T06:31:28.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.506+0000 7f424d1fe700 1 Processor -- start 2023-11-17T06:31:28.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.506+0000 7f424d1fe700 1 -- start start 2023-11-17T06:31:28.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f424d1fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42480c21a0 0x7f42480c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:28.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f424d1fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42481652b0 0x7f424815e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:28.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f424d1fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4248165740 0x7f42480c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:28.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f424d1fe700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42480c62f0 con 0x7f42480c21a0 2023-11-17T06:31:28.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f424d1fe700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42480c65d0 con 0x7f42481652b0 2023-11-17T06:31:28.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f424d1fe700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42480c68b0 con 0x7f4248165740 2023-11-17T06:31:28.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4247fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42480c21a0 0x7f42480c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:28.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4247fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42480c21a0 0x7f42480c5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32814/0 (socket says 172.21.15.69:32814) 2023-11-17T06:31:28.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4247fff700 1 -- 172.21.15.69:0/461174154 learned_addr learned my addr 172.21.15.69:0/461174154 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:28.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f42477fe700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42481652b0 0x7f424815e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:28.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f424c9fd700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4248165740 0x7f42480c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:28.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4247fff700 1 -- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4248165740 msgr2=0x7f42480c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:28.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4247fff700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4248165740 0x7f42480c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4247fff700 1 -- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42481652b0 msgr2=0x7f424815e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:28.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4247fff700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42481652b0 0x7f424815e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:28.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4247fff700 1 -- 172.21.15.69:0/461174154 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c009570 con 0x7f42480c21a0 2023-11-17T06:31:28.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4247fff700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42480c21a0 0x7f42480c5350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f423800e940 tx=0x7f423800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:28.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4244ff9700 1 -- 172.21.15.69:0/461174154 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238013680 con 0x7f42480c21a0 2023-11-17T06:31:28.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4244ff9700 1 -- 172.21.15.69:0/461174154 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42380137e0 con 0x7f42480c21a0 2023-11-17T06:31:28.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f424d1fe700 1 -- 172.21.15.69:0/461174154 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42480c6b90 con 0x7f42480c21a0 2023-11-17T06:31:28.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f4244ff9700 1 -- 172.21.15.69:0/461174154 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238013b70 con 0x7f42480c21a0 2023-11-17T06:31:28.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.510+0000 7f424d1fe700 1 -- 172.21.15.69:0/461174154 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42480b4a20 con 0x7f42480c21a0 2023-11-17T06:31:28.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.514+0000 7f424d1fe700 1 -- 172.21.15.69:0/461174154 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4248073f00 con 0x7f42480c21a0 2023-11-17T06:31:28.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.514+0000 7f4244ff9700 1 -- 172.21.15.69:0/461174154 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4238013cd0 con 0x7f42480c21a0 2023-11-17T06:31:28.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.518+0000 7f4244ff9700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4234066510 0x7f42340689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:28.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.518+0000 7f4244ff9700 1 -- 172.21.15.69:0/461174154 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4238083df0 con 0x7f42480c21a0 2023-11-17T06:31:28.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.518+0000 7f42477fe700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4234066510 0x7f42340689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:28.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.518+0000 7f42477fe700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4234066510 0x7f42340689d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f423c000c00 tx=0x7f423c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:28.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.522+0000 7f4244ff9700 1 -- 172.21.15.69:0/461174154 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4238051260 con 0x7f42480c21a0 2023-11-17T06:31:28.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:28.742+0000 7f424d1fe700 1 -- 172.21.15.69:0/461174154 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4248073760 con 0x7f42480c21a0 2023-11-17T06:31:29.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.294+0000 7f4244ff9700 1 -- 172.21.15.69:0/461174154 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f42380170c0 con 0x7f42480c21a0 2023-11-17T06:31:29.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 -- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4234066510 msgr2=0x7f42340689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4234066510 0x7f42340689d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f423c000c00 tx=0x7f423c008030 comp rx=0 tx=0).stop 2023-11-17T06:31:29.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 -- 172.21.15.69:0/461174154 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42480c21a0 msgr2=0x7f42480c5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42480c21a0 0x7f42480c5350 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f423800e940 tx=0x7f423800ec50 comp rx=0 tx=0).stop 2023-11-17T06:31:29.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 -- 172.21.15.69:0/461174154 shutdown_connections 2023-11-17T06:31:29.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4234066510 0x7f42340689d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4248165740 0x7f42480c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42481652b0 0x7f424815e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 --2- 172.21.15.69:0/461174154 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42480c21a0 0x7f42480c5350 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 -- 172.21.15.69:0/461174154 >> 172.21.15.69:0/461174154 conn(0x7f42480b0900 msgr2=0x7f4248070c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 -- 172.21.15.69:0/461174154 shutdown_connections 2023-11-17T06:31:29.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.298+0000 7f424d1fe700 1 -- 172.21.15.69:0/461174154 wait complete. 2023-11-17T06:31:29.329 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-17T06:31:29.330 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:29.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.502+0000 7ff8470ba700 1 Processor -- start 2023-11-17T06:31:29.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.502+0000 7ff8470ba700 1 -- start start 2023-11-17T06:31:29.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.502+0000 7ff8470ba700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff8400b5440 0x7ff8400d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.502+0000 7ff8470ba700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff8400d1ca0 0x7ff8400b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.502+0000 7ff8470ba700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8400b6750 con 0x7ff84015d980 2023-11-17T06:31:29.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.502+0000 7ff8470ba700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8400d2a30 con 0x7ff8400b5440 2023-11-17T06:31:29.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.502+0000 7ff8470ba700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400b6980 con 0x7ff8400d1ca0 2023-11-17T06:31:29.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff837fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff8400b5440 0x7ff8400d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff837fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff8400b5440 0x7ff8400d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32820/0 (socket says 172.21.15.69:32820) 2023-11-17T06:31:29.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff844e56700 1 --1- 172.21.15.69:0/805674427 >> v1:172.21.15.93:6789/0 conn(0x7ff84015d980 0x7ff8400b4d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:33322/0 (socket says 172.21.15.69:33322) 2023-11-17T06:31:29.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff837fff700 1 -- 172.21.15.69:0/805674427 learned_addr learned my addr 172.21.15.69:0/805674427 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:29.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff845657700 1 --2- 172.21.15.69:0/805674427 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff8400d1ca0 0x7ff8400b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff837fff700 1 -- 172.21.15.69:0/805674427 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff8400d1ca0 msgr2=0x7ff8400b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:29.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff837fff700 1 --2- 172.21.15.69:0/805674427 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff8400d1ca0 0x7ff8400b7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff837fff700 1 -- 172.21.15.69:0/805674427 >> v1:172.21.15.93:6789/0 conn(0x7ff84015d980 legacy=0x7ff8400b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff837fff700 1 -- 172.21.15.69:0/805674427 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8400d2470 con 0x7ff8400b5440 2023-11-17T06:31:29.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff837fff700 1 --2- 172.21.15.69:0/805674427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 0x7ff8400d1760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff830009910 tx=0x7ff830009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7002c431cb340798 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8377fe700 1 -- 172.21.15.69:0/805674427 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830004230 con 0x7ff8400b5440 2023-11-17T06:31:29.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8377fe700 1 -- 172.21.15.69:0/805674427 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff830004390 con 0x7ff8400b5440 2023-11-17T06:31:29.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8377fe700 1 -- 172.21.15.69:0/805674427 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8300036c0 con 0x7ff8400b5440 2023-11-17T06:31:29.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8470ba700 1 -- 172.21.15.69:0/805674427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 msgr2=0x7ff8400d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8470ba700 1 --2- 172.21.15.69:0/805674427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 0x7ff8400d1760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff830009910 tx=0x7ff830009c20 comp rx=0 tx=0).stop 2023-11-17T06:31:29.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8470ba700 1 -- 172.21.15.69:0/805674427 shutdown_connections 2023-11-17T06:31:29.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8470ba700 1 --2- 172.21.15.69:0/805674427 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff8400d1ca0 0x7ff8400b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8470ba700 1 --2- 172.21.15.69:0/805674427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 0x7ff8400d1760 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8470ba700 1 -- 172.21.15.69:0/805674427 >> 172.21.15.69:0/805674427 conn(0x7ff8400cfd30 msgr2=0x7ff8400d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8470ba700 1 -- 172.21.15.69:0/805674427 shutdown_connections 2023-11-17T06:31:29.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.506+0000 7ff8470ba700 1 -- 172.21.15.69:0/805674427 wait complete. 2023-11-17T06:31:29.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.510+0000 7ff8470ba700 1 Processor -- start 2023-11-17T06:31:29.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.510+0000 7ff8470ba700 1 -- start start 2023-11-17T06:31:29.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.510+0000 7ff8470ba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 0x7ff8400ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.510+0000 7ff8470ba700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff8400d1ca0 0x7ff8400cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.510+0000 7ff8470ba700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff84015e980 0x7ff8401531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.510+0000 7ff8470ba700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400ca9f0 con 0x7ff8400b5440 2023-11-17T06:31:29.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.510+0000 7ff8470ba700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400cacd0 con 0x7ff84015e980 2023-11-17T06:31:29.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff8470ba700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8400cafb0 con 0x7ff8400d1ca0 2023-11-17T06:31:29.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff844e56700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 0x7ff8400ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff844e56700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 0x7ff8400ca380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32824/0 (socket says 172.21.15.69:32824) 2023-11-17T06:31:29.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff844e56700 1 -- 172.21.15.69:0/948287025 learned_addr learned my addr 172.21.15.69:0/948287025 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:29.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff837fff700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff8400d1ca0 0x7ff8400cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff845657700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff84015e980 0x7ff8401531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff844e56700 1 -- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff8400d1ca0 msgr2=0x7ff8400cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff844e56700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff8400d1ca0 0x7ff8400cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff844e56700 1 -- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff84015e980 msgr2=0x7ff8401531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff844e56700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff84015e980 0x7ff8401531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff844e56700 1 -- 172.21.15.69:0/948287025 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff830009570 con 0x7ff8400b5440 2023-11-17T06:31:29.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff844e56700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 0x7ff8400ca380 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00c780 tx=0x7ff83c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff8357fa700 1 -- 172.21.15.69:0/948287025 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c004ca0 con 0x7ff8400b5440 2023-11-17T06:31:29.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff8357fa700 1 -- 172.21.15.69:0/948287025 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83c004e00 con 0x7ff8400b5440 2023-11-17T06:31:29.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff8470ba700 1 -- 172.21.15.69:0/948287025 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8400cb290 con 0x7ff8400b5440 2023-11-17T06:31:29.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff8357fa700 1 -- 172.21.15.69:0/948287025 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83c0072f0 con 0x7ff8400b5440 2023-11-17T06:31:29.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.514+0000 7ff8470ba700 1 -- 172.21.15.69:0/948287025 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84015ee10 con 0x7ff8400b5440 2023-11-17T06:31:29.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.518+0000 7ff8470ba700 1 -- 172.21.15.69:0/948287025 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8400cb7b0 con 0x7ff8400b5440 2023-11-17T06:31:29.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.518+0000 7ff8357fa700 1 -- 172.21.15.69:0/948287025 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff83c007450 con 0x7ff8400b5440 2023-11-17T06:31:29.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.518+0000 7ff8357fa700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff82c066510 0x7ff82c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.518+0000 7ff8357fa700 1 -- 172.21.15.69:0/948287025 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff83c082f90 con 0x7ff8400b5440 2023-11-17T06:31:29.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.518+0000 7ff837fff700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff82c066510 0x7ff82c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.522+0000 7ff837fff700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff82c066510 0x7ff82c0689d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff830009910 tx=0x7ff830008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.526+0000 7ff8357fa700 1 -- 172.21.15.69:0/948287025 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff8400cb7b0 con 0x7ff8400b5440 2023-11-17T06:31:29.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.734+0000 7ff8470ba700 1 -- 172.21.15.69:0/948287025 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8400cb7b0 con 0x7ff8400b5440 2023-11-17T06:31:29.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.734+0000 7ff8357fa700 1 -- 172.21.15.69:0/948287025 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4913 (secure 0 0 0) 0x7ff8400cb7b0 con 0x7ff8400b5440 2023-11-17T06:31:29.740 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:29.741 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5202,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1050522275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1050522275},{"type":"v1","addr":"172.21.15.69:6835","nonce":1050522275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:31:28.746851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.93:6837/4181304583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":4181304583},{"type":"v1","addr":"172.21.15.93:6837","nonce":4181304583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:31:29.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 -- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff82c066510 msgr2=0x7ff82c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff82c066510 0x7ff82c0689d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff830009910 tx=0x7ff830008030 comp rx=0 tx=0).stop 2023-11-17T06:31:29.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 -- 172.21.15.69:0/948287025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 msgr2=0x7ff8400ca380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 0x7ff8400ca380 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff83c00c780 tx=0x7ff83c00ca90 comp rx=0 tx=0).stop 2023-11-17T06:31:29.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 -- 172.21.15.69:0/948287025 shutdown_connections 2023-11-17T06:31:29.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff82c066510 0x7ff82c0689d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff84015e980 0x7ff8401531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff8400d1ca0 0x7ff8400cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 --2- 172.21.15.69:0/948287025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8400b5440 0x7ff8400ca380 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 -- 172.21.15.69:0/948287025 >> 172.21.15.69:0/948287025 conn(0x7ff8400cfd30 msgr2=0x7ff8400cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 -- 172.21.15.69:0/948287025 shutdown_connections 2023-11-17T06:31:29.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.738+0000 7ff8470ba700 1 -- 172.21.15.69:0/948287025 wait complete. 2023-11-17T06:31:29.748 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 15 2023-11-17T06:31:29.767 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:31:29.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.930+0000 7f17f359e700 1 Processor -- start 2023-11-17T06:31:29.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.930+0000 7f17f359e700 1 -- start start 2023-11-17T06:31:29.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f359e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f17f40c9b30 0x7f17f415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f359e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f406fc20 con 0x7f17f415b980 2023-11-17T06:31:29.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f359e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f406fe70 con 0x7f17f40719e0 2023-11-17T06:31:29.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f359e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f4070430 con 0x7f17f40c9b30 2023-11-17T06:31:29.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f259c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f17f415b980 0x7f17f415f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40528/0 (socket says 172.21.15.69:40528) 2023-11-17T06:31:29.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f259c700 1 -- 172.21.15.69:0/727771656 learned_addr learned my addr 172.21.15.69:0/727771656 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:29.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f2d9d700 1 --2- 172.21.15.69:0/727771656 >> v2:172.21.15.69:3300/0 conn(0x7f17f40c9b30 0x7f17f415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f2d9d700 1 -- 172.21.15.69:0/727771656 >> v1:172.21.15.93:6789/0 conn(0x7f17f40719e0 legacy=0x7f17f40c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f2d9d700 1 -- 172.21.15.69:0/727771656 >> v1:172.21.15.69:6789/0 conn(0x7f17f415b980 legacy=0x7f17f415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f159a700 1 -- 172.21.15.69:0/727771656 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3532087207 0 0) 0x7f17f406fe70 con 0x7f17f40719e0 2023-11-17T06:31:29.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f2d9d700 1 -- 172.21.15.69:0/727771656 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4070150 con 0x7f17f40c9b30 2023-11-17T06:31:29.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f2d9d700 1 --2- 172.21.15.69:0/727771656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40c9b30 0x7f17f415bd60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009d90 tx=0x7f17ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e734da58e1062660 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f159a700 1 -- 172.21.15.69:0/727771656 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00e070 con 0x7f17f40c9b30 2023-11-17T06:31:29.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f159a700 1 -- 172.21.15.69:0/727771656 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec00bad0 con 0x7f17f40c9b30 2023-11-17T06:31:29.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f159a700 1 -- 172.21.15.69:0/727771656 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec00be80 con 0x7f17f40c9b30 2023-11-17T06:31:29.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f359e700 1 -- 172.21.15.69:0/727771656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40c9b30 msgr2=0x7f17f415bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.934+0000 7f17f359e700 1 --2- 172.21.15.69:0/727771656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40c9b30 0x7f17f415bd60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009d90 tx=0x7f17ec00b330 comp rx=0 tx=0).stop 2023-11-17T06:31:29.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.938+0000 7f17f359e700 1 -- 172.21.15.69:0/727771656 shutdown_connections 2023-11-17T06:31:29.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.938+0000 7f17f359e700 1 --2- 172.21.15.69:0/727771656 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40c9b30 0x7f17f415bd60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.938+0000 7f17f359e700 1 -- 172.21.15.69:0/727771656 >> 172.21.15.69:0/727771656 conn(0x7f17f40b0900 msgr2=0x7f17f40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:29.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.938+0000 7f17f359e700 1 -- 172.21.15.69:0/727771656 shutdown_connections 2023-11-17T06:31:29.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.938+0000 7f17f359e700 1 -- 172.21.15.69:0/727771656 wait complete. 2023-11-17T06:31:29.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.938+0000 7f17f359e700 1 Processor -- start 2023-11-17T06:31:29.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.938+0000 7f17f359e700 1 -- start start 2023-11-17T06:31:29.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f359e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40719e0 0x7f17f406bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f359e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17f40c9b30 0x7f17f4158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f359e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17f415b980 0x7f17f4154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f359e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41f6db0 con 0x7f17f40719e0 2023-11-17T06:31:29.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f359e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41f6fa0 con 0x7f17f415b980 2023-11-17T06:31:29.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f359e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f41f7280 con 0x7f17f40c9b30 2023-11-17T06:31:29.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40719e0 0x7f17f406bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40719e0 0x7f17f406bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32846/0 (socket says 172.21.15.69:32846) 2023-11-17T06:31:29.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f259c700 1 -- 172.21.15.69:0/2276847353 learned_addr learned my addr 172.21.15.69:0/2276847353 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:29.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f2d9d700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17f415b980 0x7f17f4154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f1d9b700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17f40c9b30 0x7f17f4158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f259c700 1 -- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17f40c9b30 msgr2=0x7f17f4158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f259c700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17f40c9b30 0x7f17f4158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f259c700 1 -- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17f415b980 msgr2=0x7f17f4154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:29.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f259c700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17f415b980 0x7f17f4154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:29.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f259c700 1 -- 172.21.15.69:0/2276847353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec009a70 con 0x7f17f40719e0 2023-11-17T06:31:29.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f259c700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40719e0 0x7f17f406bf60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f17e400c570 tx=0x7f17e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17e2ffd700 1 -- 172.21.15.69:0/2276847353 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4004ca0 con 0x7f17f40719e0 2023-11-17T06:31:29.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17e2ffd700 1 -- 172.21.15.69:0/2276847353 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e4004e20 con 0x7f17f40719e0 2023-11-17T06:31:29.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17e2ffd700 1 -- 172.21.15.69:0/2276847353 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e4007310 con 0x7f17f40719e0 2023-11-17T06:31:29.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f359e700 1 -- 172.21.15.69:0/2276847353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f41f7560 con 0x7f17f40719e0 2023-11-17T06:31:29.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f359e700 1 -- 172.21.15.69:0/2276847353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f41f7b20 con 0x7f17f40719e0 2023-11-17T06:31:29.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.942+0000 7f17f359e700 1 -- 172.21.15.69:0/2276847353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f41f7d40 con 0x7f17f40719e0 2023-11-17T06:31:29.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.946+0000 7f17e2ffd700 1 -- 172.21.15.69:0/2276847353 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f17e4007470 con 0x7f17f40719e0 2023-11-17T06:31:29.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.950+0000 7f17e2ffd700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f17d4066510 0x7f17d40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:29.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.950+0000 7f17e2ffd700 1 -- 172.21.15.69:0/2276847353 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17e4083bc0 con 0x7f17f40719e0 2023-11-17T06:31:29.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.950+0000 7f17f1d9b700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f17d4066510 0x7f17d40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:29.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.950+0000 7f17f1d9b700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f17d4066510 0x7f17d40689d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f17f406c9b0 tx=0x7f17e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:29.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:29.954+0000 7f17e2ffd700 1 -- 172.21.15.69:0/2276847353 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f17e4051030 con 0x7f17f40719e0 2023-11-17T06:31:30.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.134+0000 7f17f359e700 1 -- 172.21.15.69:0/2276847353 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17f4073f00 con 0x7f17f40719e0 2023-11-17T06:31:30.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17e2ffd700 1 -- 172.21.15.69:0/2276847353 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16425 (secure 0 0 0) 0x7f17e4007720 con 0x7f17f40719e0 2023-11-17T06:31:30.143 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:30.144 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":37,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:31:27.264435+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:31:30.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 -- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f17d4066510 msgr2=0x7f17d40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f17d4066510 0x7f17d40689d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f17f406c9b0 tx=0x7f17e8009040 comp rx=0 tx=0).stop 2023-11-17T06:31:30.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 -- 172.21.15.69:0/2276847353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40719e0 msgr2=0x7f17f406bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40719e0 0x7f17f406bf60 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f17e400c570 tx=0x7f17e400c880 comp rx=0 tx=0).stop 2023-11-17T06:31:30.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 -- 172.21.15.69:0/2276847353 shutdown_connections 2023-11-17T06:31:30.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f17d4066510 0x7f17d40689d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17f415b980 0x7f17f4154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f17f40c9b30 0x7f17f4158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 --2- 172.21.15.69:0/2276847353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17f40719e0 0x7f17f406bf60 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 -- 172.21.15.69:0/2276847353 >> 172.21.15.69:0/2276847353 conn(0x7f17f40b0900 msgr2=0x7f17f40b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:30.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 -- 172.21.15.69:0/2276847353 shutdown_connections 2023-11-17T06:31:30.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.138+0000 7f17f359e700 1 -- 172.21.15.69:0/2276847353 wait complete. 2023-11-17T06:31:30.168 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-17T06:31:30.168 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:31:30.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3af34b700 1 Processor -- start 2023-11-17T06:31:30.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3af34b700 1 -- start start 2023-11-17T06:31:30.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3af34b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 0x7fd3a80c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3af34b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd3a80c9960 0x7fd3a815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3af34b700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a806fc20 con 0x7fd3a815b980 2023-11-17T06:31:30.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3af34b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a8070430 con 0x7fd3a80c9960 2023-11-17T06:31:30.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3af34b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a815ed70 con 0x7fd3a80719e0 2023-11-17T06:31:30.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3aeb4a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd3a80c9960 0x7fd3a815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3adb48700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 0x7fd3a80c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3aeb4a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd3a80c9960 0x7fd3a815bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:49144/0 (socket says 172.21.15.69:49144) 2023-11-17T06:31:30.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3aeb4a700 1 -- 172.21.15.69:0/3227133284 learned_addr learned my addr 172.21.15.69:0/3227133284 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:30.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.334+0000 7fd3adb48700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 0x7fd3a80c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:60352/0 (socket says 172.21.15.69:60352) 2023-11-17T06:31:30.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3aeb4a700 1 -- 172.21.15.69:0/3227133284 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 msgr2=0x7fd3a80c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:30.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3aeb4a700 1 --2- 172.21.15.69:0/3227133284 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 0x7fd3a80c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3aeb4a700 1 -- 172.21.15.69:0/3227133284 >> v1:172.21.15.93:6789/0 conn(0x7fd3a815b980 legacy=0x7fd3a815f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3aeb4a700 1 -- 172.21.15.69:0/3227133284 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a80c9da0 con 0x7fd3a80c9960 2023-11-17T06:31:30.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3aeb4a700 1 --2- 172.21.15.69:0/3227133284 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3a80c9960 0x7fd3a815bd60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009e50 tx=0x7fd3a000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cfbc30f3599bd8d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:30.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3ad347700 1 -- 172.21.15.69:0/3227133284 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a000e070 con 0x7fd3a80c9960 2023-11-17T06:31:30.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3ad347700 1 -- 172.21.15.69:0/3227133284 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a000b910 con 0x7fd3a80c9960 2023-11-17T06:31:30.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3ad347700 1 -- 172.21.15.69:0/3227133284 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a000bcc0 con 0x7fd3a80c9960 2023-11-17T06:31:30.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3af34b700 1 -- 172.21.15.69:0/3227133284 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3a80c9960 msgr2=0x7fd3a815bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3af34b700 1 --2- 172.21.15.69:0/3227133284 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3a80c9960 0x7fd3a815bd60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0009e50 tx=0x7fd3a000b330 comp rx=0 tx=0).stop 2023-11-17T06:31:30.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3af34b700 1 -- 172.21.15.69:0/3227133284 shutdown_connections 2023-11-17T06:31:30.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3af34b700 1 --2- 172.21.15.69:0/3227133284 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3a80c9960 0x7fd3a815bd60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3af34b700 1 --2- 172.21.15.69:0/3227133284 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 0x7fd3a80c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3af34b700 1 -- 172.21.15.69:0/3227133284 >> 172.21.15.69:0/3227133284 conn(0x7fd3a80b0900 msgr2=0x7fd3a80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:30.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3af34b700 1 -- 172.21.15.69:0/3227133284 shutdown_connections 2023-11-17T06:31:30.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.338+0000 7fd3af34b700 1 -- 172.21.15.69:0/3227133284 wait complete. 2023-11-17T06:31:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.342+0000 7fd3af34b700 1 Processor -- start 2023-11-17T06:31:30.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.342+0000 7fd3af34b700 1 -- start start 2023-11-17T06:31:30.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.342+0000 7fd3af34b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 0x7fd3a80c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.342+0000 7fd3af34b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3a80c9960 0x7fd3a80acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.342+0000 7fd3af34b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3a815b980 0x7fd3a8150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.342+0000 7fd3af34b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80c8240 con 0x7fd3a815b980 2023-11-17T06:31:30.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.342+0000 7fd3af34b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80c75c0 con 0x7fd3a80c9960 2023-11-17T06:31:30.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.342+0000 7fd3af34b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80c78a0 con 0x7fd3a80719e0 2023-11-17T06:31:30.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.342+0000 7fd3aeb4a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3a815b980 0x7fd3a8150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.342+0000 7fd3aeb4a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3a815b980 0x7fd3a8150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32856/0 (socket says 172.21.15.69:32856) 2023-11-17T06:31:30.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3aeb4a700 1 -- 172.21.15.69:0/1325215831 learned_addr learned my addr 172.21.15.69:0/1325215831 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:30.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3adb48700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3a80c9960 0x7fd3a80acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3ae349700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 0x7fd3a80c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3aeb4a700 1 -- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 msgr2=0x7fd3a80c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3aeb4a700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 0x7fd3a80c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3aeb4a700 1 -- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3a80c9960 msgr2=0x7fd3a80acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3aeb4a700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3a80c9960 0x7fd3a80acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3aeb4a700 1 -- 172.21.15.69:0/1325215831 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0009b30 con 0x7fd3a815b980 2023-11-17T06:31:30.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3aeb4a700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3a815b980 0x7fd3a8150c10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8068700 tx=0x7fd3a0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:30.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd39effd700 1 -- 172.21.15.69:0/1325215831 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0004800 con 0x7fd3a815b980 2023-11-17T06:31:30.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd39effd700 1 -- 172.21.15.69:0/1325215831 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a00092e0 con 0x7fd3a815b980 2023-11-17T06:31:30.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3af34b700 1 -- 172.21.15.69:0/1325215831 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a80c7b80 con 0x7fd3a815b980 2023-11-17T06:31:30.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd39effd700 1 -- 172.21.15.69:0/1325215831 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a001c660 con 0x7fd3a815b980 2023-11-17T06:31:30.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.346+0000 7fd3af34b700 1 -- 172.21.15.69:0/1325215831 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a80ad510 con 0x7fd3a815b980 2023-11-17T06:31:30.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.350+0000 7fd3af34b700 1 -- 172.21.15.69:0/1325215831 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a80c8380 con 0x7fd3a815b980 2023-11-17T06:31:30.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.350+0000 7fd39effd700 1 -- 172.21.15.69:0/1325215831 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fd3a001c7c0 con 0x7fd3a815b980 2023-11-17T06:31:30.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.350+0000 7fd39effd700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd38c066510 0x7fd38c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.350+0000 7fd39effd700 1 -- 172.21.15.69:0/1325215831 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3a00859c0 con 0x7fd3a815b980 2023-11-17T06:31:30.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.354+0000 7fd3ae349700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd38c066510 0x7fd38c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.354+0000 7fd3ae349700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd38c066510 0x7fd38c0689d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000f60 tx=0x7fd3a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:30.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.358+0000 7fd39effd700 1 -- 172.21.15.69:0/1325215831 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fd3a80c8380 con 0x7fd3a815b980 2023-11-17T06:31:30.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.526+0000 7fd3af34b700 1 -- 172.21.15.69:0/1325215831 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3a8070150 con 0x7fd38c066510 2023-11-17T06:31:30.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.546+0000 7fd39effd700 1 -- 172.21.15.69:0/1325215831 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287221 (secure 0 0 0) 0x7fd3a4001540 con 0x7fd38c066510 2023-11-17T06:31:30.558 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 -- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd38c066510 msgr2=0x7fd38c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd38c066510 0x7fd38c0689d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000f60 tx=0x7fd3a4009040 comp rx=0 tx=0).stop 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 -- 172.21.15.69:0/1325215831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3a815b980 msgr2=0x7fd3a8150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3a815b980 0x7fd3a8150c10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd3a8068700 tx=0x7fd3a0004af0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 -- 172.21.15.69:0/1325215831 shutdown_connections 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fd38c066510 0x7fd38c0689d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3a815b980 0x7fd3a8150c10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd3a80c9960 0x7fd3a80acfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 --2- 172.21.15.69:0/1325215831 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fd3a80719e0 0x7fd3a80c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 -- 172.21.15.69:0/1325215831 >> 172.21.15.69:0/1325215831 conn(0x7fd3a80b0900 msgr2=0x7fd3a80ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 -- 172.21.15.69:0/1325215831 shutdown_connections 2023-11-17T06:31:30.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.558+0000 7fd3af34b700 1 -- 172.21.15.69:0/1325215831 wait complete. 2023-11-17T06:31:30.565 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:31:30.584 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-17T06:31:30.396269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220640,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754080,"statfs":{"total":773094113280,"available":772868177920,"internally_reserved":0,"allocated":4562944,"data_stored":2477564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002088"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280940+0000","last_change":"2023-11-17T06:31:26.297207+0000","last_active":"2023-11-17T06:31:27.280940+0000","last_peered":"2023-11-17T06:31:27.280940+0000","last_clean":"2023-11-17T06:31:27.280940+0000","last_became_active":"2023-11-17T06:31:26.296599+0000","last_became_peered":"2023-11-17T06:31:26.296599+0000","last_unstale":"2023-11-17T06:31:27.280940+0000","last_undegraded":"2023-11-17T06:31:27.280940+0000","last_fullsized":"2023-11-17T06:31:27.280940+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:49.217393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282147+0000","last_change":"2023-11-17T06:31:26.292821+0000","last_active":"2023-11-17T06:31:27.282147+0000","last_peered":"2023-11-17T06:31:27.282147+0000","last_clean":"2023-11-17T06:31:27.282147+0000","last_became_active":"2023-11-17T06:31:26.292506+0000","last_became_peered":"2023-11-17T06:31:26.292506+0000","last_unstale":"2023-11-17T06:31:27.282147+0000","last_undegraded":"2023-11-17T06:31:27.282147+0000","last_fullsized":"2023-11-17T06:31:27.282147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:26:15.017589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800467+0000","last_change":"2023-11-17T06:31:26.291246+0000","last_active":"2023-11-17T06:31:27.800467+0000","last_peered":"2023-11-17T06:31:27.800467+0000","last_clean":"2023-11-17T06:31:27.800467+0000","last_became_active":"2023-11-17T06:31:26.290817+0000","last_became_peered":"2023-11-17T06:31:26.290817+0000","last_unstale":"2023-11-17T06:31:27.800467+0000","last_undegraded":"2023-11-17T06:31:27.800467+0000","last_fullsized":"2023-11-17T06:31:27.800467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:08:09.905483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800632+0000","last_change":"2023-11-17T06:31:26.306872+0000","last_active":"2023-11-17T06:31:27.800632+0000","last_peered":"2023-11-17T06:31:27.800632+0000","last_clean":"2023-11-17T06:31:27.800632+0000","last_became_active":"2023-11-17T06:31:26.306228+0000","last_became_peered":"2023-11-17T06:31:26.306228+0000","last_unstale":"2023-11-17T06:31:27.800632+0000","last_undegraded":"2023-11-17T06:31:27.800632+0000","last_fullsized":"2023-11-17T06:31:27.800632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:53:52.997397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281986+0000","last_change":"2023-11-17T06:31:26.305529+0000","last_active":"2023-11-17T06:31:27.281986+0000","last_peered":"2023-11-17T06:31:27.281986+0000","last_clean":"2023-11-17T06:31:27.281986+0000","last_became_active":"2023-11-17T06:31:26.305191+0000","last_became_peered":"2023-11-17T06:31:26.305191+0000","last_unstale":"2023-11-17T06:31:27.281986+0000","last_undegraded":"2023-11-17T06:31:27.281986+0000","last_fullsized":"2023-11-17T06:31:27.281986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:55:16.580775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281541+0000","last_change":"2023-11-17T06:31:26.279371+0000","last_active":"2023-11-17T06:31:27.281541+0000","last_peered":"2023-11-17T06:31:27.281541+0000","last_clean":"2023-11-17T06:31:27.281541+0000","last_became_active":"2023-11-17T06:31:26.278750+0000","last_became_peered":"2023-11-17T06:31:26.278750+0000","last_unstale":"2023-11-17T06:31:27.281541+0000","last_undegraded":"2023-11-17T06:31:27.281541+0000","last_fullsized":"2023-11-17T06:31:27.281541+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:18:55.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280322+0000","last_change":"2023-11-17T06:31:26.293836+0000","last_active":"2023-11-17T06:31:27.280322+0000","last_peered":"2023-11-17T06:31:27.280322+0000","last_clean":"2023-11-17T06:31:27.280322+0000","last_became_active":"2023-11-17T06:31:26.290832+0000","last_became_peered":"2023-11-17T06:31:26.290832+0000","last_unstale":"2023-11-17T06:31:27.280322+0000","last_undegraded":"2023-11-17T06:31:27.280322+0000","last_fullsized":"2023-11-17T06:31:27.280322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:13:52.420324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280590+0000","last_change":"2023-11-17T06:31:26.297182+0000","last_active":"2023-11-17T06:31:27.280590+0000","last_peered":"2023-11-17T06:31:27.280590+0000","last_clean":"2023-11-17T06:31:27.280590+0000","last_became_active":"2023-11-17T06:31:26.296851+0000","last_became_peered":"2023-11-17T06:31:26.296851+0000","last_unstale":"2023-11-17T06:31:27.280590+0000","last_undegraded":"2023-11-17T06:31:27.280590+0000","last_fullsized":"2023-11-17T06:31:27.280590+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:52:27.381439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800411+0000","last_change":"2023-11-17T06:31:26.292325+0000","last_active":"2023-11-17T06:31:27.800411+0000","last_peered":"2023-11-17T06:31:27.800411+0000","last_clean":"2023-11-17T06:31:27.800411+0000","last_became_active":"2023-11-17T06:31:26.292008+0000","last_became_peered":"2023-11-17T06:31:26.292008+0000","last_unstale":"2023-11-17T06:31:27.800411+0000","last_undegraded":"2023-11-17T06:31:27.800411+0000","last_fullsized":"2023-11-17T06:31:27.800411+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:10:46.351324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.801484+0000","last_change":"2023-11-17T06:31:26.297871+0000","last_active":"2023-11-17T06:31:27.801484+0000","last_peered":"2023-11-17T06:31:27.801484+0000","last_clean":"2023-11-17T06:31:27.801484+0000","last_became_active":"2023-11-17T06:31:26.297603+0000","last_became_peered":"2023-11-17T06:31:26.297603+0000","last_unstale":"2023-11-17T06:31:27.801484+0000","last_undegraded":"2023-11-17T06:31:27.801484+0000","last_fullsized":"2023-11-17T06:31:27.801484+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:47:23.787289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800576+0000","last_change":"2023-11-17T06:31:26.296449+0000","last_active":"2023-11-17T06:31:27.800576+0000","last_peered":"2023-11-17T06:31:27.800576+0000","last_clean":"2023-11-17T06:31:27.800576+0000","last_became_active":"2023-11-17T06:31:26.296159+0000","last_became_peered":"2023-11-17T06:31:26.296159+0000","last_unstale":"2023-11-17T06:31:27.800576+0000","last_undegraded":"2023-11-17T06:31:27.800576+0000","last_fullsized":"2023-11-17T06:31:27.800576+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:05:07.887854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800333+0000","last_change":"2023-11-17T06:31:26.313459+0000","last_active":"2023-11-17T06:31:27.800333+0000","last_peered":"2023-11-17T06:31:27.800333+0000","last_clean":"2023-11-17T06:31:27.800333+0000","last_became_active":"2023-11-17T06:31:26.313196+0000","last_became_peered":"2023-11-17T06:31:26.313196+0000","last_unstale":"2023-11-17T06:31:27.800333+0000","last_undegraded":"2023-11-17T06:31:27.800333+0000","last_fullsized":"2023-11-17T06:31:27.800333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:24:56.000069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489355+0000","last_change":"2023-11-17T06:31:26.300489+0000","last_active":"2023-11-17T06:31:27.489355+0000","last_peered":"2023-11-17T06:31:27.489355+0000","last_clean":"2023-11-17T06:31:27.489355+0000","last_became_active":"2023-11-17T06:31:26.300101+0000","last_became_peered":"2023-11-17T06:31:26.300101+0000","last_unstale":"2023-11-17T06:31:27.489355+0000","last_undegraded":"2023-11-17T06:31:27.489355+0000","last_fullsized":"2023-11-17T06:31:27.489355+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:52:27.381439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800309+0000","last_change":"2023-11-17T06:31:26.300468+0000","last_active":"2023-11-17T06:31:27.800309+0000","last_peered":"2023-11-17T06:31:27.800309+0000","last_clean":"2023-11-17T06:31:27.800309+0000","last_became_active":"2023-11-17T06:31:26.300187+0000","last_became_peered":"2023-11-17T06:31:26.300187+0000","last_unstale":"2023-11-17T06:31:27.800309+0000","last_undegraded":"2023-11-17T06:31:27.800309+0000","last_fullsized":"2023-11-17T06:31:27.800309+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:51:36.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296765+0000","last_change":"2023-11-17T06:31:26.301487+0000","last_active":"2023-11-17T06:31:27.296765+0000","last_peered":"2023-11-17T06:31:27.296765+0000","last_clean":"2023-11-17T06:31:27.296765+0000","last_became_active":"2023-11-17T06:31:26.299855+0000","last_became_peered":"2023-11-17T06:31:26.299855+0000","last_unstale":"2023-11-17T06:31:27.296765+0000","last_undegraded":"2023-11-17T06:31:27.296765+0000","last_fullsized":"2023-11-17T06:31:27.296765+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:06:41.173890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296621+0000","last_change":"2023-11-17T06:31:26.294563+0000","last_active":"2023-11-17T06:31:27.296621+0000","last_peered":"2023-11-17T06:31:27.296621+0000","last_clean":"2023-11-17T06:31:27.296621+0000","last_became_active":"2023-11-17T06:31:26.294252+0000","last_became_peered":"2023-11-17T06:31:26.294252+0000","last_unstale":"2023-11-17T06:31:27.296621+0000","last_undegraded":"2023-11-17T06:31:27.296621+0000","last_fullsized":"2023-11-17T06:31:27.296621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:51:36.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.799490+0000","last_change":"2023-11-17T06:31:26.295331+0000","last_active":"2023-11-17T06:31:27.799490+0000","last_peered":"2023-11-17T06:31:27.799490+0000","last_clean":"2023-11-17T06:31:27.799490+0000","last_became_active":"2023-11-17T06:31:26.293949+0000","last_became_peered":"2023-11-17T06:31:26.293949+0000","last_unstale":"2023-11-17T06:31:27.799490+0000","last_undegraded":"2023-11-17T06:31:27.799490+0000","last_fullsized":"2023-11-17T06:31:27.799490+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:40.354591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282036+0000","last_change":"2023-11-17T06:31:26.304681+0000","last_active":"2023-11-17T06:31:27.282036+0000","last_peered":"2023-11-17T06:31:27.282036+0000","last_clean":"2023-11-17T06:31:27.282036+0000","last_became_active":"2023-11-17T06:31:26.302695+0000","last_became_peered":"2023-11-17T06:31:26.302695+0000","last_unstale":"2023-11-17T06:31:27.282036+0000","last_undegraded":"2023-11-17T06:31:27.282036+0000","last_fullsized":"2023-11-17T06:31:27.282036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:45.750367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281472+0000","last_change":"2023-11-17T06:31:26.290570+0000","last_active":"2023-11-17T06:31:27.281472+0000","last_peered":"2023-11-17T06:31:27.281472+0000","last_clean":"2023-11-17T06:31:27.281472+0000","last_became_active":"2023-11-17T06:31:26.290143+0000","last_became_peered":"2023-11-17T06:31:26.290143+0000","last_unstale":"2023-11-17T06:31:27.281472+0000","last_undegraded":"2023-11-17T06:31:27.281472+0000","last_fullsized":"2023-11-17T06:31:27.281472+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:55:33.513783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489744+0000","last_change":"2023-11-17T06:31:26.313308+0000","last_active":"2023-11-17T06:31:27.489744+0000","last_peered":"2023-11-17T06:31:27.489744+0000","last_clean":"2023-11-17T06:31:27.489744+0000","last_became_active":"2023-11-17T06:31:26.312954+0000","last_became_peered":"2023-11-17T06:31:26.312954+0000","last_unstale":"2023-11-17T06:31:27.489744+0000","last_undegraded":"2023-11-17T06:31:27.489744+0000","last_fullsized":"2023-11-17T06:31:27.489744+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:12:57.233401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296808+0000","last_change":"2023-11-17T06:31:26.301857+0000","last_active":"2023-11-17T06:31:27.296808+0000","last_peered":"2023-11-17T06:31:27.296808+0000","last_clean":"2023-11-17T06:31:27.296808+0000","last_became_active":"2023-11-17T06:31:26.301580+0000","last_became_peered":"2023-11-17T06:31:26.301580+0000","last_unstale":"2023-11-17T06:31:27.296808+0000","last_undegraded":"2023-11-17T06:31:27.296808+0000","last_fullsized":"2023-11-17T06:31:27.296808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:06:53.507705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281074+0000","last_change":"2023-11-17T06:31:26.294529+0000","last_active":"2023-11-17T06:31:27.281074+0000","last_peered":"2023-11-17T06:31:27.281074+0000","last_clean":"2023-11-17T06:31:27.281074+0000","last_became_active":"2023-11-17T06:31:26.294190+0000","last_became_peered":"2023-11-17T06:31:26.294190+0000","last_unstale":"2023-11-17T06:31:27.281074+0000","last_undegraded":"2023-11-17T06:31:27.281074+0000","last_fullsized":"2023-11-17T06:31:27.281074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:51:36.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489055+0000","last_change":"2023-11-17T06:31:26.301111+0000","last_active":"2023-11-17T06:31:27.489055+0000","last_peered":"2023-11-17T06:31:27.489055+0000","last_clean":"2023-11-17T06:31:27.489055+0000","last_became_active":"2023-11-17T06:31:26.300815+0000","last_became_peered":"2023-11-17T06:31:26.300815+0000","last_unstale":"2023-11-17T06:31:27.489055+0000","last_undegraded":"2023-11-17T06:31:27.489055+0000","last_fullsized":"2023-11-17T06:31:27.489055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:16:56.075938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280300+0000","last_change":"2023-11-17T06:31:26.294727+0000","last_active":"2023-11-17T06:31:27.280300+0000","last_peered":"2023-11-17T06:31:27.280300+0000","last_clean":"2023-11-17T06:31:27.280300+0000","last_became_active":"2023-11-17T06:31:26.294241+0000","last_became_peered":"2023-11-17T06:31:26.294241+0000","last_unstale":"2023-11-17T06:31:27.280300+0000","last_undegraded":"2023-11-17T06:31:27.280300+0000","last_fullsized":"2023-11-17T06:31:27.280300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:38:52.743440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.801581+0000","last_change":"2023-11-17T06:31:26.293428+0000","last_active":"2023-11-17T06:31:27.801581+0000","last_peered":"2023-11-17T06:31:27.801581+0000","last_clean":"2023-11-17T06:31:27.801581+0000","last_became_active":"2023-11-17T06:31:26.292986+0000","last_became_peered":"2023-11-17T06:31:26.292986+0000","last_unstale":"2023-11-17T06:31:27.801581+0000","last_undegraded":"2023-11-17T06:31:27.801581+0000","last_fullsized":"2023-11-17T06:31:27.801581+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:11:32.090895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.801511+0000","last_change":"2023-11-17T06:31:26.296160+0000","last_active":"2023-11-17T06:31:27.801511+0000","last_peered":"2023-11-17T06:31:27.801511+0000","last_clean":"2023-11-17T06:31:27.801511+0000","last_became_active":"2023-11-17T06:31:26.295817+0000","last_became_peered":"2023-11-17T06:31:26.295817+0000","last_unstale":"2023-11-17T06:31:27.801511+0000","last_undegraded":"2023-11-17T06:31:27.801511+0000","last_fullsized":"2023-11-17T06:31:27.801511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:22:39.060650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281964+0000","last_change":"2023-11-17T06:31:26.299553+0000","last_active":"2023-11-17T06:31:27.281964+0000","last_peered":"2023-11-17T06:31:27.281964+0000","last_clean":"2023-11-17T06:31:27.281964+0000","last_became_active":"2023-11-17T06:31:26.299273+0000","last_became_peered":"2023-11-17T06:31:26.299273+0000","last_unstale":"2023-11-17T06:31:27.281964+0000","last_undegraded":"2023-11-17T06:31:27.281964+0000","last_fullsized":"2023-11-17T06:31:27.281964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:09:09.101298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280717+0000","last_change":"2023-11-17T06:31:26.314701+0000","last_active":"2023-11-17T06:31:27.280717+0000","last_peered":"2023-11-17T06:31:27.280717+0000","last_clean":"2023-11-17T06:31:27.280717+0000","last_became_active":"2023-11-17T06:31:26.314437+0000","last_became_peered":"2023-11-17T06:31:26.314437+0000","last_unstale":"2023-11-17T06:31:27.280717+0000","last_undegraded":"2023-11-17T06:31:27.280717+0000","last_fullsized":"2023-11-17T06:31:27.280717+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:00:18.204441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296805+0000","last_change":"2023-11-17T06:31:26.297641+0000","last_active":"2023-11-17T06:31:27.296805+0000","last_peered":"2023-11-17T06:31:27.296805+0000","last_clean":"2023-11-17T06:31:27.296805+0000","last_became_active":"2023-11-17T06:31:26.297386+0000","last_became_peered":"2023-11-17T06:31:26.297386+0000","last_unstale":"2023-11-17T06:31:27.296805+0000","last_undegraded":"2023-11-17T06:31:27.296805+0000","last_fullsized":"2023-11-17T06:31:27.296805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:30:53.257713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296541+0000","last_change":"2023-11-17T06:31:26.296334+0000","last_active":"2023-11-17T06:31:27.296541+0000","last_peered":"2023-11-17T06:31:27.296541+0000","last_clean":"2023-11-17T06:31:27.296541+0000","last_became_active":"2023-11-17T06:31:26.295950+0000","last_became_peered":"2023-11-17T06:31:26.295950+0000","last_unstale":"2023-11-17T06:31:27.296541+0000","last_undegraded":"2023-11-17T06:31:27.296541+0000","last_fullsized":"2023-11-17T06:31:27.296541+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:01:54.604909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280553+0000","last_change":"2023-11-17T06:31:26.290737+0000","last_active":"2023-11-17T06:31:27.280553+0000","last_peered":"2023-11-17T06:31:27.280553+0000","last_clean":"2023-11-17T06:31:27.280553+0000","last_became_active":"2023-11-17T06:31:26.287660+0000","last_became_peered":"2023-11-17T06:31:26.287660+0000","last_unstale":"2023-11-17T06:31:27.280553+0000","last_undegraded":"2023-11-17T06:31:27.280553+0000","last_fullsized":"2023-11-17T06:31:27.280553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:49:19.311852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.798922+0000","last_change":"2023-11-17T06:31:26.292304+0000","last_active":"2023-11-17T06:31:27.798922+0000","last_peered":"2023-11-17T06:31:27.798922+0000","last_clean":"2023-11-17T06:31:27.798922+0000","last_became_active":"2023-11-17T06:31:26.291997+0000","last_became_peered":"2023-11-17T06:31:26.291997+0000","last_unstale":"2023-11-17T06:31:27.798922+0000","last_undegraded":"2023-11-17T06:31:27.798922+0000","last_fullsized":"2023-11-17T06:31:27.798922+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:48:00.704677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489837+0000","last_change":"2023-11-17T06:31:26.297053+0000","last_active":"2023-11-17T06:31:27.489837+0000","last_peered":"2023-11-17T06:31:27.489837+0000","last_clean":"2023-11-17T06:31:27.489837+0000","last_became_active":"2023-11-17T06:31:26.296719+0000","last_became_peered":"2023-11-17T06:31:26.296719+0000","last_unstale":"2023-11-17T06:31:27.489837+0000","last_undegraded":"2023-11-17T06:31:27.489837+0000","last_fullsized":"2023-11-17T06:31:27.489837+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:00:18.204441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"36'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.313955+0000","last_change":"2023-11-17T06:31:25.249574+0000","last_active":"2023-11-17T06:31:26.313955+0000","last_peered":"2023-11-17T06:31:26.313955+0000","last_clean":"2023-11-17T06:31:26.313955+0000","last_became_active":"2023-11-17T06:31:25.248652+0000","last_became_peered":"2023-11-17T06:31:25.248652+0000","last_unstale":"2023-11-17T06:31:26.313955+0000","last_undegraded":"2023-11-17T06:31:26.313955+0000","last_fullsized":"2023-11-17T06:31:26.313955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:00:35.723259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281072+0000","last_change":"2023-11-17T06:31:26.284696+0000","last_active":"2023-11-17T06:31:27.281072+0000","last_peered":"2023-11-17T06:31:27.281072+0000","last_clean":"2023-11-17T06:31:27.281072+0000","last_became_active":"2023-11-17T06:31:26.281553+0000","last_became_peered":"2023-11-17T06:31:26.281553+0000","last_unstale":"2023-11-17T06:31:27.281072+0000","last_undegraded":"2023-11-17T06:31:27.281072+0000","last_fullsized":"2023-11-17T06:31:27.281072+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:01:54.604909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.317640+0000","last_change":"2023-11-17T06:31:25.252822+0000","last_active":"2023-11-17T06:31:26.317640+0000","last_peered":"2023-11-17T06:31:26.317640+0000","last_clean":"2023-11-17T06:31:26.317640+0000","last_became_active":"2023-11-17T06:31:25.252142+0000","last_became_peered":"2023-11-17T06:31:25.252142+0000","last_unstale":"2023-11-17T06:31:26.317640+0000","last_undegraded":"2023-11-17T06:31:26.317640+0000","last_fullsized":"2023-11-17T06:31:26.317640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:21:16.382787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280781+0000","last_change":"2023-11-17T06:31:26.298210+0000","last_active":"2023-11-17T06:31:27.280781+0000","last_peered":"2023-11-17T06:31:27.280781+0000","last_clean":"2023-11-17T06:31:27.280781+0000","last_became_active":"2023-11-17T06:31:26.296906+0000","last_became_peered":"2023-11-17T06:31:26.296906+0000","last_unstale":"2023-11-17T06:31:27.280781+0000","last_undegraded":"2023-11-17T06:31:27.280781+0000","last_fullsized":"2023-11-17T06:31:27.280781+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:21:17.389144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.314182+0000","last_change":"2023-11-17T06:31:25.244027+0000","last_active":"2023-11-17T06:31:26.314182+0000","last_peered":"2023-11-17T06:31:26.314182+0000","last_clean":"2023-11-17T06:31:26.314182+0000","last_became_active":"2023-11-17T06:31:25.243633+0000","last_became_peered":"2023-11-17T06:31:25.243633+0000","last_unstale":"2023-11-17T06:31:26.314182+0000","last_undegraded":"2023-11-17T06:31:26.314182+0000","last_fullsized":"2023-11-17T06:31:26.314182+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:24:54.993712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800984+0000","last_change":"2023-11-17T06:31:26.304746+0000","last_active":"2023-11-17T06:31:27.800984+0000","last_peered":"2023-11-17T06:31:27.800984+0000","last_clean":"2023-11-17T06:31:27.800984+0000","last_became_active":"2023-11-17T06:31:26.304100+0000","last_became_peered":"2023-11-17T06:31:26.304100+0000","last_unstale":"2023-11-17T06:31:27.800984+0000","last_undegraded":"2023-11-17T06:31:27.800984+0000","last_fullsized":"2023-11-17T06:31:27.800984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:20:31.494078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.318899+0000","last_change":"2023-11-17T06:31:25.247844+0000","last_active":"2023-11-17T06:31:26.318899+0000","last_peered":"2023-11-17T06:31:26.318899+0000","last_clean":"2023-11-17T06:31:26.318899+0000","last_became_active":"2023-11-17T06:31:25.247518+0000","last_became_peered":"2023-11-17T06:31:25.247518+0000","last_unstale":"2023-11-17T06:31:26.318899+0000","last_undegraded":"2023-11-17T06:31:26.318899+0000","last_fullsized":"2023-11-17T06:31:26.318899+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:12:56.227044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800845+0000","last_change":"2023-11-17T06:31:26.296251+0000","last_active":"2023-11-17T06:31:27.800845+0000","last_peered":"2023-11-17T06:31:27.800845+0000","last_clean":"2023-11-17T06:31:27.800845+0000","last_became_active":"2023-11-17T06:31:26.295697+0000","last_became_peered":"2023-11-17T06:31:26.295697+0000","last_unstale":"2023-11-17T06:31:27.800845+0000","last_undegraded":"2023-11-17T06:31:27.800845+0000","last_fullsized":"2023-11-17T06:31:27.800845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:45.750367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.316178+0000","last_change":"2023-11-17T06:31:25.252197+0000","last_active":"2023-11-17T06:31:26.316178+0000","last_peered":"2023-11-17T06:31:26.316178+0000","last_clean":"2023-11-17T06:31:26.316178+0000","last_became_active":"2023-11-17T06:31:25.251886+0000","last_became_peered":"2023-11-17T06:31:25.251886+0000","last_unstale":"2023-11-17T06:31:26.316178+0000","last_undegraded":"2023-11-17T06:31:26.316178+0000","last_fullsized":"2023-11-17T06:31:26.316178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:44.744010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280419+0000","last_change":"2023-11-17T06:31:26.285622+0000","last_active":"2023-11-17T06:31:27.280419+0000","last_peered":"2023-11-17T06:31:27.280419+0000","last_clean":"2023-11-17T06:31:27.280419+0000","last_became_active":"2023-11-17T06:31:26.284862+0000","last_became_peered":"2023-11-17T06:31:26.284862+0000","last_unstale":"2023-11-17T06:31:27.280419+0000","last_undegraded":"2023-11-17T06:31:27.280419+0000","last_fullsized":"2023-11-17T06:31:27.280419+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:16:56.075938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.318289+0000","last_change":"2023-11-17T06:31:25.252108+0000","last_active":"2023-11-17T06:31:26.318289+0000","last_peered":"2023-11-17T06:31:26.318289+0000","last_clean":"2023-11-17T06:31:26.318289+0000","last_became_active":"2023-11-17T06:31:25.251838+0000","last_became_peered":"2023-11-17T06:31:25.251838+0000","last_unstale":"2023-11-17T06:31:26.318289+0000","last_undegraded":"2023-11-17T06:31:26.318289+0000","last_fullsized":"2023-11-17T06:31:26.318289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:12.818918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800714+0000","last_change":"2023-11-17T06:31:26.299245+0000","last_active":"2023-11-17T06:31:27.800714+0000","last_peered":"2023-11-17T06:31:27.800714+0000","last_clean":"2023-11-17T06:31:27.800714+0000","last_became_active":"2023-11-17T06:31:26.298948+0000","last_became_peered":"2023-11-17T06:31:26.298948+0000","last_unstale":"2023-11-17T06:31:27.800714+0000","last_undegraded":"2023-11-17T06:31:27.800714+0000","last_fullsized":"2023-11-17T06:31:27.800714+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:18:55.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.271472+0000","last_change":"2023-11-17T06:31:25.235288+0000","last_active":"2023-11-17T06:31:26.271472+0000","last_peered":"2023-11-17T06:31:26.271472+0000","last_clean":"2023-11-17T06:31:26.271472+0000","last_became_active":"2023-11-17T06:31:25.234543+0000","last_became_peered":"2023-11-17T06:31:25.234543+0000","last_unstale":"2023-11-17T06:31:26.271472+0000","last_undegraded":"2023-11-17T06:31:26.271472+0000","last_fullsized":"2023-11-17T06:31:26.271472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:01:43.682306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800529+0000","last_change":"2023-11-17T06:31:26.291387+0000","last_active":"2023-11-17T06:31:27.800529+0000","last_peered":"2023-11-17T06:31:27.800529+0000","last_clean":"2023-11-17T06:31:27.800529+0000","last_became_active":"2023-11-17T06:31:26.290940+0000","last_became_peered":"2023-11-17T06:31:26.290940+0000","last_unstale":"2023-11-17T06:31:27.800529+0000","last_undegraded":"2023-11-17T06:31:27.800529+0000","last_fullsized":"2023-11-17T06:31:27.800529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:01:54.604909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.273234+0000","last_change":"2023-11-17T06:31:25.250464+0000","last_active":"2023-11-17T06:31:26.273234+0000","last_peered":"2023-11-17T06:31:26.273234+0000","last_clean":"2023-11-17T06:31:26.273234+0000","last_became_active":"2023-11-17T06:31:25.250151+0000","last_became_peered":"2023-11-17T06:31:25.250151+0000","last_unstale":"2023-11-17T06:31:26.273234+0000","last_undegraded":"2023-11-17T06:31:26.273234+0000","last_fullsized":"2023-11-17T06:31:26.273234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:29:43.000790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.799757+0000","last_change":"2023-11-17T06:31:26.301980+0000","last_active":"2023-11-17T06:31:27.799757+0000","last_peered":"2023-11-17T06:31:27.799757+0000","last_clean":"2023-11-17T06:31:27.799757+0000","last_became_active":"2023-11-17T06:31:26.301683+0000","last_became_peered":"2023-11-17T06:31:26.301683+0000","last_unstale":"2023-11-17T06:31:27.799757+0000","last_undegraded":"2023-11-17T06:31:27.799757+0000","last_fullsized":"2023-11-17T06:31:27.799757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:16:39.849864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282530+0000","last_change":"2023-11-17T06:31:25.246915+0000","last_active":"2023-11-17T06:31:27.282530+0000","last_peered":"2023-11-17T06:31:27.282530+0000","last_clean":"2023-11-17T06:31:27.282530+0000","last_became_active":"2023-11-17T06:31:25.246557+0000","last_became_peered":"2023-11-17T06:31:25.246557+0000","last_unstale":"2023-11-17T06:31:27.282530+0000","last_undegraded":"2023-11-17T06:31:27.282530+0000","last_fullsized":"2023-11-17T06:31:27.282530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:30:55.881195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.801522+0000","last_change":"2023-11-17T06:31:26.290902+0000","last_active":"2023-11-17T06:31:27.801522+0000","last_peered":"2023-11-17T06:31:27.801522+0000","last_clean":"2023-11-17T06:31:27.801522+0000","last_became_active":"2023-11-17T06:31:26.290573+0000","last_became_peered":"2023-11-17T06:31:26.290573+0000","last_unstale":"2023-11-17T06:31:27.801522+0000","last_undegraded":"2023-11-17T06:31:27.801522+0000","last_fullsized":"2023-11-17T06:31:27.801522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:57:16.189425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282311+0000","last_change":"2023-11-17T06:31:25.249279+0000","last_active":"2023-11-17T06:31:27.282311+0000","last_peered":"2023-11-17T06:31:27.282311+0000","last_clean":"2023-11-17T06:31:27.282311+0000","last_became_active":"2023-11-17T06:31:25.248819+0000","last_became_peered":"2023-11-17T06:31:25.248819+0000","last_unstale":"2023-11-17T06:31:27.282311+0000","last_undegraded":"2023-11-17T06:31:27.282311+0000","last_fullsized":"2023-11-17T06:31:27.282311+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:55:11.854600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800824+0000","last_change":"2023-11-17T06:31:26.307125+0000","last_active":"2023-11-17T06:31:27.800824+0000","last_peered":"2023-11-17T06:31:27.800824+0000","last_clean":"2023-11-17T06:31:27.800824+0000","last_became_active":"2023-11-17T06:31:26.306552+0000","last_became_peered":"2023-11-17T06:31:26.306552+0000","last_unstale":"2023-11-17T06:31:27.800824+0000","last_undegraded":"2023-11-17T06:31:27.800824+0000","last_fullsized":"2023-11-17T06:31:27.800824+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:43:17.919483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"36'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.314206+0000","last_change":"2023-11-17T06:31:25.254102+0000","last_active":"2023-11-17T06:31:26.314206+0000","last_peered":"2023-11-17T06:31:26.314206+0000","last_clean":"2023-11-17T06:31:26.314206+0000","last_became_active":"2023-11-17T06:31:25.253807+0000","last_became_peered":"2023-11-17T06:31:25.253807+0000","last_unstale":"2023-11-17T06:31:26.314206+0000","last_undegraded":"2023-11-17T06:31:26.314206+0000","last_fullsized":"2023-11-17T06:31:26.314206+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:57:15.183068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.799191+0000","last_change":"2023-11-17T06:31:26.291703+0000","last_active":"2023-11-17T06:31:27.799191+0000","last_peered":"2023-11-17T06:31:27.799191+0000","last_clean":"2023-11-17T06:31:27.799191+0000","last_became_active":"2023-11-17T06:31:26.290546+0000","last_became_peered":"2023-11-17T06:31:26.290546+0000","last_unstale":"2023-11-17T06:31:27.799191+0000","last_undegraded":"2023-11-17T06:31:27.799191+0000","last_fullsized":"2023-11-17T06:31:27.799191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:02:48.577537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.320808+0000","last_change":"2023-11-17T06:31:25.249611+0000","last_active":"2023-11-17T06:31:26.320808+0000","last_peered":"2023-11-17T06:31:26.320808+0000","last_clean":"2023-11-17T06:31:26.320808+0000","last_became_active":"2023-11-17T06:31:25.249296+0000","last_became_peered":"2023-11-17T06:31:25.249296+0000","last_unstale":"2023-11-17T06:31:26.320808+0000","last_undegraded":"2023-11-17T06:31:26.320808+0000","last_fullsized":"2023-11-17T06:31:26.320808+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:09.031806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489015+0000","last_change":"2023-11-17T06:31:26.301559+0000","last_active":"2023-11-17T06:31:27.489015+0000","last_peered":"2023-11-17T06:31:27.489015+0000","last_clean":"2023-11-17T06:31:27.489015+0000","last_became_active":"2023-11-17T06:31:26.301251+0000","last_became_peered":"2023-11-17T06:31:26.301251+0000","last_unstale":"2023-11-17T06:31:27.489015+0000","last_undegraded":"2023-11-17T06:31:27.489015+0000","last_fullsized":"2023-11-17T06:31:27.489015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:13:52.420324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.316890+0000","last_change":"2023-11-17T06:31:25.251561+0000","last_active":"2023-11-17T06:31:26.316890+0000","last_peered":"2023-11-17T06:31:26.316890+0000","last_clean":"2023-11-17T06:31:26.316890+0000","last_became_active":"2023-11-17T06:31:25.251266+0000","last_became_peered":"2023-11-17T06:31:25.251266+0000","last_unstale":"2023-11-17T06:31:26.316890+0000","last_undegraded":"2023-11-17T06:31:26.316890+0000","last_fullsized":"2023-11-17T06:31:26.316890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:46:12.076660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800359+0000","last_change":"2023-11-17T06:31:26.304948+0000","last_active":"2023-11-17T06:31:27.800359+0000","last_peered":"2023-11-17T06:31:27.800359+0000","last_clean":"2023-11-17T06:31:27.800359+0000","last_became_active":"2023-11-17T06:31:26.304348+0000","last_became_peered":"2023-11-17T06:31:26.304348+0000","last_unstale":"2023-11-17T06:31:27.800359+0000","last_undegraded":"2023-11-17T06:31:27.800359+0000","last_fullsized":"2023-11-17T06:31:27.800359+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:06:41.173890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.285168+0000","last_change":"2023-11-17T06:31:25.249878+0000","last_active":"2023-11-17T06:31:26.285168+0000","last_peered":"2023-11-17T06:31:26.285168+0000","last_clean":"2023-11-17T06:31:26.285168+0000","last_became_active":"2023-11-17T06:31:25.249493+0000","last_became_peered":"2023-11-17T06:31:25.249493+0000","last_unstale":"2023-11-17T06:31:26.285168+0000","last_undegraded":"2023-11-17T06:31:26.285168+0000","last_fullsized":"2023-11-17T06:31:26.285168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:48.211036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280666+0000","last_change":"2023-11-17T06:31:26.289802+0000","last_active":"2023-11-17T06:31:27.280666+0000","last_peered":"2023-11-17T06:31:27.280666+0000","last_clean":"2023-11-17T06:31:27.280666+0000","last_became_active":"2023-11-17T06:31:26.284057+0000","last_became_peered":"2023-11-17T06:31:26.284057+0000","last_unstale":"2023-11-17T06:31:27.280666+0000","last_undegraded":"2023-11-17T06:31:27.280666+0000","last_fullsized":"2023-11-17T06:31:27.280666+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:12:57.233401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.284209+0000","last_change":"2023-11-17T06:31:25.253301+0000","last_active":"2023-11-17T06:31:26.284209+0000","last_peered":"2023-11-17T06:31:26.284209+0000","last_clean":"2023-11-17T06:31:26.284209+0000","last_became_active":"2023-11-17T06:31:25.252922+0000","last_became_peered":"2023-11-17T06:31:25.252922+0000","last_unstale":"2023-11-17T06:31:26.284209+0000","last_undegraded":"2023-11-17T06:31:26.284209+0000","last_fullsized":"2023-11-17T06:31:26.284209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:52:26.375083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.798890+0000","last_change":"2023-11-17T06:31:26.300545+0000","last_active":"2023-11-17T06:31:27.798890+0000","last_peered":"2023-11-17T06:31:27.798890+0000","last_clean":"2023-11-17T06:31:27.798890+0000","last_became_active":"2023-11-17T06:31:26.300278+0000","last_became_peered":"2023-11-17T06:31:26.300278+0000","last_unstale":"2023-11-17T06:31:27.798890+0000","last_undegraded":"2023-11-17T06:31:27.798890+0000","last_fullsized":"2023-11-17T06:31:27.798890+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:12:40.917933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.318744+0000","last_change":"2023-11-17T06:31:25.238334+0000","last_active":"2023-11-17T06:31:26.318744+0000","last_peered":"2023-11-17T06:31:26.318744+0000","last_clean":"2023-11-17T06:31:26.318744+0000","last_became_active":"2023-11-17T06:31:25.238015+0000","last_became_peered":"2023-11-17T06:31:25.238015+0000","last_unstale":"2023-11-17T06:31:26.318744+0000","last_undegraded":"2023-11-17T06:31:26.318744+0000","last_fullsized":"2023-11-17T06:31:26.318744+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:33:00.604268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.799444+0000","last_change":"2023-11-17T06:31:26.292782+0000","last_active":"2023-11-17T06:31:27.799444+0000","last_peered":"2023-11-17T06:31:27.799444+0000","last_clean":"2023-11-17T06:31:27.799444+0000","last_became_active":"2023-11-17T06:31:26.292518+0000","last_became_peered":"2023-11-17T06:31:26.292518+0000","last_unstale":"2023-11-17T06:31:27.799444+0000","last_undegraded":"2023-11-17T06:31:27.799444+0000","last_fullsized":"2023-11-17T06:31:27.799444+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:09:29.533071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.318164+0000","last_change":"2023-11-17T06:31:25.246380+0000","last_active":"2023-11-17T06:31:26.318164+0000","last_peered":"2023-11-17T06:31:26.318164+0000","last_clean":"2023-11-17T06:31:26.318164+0000","last_became_active":"2023-11-17T06:31:25.245844+0000","last_became_peered":"2023-11-17T06:31:25.245844+0000","last_unstale":"2023-11-17T06:31:26.318164+0000","last_undegraded":"2023-11-17T06:31:26.318164+0000","last_fullsized":"2023-11-17T06:31:26.318164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:18:36.027307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800643+0000","last_change":"2023-11-17T06:31:26.297791+0000","last_active":"2023-11-17T06:31:27.800643+0000","last_peered":"2023-11-17T06:31:27.800643+0000","last_clean":"2023-11-17T06:31:27.800643+0000","last_became_active":"2023-11-17T06:31:26.297537+0000","last_became_peered":"2023-11-17T06:31:26.297537+0000","last_unstale":"2023-11-17T06:31:27.800643+0000","last_undegraded":"2023-11-17T06:31:27.800643+0000","last_fullsized":"2023-11-17T06:31:27.800643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:55:33.513783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.316589+0000","last_change":"2023-11-17T06:31:25.256888+0000","last_active":"2023-11-17T06:31:26.316589+0000","last_peered":"2023-11-17T06:31:26.316589+0000","last_clean":"2023-11-17T06:31:26.316589+0000","last_became_active":"2023-11-17T06:31:25.256562+0000","last_became_peered":"2023-11-17T06:31:25.256562+0000","last_unstale":"2023-11-17T06:31:26.316589+0000","last_undegraded":"2023-11-17T06:31:26.316589+0000","last_fullsized":"2023-11-17T06:31:26.316589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:33:56.102266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281875+0000","last_change":"2023-11-17T06:31:26.287378+0000","last_active":"2023-11-17T06:31:27.281875+0000","last_peered":"2023-11-17T06:31:27.281875+0000","last_clean":"2023-11-17T06:31:27.281875+0000","last_became_active":"2023-11-17T06:31:26.287010+0000","last_became_peered":"2023-11-17T06:31:26.287010+0000","last_unstale":"2023-11-17T06:31:27.281875+0000","last_undegraded":"2023-11-17T06:31:27.281875+0000","last_fullsized":"2023-11-17T06:31:27.281875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:48:31.533988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.314294+0000","last_change":"2023-11-17T06:31:25.249803+0000","last_active":"2023-11-17T06:31:26.314294+0000","last_peered":"2023-11-17T06:31:26.314294+0000","last_clean":"2023-11-17T06:31:26.314294+0000","last_became_active":"2023-11-17T06:31:25.249464+0000","last_became_peered":"2023-11-17T06:31:25.249464+0000","last_unstale":"2023-11-17T06:31:26.314294+0000","last_undegraded":"2023-11-17T06:31:26.314294+0000","last_fullsized":"2023-11-17T06:31:26.314294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:11:31.084539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281464+0000","last_change":"2023-11-17T06:31:26.303900+0000","last_active":"2023-11-17T06:31:27.281464+0000","last_peered":"2023-11-17T06:31:27.281464+0000","last_clean":"2023-11-17T06:31:27.281464+0000","last_became_active":"2023-11-17T06:31:26.303631+0000","last_became_peered":"2023-11-17T06:31:26.303631+0000","last_unstale":"2023-11-17T06:31:27.281464+0000","last_undegraded":"2023-11-17T06:31:27.281464+0000","last_fullsized":"2023-11-17T06:31:27.281464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:08:09.905483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.289318+0000","last_change":"2023-11-17T06:31:25.255987+0000","last_active":"2023-11-17T06:31:26.289318+0000","last_peered":"2023-11-17T06:31:26.289318+0000","last_clean":"2023-11-17T06:31:26.289318+0000","last_became_active":"2023-11-17T06:31:25.255688+0000","last_became_peered":"2023-11-17T06:31:25.255688+0000","last_unstale":"2023-11-17T06:31:26.289318+0000","last_undegraded":"2023-11-17T06:31:26.289318+0000","last_fullsized":"2023-11-17T06:31:26.289318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:00:17.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489101+0000","last_change":"2023-11-17T06:31:26.311002+0000","last_active":"2023-11-17T06:31:27.489101+0000","last_peered":"2023-11-17T06:31:27.489101+0000","last_clean":"2023-11-17T06:31:27.489101+0000","last_became_active":"2023-11-17T06:31:26.310725+0000","last_became_peered":"2023-11-17T06:31:26.310725+0000","last_unstale":"2023-11-17T06:31:27.489101+0000","last_undegraded":"2023-11-17T06:31:27.489101+0000","last_fullsized":"2023-11-17T06:31:27.489101+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:49:19.311852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282345+0000","last_change":"2023-11-17T06:31:25.249583+0000","last_active":"2023-11-17T06:31:27.282345+0000","last_peered":"2023-11-17T06:31:27.282345+0000","last_clean":"2023-11-17T06:31:27.282345+0000","last_became_active":"2023-11-17T06:31:25.249331+0000","last_became_peered":"2023-11-17T06:31:25.249331+0000","last_unstale":"2023-11-17T06:31:27.282345+0000","last_undegraded":"2023-11-17T06:31:27.282345+0000","last_fullsized":"2023-11-17T06:31:27.282345+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:03:06.186284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282208+0000","last_change":"2023-11-17T06:31:26.278376+0000","last_active":"2023-11-17T06:31:27.282208+0000","last_peered":"2023-11-17T06:31:27.282208+0000","last_clean":"2023-11-17T06:31:27.282208+0000","last_became_active":"2023-11-17T06:31:26.277778+0000","last_became_peered":"2023-11-17T06:31:26.277778+0000","last_unstale":"2023-11-17T06:31:27.282208+0000","last_undegraded":"2023-11-17T06:31:27.282208+0000","last_fullsized":"2023-11-17T06:31:27.282208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:50:53.148267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.274226+0000","last_change":"2023-11-17T06:31:25.256031+0000","last_active":"2023-11-17T06:31:26.274226+0000","last_peered":"2023-11-17T06:31:26.274226+0000","last_clean":"2023-11-17T06:31:26.274226+0000","last_became_active":"2023-11-17T06:31:25.255735+0000","last_became_peered":"2023-11-17T06:31:25.255735+0000","last_unstale":"2023-11-17T06:31:26.274226+0000","last_undegraded":"2023-11-17T06:31:26.274226+0000","last_fullsized":"2023-11-17T06:31:26.274226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:38:34.520594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.488900+0000","last_change":"2023-11-17T06:31:26.299344+0000","last_active":"2023-11-17T06:31:27.488900+0000","last_peered":"2023-11-17T06:31:27.488900+0000","last_clean":"2023-11-17T06:31:27.488900+0000","last_became_active":"2023-11-17T06:31:26.299033+0000","last_became_peered":"2023-11-17T06:31:26.299033+0000","last_unstale":"2023-11-17T06:31:27.488900+0000","last_undegraded":"2023-11-17T06:31:27.488900+0000","last_fullsized":"2023-11-17T06:31:27.488900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:38:52.743440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.278029+0000","last_change":"2023-11-17T06:31:25.239323+0000","last_active":"2023-11-17T06:31:26.278029+0000","last_peered":"2023-11-17T06:31:26.278029+0000","last_clean":"2023-11-17T06:31:26.278029+0000","last_became_active":"2023-11-17T06:31:25.239040+0000","last_became_peered":"2023-11-17T06:31:25.239040+0000","last_unstale":"2023-11-17T06:31:26.278029+0000","last_undegraded":"2023-11-17T06:31:26.278029+0000","last_fullsized":"2023-11-17T06:31:26.278029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:46:40.843875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800085+0000","last_change":"2023-11-17T06:31:26.297070+0000","last_active":"2023-11-17T06:31:27.800085+0000","last_peered":"2023-11-17T06:31:27.800085+0000","last_clean":"2023-11-17T06:31:27.800085+0000","last_became_active":"2023-11-17T06:31:26.296807+0000","last_became_peered":"2023-11-17T06:31:26.296807+0000","last_unstale":"2023-11-17T06:31:27.800085+0000","last_undegraded":"2023-11-17T06:31:27.800085+0000","last_fullsized":"2023-11-17T06:31:27.800085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:45:03.196551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.280613+0000","last_change":"2023-11-17T06:31:25.250132+0000","last_active":"2023-11-17T06:31:26.280613+0000","last_peered":"2023-11-17T06:31:26.280613+0000","last_clean":"2023-11-17T06:31:26.280613+0000","last_became_active":"2023-11-17T06:31:25.248101+0000","last_became_peered":"2023-11-17T06:31:25.248101+0000","last_unstale":"2023-11-17T06:31:26.280613+0000","last_undegraded":"2023-11-17T06:31:26.280613+0000","last_fullsized":"2023-11-17T06:31:26.280613+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:22:38.054293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282165+0000","last_change":"2023-11-17T06:31:26.302423+0000","last_active":"2023-11-17T06:31:27.282165+0000","last_peered":"2023-11-17T06:31:27.282165+0000","last_clean":"2023-11-17T06:31:27.282165+0000","last_became_active":"2023-11-17T06:31:26.302152+0000","last_became_peered":"2023-11-17T06:31:26.302152+0000","last_unstale":"2023-11-17T06:31:27.282165+0000","last_undegraded":"2023-11-17T06:31:27.282165+0000","last_fullsized":"2023-11-17T06:31:27.282165+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:07:53.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.318396+0000","last_change":"2023-11-17T06:31:25.249362+0000","last_active":"2023-11-17T06:31:26.318396+0000","last_peered":"2023-11-17T06:31:26.318396+0000","last_clean":"2023-11-17T06:31:26.318396+0000","last_became_active":"2023-11-17T06:31:25.248832+0000","last_became_peered":"2023-11-17T06:31:25.248832+0000","last_unstale":"2023-11-17T06:31:26.318396+0000","last_undegraded":"2023-11-17T06:31:26.318396+0000","last_fullsized":"2023-11-17T06:31:26.318396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:18:54.162637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.799740+0000","last_change":"2023-11-17T06:31:26.289858+0000","last_active":"2023-11-17T06:31:27.799740+0000","last_peered":"2023-11-17T06:31:27.799740+0000","last_clean":"2023-11-17T06:31:27.799740+0000","last_became_active":"2023-11-17T06:31:26.289370+0000","last_became_peered":"2023-11-17T06:31:26.289370+0000","last_unstale":"2023-11-17T06:31:27.799740+0000","last_undegraded":"2023-11-17T06:31:27.799740+0000","last_fullsized":"2023-11-17T06:31:27.799740+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:49:36.534730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282342+0000","last_change":"2023-11-17T06:31:25.249037+0000","last_active":"2023-11-17T06:31:27.282342+0000","last_peered":"2023-11-17T06:31:27.282342+0000","last_clean":"2023-11-17T06:31:27.282342+0000","last_became_active":"2023-11-17T06:31:25.247762+0000","last_became_peered":"2023-11-17T06:31:25.247762+0000","last_unstale":"2023-11-17T06:31:27.282342+0000","last_undegraded":"2023-11-17T06:31:27.282342+0000","last_fullsized":"2023-11-17T06:31:27.282342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:38:46.098374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282208+0000","last_change":"2023-11-17T06:31:26.291847+0000","last_active":"2023-11-17T06:31:27.282208+0000","last_peered":"2023-11-17T06:31:27.282208+0000","last_clean":"2023-11-17T06:31:27.282208+0000","last_became_active":"2023-11-17T06:31:26.291316+0000","last_became_peered":"2023-11-17T06:31:26.291316+0000","last_unstale":"2023-11-17T06:31:27.282208+0000","last_undegraded":"2023-11-17T06:31:27.282208+0000","last_fullsized":"2023-11-17T06:31:27.282208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:33:57.108622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.295519+0000","last_change":"2023-11-17T06:31:25.234140+0000","last_active":"2023-11-17T06:31:26.295519+0000","last_peered":"2023-11-17T06:31:26.295519+0000","last_clean":"2023-11-17T06:31:26.295519+0000","last_became_active":"2023-11-17T06:31:25.233840+0000","last_became_peered":"2023-11-17T06:31:25.233840+0000","last_unstale":"2023-11-17T06:31:26.295519+0000","last_undegraded":"2023-11-17T06:31:26.295519+0000","last_fullsized":"2023-11-17T06:31:26.295519+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:18:12.160973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296969+0000","last_change":"2023-11-17T06:31:26.295066+0000","last_active":"2023-11-17T06:31:27.296969+0000","last_peered":"2023-11-17T06:31:27.296969+0000","last_clean":"2023-11-17T06:31:27.296969+0000","last_became_active":"2023-11-17T06:31:26.293667+0000","last_became_peered":"2023-11-17T06:31:26.293667+0000","last_unstale":"2023-11-17T06:31:27.296969+0000","last_undegraded":"2023-11-17T06:31:27.296969+0000","last_fullsized":"2023-11-17T06:31:27.296969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:43:17.919483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.287962+0000","last_change":"2023-11-17T06:31:25.251805+0000","last_active":"2023-11-17T06:31:26.287962+0000","last_peered":"2023-11-17T06:31:26.287962+0000","last_clean":"2023-11-17T06:31:26.287962+0000","last_became_active":"2023-11-17T06:31:25.251539+0000","last_became_peered":"2023-11-17T06:31:25.251539+0000","last_unstale":"2023-11-17T06:31:26.287962+0000","last_undegraded":"2023-11-17T06:31:26.287962+0000","last_fullsized":"2023-11-17T06:31:26.287962+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:12.818918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800484+0000","last_change":"2023-11-17T06:31:26.304756+0000","last_active":"2023-11-17T06:31:27.800484+0000","last_peered":"2023-11-17T06:31:27.800484+0000","last_clean":"2023-11-17T06:31:27.800484+0000","last_became_active":"2023-11-17T06:31:26.303910+0000","last_became_peered":"2023-11-17T06:31:26.303910+0000","last_unstale":"2023-11-17T06:31:27.800484+0000","last_undegraded":"2023-11-17T06:31:27.800484+0000","last_fullsized":"2023-11-17T06:31:27.800484+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:06:53.507705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.287167+0000","last_change":"2023-11-17T06:31:25.242816+0000","last_active":"2023-11-17T06:31:26.287167+0000","last_peered":"2023-11-17T06:31:26.287167+0000","last_clean":"2023-11-17T06:31:26.287167+0000","last_became_active":"2023-11-17T06:31:25.242403+0000","last_became_peered":"2023-11-17T06:31:25.242403+0000","last_unstale":"2023-11-17T06:31:26.287167+0000","last_undegraded":"2023-11-17T06:31:26.287167+0000","last_fullsized":"2023-11-17T06:31:26.287167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:46:12.076660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800406+0000","last_change":"2023-11-17T06:31:26.291580+0000","last_active":"2023-11-17T06:31:27.800406+0000","last_peered":"2023-11-17T06:31:27.800406+0000","last_clean":"2023-11-17T06:31:27.800406+0000","last_became_active":"2023-11-17T06:31:26.291295+0000","last_became_peered":"2023-11-17T06:31:26.291295+0000","last_unstale":"2023-11-17T06:31:27.800406+0000","last_undegraded":"2023-11-17T06:31:27.800406+0000","last_fullsized":"2023-11-17T06:31:27.800406+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:30:53.257713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.272352+0000","last_change":"2023-11-17T06:31:25.251537+0000","last_active":"2023-11-17T06:31:26.272352+0000","last_peered":"2023-11-17T06:31:26.272352+0000","last_clean":"2023-11-17T06:31:26.272352+0000","last_became_active":"2023-11-17T06:31:25.251229+0000","last_became_peered":"2023-11-17T06:31:25.251229+0000","last_unstale":"2023-11-17T06:31:26.272352+0000","last_undegraded":"2023-11-17T06:31:26.272352+0000","last_fullsized":"2023-11-17T06:31:26.272352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:18:54.162637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.798999+0000","last_change":"2023-11-17T06:31:26.287948+0000","last_active":"2023-11-17T06:31:27.798999+0000","last_peered":"2023-11-17T06:31:27.798999+0000","last_clean":"2023-11-17T06:31:27.798999+0000","last_became_active":"2023-11-17T06:31:26.287656+0000","last_became_peered":"2023-11-17T06:31:26.287656+0000","last_unstale":"2023-11-17T06:31:27.798999+0000","last_undegraded":"2023-11-17T06:31:27.798999+0000","last_fullsized":"2023-11-17T06:31:27.798999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:58:55.526605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.283485+0000","last_change":"2023-11-17T06:31:25.247067+0000","last_active":"2023-11-17T06:31:26.283485+0000","last_peered":"2023-11-17T06:31:26.283485+0000","last_clean":"2023-11-17T06:31:26.283485+0000","last_became_active":"2023-11-17T06:31:25.245736+0000","last_became_peered":"2023-11-17T06:31:25.245736+0000","last_unstale":"2023-11-17T06:31:26.283485+0000","last_undegraded":"2023-11-17T06:31:26.283485+0000","last_fullsized":"2023-11-17T06:31:26.283485+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:16:55.069581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296905+0000","last_change":"2023-11-17T06:31:26.300127+0000","last_active":"2023-11-17T06:31:27.296905+0000","last_peered":"2023-11-17T06:31:27.296905+0000","last_clean":"2023-11-17T06:31:27.296905+0000","last_became_active":"2023-11-17T06:31:26.299793+0000","last_became_peered":"2023-11-17T06:31:26.299793+0000","last_unstale":"2023-11-17T06:31:27.296905+0000","last_undegraded":"2023-11-17T06:31:27.296905+0000","last_fullsized":"2023-11-17T06:31:27.296905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:53:52.997397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.283816+0000","last_change":"2023-11-17T06:31:25.244315+0000","last_active":"2023-11-17T06:31:26.283816+0000","last_peered":"2023-11-17T06:31:26.283816+0000","last_clean":"2023-11-17T06:31:26.283816+0000","last_became_active":"2023-11-17T06:31:25.243771+0000","last_became_peered":"2023-11-17T06:31:25.243771+0000","last_unstale":"2023-11-17T06:31:26.283816+0000","last_undegraded":"2023-11-17T06:31:26.283816+0000","last_fullsized":"2023-11-17T06:31:26.283816+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:10:08.013131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.278355+0000","last_change":"2023-11-17T06:29:48.031659+0000","last_active":"2023-11-17T06:31:26.278355+0000","last_peered":"2023-11-17T06:31:26.278355+0000","last_clean":"2023-11-17T06:31:26.278355+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:31:26.278355+0000","last_undegraded":"2023-11-17T06:31:26.278355+0000","last_fullsized":"2023-11-17T06:31:26.278355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_clean_scrub_stamp":"2023-11-17T06:29:47.005420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:11:29.801860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":161523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.238},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.91700000000000004}]},{"osd":2,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.137},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":1.089,"5min":1.089,"15min":1.089},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.069}]},{"osd":3,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.1859999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.139,"5min":1.139,"15min":1.139},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.105}]},{"osd":6,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":1.127,"5min":1.127,"15min":1.127},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.0329999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":163113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.726,"5min":2.726,"15min":2.726},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":6.3339999999999996,"5min":6.3339999999999996,"15min":6.3339999999999996},"last":1.083}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.85599999999999998}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.446}]},{"osd":3,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":6.2210000000000001,"5min":6.2210000000000001,"15min":6.2210000000000001},"last":1.1439999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.018},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.4950000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.3939999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.6950000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":163135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.294},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1990000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.514}]},{"osd":3,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.25},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.232}]},{"osd":5,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.423},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.373}]},{"osd":6,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.151},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.5900000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.462},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.401}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":162277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.874}]},{"osd":2,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":4.2990000000000004,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.0309999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.6779999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.216},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.484}]},{"osd":6,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.776},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.3}]},{"osd":7,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.873}]}]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":161535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.2469999999999999,"5min":4.2469999999999999,"15min":4.2469999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":8.0510000000000002,"5min":8.0510000000000002,"15min":8.0510000000000002},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":4.5279999999999996,"5min":4.5279999999999996,"15min":4.5279999999999996},"last":0.98799999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":4.2960000000000003,"5min":4.2960000000000003,"15min":4.2960000000000003},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":4.2720000000000002,"5min":4.2720000000000002,"15min":4.2720000000000002},"last":1.155}]},{"osd":4,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.6280000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.016},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"max":{"1min":4.6459999999999999,"5min":4.6459999999999999,"15min":4.6459999999999999},"last":1.226}]},{"osd":5,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.609,"5min":1.609,"15min":1.609},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":4.4420000000000002,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":1.109}]},{"osd":6,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"min":{"1min":1.056,"5min":1.056,"15min":1.056},"max":{"1min":4.5679999999999996,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.196}]},{"osd":7,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.9969999999999999,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.276},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.3600000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":751939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":4.0709999999999997,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":4.7199999999999998,"5min":4.7199999999999998,"15min":4.7199999999999998},"last":1.6499999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":7.6180000000000003,"5min":7.6180000000000003,"15min":7.6180000000000003},"last":1.252},{"interface":"front","average":{"1min":1.778,"5min":1.778,"15min":1.778},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":8.4649999999999999,"5min":8.4649999999999999,"15min":8.4649999999999999},"last":1.4059999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":4.782,"5min":4.782,"15min":4.782},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.3079999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.89300000000000002}]},{"osd":4,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":4.3639999999999999,"5min":4.3639999999999999,"15min":4.3639999999999999},"last":1.456}]},{"osd":5,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":4.4180000000000001,"5min":4.4180000000000001,"15min":4.4180000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":4.6479999999999997,"5min":4.6479999999999997,"15min":4.6479999999999997},"last":1.214}]},{"osd":6,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":4.5839999999999996,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.341},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":4.2359999999999998,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":1.552}]},{"osd":7,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.75,"15min":1.75},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":1.583},{"interface":"front","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":1.4970000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":161591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.0209999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.1659999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.2869999999999999,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":1.272},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.2130000000000001,"5min":3.2130000000000001,"15min":3.2130000000000001},"last":1.5069999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.359},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.3180000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":3.3719999999999999,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.474}]},{"osd":7,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":3.5219999999999998,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.6200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":752451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.45},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.218}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.579}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.113},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.86599999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.0629999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.351}]},{"osd":6,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.159},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.681}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.395},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.97999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:31:30.589 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:31:30.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.794+0000 7f6662d27700 1 Processor -- start 2023-11-17T06:31:30.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.794+0000 7f6662d27700 1 -- start start 2023-11-17T06:31:30.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.798+0000 7f6662d27700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0cbef0 0x7f665c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.798+0000 7f6662d27700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665c06c200 con 0x7f665c0c21a0 2023-11-17T06:31:30.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.798+0000 7f6662d27700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665c165d00 con 0x7f665c1652b0 2023-11-17T06:31:30.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.798+0000 7f6662d27700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c1662c0 con 0x7f665c0cbef0 2023-11-17T06:31:30.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.798+0000 7f6661d25700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f665c0c21a0 0x7f665c06c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40530/0 (socket says 172.21.15.69:40530) 2023-11-17T06:31:30.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.798+0000 7f6661d25700 1 -- 172.21.15.69:0/38184687 learned_addr learned my addr 172.21.15.69:0/38184687 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:30.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6662526700 1 --2- 172.21.15.69:0/38184687 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0cbef0 0x7f665c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:30.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6660d23700 1 -- 172.21.15.69:0/38184687 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922704464 0 0) 0x7f665c06c200 con 0x7f665c0c21a0 2023-11-17T06:31:30.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6660d23700 1 -- 172.21.15.69:0/38184687 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66480035d0 con 0x7f665c0c21a0 2023-11-17T06:31:30.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6660d23700 1 -- 172.21.15.69:0/38184687 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413914824 0 0) 0x7f665c165d00 con 0x7f665c1652b0 2023-11-17T06:31:30.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6660d23700 1 -- 172.21.15.69:0/38184687 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f665c06c200 con 0x7f665c1652b0 2023-11-17T06:31:30.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6660d23700 1 -- 172.21.15.69:0/38184687 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586708032 0 0) 0x7f66480035d0 con 0x7f665c0c21a0 2023-11-17T06:31:30.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6662526700 1 -- 172.21.15.69:0/38184687 >> v1:172.21.15.93:6789/0 conn(0x7f665c1652b0 legacy=0x7f665c0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6662526700 1 -- 172.21.15.69:0/38184687 >> v1:172.21.15.69:6789/0 conn(0x7f665c0c21a0 legacy=0x7f665c06c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6662526700 1 -- 172.21.15.69:0/38184687 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c165fe0 con 0x7f665c0cbef0 2023-11-17T06:31:30.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6662526700 1 --2- 172.21.15.69:0/38184687 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0cbef0 0x7f665c0cc9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6654009dc0 tx=0x7f665400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8183264f8cc0067 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:30.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6660d23700 1 -- 172.21.15.69:0/38184687 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665400e070 con 0x7f665c0cbef0 2023-11-17T06:31:30.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6660d23700 1 -- 172.21.15.69:0/38184687 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6654003a40 con 0x7f665c0cbef0 2023-11-17T06:31:30.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6660d23700 1 -- 172.21.15.69:0/38184687 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6658001670 con 0x7f665c0cbef0 2023-11-17T06:31:30.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6662d27700 1 -- 172.21.15.69:0/38184687 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0cbef0 msgr2=0x7f665c0cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:30.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6662d27700 1 --2- 172.21.15.69:0/38184687 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0cbef0 0x7f665c0cc9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6654009dc0 tx=0x7f665400b330 comp rx=0 tx=0).stop 2023-11-17T06:31:30.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6662d27700 1 -- 172.21.15.69:0/38184687 shutdown_connections 2023-11-17T06:31:30.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6662d27700 1 --2- 172.21.15.69:0/38184687 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0cbef0 0x7f665c0cc9a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:30.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.802+0000 7f6662d27700 1 -- 172.21.15.69:0/38184687 >> 172.21.15.69:0/38184687 conn(0x7f665c0b0900 msgr2=0x7f665c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:30.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.806+0000 7f6662d27700 1 -- 172.21.15.69:0/38184687 shutdown_connections 2023-11-17T06:31:30.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.806+0000 7f6662d27700 1 -- 172.21.15.69:0/38184687 wait complete. 2023-11-17T06:31:30.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.806+0000 7f6662d27700 1 Processor -- start 2023-11-17T06:31:30.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.806+0000 7f6662d27700 1 -- start start 2023-11-17T06:31:30.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6662d27700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0c21a0 0x7f665c152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6662d27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f665c0cbef0 0x7f665c161c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6662d27700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f665c1652b0 0x7f665c163fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:30.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6662d27700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c1fac50 con 0x7f665c0cbef0 2023-11-17T06:31:30.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6662d27700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0c5ea0 con 0x7f665c1652b0 2023-11-17T06:31:35.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6662d27700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665c0c6180 con 0x7f665c0c21a0 2023-11-17T06:31:35.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6661524700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f665c0cbef0 0x7f665c161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:35.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6661524700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f665c0cbef0 0x7f665c161c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32862/0 (socket says 172.21.15.69:32862) 2023-11-17T06:31:35.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6661524700 1 -- 172.21.15.69:0/311550460 learned_addr learned my addr 172.21.15.69:0/311550460 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:35.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6662526700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f665c1652b0 0x7f665c163fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:35.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6661d25700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0c21a0 0x7f665c152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:35.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6661524700 1 -- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0c21a0 msgr2=0x7f665c152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:35.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6661524700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0c21a0 0x7f665c152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6661524700 1 -- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f665c1652b0 msgr2=0x7f665c163fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6661524700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f665c1652b0 0x7f665c163fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6661524700 1 -- 172.21.15.69:0/311550460 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6654009a70 con 0x7f665c0cbef0 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6662526700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f665c1652b0 0x7f665c163fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6661524700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f665c0cbef0 0x7f665c161c60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c490 tx=0x7f664c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f66527fc700 1 -- 172.21.15.69:0/311550460 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c0052d0 con 0x7f665c0cbef0 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f66527fc700 1 -- 172.21.15.69:0/311550460 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c005450 con 0x7f665c0cbef0 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f66527fc700 1 -- 172.21.15.69:0/311550460 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c0038e0 con 0x7f665c0cbef0 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6662d27700 1 -- 172.21.15.69:0/311550460 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c0c6460 con 0x7f665c0cbef0 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.810+0000 7f6662d27700 1 -- 172.21.15.69:0/311550460 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665c152750 con 0x7f665c0cbef0 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.814+0000 7f6662d27700 1 -- 172.21.15.69:0/311550460 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665c0c6980 con 0x7f665c0cbef0 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.814+0000 7f66527fc700 1 -- 172.21.15.69:0/311550460 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f664c003a40 con 0x7f665c0cbef0 2023-11-17T06:31:35.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.814+0000 7f66527fc700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6640066510 0x7f66400689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:35.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.814+0000 7f66527fc700 1 -- 172.21.15.69:0/311550460 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f664c0832b0 con 0x7f665c0cbef0 2023-11-17T06:31:35.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.818+0000 7f6661d25700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6640066510 0x7f66400689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:35.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.818+0000 7f6661d25700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6640066510 0x7f66400689d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f66580059b0 tx=0x7f6658001b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:35.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.822+0000 7f66527fc700 1 -- 172.21.15.69:0/311550460 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f665c0c6980 con 0x7f665c0cbef0 2023-11-17T06:31:35.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:30.990+0000 7f6662d27700 1 -- 172.21.15.69:0/311550460 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f665c0c6010 con 0x7f6640066510 2023-11-17T06:31:35.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.010+0000 7f66527fc700 1 -- 172.21.15.69:0/311550460 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287221 (secure 0 0 0) 0x7f665c0c6010 con 0x7f6640066510 2023-11-17T06:31:35.326 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:35.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 -- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6640066510 msgr2=0x7f66400689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:35.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6640066510 0x7f66400689d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f66580059b0 tx=0x7f6658001b80 comp rx=0 tx=0).stop 2023-11-17T06:31:35.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 -- 172.21.15.69:0/311550460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f665c0cbef0 msgr2=0x7f665c161c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:35.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f665c0cbef0 0x7f665c161c60 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c490 tx=0x7f664c00c850 comp rx=0 tx=0).stop 2023-11-17T06:31:35.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 -- 172.21.15.69:0/311550460 shutdown_connections 2023-11-17T06:31:35.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6640066510 0x7f66400689d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f665c1652b0 0x7f665c163fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f665c0cbef0 0x7f665c161c60 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 --2- 172.21.15.69:0/311550460 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f665c0c21a0 0x7f665c152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 -- 172.21.15.69:0/311550460 >> 172.21.15.69:0/311550460 conn(0x7f665c0b0900 msgr2=0x7f665c06fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:35.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 -- 172.21.15.69:0/311550460 shutdown_connections 2023-11-17T06:31:35.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:31.018+0000 7f6662d27700 1 -- 172.21.15.69:0/311550460 wait complete. 2023-11-17T06:31:35.330 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:31:35.330 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2023-11-17T06:31:30.396269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220640,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754080,"statfs":{"total":773094113280,"available":772868177920,"internally_reserved":0,"allocated":4562944,"data_stored":2477564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002088"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280940+0000","last_change":"2023-11-17T06:31:26.297207+0000","last_active":"2023-11-17T06:31:27.280940+0000","last_peered":"2023-11-17T06:31:27.280940+0000","last_clean":"2023-11-17T06:31:27.280940+0000","last_became_active":"2023-11-17T06:31:26.296599+0000","last_became_peered":"2023-11-17T06:31:26.296599+0000","last_unstale":"2023-11-17T06:31:27.280940+0000","last_undegraded":"2023-11-17T06:31:27.280940+0000","last_fullsized":"2023-11-17T06:31:27.280940+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:49.217393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282147+0000","last_change":"2023-11-17T06:31:26.292821+0000","last_active":"2023-11-17T06:31:27.282147+0000","last_peered":"2023-11-17T06:31:27.282147+0000","last_clean":"2023-11-17T06:31:27.282147+0000","last_became_active":"2023-11-17T06:31:26.292506+0000","last_became_peered":"2023-11-17T06:31:26.292506+0000","last_unstale":"2023-11-17T06:31:27.282147+0000","last_undegraded":"2023-11-17T06:31:27.282147+0000","last_fullsized":"2023-11-17T06:31:27.282147+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:26:15.017589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800467+0000","last_change":"2023-11-17T06:31:26.291246+0000","last_active":"2023-11-17T06:31:27.800467+0000","last_peered":"2023-11-17T06:31:27.800467+0000","last_clean":"2023-11-17T06:31:27.800467+0000","last_became_active":"2023-11-17T06:31:26.290817+0000","last_became_peered":"2023-11-17T06:31:26.290817+0000","last_unstale":"2023-11-17T06:31:27.800467+0000","last_undegraded":"2023-11-17T06:31:27.800467+0000","last_fullsized":"2023-11-17T06:31:27.800467+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:08:09.905483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800632+0000","last_change":"2023-11-17T06:31:26.306872+0000","last_active":"2023-11-17T06:31:27.800632+0000","last_peered":"2023-11-17T06:31:27.800632+0000","last_clean":"2023-11-17T06:31:27.800632+0000","last_became_active":"2023-11-17T06:31:26.306228+0000","last_became_peered":"2023-11-17T06:31:26.306228+0000","last_unstale":"2023-11-17T06:31:27.800632+0000","last_undegraded":"2023-11-17T06:31:27.800632+0000","last_fullsized":"2023-11-17T06:31:27.800632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:53:52.997397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281986+0000","last_change":"2023-11-17T06:31:26.305529+0000","last_active":"2023-11-17T06:31:27.281986+0000","last_peered":"2023-11-17T06:31:27.281986+0000","last_clean":"2023-11-17T06:31:27.281986+0000","last_became_active":"2023-11-17T06:31:26.305191+0000","last_became_peered":"2023-11-17T06:31:26.305191+0000","last_unstale":"2023-11-17T06:31:27.281986+0000","last_undegraded":"2023-11-17T06:31:27.281986+0000","last_fullsized":"2023-11-17T06:31:27.281986+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:55:16.580775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281541+0000","last_change":"2023-11-17T06:31:26.279371+0000","last_active":"2023-11-17T06:31:27.281541+0000","last_peered":"2023-11-17T06:31:27.281541+0000","last_clean":"2023-11-17T06:31:27.281541+0000","last_became_active":"2023-11-17T06:31:26.278750+0000","last_became_peered":"2023-11-17T06:31:26.278750+0000","last_unstale":"2023-11-17T06:31:27.281541+0000","last_undegraded":"2023-11-17T06:31:27.281541+0000","last_fullsized":"2023-11-17T06:31:27.281541+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:18:55.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280322+0000","last_change":"2023-11-17T06:31:26.293836+0000","last_active":"2023-11-17T06:31:27.280322+0000","last_peered":"2023-11-17T06:31:27.280322+0000","last_clean":"2023-11-17T06:31:27.280322+0000","last_became_active":"2023-11-17T06:31:26.290832+0000","last_became_peered":"2023-11-17T06:31:26.290832+0000","last_unstale":"2023-11-17T06:31:27.280322+0000","last_undegraded":"2023-11-17T06:31:27.280322+0000","last_fullsized":"2023-11-17T06:31:27.280322+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:13:52.420324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280590+0000","last_change":"2023-11-17T06:31:26.297182+0000","last_active":"2023-11-17T06:31:27.280590+0000","last_peered":"2023-11-17T06:31:27.280590+0000","last_clean":"2023-11-17T06:31:27.280590+0000","last_became_active":"2023-11-17T06:31:26.296851+0000","last_became_peered":"2023-11-17T06:31:26.296851+0000","last_unstale":"2023-11-17T06:31:27.280590+0000","last_undegraded":"2023-11-17T06:31:27.280590+0000","last_fullsized":"2023-11-17T06:31:27.280590+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:52:27.381439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800411+0000","last_change":"2023-11-17T06:31:26.292325+0000","last_active":"2023-11-17T06:31:27.800411+0000","last_peered":"2023-11-17T06:31:27.800411+0000","last_clean":"2023-11-17T06:31:27.800411+0000","last_became_active":"2023-11-17T06:31:26.292008+0000","last_became_peered":"2023-11-17T06:31:26.292008+0000","last_unstale":"2023-11-17T06:31:27.800411+0000","last_undegraded":"2023-11-17T06:31:27.800411+0000","last_fullsized":"2023-11-17T06:31:27.800411+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:10:46.351324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.801484+0000","last_change":"2023-11-17T06:31:26.297871+0000","last_active":"2023-11-17T06:31:27.801484+0000","last_peered":"2023-11-17T06:31:27.801484+0000","last_clean":"2023-11-17T06:31:27.801484+0000","last_became_active":"2023-11-17T06:31:26.297603+0000","last_became_peered":"2023-11-17T06:31:26.297603+0000","last_unstale":"2023-11-17T06:31:27.801484+0000","last_undegraded":"2023-11-17T06:31:27.801484+0000","last_fullsized":"2023-11-17T06:31:27.801484+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:47:23.787289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800576+0000","last_change":"2023-11-17T06:31:26.296449+0000","last_active":"2023-11-17T06:31:27.800576+0000","last_peered":"2023-11-17T06:31:27.800576+0000","last_clean":"2023-11-17T06:31:27.800576+0000","last_became_active":"2023-11-17T06:31:26.296159+0000","last_became_peered":"2023-11-17T06:31:26.296159+0000","last_unstale":"2023-11-17T06:31:27.800576+0000","last_undegraded":"2023-11-17T06:31:27.800576+0000","last_fullsized":"2023-11-17T06:31:27.800576+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:05:07.887854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800333+0000","last_change":"2023-11-17T06:31:26.313459+0000","last_active":"2023-11-17T06:31:27.800333+0000","last_peered":"2023-11-17T06:31:27.800333+0000","last_clean":"2023-11-17T06:31:27.800333+0000","last_became_active":"2023-11-17T06:31:26.313196+0000","last_became_peered":"2023-11-17T06:31:26.313196+0000","last_unstale":"2023-11-17T06:31:27.800333+0000","last_undegraded":"2023-11-17T06:31:27.800333+0000","last_fullsized":"2023-11-17T06:31:27.800333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:24:56.000069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489355+0000","last_change":"2023-11-17T06:31:26.300489+0000","last_active":"2023-11-17T06:31:27.489355+0000","last_peered":"2023-11-17T06:31:27.489355+0000","last_clean":"2023-11-17T06:31:27.489355+0000","last_became_active":"2023-11-17T06:31:26.300101+0000","last_became_peered":"2023-11-17T06:31:26.300101+0000","last_unstale":"2023-11-17T06:31:27.489355+0000","last_undegraded":"2023-11-17T06:31:27.489355+0000","last_fullsized":"2023-11-17T06:31:27.489355+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:52:27.381439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800309+0000","last_change":"2023-11-17T06:31:26.300468+0000","last_active":"2023-11-17T06:31:27.800309+0000","last_peered":"2023-11-17T06:31:27.800309+0000","last_clean":"2023-11-17T06:31:27.800309+0000","last_became_active":"2023-11-17T06:31:26.300187+0000","last_became_peered":"2023-11-17T06:31:26.300187+0000","last_unstale":"2023-11-17T06:31:27.800309+0000","last_undegraded":"2023-11-17T06:31:27.800309+0000","last_fullsized":"2023-11-17T06:31:27.800309+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:51:36.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296765+0000","last_change":"2023-11-17T06:31:26.301487+0000","last_active":"2023-11-17T06:31:27.296765+0000","last_peered":"2023-11-17T06:31:27.296765+0000","last_clean":"2023-11-17T06:31:27.296765+0000","last_became_active":"2023-11-17T06:31:26.299855+0000","last_became_peered":"2023-11-17T06:31:26.299855+0000","last_unstale":"2023-11-17T06:31:27.296765+0000","last_undegraded":"2023-11-17T06:31:27.296765+0000","last_fullsized":"2023-11-17T06:31:27.296765+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:06:41.173890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296621+0000","last_change":"2023-11-17T06:31:26.294563+0000","last_active":"2023-11-17T06:31:27.296621+0000","last_peered":"2023-11-17T06:31:27.296621+0000","last_clean":"2023-11-17T06:31:27.296621+0000","last_became_active":"2023-11-17T06:31:26.294252+0000","last_became_peered":"2023-11-17T06:31:26.294252+0000","last_unstale":"2023-11-17T06:31:27.296621+0000","last_undegraded":"2023-11-17T06:31:27.296621+0000","last_fullsized":"2023-11-17T06:31:27.296621+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:51:36.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.799490+0000","last_change":"2023-11-17T06:31:26.295331+0000","last_active":"2023-11-17T06:31:27.799490+0000","last_peered":"2023-11-17T06:31:27.799490+0000","last_clean":"2023-11-17T06:31:27.799490+0000","last_became_active":"2023-11-17T06:31:26.293949+0000","last_became_peered":"2023-11-17T06:31:26.293949+0000","last_unstale":"2023-11-17T06:31:27.799490+0000","last_undegraded":"2023-11-17T06:31:27.799490+0000","last_fullsized":"2023-11-17T06:31:27.799490+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:57:40.354591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282036+0000","last_change":"2023-11-17T06:31:26.304681+0000","last_active":"2023-11-17T06:31:27.282036+0000","last_peered":"2023-11-17T06:31:27.282036+0000","last_clean":"2023-11-17T06:31:27.282036+0000","last_became_active":"2023-11-17T06:31:26.302695+0000","last_became_peered":"2023-11-17T06:31:26.302695+0000","last_unstale":"2023-11-17T06:31:27.282036+0000","last_undegraded":"2023-11-17T06:31:27.282036+0000","last_fullsized":"2023-11-17T06:31:27.282036+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:45.750367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281472+0000","last_change":"2023-11-17T06:31:26.290570+0000","last_active":"2023-11-17T06:31:27.281472+0000","last_peered":"2023-11-17T06:31:27.281472+0000","last_clean":"2023-11-17T06:31:27.281472+0000","last_became_active":"2023-11-17T06:31:26.290143+0000","last_became_peered":"2023-11-17T06:31:26.290143+0000","last_unstale":"2023-11-17T06:31:27.281472+0000","last_undegraded":"2023-11-17T06:31:27.281472+0000","last_fullsized":"2023-11-17T06:31:27.281472+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:55:33.513783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489744+0000","last_change":"2023-11-17T06:31:26.313308+0000","last_active":"2023-11-17T06:31:27.489744+0000","last_peered":"2023-11-17T06:31:27.489744+0000","last_clean":"2023-11-17T06:31:27.489744+0000","last_became_active":"2023-11-17T06:31:26.312954+0000","last_became_peered":"2023-11-17T06:31:26.312954+0000","last_unstale":"2023-11-17T06:31:27.489744+0000","last_undegraded":"2023-11-17T06:31:27.489744+0000","last_fullsized":"2023-11-17T06:31:27.489744+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:12:57.233401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296808+0000","last_change":"2023-11-17T06:31:26.301857+0000","last_active":"2023-11-17T06:31:27.296808+0000","last_peered":"2023-11-17T06:31:27.296808+0000","last_clean":"2023-11-17T06:31:27.296808+0000","last_became_active":"2023-11-17T06:31:26.301580+0000","last_became_peered":"2023-11-17T06:31:26.301580+0000","last_unstale":"2023-11-17T06:31:27.296808+0000","last_undegraded":"2023-11-17T06:31:27.296808+0000","last_fullsized":"2023-11-17T06:31:27.296808+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:06:53.507705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281074+0000","last_change":"2023-11-17T06:31:26.294529+0000","last_active":"2023-11-17T06:31:27.281074+0000","last_peered":"2023-11-17T06:31:27.281074+0000","last_clean":"2023-11-17T06:31:27.281074+0000","last_became_active":"2023-11-17T06:31:26.294190+0000","last_became_peered":"2023-11-17T06:31:26.294190+0000","last_unstale":"2023-11-17T06:31:27.281074+0000","last_undegraded":"2023-11-17T06:31:27.281074+0000","last_fullsized":"2023-11-17T06:31:27.281074+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:51:36.867630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489055+0000","last_change":"2023-11-17T06:31:26.301111+0000","last_active":"2023-11-17T06:31:27.489055+0000","last_peered":"2023-11-17T06:31:27.489055+0000","last_clean":"2023-11-17T06:31:27.489055+0000","last_became_active":"2023-11-17T06:31:26.300815+0000","last_became_peered":"2023-11-17T06:31:26.300815+0000","last_unstale":"2023-11-17T06:31:27.489055+0000","last_undegraded":"2023-11-17T06:31:27.489055+0000","last_fullsized":"2023-11-17T06:31:27.489055+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:16:56.075938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280300+0000","last_change":"2023-11-17T06:31:26.294727+0000","last_active":"2023-11-17T06:31:27.280300+0000","last_peered":"2023-11-17T06:31:27.280300+0000","last_clean":"2023-11-17T06:31:27.280300+0000","last_became_active":"2023-11-17T06:31:26.294241+0000","last_became_peered":"2023-11-17T06:31:26.294241+0000","last_unstale":"2023-11-17T06:31:27.280300+0000","last_undegraded":"2023-11-17T06:31:27.280300+0000","last_fullsized":"2023-11-17T06:31:27.280300+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:38:52.743440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.801581+0000","last_change":"2023-11-17T06:31:26.293428+0000","last_active":"2023-11-17T06:31:27.801581+0000","last_peered":"2023-11-17T06:31:27.801581+0000","last_clean":"2023-11-17T06:31:27.801581+0000","last_became_active":"2023-11-17T06:31:26.292986+0000","last_became_peered":"2023-11-17T06:31:26.292986+0000","last_unstale":"2023-11-17T06:31:27.801581+0000","last_undegraded":"2023-11-17T06:31:27.801581+0000","last_fullsized":"2023-11-17T06:31:27.801581+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:11:32.090895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.801511+0000","last_change":"2023-11-17T06:31:26.296160+0000","last_active":"2023-11-17T06:31:27.801511+0000","last_peered":"2023-11-17T06:31:27.801511+0000","last_clean":"2023-11-17T06:31:27.801511+0000","last_became_active":"2023-11-17T06:31:26.295817+0000","last_became_peered":"2023-11-17T06:31:26.295817+0000","last_unstale":"2023-11-17T06:31:27.801511+0000","last_undegraded":"2023-11-17T06:31:27.801511+0000","last_fullsized":"2023-11-17T06:31:27.801511+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:22:39.060650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281964+0000","last_change":"2023-11-17T06:31:26.299553+0000","last_active":"2023-11-17T06:31:27.281964+0000","last_peered":"2023-11-17T06:31:27.281964+0000","last_clean":"2023-11-17T06:31:27.281964+0000","last_became_active":"2023-11-17T06:31:26.299273+0000","last_became_peered":"2023-11-17T06:31:26.299273+0000","last_unstale":"2023-11-17T06:31:27.281964+0000","last_undegraded":"2023-11-17T06:31:27.281964+0000","last_fullsized":"2023-11-17T06:31:27.281964+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:09:09.101298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280717+0000","last_change":"2023-11-17T06:31:26.314701+0000","last_active":"2023-11-17T06:31:27.280717+0000","last_peered":"2023-11-17T06:31:27.280717+0000","last_clean":"2023-11-17T06:31:27.280717+0000","last_became_active":"2023-11-17T06:31:26.314437+0000","last_became_peered":"2023-11-17T06:31:26.314437+0000","last_unstale":"2023-11-17T06:31:27.280717+0000","last_undegraded":"2023-11-17T06:31:27.280717+0000","last_fullsized":"2023-11-17T06:31:27.280717+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:00:18.204441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296805+0000","last_change":"2023-11-17T06:31:26.297641+0000","last_active":"2023-11-17T06:31:27.296805+0000","last_peered":"2023-11-17T06:31:27.296805+0000","last_clean":"2023-11-17T06:31:27.296805+0000","last_became_active":"2023-11-17T06:31:26.297386+0000","last_became_peered":"2023-11-17T06:31:26.297386+0000","last_unstale":"2023-11-17T06:31:27.296805+0000","last_undegraded":"2023-11-17T06:31:27.296805+0000","last_fullsized":"2023-11-17T06:31:27.296805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:30:53.257713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296541+0000","last_change":"2023-11-17T06:31:26.296334+0000","last_active":"2023-11-17T06:31:27.296541+0000","last_peered":"2023-11-17T06:31:27.296541+0000","last_clean":"2023-11-17T06:31:27.296541+0000","last_became_active":"2023-11-17T06:31:26.295950+0000","last_became_peered":"2023-11-17T06:31:26.295950+0000","last_unstale":"2023-11-17T06:31:27.296541+0000","last_undegraded":"2023-11-17T06:31:27.296541+0000","last_fullsized":"2023-11-17T06:31:27.296541+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:01:54.604909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280553+0000","last_change":"2023-11-17T06:31:26.290737+0000","last_active":"2023-11-17T06:31:27.280553+0000","last_peered":"2023-11-17T06:31:27.280553+0000","last_clean":"2023-11-17T06:31:27.280553+0000","last_became_active":"2023-11-17T06:31:26.287660+0000","last_became_peered":"2023-11-17T06:31:26.287660+0000","last_unstale":"2023-11-17T06:31:27.280553+0000","last_undegraded":"2023-11-17T06:31:27.280553+0000","last_fullsized":"2023-11-17T06:31:27.280553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:49:19.311852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.798922+0000","last_change":"2023-11-17T06:31:26.292304+0000","last_active":"2023-11-17T06:31:27.798922+0000","last_peered":"2023-11-17T06:31:27.798922+0000","last_clean":"2023-11-17T06:31:27.798922+0000","last_became_active":"2023-11-17T06:31:26.291997+0000","last_became_peered":"2023-11-17T06:31:26.291997+0000","last_unstale":"2023-11-17T06:31:27.798922+0000","last_undegraded":"2023-11-17T06:31:27.798922+0000","last_fullsized":"2023-11-17T06:31:27.798922+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T06:48:00.704677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489837+0000","last_change":"2023-11-17T06:31:26.297053+0000","last_active":"2023-11-17T06:31:27.489837+0000","last_peered":"2023-11-17T06:31:27.489837+0000","last_clean":"2023-11-17T06:31:27.489837+0000","last_became_active":"2023-11-17T06:31:26.296719+0000","last_became_peered":"2023-11-17T06:31:26.296719+0000","last_unstale":"2023-11-17T06:31:27.489837+0000","last_undegraded":"2023-11-17T06:31:27.489837+0000","last_fullsized":"2023-11-17T06:31:27.489837+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:00:18.204441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"36'4","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.313955+0000","last_change":"2023-11-17T06:31:25.249574+0000","last_active":"2023-11-17T06:31:26.313955+0000","last_peered":"2023-11-17T06:31:26.313955+0000","last_clean":"2023-11-17T06:31:26.313955+0000","last_became_active":"2023-11-17T06:31:25.248652+0000","last_became_peered":"2023-11-17T06:31:25.248652+0000","last_unstale":"2023-11-17T06:31:26.313955+0000","last_undegraded":"2023-11-17T06:31:26.313955+0000","last_fullsized":"2023-11-17T06:31:26.313955+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:00:35.723259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281072+0000","last_change":"2023-11-17T06:31:26.284696+0000","last_active":"2023-11-17T06:31:27.281072+0000","last_peered":"2023-11-17T06:31:27.281072+0000","last_clean":"2023-11-17T06:31:27.281072+0000","last_became_active":"2023-11-17T06:31:26.281553+0000","last_became_peered":"2023-11-17T06:31:26.281553+0000","last_unstale":"2023-11-17T06:31:27.281072+0000","last_undegraded":"2023-11-17T06:31:27.281072+0000","last_fullsized":"2023-11-17T06:31:27.281072+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:01:54.604909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.317640+0000","last_change":"2023-11-17T06:31:25.252822+0000","last_active":"2023-11-17T06:31:26.317640+0000","last_peered":"2023-11-17T06:31:26.317640+0000","last_clean":"2023-11-17T06:31:26.317640+0000","last_became_active":"2023-11-17T06:31:25.252142+0000","last_became_peered":"2023-11-17T06:31:25.252142+0000","last_unstale":"2023-11-17T06:31:26.317640+0000","last_undegraded":"2023-11-17T06:31:26.317640+0000","last_fullsized":"2023-11-17T06:31:26.317640+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:21:16.382787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280781+0000","last_change":"2023-11-17T06:31:26.298210+0000","last_active":"2023-11-17T06:31:27.280781+0000","last_peered":"2023-11-17T06:31:27.280781+0000","last_clean":"2023-11-17T06:31:27.280781+0000","last_became_active":"2023-11-17T06:31:26.296906+0000","last_became_peered":"2023-11-17T06:31:26.296906+0000","last_unstale":"2023-11-17T06:31:27.280781+0000","last_undegraded":"2023-11-17T06:31:27.280781+0000","last_fullsized":"2023-11-17T06:31:27.280781+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:21:17.389144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.314182+0000","last_change":"2023-11-17T06:31:25.244027+0000","last_active":"2023-11-17T06:31:26.314182+0000","last_peered":"2023-11-17T06:31:26.314182+0000","last_clean":"2023-11-17T06:31:26.314182+0000","last_became_active":"2023-11-17T06:31:25.243633+0000","last_became_peered":"2023-11-17T06:31:25.243633+0000","last_unstale":"2023-11-17T06:31:26.314182+0000","last_undegraded":"2023-11-17T06:31:26.314182+0000","last_fullsized":"2023-11-17T06:31:26.314182+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:24:54.993712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800984+0000","last_change":"2023-11-17T06:31:26.304746+0000","last_active":"2023-11-17T06:31:27.800984+0000","last_peered":"2023-11-17T06:31:27.800984+0000","last_clean":"2023-11-17T06:31:27.800984+0000","last_became_active":"2023-11-17T06:31:26.304100+0000","last_became_peered":"2023-11-17T06:31:26.304100+0000","last_unstale":"2023-11-17T06:31:27.800984+0000","last_undegraded":"2023-11-17T06:31:27.800984+0000","last_fullsized":"2023-11-17T06:31:27.800984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:20:31.494078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.318899+0000","last_change":"2023-11-17T06:31:25.247844+0000","last_active":"2023-11-17T06:31:26.318899+0000","last_peered":"2023-11-17T06:31:26.318899+0000","last_clean":"2023-11-17T06:31:26.318899+0000","last_became_active":"2023-11-17T06:31:25.247518+0000","last_became_peered":"2023-11-17T06:31:25.247518+0000","last_unstale":"2023-11-17T06:31:26.318899+0000","last_undegraded":"2023-11-17T06:31:26.318899+0000","last_fullsized":"2023-11-17T06:31:26.318899+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:12:56.227044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800845+0000","last_change":"2023-11-17T06:31:26.296251+0000","last_active":"2023-11-17T06:31:27.800845+0000","last_peered":"2023-11-17T06:31:27.800845+0000","last_clean":"2023-11-17T06:31:27.800845+0000","last_became_active":"2023-11-17T06:31:26.295697+0000","last_became_peered":"2023-11-17T06:31:26.295697+0000","last_unstale":"2023-11-17T06:31:27.800845+0000","last_undegraded":"2023-11-17T06:31:27.800845+0000","last_fullsized":"2023-11-17T06:31:27.800845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:45.750367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.316178+0000","last_change":"2023-11-17T06:31:25.252197+0000","last_active":"2023-11-17T06:31:26.316178+0000","last_peered":"2023-11-17T06:31:26.316178+0000","last_clean":"2023-11-17T06:31:26.316178+0000","last_became_active":"2023-11-17T06:31:25.251886+0000","last_became_peered":"2023-11-17T06:31:25.251886+0000","last_unstale":"2023-11-17T06:31:26.316178+0000","last_undegraded":"2023-11-17T06:31:26.316178+0000","last_fullsized":"2023-11-17T06:31:26.316178+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:34:44.744010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280419+0000","last_change":"2023-11-17T06:31:26.285622+0000","last_active":"2023-11-17T06:31:27.280419+0000","last_peered":"2023-11-17T06:31:27.280419+0000","last_clean":"2023-11-17T06:31:27.280419+0000","last_became_active":"2023-11-17T06:31:26.284862+0000","last_became_peered":"2023-11-17T06:31:26.284862+0000","last_unstale":"2023-11-17T06:31:27.280419+0000","last_undegraded":"2023-11-17T06:31:27.280419+0000","last_fullsized":"2023-11-17T06:31:27.280419+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:16:56.075938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.318289+0000","last_change":"2023-11-17T06:31:25.252108+0000","last_active":"2023-11-17T06:31:26.318289+0000","last_peered":"2023-11-17T06:31:26.318289+0000","last_clean":"2023-11-17T06:31:26.318289+0000","last_became_active":"2023-11-17T06:31:25.251838+0000","last_became_peered":"2023-11-17T06:31:25.251838+0000","last_unstale":"2023-11-17T06:31:26.318289+0000","last_undegraded":"2023-11-17T06:31:26.318289+0000","last_fullsized":"2023-11-17T06:31:26.318289+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:12.818918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800714+0000","last_change":"2023-11-17T06:31:26.299245+0000","last_active":"2023-11-17T06:31:27.800714+0000","last_peered":"2023-11-17T06:31:27.800714+0000","last_clean":"2023-11-17T06:31:27.800714+0000","last_became_active":"2023-11-17T06:31:26.298948+0000","last_became_peered":"2023-11-17T06:31:26.298948+0000","last_unstale":"2023-11-17T06:31:27.800714+0000","last_undegraded":"2023-11-17T06:31:27.800714+0000","last_fullsized":"2023-11-17T06:31:27.800714+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:18:55.168994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.271472+0000","last_change":"2023-11-17T06:31:25.235288+0000","last_active":"2023-11-17T06:31:26.271472+0000","last_peered":"2023-11-17T06:31:26.271472+0000","last_clean":"2023-11-17T06:31:26.271472+0000","last_became_active":"2023-11-17T06:31:25.234543+0000","last_became_peered":"2023-11-17T06:31:25.234543+0000","last_unstale":"2023-11-17T06:31:26.271472+0000","last_undegraded":"2023-11-17T06:31:26.271472+0000","last_fullsized":"2023-11-17T06:31:26.271472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:01:43.682306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800529+0000","last_change":"2023-11-17T06:31:26.291387+0000","last_active":"2023-11-17T06:31:27.800529+0000","last_peered":"2023-11-17T06:31:27.800529+0000","last_clean":"2023-11-17T06:31:27.800529+0000","last_became_active":"2023-11-17T06:31:26.290940+0000","last_became_peered":"2023-11-17T06:31:26.290940+0000","last_unstale":"2023-11-17T06:31:27.800529+0000","last_undegraded":"2023-11-17T06:31:27.800529+0000","last_fullsized":"2023-11-17T06:31:27.800529+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:01:54.604909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.273234+0000","last_change":"2023-11-17T06:31:25.250464+0000","last_active":"2023-11-17T06:31:26.273234+0000","last_peered":"2023-11-17T06:31:26.273234+0000","last_clean":"2023-11-17T06:31:26.273234+0000","last_became_active":"2023-11-17T06:31:25.250151+0000","last_became_peered":"2023-11-17T06:31:25.250151+0000","last_unstale":"2023-11-17T06:31:26.273234+0000","last_undegraded":"2023-11-17T06:31:26.273234+0000","last_fullsized":"2023-11-17T06:31:26.273234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:29:43.000790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.799757+0000","last_change":"2023-11-17T06:31:26.301980+0000","last_active":"2023-11-17T06:31:27.799757+0000","last_peered":"2023-11-17T06:31:27.799757+0000","last_clean":"2023-11-17T06:31:27.799757+0000","last_became_active":"2023-11-17T06:31:26.301683+0000","last_became_peered":"2023-11-17T06:31:26.301683+0000","last_unstale":"2023-11-17T06:31:27.799757+0000","last_undegraded":"2023-11-17T06:31:27.799757+0000","last_fullsized":"2023-11-17T06:31:27.799757+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:16:39.849864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282530+0000","last_change":"2023-11-17T06:31:25.246915+0000","last_active":"2023-11-17T06:31:27.282530+0000","last_peered":"2023-11-17T06:31:27.282530+0000","last_clean":"2023-11-17T06:31:27.282530+0000","last_became_active":"2023-11-17T06:31:25.246557+0000","last_became_peered":"2023-11-17T06:31:25.246557+0000","last_unstale":"2023-11-17T06:31:27.282530+0000","last_undegraded":"2023-11-17T06:31:27.282530+0000","last_fullsized":"2023-11-17T06:31:27.282530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:30:55.881195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.801522+0000","last_change":"2023-11-17T06:31:26.290902+0000","last_active":"2023-11-17T06:31:27.801522+0000","last_peered":"2023-11-17T06:31:27.801522+0000","last_clean":"2023-11-17T06:31:27.801522+0000","last_became_active":"2023-11-17T06:31:26.290573+0000","last_became_peered":"2023-11-17T06:31:26.290573+0000","last_unstale":"2023-11-17T06:31:27.801522+0000","last_undegraded":"2023-11-17T06:31:27.801522+0000","last_fullsized":"2023-11-17T06:31:27.801522+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:57:16.189425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282311+0000","last_change":"2023-11-17T06:31:25.249279+0000","last_active":"2023-11-17T06:31:27.282311+0000","last_peered":"2023-11-17T06:31:27.282311+0000","last_clean":"2023-11-17T06:31:27.282311+0000","last_became_active":"2023-11-17T06:31:25.248819+0000","last_became_peered":"2023-11-17T06:31:25.248819+0000","last_unstale":"2023-11-17T06:31:27.282311+0000","last_undegraded":"2023-11-17T06:31:27.282311+0000","last_fullsized":"2023-11-17T06:31:27.282311+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:55:11.854600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800824+0000","last_change":"2023-11-17T06:31:26.307125+0000","last_active":"2023-11-17T06:31:27.800824+0000","last_peered":"2023-11-17T06:31:27.800824+0000","last_clean":"2023-11-17T06:31:27.800824+0000","last_became_active":"2023-11-17T06:31:26.306552+0000","last_became_peered":"2023-11-17T06:31:26.306552+0000","last_unstale":"2023-11-17T06:31:27.800824+0000","last_undegraded":"2023-11-17T06:31:27.800824+0000","last_fullsized":"2023-11-17T06:31:27.800824+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:43:17.919483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"36'3","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.314206+0000","last_change":"2023-11-17T06:31:25.254102+0000","last_active":"2023-11-17T06:31:26.314206+0000","last_peered":"2023-11-17T06:31:26.314206+0000","last_clean":"2023-11-17T06:31:26.314206+0000","last_became_active":"2023-11-17T06:31:25.253807+0000","last_became_peered":"2023-11-17T06:31:25.253807+0000","last_unstale":"2023-11-17T06:31:26.314206+0000","last_undegraded":"2023-11-17T06:31:26.314206+0000","last_fullsized":"2023-11-17T06:31:26.314206+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:57:15.183068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.799191+0000","last_change":"2023-11-17T06:31:26.291703+0000","last_active":"2023-11-17T06:31:27.799191+0000","last_peered":"2023-11-17T06:31:27.799191+0000","last_clean":"2023-11-17T06:31:27.799191+0000","last_became_active":"2023-11-17T06:31:26.290546+0000","last_became_peered":"2023-11-17T06:31:26.290546+0000","last_unstale":"2023-11-17T06:31:27.799191+0000","last_undegraded":"2023-11-17T06:31:27.799191+0000","last_fullsized":"2023-11-17T06:31:27.799191+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:02:48.577537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"36'6","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.320808+0000","last_change":"2023-11-17T06:31:25.249611+0000","last_active":"2023-11-17T06:31:26.320808+0000","last_peered":"2023-11-17T06:31:26.320808+0000","last_clean":"2023-11-17T06:31:26.320808+0000","last_became_active":"2023-11-17T06:31:25.249296+0000","last_became_peered":"2023-11-17T06:31:25.249296+0000","last_unstale":"2023-11-17T06:31:26.320808+0000","last_undegraded":"2023-11-17T06:31:26.320808+0000","last_fullsized":"2023-11-17T06:31:26.320808+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:30:09.031806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489015+0000","last_change":"2023-11-17T06:31:26.301559+0000","last_active":"2023-11-17T06:31:27.489015+0000","last_peered":"2023-11-17T06:31:27.489015+0000","last_clean":"2023-11-17T06:31:27.489015+0000","last_became_active":"2023-11-17T06:31:26.301251+0000","last_became_peered":"2023-11-17T06:31:26.301251+0000","last_unstale":"2023-11-17T06:31:27.489015+0000","last_undegraded":"2023-11-17T06:31:27.489015+0000","last_fullsized":"2023-11-17T06:31:27.489015+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:13:52.420324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.316890+0000","last_change":"2023-11-17T06:31:25.251561+0000","last_active":"2023-11-17T06:31:26.316890+0000","last_peered":"2023-11-17T06:31:26.316890+0000","last_clean":"2023-11-17T06:31:26.316890+0000","last_became_active":"2023-11-17T06:31:25.251266+0000","last_became_peered":"2023-11-17T06:31:25.251266+0000","last_unstale":"2023-11-17T06:31:26.316890+0000","last_undegraded":"2023-11-17T06:31:26.316890+0000","last_fullsized":"2023-11-17T06:31:26.316890+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:46:12.076660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800359+0000","last_change":"2023-11-17T06:31:26.304948+0000","last_active":"2023-11-17T06:31:27.800359+0000","last_peered":"2023-11-17T06:31:27.800359+0000","last_clean":"2023-11-17T06:31:27.800359+0000","last_became_active":"2023-11-17T06:31:26.304348+0000","last_became_peered":"2023-11-17T06:31:26.304348+0000","last_unstale":"2023-11-17T06:31:27.800359+0000","last_undegraded":"2023-11-17T06:31:27.800359+0000","last_fullsized":"2023-11-17T06:31:27.800359+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:06:41.173890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.285168+0000","last_change":"2023-11-17T06:31:25.249878+0000","last_active":"2023-11-17T06:31:26.285168+0000","last_peered":"2023-11-17T06:31:26.285168+0000","last_clean":"2023-11-17T06:31:26.285168+0000","last_became_active":"2023-11-17T06:31:25.249493+0000","last_became_peered":"2023-11-17T06:31:25.249493+0000","last_unstale":"2023-11-17T06:31:26.285168+0000","last_undegraded":"2023-11-17T06:31:26.285168+0000","last_fullsized":"2023-11-17T06:31:26.285168+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:20:48.211036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.280666+0000","last_change":"2023-11-17T06:31:26.289802+0000","last_active":"2023-11-17T06:31:27.280666+0000","last_peered":"2023-11-17T06:31:27.280666+0000","last_clean":"2023-11-17T06:31:27.280666+0000","last_became_active":"2023-11-17T06:31:26.284057+0000","last_became_peered":"2023-11-17T06:31:26.284057+0000","last_unstale":"2023-11-17T06:31:27.280666+0000","last_undegraded":"2023-11-17T06:31:27.280666+0000","last_fullsized":"2023-11-17T06:31:27.280666+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:12:57.233401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.284209+0000","last_change":"2023-11-17T06:31:25.253301+0000","last_active":"2023-11-17T06:31:26.284209+0000","last_peered":"2023-11-17T06:31:26.284209+0000","last_clean":"2023-11-17T06:31:26.284209+0000","last_became_active":"2023-11-17T06:31:25.252922+0000","last_became_peered":"2023-11-17T06:31:25.252922+0000","last_unstale":"2023-11-17T06:31:26.284209+0000","last_undegraded":"2023-11-17T06:31:26.284209+0000","last_fullsized":"2023-11-17T06:31:26.284209+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:52:26.375083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.798890+0000","last_change":"2023-11-17T06:31:26.300545+0000","last_active":"2023-11-17T06:31:27.798890+0000","last_peered":"2023-11-17T06:31:27.798890+0000","last_clean":"2023-11-17T06:31:27.798890+0000","last_became_active":"2023-11-17T06:31:26.300278+0000","last_became_peered":"2023-11-17T06:31:26.300278+0000","last_unstale":"2023-11-17T06:31:27.798890+0000","last_undegraded":"2023-11-17T06:31:27.798890+0000","last_fullsized":"2023-11-17T06:31:27.798890+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:12:40.917933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"36'8","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.318744+0000","last_change":"2023-11-17T06:31:25.238334+0000","last_active":"2023-11-17T06:31:26.318744+0000","last_peered":"2023-11-17T06:31:26.318744+0000","last_clean":"2023-11-17T06:31:26.318744+0000","last_became_active":"2023-11-17T06:31:25.238015+0000","last_became_peered":"2023-11-17T06:31:25.238015+0000","last_unstale":"2023-11-17T06:31:26.318744+0000","last_undegraded":"2023-11-17T06:31:26.318744+0000","last_fullsized":"2023-11-17T06:31:26.318744+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:33:00.604268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.799444+0000","last_change":"2023-11-17T06:31:26.292782+0000","last_active":"2023-11-17T06:31:27.799444+0000","last_peered":"2023-11-17T06:31:27.799444+0000","last_clean":"2023-11-17T06:31:27.799444+0000","last_became_active":"2023-11-17T06:31:26.292518+0000","last_became_peered":"2023-11-17T06:31:26.292518+0000","last_unstale":"2023-11-17T06:31:27.799444+0000","last_undegraded":"2023-11-17T06:31:27.799444+0000","last_fullsized":"2023-11-17T06:31:27.799444+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:09:29.533071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.318164+0000","last_change":"2023-11-17T06:31:25.246380+0000","last_active":"2023-11-17T06:31:26.318164+0000","last_peered":"2023-11-17T06:31:26.318164+0000","last_clean":"2023-11-17T06:31:26.318164+0000","last_became_active":"2023-11-17T06:31:25.245844+0000","last_became_peered":"2023-11-17T06:31:25.245844+0000","last_unstale":"2023-11-17T06:31:26.318164+0000","last_undegraded":"2023-11-17T06:31:26.318164+0000","last_fullsized":"2023-11-17T06:31:26.318164+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:18:36.027307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800643+0000","last_change":"2023-11-17T06:31:26.297791+0000","last_active":"2023-11-17T06:31:27.800643+0000","last_peered":"2023-11-17T06:31:27.800643+0000","last_clean":"2023-11-17T06:31:27.800643+0000","last_became_active":"2023-11-17T06:31:26.297537+0000","last_became_peered":"2023-11-17T06:31:26.297537+0000","last_unstale":"2023-11-17T06:31:27.800643+0000","last_undegraded":"2023-11-17T06:31:27.800643+0000","last_fullsized":"2023-11-17T06:31:27.800643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:55:33.513783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.316589+0000","last_change":"2023-11-17T06:31:25.256888+0000","last_active":"2023-11-17T06:31:26.316589+0000","last_peered":"2023-11-17T06:31:26.316589+0000","last_clean":"2023-11-17T06:31:26.316589+0000","last_became_active":"2023-11-17T06:31:25.256562+0000","last_became_peered":"2023-11-17T06:31:25.256562+0000","last_unstale":"2023-11-17T06:31:26.316589+0000","last_undegraded":"2023-11-17T06:31:26.316589+0000","last_fullsized":"2023-11-17T06:31:26.316589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:33:56.102266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281875+0000","last_change":"2023-11-17T06:31:26.287378+0000","last_active":"2023-11-17T06:31:27.281875+0000","last_peered":"2023-11-17T06:31:27.281875+0000","last_clean":"2023-11-17T06:31:27.281875+0000","last_became_active":"2023-11-17T06:31:26.287010+0000","last_became_peered":"2023-11-17T06:31:26.287010+0000","last_unstale":"2023-11-17T06:31:27.281875+0000","last_undegraded":"2023-11-17T06:31:27.281875+0000","last_fullsized":"2023-11-17T06:31:27.281875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:48:31.533988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"36'1","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.314294+0000","last_change":"2023-11-17T06:31:25.249803+0000","last_active":"2023-11-17T06:31:26.314294+0000","last_peered":"2023-11-17T06:31:26.314294+0000","last_clean":"2023-11-17T06:31:26.314294+0000","last_became_active":"2023-11-17T06:31:25.249464+0000","last_became_peered":"2023-11-17T06:31:25.249464+0000","last_unstale":"2023-11-17T06:31:26.314294+0000","last_undegraded":"2023-11-17T06:31:26.314294+0000","last_fullsized":"2023-11-17T06:31:26.314294+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:11:31.084539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.281464+0000","last_change":"2023-11-17T06:31:26.303900+0000","last_active":"2023-11-17T06:31:27.281464+0000","last_peered":"2023-11-17T06:31:27.281464+0000","last_clean":"2023-11-17T06:31:27.281464+0000","last_became_active":"2023-11-17T06:31:26.303631+0000","last_became_peered":"2023-11-17T06:31:26.303631+0000","last_unstale":"2023-11-17T06:31:27.281464+0000","last_undegraded":"2023-11-17T06:31:27.281464+0000","last_fullsized":"2023-11-17T06:31:27.281464+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:08:09.905483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.289318+0000","last_change":"2023-11-17T06:31:25.255987+0000","last_active":"2023-11-17T06:31:26.289318+0000","last_peered":"2023-11-17T06:31:26.289318+0000","last_clean":"2023-11-17T06:31:26.289318+0000","last_became_active":"2023-11-17T06:31:25.255688+0000","last_became_peered":"2023-11-17T06:31:25.255688+0000","last_unstale":"2023-11-17T06:31:26.289318+0000","last_undegraded":"2023-11-17T06:31:26.289318+0000","last_fullsized":"2023-11-17T06:31:26.289318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:00:17.198084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.489101+0000","last_change":"2023-11-17T06:31:26.311002+0000","last_active":"2023-11-17T06:31:27.489101+0000","last_peered":"2023-11-17T06:31:27.489101+0000","last_clean":"2023-11-17T06:31:27.489101+0000","last_became_active":"2023-11-17T06:31:26.310725+0000","last_became_peered":"2023-11-17T06:31:26.310725+0000","last_unstale":"2023-11-17T06:31:27.489101+0000","last_undegraded":"2023-11-17T06:31:27.489101+0000","last_fullsized":"2023-11-17T06:31:27.489101+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:49:19.311852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"36'2","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282345+0000","last_change":"2023-11-17T06:31:25.249583+0000","last_active":"2023-11-17T06:31:27.282345+0000","last_peered":"2023-11-17T06:31:27.282345+0000","last_clean":"2023-11-17T06:31:27.282345+0000","last_became_active":"2023-11-17T06:31:25.249331+0000","last_became_peered":"2023-11-17T06:31:25.249331+0000","last_unstale":"2023-11-17T06:31:27.282345+0000","last_undegraded":"2023-11-17T06:31:27.282345+0000","last_fullsized":"2023-11-17T06:31:27.282345+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:03:06.186284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282208+0000","last_change":"2023-11-17T06:31:26.278376+0000","last_active":"2023-11-17T06:31:27.282208+0000","last_peered":"2023-11-17T06:31:27.282208+0000","last_clean":"2023-11-17T06:31:27.282208+0000","last_became_active":"2023-11-17T06:31:26.277778+0000","last_became_peered":"2023-11-17T06:31:26.277778+0000","last_unstale":"2023-11-17T06:31:27.282208+0000","last_undegraded":"2023-11-17T06:31:27.282208+0000","last_fullsized":"2023-11-17T06:31:27.282208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:50:53.148267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.274226+0000","last_change":"2023-11-17T06:31:25.256031+0000","last_active":"2023-11-17T06:31:26.274226+0000","last_peered":"2023-11-17T06:31:26.274226+0000","last_clean":"2023-11-17T06:31:26.274226+0000","last_became_active":"2023-11-17T06:31:25.255735+0000","last_became_peered":"2023-11-17T06:31:25.255735+0000","last_unstale":"2023-11-17T06:31:26.274226+0000","last_undegraded":"2023-11-17T06:31:26.274226+0000","last_fullsized":"2023-11-17T06:31:26.274226+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T08:38:34.520594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.488900+0000","last_change":"2023-11-17T06:31:26.299344+0000","last_active":"2023-11-17T06:31:27.488900+0000","last_peered":"2023-11-17T06:31:27.488900+0000","last_clean":"2023-11-17T06:31:27.488900+0000","last_became_active":"2023-11-17T06:31:26.299033+0000","last_became_peered":"2023-11-17T06:31:26.299033+0000","last_unstale":"2023-11-17T06:31:27.488900+0000","last_undegraded":"2023-11-17T06:31:27.488900+0000","last_fullsized":"2023-11-17T06:31:27.488900+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:38:52.743440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.278029+0000","last_change":"2023-11-17T06:31:25.239323+0000","last_active":"2023-11-17T06:31:26.278029+0000","last_peered":"2023-11-17T06:31:26.278029+0000","last_clean":"2023-11-17T06:31:26.278029+0000","last_became_active":"2023-11-17T06:31:25.239040+0000","last_became_peered":"2023-11-17T06:31:25.239040+0000","last_unstale":"2023-11-17T06:31:26.278029+0000","last_undegraded":"2023-11-17T06:31:26.278029+0000","last_fullsized":"2023-11-17T06:31:26.278029+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:46:40.843875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800085+0000","last_change":"2023-11-17T06:31:26.297070+0000","last_active":"2023-11-17T06:31:27.800085+0000","last_peered":"2023-11-17T06:31:27.800085+0000","last_clean":"2023-11-17T06:31:27.800085+0000","last_became_active":"2023-11-17T06:31:26.296807+0000","last_became_peered":"2023-11-17T06:31:26.296807+0000","last_unstale":"2023-11-17T06:31:27.800085+0000","last_undegraded":"2023-11-17T06:31:27.800085+0000","last_fullsized":"2023-11-17T06:31:27.800085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:45:03.196551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.280613+0000","last_change":"2023-11-17T06:31:25.250132+0000","last_active":"2023-11-17T06:31:26.280613+0000","last_peered":"2023-11-17T06:31:26.280613+0000","last_clean":"2023-11-17T06:31:26.280613+0000","last_became_active":"2023-11-17T06:31:25.248101+0000","last_became_peered":"2023-11-17T06:31:25.248101+0000","last_unstale":"2023-11-17T06:31:26.280613+0000","last_undegraded":"2023-11-17T06:31:26.280613+0000","last_fullsized":"2023-11-17T06:31:26.280613+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T16:22:38.054293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282165+0000","last_change":"2023-11-17T06:31:26.302423+0000","last_active":"2023-11-17T06:31:27.282165+0000","last_peered":"2023-11-17T06:31:27.282165+0000","last_clean":"2023-11-17T06:31:27.282165+0000","last_became_active":"2023-11-17T06:31:26.302152+0000","last_became_peered":"2023-11-17T06:31:26.302152+0000","last_unstale":"2023-11-17T06:31:27.282165+0000","last_undegraded":"2023-11-17T06:31:27.282165+0000","last_fullsized":"2023-11-17T06:31:27.282165+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:07:53.823959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"36'2","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.318396+0000","last_change":"2023-11-17T06:31:25.249362+0000","last_active":"2023-11-17T06:31:26.318396+0000","last_peered":"2023-11-17T06:31:26.318396+0000","last_clean":"2023-11-17T06:31:26.318396+0000","last_became_active":"2023-11-17T06:31:25.248832+0000","last_became_peered":"2023-11-17T06:31:25.248832+0000","last_unstale":"2023-11-17T06:31:26.318396+0000","last_undegraded":"2023-11-17T06:31:26.318396+0000","last_fullsized":"2023-11-17T06:31:26.318396+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:18:54.162637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.799740+0000","last_change":"2023-11-17T06:31:26.289858+0000","last_active":"2023-11-17T06:31:27.799740+0000","last_peered":"2023-11-17T06:31:27.799740+0000","last_clean":"2023-11-17T06:31:27.799740+0000","last_became_active":"2023-11-17T06:31:26.289370+0000","last_became_peered":"2023-11-17T06:31:26.289370+0000","last_unstale":"2023-11-17T06:31:27.799740+0000","last_undegraded":"2023-11-17T06:31:27.799740+0000","last_fullsized":"2023-11-17T06:31:27.799740+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:49:36.534730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282342+0000","last_change":"2023-11-17T06:31:25.249037+0000","last_active":"2023-11-17T06:31:27.282342+0000","last_peered":"2023-11-17T06:31:27.282342+0000","last_clean":"2023-11-17T06:31:27.282342+0000","last_became_active":"2023-11-17T06:31:25.247762+0000","last_became_peered":"2023-11-17T06:31:25.247762+0000","last_unstale":"2023-11-17T06:31:27.282342+0000","last_undegraded":"2023-11-17T06:31:27.282342+0000","last_fullsized":"2023-11-17T06:31:27.282342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:38:46.098374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.282208+0000","last_change":"2023-11-17T06:31:26.291847+0000","last_active":"2023-11-17T06:31:27.282208+0000","last_peered":"2023-11-17T06:31:27.282208+0000","last_clean":"2023-11-17T06:31:27.282208+0000","last_became_active":"2023-11-17T06:31:26.291316+0000","last_became_peered":"2023-11-17T06:31:26.291316+0000","last_unstale":"2023-11-17T06:31:27.282208+0000","last_undegraded":"2023-11-17T06:31:27.282208+0000","last_fullsized":"2023-11-17T06:31:27.282208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:33:57.108622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.295519+0000","last_change":"2023-11-17T06:31:25.234140+0000","last_active":"2023-11-17T06:31:26.295519+0000","last_peered":"2023-11-17T06:31:26.295519+0000","last_clean":"2023-11-17T06:31:26.295519+0000","last_became_active":"2023-11-17T06:31:25.233840+0000","last_became_peered":"2023-11-17T06:31:25.233840+0000","last_unstale":"2023-11-17T06:31:26.295519+0000","last_undegraded":"2023-11-17T06:31:26.295519+0000","last_fullsized":"2023-11-17T06:31:26.295519+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T12:18:12.160973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296969+0000","last_change":"2023-11-17T06:31:26.295066+0000","last_active":"2023-11-17T06:31:27.296969+0000","last_peered":"2023-11-17T06:31:27.296969+0000","last_clean":"2023-11-17T06:31:27.296969+0000","last_became_active":"2023-11-17T06:31:26.293667+0000","last_became_peered":"2023-11-17T06:31:26.293667+0000","last_unstale":"2023-11-17T06:31:27.296969+0000","last_undegraded":"2023-11-17T06:31:27.296969+0000","last_fullsized":"2023-11-17T06:31:27.296969+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:43:17.919483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.287962+0000","last_change":"2023-11-17T06:31:25.251805+0000","last_active":"2023-11-17T06:31:26.287962+0000","last_peered":"2023-11-17T06:31:26.287962+0000","last_clean":"2023-11-17T06:31:26.287962+0000","last_became_active":"2023-11-17T06:31:25.251539+0000","last_became_peered":"2023-11-17T06:31:25.251539+0000","last_unstale":"2023-11-17T06:31:26.287962+0000","last_undegraded":"2023-11-17T06:31:26.287962+0000","last_fullsized":"2023-11-17T06:31:26.287962+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T13:28:12.818918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800484+0000","last_change":"2023-11-17T06:31:26.304756+0000","last_active":"2023-11-17T06:31:27.800484+0000","last_peered":"2023-11-17T06:31:27.800484+0000","last_clean":"2023-11-17T06:31:27.800484+0000","last_became_active":"2023-11-17T06:31:26.303910+0000","last_became_peered":"2023-11-17T06:31:26.303910+0000","last_unstale":"2023-11-17T06:31:27.800484+0000","last_undegraded":"2023-11-17T06:31:27.800484+0000","last_fullsized":"2023-11-17T06:31:27.800484+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T14:06:53.507705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.287167+0000","last_change":"2023-11-17T06:31:25.242816+0000","last_active":"2023-11-17T06:31:26.287167+0000","last_peered":"2023-11-17T06:31:26.287167+0000","last_clean":"2023-11-17T06:31:26.287167+0000","last_became_active":"2023-11-17T06:31:25.242403+0000","last_became_peered":"2023-11-17T06:31:25.242403+0000","last_unstale":"2023-11-17T06:31:26.287167+0000","last_undegraded":"2023-11-17T06:31:26.287167+0000","last_fullsized":"2023-11-17T06:31:26.287167+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:46:12.076660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.800406+0000","last_change":"2023-11-17T06:31:26.291580+0000","last_active":"2023-11-17T06:31:27.800406+0000","last_peered":"2023-11-17T06:31:27.800406+0000","last_clean":"2023-11-17T06:31:27.800406+0000","last_became_active":"2023-11-17T06:31:26.291295+0000","last_became_peered":"2023-11-17T06:31:26.291295+0000","last_unstale":"2023-11-17T06:31:27.800406+0000","last_undegraded":"2023-11-17T06:31:27.800406+0000","last_fullsized":"2023-11-17T06:31:27.800406+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T07:30:53.257713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.272352+0000","last_change":"2023-11-17T06:31:25.251537+0000","last_active":"2023-11-17T06:31:26.272352+0000","last_peered":"2023-11-17T06:31:26.272352+0000","last_clean":"2023-11-17T06:31:26.272352+0000","last_became_active":"2023-11-17T06:31:25.251229+0000","last_became_peered":"2023-11-17T06:31:25.251229+0000","last_unstale":"2023-11-17T06:31:26.272352+0000","last_undegraded":"2023-11-17T06:31:26.272352+0000","last_fullsized":"2023-11-17T06:31:26.272352+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:18:54.162637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.798999+0000","last_change":"2023-11-17T06:31:26.287948+0000","last_active":"2023-11-17T06:31:27.798999+0000","last_peered":"2023-11-17T06:31:27.798999+0000","last_clean":"2023-11-17T06:31:27.798999+0000","last_became_active":"2023-11-17T06:31:26.287656+0000","last_became_peered":"2023-11-17T06:31:26.287656+0000","last_unstale":"2023-11-17T06:31:27.798999+0000","last_undegraded":"2023-11-17T06:31:27.798999+0000","last_fullsized":"2023-11-17T06:31:27.798999+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T17:58:55.526605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.283485+0000","last_change":"2023-11-17T06:31:25.247067+0000","last_active":"2023-11-17T06:31:26.283485+0000","last_peered":"2023-11-17T06:31:26.283485+0000","last_clean":"2023-11-17T06:31:26.283485+0000","last_became_active":"2023-11-17T06:31:25.245736+0000","last_became_peered":"2023-11-17T06:31:25.245736+0000","last_unstale":"2023-11-17T06:31:26.283485+0000","last_undegraded":"2023-11-17T06:31:26.283485+0000","last_fullsized":"2023-11-17T06:31:26.283485+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T10:16:55.069581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-11-17T06:31:27.296905+0000","last_change":"2023-11-17T06:31:26.300127+0000","last_active":"2023-11-17T06:31:27.296905+0000","last_peered":"2023-11-17T06:31:27.296905+0000","last_clean":"2023-11-17T06:31:27.296905+0000","last_became_active":"2023-11-17T06:31:26.299793+0000","last_became_peered":"2023-11-17T06:31:26.299793+0000","last_unstale":"2023-11-17T06:31:27.296905+0000","last_undegraded":"2023-11-17T06:31:27.296905+0000","last_fullsized":"2023-11-17T06:31:27.296905+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:25.210157+0000","last_clean_scrub_stamp":"2023-11-17T06:31:25.210157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T11:53:52.997397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.283816+0000","last_change":"2023-11-17T06:31:25.244315+0000","last_active":"2023-11-17T06:31:26.283816+0000","last_peered":"2023-11-17T06:31:26.283816+0000","last_clean":"2023-11-17T06:31:26.283816+0000","last_became_active":"2023-11-17T06:31:25.243771+0000","last_became_peered":"2023-11-17T06:31:25.243771+0000","last_unstale":"2023-11-17T06:31:26.283816+0000","last_undegraded":"2023-11-17T06:31:26.283816+0000","last_fullsized":"2023-11-17T06:31:26.283816+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:31:24.203800+0000","last_clean_scrub_stamp":"2023-11-17T06:31:24.203800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T15:10:08.013131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":175,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-17T06:31:26.278355+0000","last_change":"2023-11-17T06:29:48.031659+0000","last_active":"2023-11-17T06:31:26.278355+0000","last_peered":"2023-11-17T06:31:26.278355+0000","last_clean":"2023-11-17T06:31:26.278355+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:31:26.278355+0000","last_undegraded":"2023-11-17T06:31:26.278355+0000","last_fullsized":"2023-11-17T06:31:26.278355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_clean_scrub_stamp":"2023-11-17T06:29:47.005420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:11:29.801860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":161523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.1150000000000002,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":0.78300000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":1.238},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.91700000000000004}]},{"osd":2,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":1.137},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":1.089,"5min":1.089,"15min":1.089},"max":{"1min":2.173,"5min":2.173,"15min":2.173},"last":1.069}]},{"osd":3,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":2.0910000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"max":{"1min":2.0289999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.1859999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.361,"15min":1.361},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.139,"5min":1.139,"15min":1.139},"max":{"1min":2.1040000000000001,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":2.3490000000000002,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.105}]},{"osd":6,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"min":{"1min":1.214,"5min":1.214,"15min":1.214},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":1.127,"5min":1.127,"15min":1.127},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.0329999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":163113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":2.726,"5min":2.726,"15min":2.726},"last":0.76400000000000001},{"interface":"front","average":{"1min":1.456,"5min":1.456,"15min":1.456},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":6.3339999999999996,"5min":6.3339999999999996,"15min":6.3339999999999996},"last":1.083}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.516,"5min":1.516,"15min":1.516},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.85599999999999998}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.7679999999999998,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.446}]},{"osd":3,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":6.2210000000000001,"5min":6.2210000000000001,"15min":6.2210000000000001},"last":1.1439999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.018},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":1.4950000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.2389999999999999,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.3939999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.1539999999999999,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.6950000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":163135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":1.0860000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.294},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1990000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.325,"15min":1.325},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.514}]},{"osd":3,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.7789999999999999,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.25},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.1920000000000002,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.232}]},{"osd":5,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":2.3170000000000002,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.423},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":1.069,"5min":1.069,"15min":1.069},"max":{"1min":2.411,"5min":2.411,"15min":2.411},"last":1.373}]},{"osd":6,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.1160000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.151},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":2.8679999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.5900000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.298,"5min":1.298,"15min":1.298},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.462},{"interface":"front","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.401}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":430080,"data_stored":162277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73599999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.874}]},{"osd":2,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":4.2990000000000004,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.0309999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":1.073,"5min":1.073,"15min":1.073},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.085,"5min":2.085,"15min":2.085},"last":1.6779999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.2290000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.216},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":2.1970000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.484}]},{"osd":6,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.776},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.3}]},{"osd":7,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.429,"5min":1.429,"15min":1.429},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.873}]}]},{"osd":2,"up_from":15,"seq":64424509465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":161535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.111,"15min":1.111},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.2469999999999999,"5min":4.2469999999999999,"15min":4.2469999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.387,"5min":1.387,"15min":1.387},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":8.0510000000000002,"5min":8.0510000000000002,"15min":8.0510000000000002},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":4.5279999999999996,"5min":4.5279999999999996,"15min":4.5279999999999996},"last":0.98799999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":1.206,"15min":1.206},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":4.2960000000000003,"5min":4.2960000000000003,"15min":4.2960000000000003},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":4.2720000000000002,"5min":4.2720000000000002,"15min":4.2720000000000002},"last":1.155}]},{"osd":4,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.6280000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.016},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"max":{"1min":4.6459999999999999,"5min":4.6459999999999999,"15min":4.6459999999999999},"last":1.226}]},{"osd":5,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.609,"5min":1.609,"15min":1.609},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":4.4420000000000002,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":1.109}]},{"osd":6,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"min":{"1min":1.056,"5min":1.056,"15min":1.056},"max":{"1min":4.5679999999999996,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.218,"5min":2.218,"15min":2.218},"last":1.196}]},{"osd":7,"last update":"Fri Nov 17 06:30:49 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"max":{"1min":2.9969999999999999,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.276},{"interface":"front","average":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":2.6539999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.3600000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509463,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":751939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":4.0709999999999997,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":4.7199999999999998,"5min":4.7199999999999998,"15min":4.7199999999999998},"last":1.6499999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.496,"15min":1.496},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":7.6180000000000003,"5min":7.6180000000000003,"15min":7.6180000000000003},"last":1.252},{"interface":"front","average":{"1min":1.778,"5min":1.778,"15min":1.778},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":8.4649999999999999,"5min":8.4649999999999999,"15min":8.4649999999999999},"last":1.4059999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":4.782,"5min":4.782,"15min":4.782},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":4.3079999999999998,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.89300000000000002}]},{"osd":4,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":4.3639999999999999,"5min":4.3639999999999999,"15min":4.3639999999999999},"last":1.456}]},{"osd":5,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"min":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":4.4180000000000001,"5min":4.4180000000000001,"15min":4.4180000000000001},"last":1.3680000000000001},{"interface":"front","average":{"1min":1.615,"5min":1.615,"15min":1.615},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":4.6479999999999997,"5min":4.6479999999999997,"15min":4.6479999999999997},"last":1.214}]},{"osd":6,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.625,"5min":1.625,"15min":1.625},"min":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"max":{"1min":4.5839999999999996,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.341},{"interface":"front","average":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":4.2359999999999998,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":1.552}]},{"osd":7,"last update":"Fri Nov 17 06:30:47 2023","interfaces":[{"interface":"back","average":{"1min":1.75,"5min":1.75,"15min":1.75},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":4.6849999999999996,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":1.583},{"interface":"front","average":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":4.7469999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":1.4970000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":161591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.849,"5min":1.849,"15min":1.849},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":3.0339999999999998,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.0209999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.1659999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":3.2869999999999999,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":1.272},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":3.2130000000000001,"5min":3.2130000000000001,"15min":3.2130000000000001},"last":1.5069999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.359},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.2290000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.3180000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":3.3719999999999999,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.474}]},{"osd":7,"last update":"Fri Nov 17 06:30:46 2023","interfaces":[{"interface":"back","average":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":3.5219999999999998,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":3.4169999999999998,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.6200000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542168,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":752451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":1.45},{"interface":"front","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.647,"5min":1.647,"15min":1.647},"last":1.218}]},{"osd":1,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.579}]},{"osd":2,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.113},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.86599999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.0629999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"max":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.351}]},{"osd":6,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"last":1.159},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.681}]},{"osd":7,"last update":"Fri Nov 17 06:30:45 2023","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":1.46,"15min":1.46},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.395},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.97999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:31:35.360 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-17T06:31:35.361 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-17T06:31:35.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.554+0000 7ff03314b700 1 Processor -- start 2023-11-17T06:31:35.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.554+0000 7ff03314b700 1 -- start start 2023-11-17T06:31:35.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.554+0000 7ff03314b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff02c15d980 0x7ff02c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:35.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.554+0000 7ff03314b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff02c0b5270 0x7ff02c0d1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:35.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.554+0000 7ff03314b700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c0b6750 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.554+0000 7ff03314b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c0d2a30 con 0x7ff02c0b5270 2023-11-17T06:31:35.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.554+0000 7ff03314b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c0b6980 con 0x7ff02c15d980 2023-11-17T06:31:35.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff02c0b5270 0x7ff02c0d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:35.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff02c0b5270 0x7ff02c0d1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41658/0 (socket says 172.21.15.69:41658) 2023-11-17T06:31:35.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02bfff700 1 -- 172.21.15.69:0/2267326350 learned_addr learned my addr 172.21.15.69:0/2267326350 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:35.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff030ee7700 1 --2- 172.21.15.69:0/2267326350 >> v2:172.21.15.93:3300/0 conn(0x7ff02c15d980 0x7ff02c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:35.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02bfff700 1 -- 172.21.15.69:0/2267326350 >> v2:172.21.15.93:3300/0 conn(0x7ff02c15d980 msgr2=0x7ff02c0b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:35.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02bfff700 1 --2- 172.21.15.69:0/2267326350 >> v2:172.21.15.93:3300/0 conn(0x7ff02c15d980 0x7ff02c0b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02bfff700 1 -- 172.21.15.69:0/2267326350 >> v1:172.21.15.93:6789/0 conn(0x7ff02c0d1ca0 legacy=0x7ff02c06ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:35.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02bfff700 1 -- 172.21.15.69:0/2267326350 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c0b56d0 con 0x7ff02c0b5270 2023-11-17T06:31:35.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02bfff700 1 --2- 172.21.15.69:0/2267326350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff02c0b5270 0x7ff02c0d1760 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0d43b0 tx=0x7ff018009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135ecce09c3e6fea server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:35.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02b7fe700 1 -- 172.21.15.69:0/2267326350 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01800b8a0 con 0x7ff02c0b5270 2023-11-17T06:31:35.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02b7fe700 1 -- 172.21.15.69:0/2267326350 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01800ba00 con 0x7ff02c0b5270 2023-11-17T06:31:35.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff02b7fe700 1 -- 172.21.15.69:0/2267326350 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01800bd90 con 0x7ff02c0b5270 2023-11-17T06:31:35.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff03314b700 1 -- 172.21.15.69:0/2267326350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff02c0b5270 msgr2=0x7ff02c0d1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:35.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff03314b700 1 --2- 172.21.15.69:0/2267326350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff02c0b5270 0x7ff02c0d1760 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0d43b0 tx=0x7ff018009bf0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff03314b700 1 -- 172.21.15.69:0/2267326350 shutdown_connections 2023-11-17T06:31:35.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff03314b700 1 --2- 172.21.15.69:0/2267326350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff02c0b5270 0x7ff02c0d1760 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff03314b700 1 --2- 172.21.15.69:0/2267326350 >> v2:172.21.15.93:3300/0 conn(0x7ff02c15d980 0x7ff02c0b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff03314b700 1 -- 172.21.15.69:0/2267326350 >> 172.21.15.69:0/2267326350 conn(0x7ff02c0cfd30 msgr2=0x7ff02c0d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:35.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff03314b700 1 -- 172.21.15.69:0/2267326350 shutdown_connections 2023-11-17T06:31:35.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.558+0000 7ff03314b700 1 -- 172.21.15.69:0/2267326350 wait complete. 2023-11-17T06:31:35.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.562+0000 7ff03314b700 1 Processor -- start 2023-11-17T06:31:35.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.562+0000 7ff03314b700 1 -- start start 2023-11-17T06:31:35.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff03314b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff02c0b5270 0x7ff02c1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:35.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff03314b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff02c0d1ca0 0x7ff02c154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:35.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff03314b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff02c0b4040 0x7ff02c0b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:35.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff03314b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c0b4a30 con 0x7ff02c0b4040 2023-11-17T06:31:35.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff03314b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c154080 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff03314b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c152550 con 0x7ff02c0b5270 2023-11-17T06:31:35.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff0316e8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff02c0b4040 0x7ff02c0b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:35.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff02bfff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff02c0d1ca0 0x7ff02c154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:35.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff0316e8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff02c0b4040 0x7ff02c0b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41668/0 (socket says 172.21.15.69:41668) 2023-11-17T06:31:35.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff0316e8700 1 -- 172.21.15.69:0/1410865523 learned_addr learned my addr 172.21.15.69:0/1410865523 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:35.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff030ee7700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff02c0b5270 0x7ff02c1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:35.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff02bfff700 1 -- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff02c0b5270 msgr2=0x7ff02c1517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:35.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff02bfff700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff02c0b5270 0x7ff02c1517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff02bfff700 1 -- 172.21.15.69:0/1410865523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff02c0b4040 msgr2=0x7ff02c0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:35.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff02bfff700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff02c0b4040 0x7ff02c0b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff02bfff700 1 -- 172.21.15.69:0/1410865523 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff018009570 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff02bfff700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff02c0d1ca0 0x7ff02c154910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0b2c80 tx=0x7ff018004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:35.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff0297fa700 1 -- 172.21.15.69:0/1410865523 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180038c0 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff0297fa700 1 -- 172.21.15.69:0/1410865523 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01801e070 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff03314b700 1 -- 172.21.15.69:0/1410865523 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c152830 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff0297fa700 1 -- 172.21.15.69:0/1410865523 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff018003c60 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.566+0000 7ff03314b700 1 -- 172.21.15.69:0/1410865523 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c152df0 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.570+0000 7ff03314b700 1 -- 172.21.15.69:0/1410865523 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02c0ca360 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.570+0000 7ff0297fa700 1 -- 172.21.15.69:0/1410865523 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff018011420 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.574+0000 7ff0297fa700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff010066540 0x7ff010068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:35.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.574+0000 7ff0297fa700 1 -- 172.21.15.69:0/1410865523 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff018020070 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.574+0000 7ff030ee7700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff010066540 0x7ff010068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:35.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.574+0000 7ff030ee7700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff010066540 0x7ff010068a00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff02c15d0c0 tx=0x7ff020008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:35.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.582+0000 7ff0297fa700 1 -- 172.21.15.69:0/1410865523 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff018052900 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.822+0000 7ff03314b700 1 -- 172.21.15.69:0/1410865523 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff02c073f00 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.834+0000 7ff0297fa700 1 -- 172.21.15.69:0/1410865523 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff018055f20 con 0x7ff02c0d1ca0 2023-11-17T06:31:35.839 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2023-11-17T06:31:35.839 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDkB1dlV8dIFhAARKHRwgoM6K9tEeqTeD4+ug== 2023-11-17T06:31:35.839 INFO:teuthology.orchestra.run.smithi069.stdout: caps mds = "allow" 2023-11-17T06:31:35.839 INFO:teuthology.orchestra.run.smithi069.stdout: caps mon = "allow r" 2023-11-17T06:31:35.840 INFO:teuthology.orchestra.run.smithi069.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-17T06:31:35.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 -- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff010066540 msgr2=0x7ff010068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:35.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff010066540 0x7ff010068a00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff02c15d0c0 tx=0x7ff020008040 comp rx=0 tx=0).stop 2023-11-17T06:31:35.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 -- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff02c0d1ca0 msgr2=0x7ff02c154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:35.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff02c0d1ca0 0x7ff02c154910 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff02c0b2c80 tx=0x7ff018004770 comp rx=0 tx=0).stop 2023-11-17T06:31:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 -- 172.21.15.69:0/1410865523 shutdown_connections 2023-11-17T06:31:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff010066540 0x7ff010068a00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff02c0b4040 0x7ff02c0b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff02c0d1ca0 0x7ff02c154910 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 --2- 172.21.15.69:0/1410865523 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff02c0b5270 0x7ff02c1517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 -- 172.21.15.69:0/1410865523 >> 172.21.15.69:0/1410865523 conn(0x7ff02c0cfd30 msgr2=0x7ff02c15b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:35.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 -- 172.21.15.69:0/1410865523 shutdown_connections 2023-11-17T06:31:35.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:35.838+0000 7ff03314b700 1 -- 172.21.15.69:0/1410865523 wait complete. 2023-11-17T06:31:35.846 INFO:teuthology.orchestra.run.smithi069.stderr:updated caps for client.0 2023-11-17T06:31:35.868 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:31:36.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.034+0000 7faa89e43700 1 Processor -- start 2023-11-17T06:31:36.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa89e43700 1 -- start start 2023-11-17T06:31:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa89e43700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faa840cb400 0x7faa8415ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa89e43700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cba80 0x7faa840cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa89e43700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa840b09e0 con 0x7faa840cb020 2023-11-17T06:31:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa89e43700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8415fd90 con 0x7faa840cb400 2023-11-17T06:31:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa89e43700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa840b1660 con 0x7faa840cba80 2023-11-17T06:31:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa7bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faa840cb400 0x7faa8415ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa7bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faa840cb400 0x7faa8415ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41670/0 (socket says 172.21.15.69:41670) 2023-11-17T06:31:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa7bfff700 1 -- 172.21.15.69:0/377877198 learned_addr learned my addr 172.21.15.69:0/377877198 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa837fe700 1 --1- 172.21.15.69:0/377877198 >> v1:172.21.15.69:6789/0 conn(0x7faa840cb020 0x7faa8406fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37268/0 (socket says 172.21.15.69:37268) 2023-11-17T06:31:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa83fff700 1 --2- 172.21.15.69:0/377877198 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cba80 0x7faa840cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa7bfff700 1 -- 172.21.15.69:0/377877198 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cba80 msgr2=0x7faa840cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa7bfff700 1 --2- 172.21.15.69:0/377877198 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cba80 0x7faa840cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa7bfff700 1 -- 172.21.15.69:0/377877198 >> v1:172.21.15.69:6789/0 conn(0x7faa840cb020 legacy=0x7faa8406fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:36.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa7bfff700 1 -- 172.21.15.69:0/377877198 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa840b0cc0 con 0x7faa840cb400 2023-11-17T06:31:36.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.038+0000 7faa83fff700 1 --2- 172.21.15.69:0/377877198 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cba80 0x7faa840cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:36.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa7bfff700 1 --2- 172.21.15.69:0/377877198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb400 0x7faa8415ed80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009910 tx=0x7faa6c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e922700a0716db server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:36.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa82ffd700 1 -- 172.21.15.69:0/377877198 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c00ba60 con 0x7faa840cb400 2023-11-17T06:31:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa82ffd700 1 -- 172.21.15.69:0/377877198 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6c00bbc0 con 0x7faa840cb400 2023-11-17T06:31:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa82ffd700 1 -- 172.21.15.69:0/377877198 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6c009e60 con 0x7faa840cb400 2023-11-17T06:31:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa89e43700 1 -- 172.21.15.69:0/377877198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb400 msgr2=0x7faa8415ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa89e43700 1 --2- 172.21.15.69:0/377877198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb400 0x7faa8415ed80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009910 tx=0x7faa6c009c20 comp rx=0 tx=0).stop 2023-11-17T06:31:36.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa89e43700 1 -- 172.21.15.69:0/377877198 shutdown_connections 2023-11-17T06:31:36.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa89e43700 1 --2- 172.21.15.69:0/377877198 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cba80 0x7faa840cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa89e43700 1 --2- 172.21.15.69:0/377877198 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb400 0x7faa8415ed80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa89e43700 1 -- 172.21.15.69:0/377877198 >> 172.21.15.69:0/377877198 conn(0x7faa8406a480 msgr2=0x7faa8406a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:36.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa89e43700 1 -- 172.21.15.69:0/377877198 shutdown_connections 2023-11-17T06:31:36.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.042+0000 7faa89e43700 1 -- 172.21.15.69:0/377877198 wait complete. 2023-11-17T06:31:36.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa89e43700 1 Processor -- start 2023-11-17T06:31:36.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa89e43700 1 -- start start 2023-11-17T06:31:36.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa89e43700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb020 0x7faa841f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa89e43700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cb400 0x7faa841f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa89e43700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa840cba80 0x7faa8415a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa89e43700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa841f3920 con 0x7faa840cb020 2023-11-17T06:31:36.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa89e43700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa841f6380 con 0x7faa840cba80 2023-11-17T06:31:36.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa89e43700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa841f6660 con 0x7faa840cb400 2023-11-17T06:31:36.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa837fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb020 0x7faa841f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa837fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb020 0x7faa841f33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41672/0 (socket says 172.21.15.69:41672) 2023-11-17T06:31:36.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa837fe700 1 -- 172.21.15.69:0/2457791753 learned_addr learned my addr 172.21.15.69:0/2457791753 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:36.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.046+0000 7faa7bfff700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cb400 0x7faa841f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa83fff700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa840cba80 0x7faa8415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa837fe700 1 -- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cb400 msgr2=0x7faa841f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:36.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa837fe700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cb400 0x7faa841f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa837fe700 1 -- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa840cba80 msgr2=0x7faa8415a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:36.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa837fe700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa840cba80 0x7faa8415a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa837fe700 1 -- 172.21.15.69:0/2457791753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c009570 con 0x7faa840cb020 2023-11-17T06:31:36.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa837fe700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb020 0x7faa841f33e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c4d0 tx=0x7faa7400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:36.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa80ff9700 1 -- 172.21.15.69:0/2457791753 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7400cea0 con 0x7faa840cb020 2023-11-17T06:31:36.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa80ff9700 1 -- 172.21.15.69:0/2457791753 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa74005cd0 con 0x7faa840cb020 2023-11-17T06:31:36.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa89e43700 1 -- 172.21.15.69:0/2457791753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa841f6940 con 0x7faa840cb020 2023-11-17T06:31:36.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa80ff9700 1 -- 172.21.15.69:0/2457791753 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa740072d0 con 0x7faa840cb020 2023-11-17T06:31:36.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa89e43700 1 -- 172.21.15.69:0/2457791753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa840b47b0 con 0x7faa840cb020 2023-11-17T06:31:36.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.050+0000 7faa89e43700 1 -- 172.21.15.69:0/2457791753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa84073f00 con 0x7faa840cb020 2023-11-17T06:31:36.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.054+0000 7faa80ff9700 1 -- 172.21.15.69:0/2457791753 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faa74007430 con 0x7faa840cb020 2023-11-17T06:31:36.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.058+0000 7faa80ff9700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faa64066510 0x7faa640689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:36.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.058+0000 7faa80ff9700 1 -- 172.21.15.69:0/2457791753 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa740830f0 con 0x7faa840cb020 2023-11-17T06:31:36.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.058+0000 7faa7bfff700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faa64066510 0x7faa640689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:36.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.058+0000 7faa7bfff700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faa64066510 0x7faa640689d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009910 tx=0x7faa6c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:36.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.062+0000 7faa80ff9700 1 -- 172.21.15.69:0/2457791753 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faa74050580 con 0x7faa840cb020 2023-11-17T06:31:36.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.270+0000 7faa89e43700 1 -- 172.21.15.69:0/2457791753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa840b1250 con 0x7faa840cb020 2023-11-17T06:31:36.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.270+0000 7faa80ff9700 1 -- 172.21.15.69:0/2457791753 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4913 (secure 0 0 0) 0x7faa74017090 con 0x7faa840cb020 2023-11-17T06:31:36.276 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:31:36.276 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5202,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1050522275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1050522275},{"type":"v1","addr":"172.21.15.69:6835","nonce":1050522275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:31:28.746851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.93:6837/4181304583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":4181304583},{"type":"v1","addr":"172.21.15.93:6837","nonce":4181304583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:31:36.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 -- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faa64066510 msgr2=0x7faa640689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faa64066510 0x7faa640689d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faa6c009910 tx=0x7faa6c008030 comp rx=0 tx=0).stop 2023-11-17T06:31:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 -- 172.21.15.69:0/2457791753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb020 msgr2=0x7faa841f33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb020 0x7faa841f33e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c4d0 tx=0x7faa7400c7e0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 -- 172.21.15.69:0/2457791753 shutdown_connections 2023-11-17T06:31:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faa64066510 0x7faa640689d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faa840cba80 0x7faa8415a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faa840cb400 0x7faa841f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 --2- 172.21.15.69:0/2457791753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa840cb020 0x7faa841f33e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:36.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 -- 172.21.15.69:0/2457791753 >> 172.21.15.69:0/2457791753 conn(0x7faa8406a480 msgr2=0x7faa8415dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 -- 172.21.15.69:0/2457791753 shutdown_connections 2023-11-17T06:31:36.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:36.274+0000 7faa89e43700 1 -- 172.21.15.69:0/2457791753 wait complete. 2023-11-17T06:31:36.283 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 15 2023-11-17T06:31:36.704 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:25.683625+0000', 'modified': '2023-11-17T06:31:28.746851+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5260': {'gid': 5260, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.93:6837/4181304583', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6836', 'nonce': 4181304583}, {'type': 'v1', 'addr': '172.21.15.93:6837', 'nonce': 4181304583}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:31:37.215 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-17T06:31:37.215 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-17T06:31:37.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.386+0000 7f256d2c4700 1 Processor -- start 2023-11-17T06:31:37.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.386+0000 7f256d2c4700 1 -- start start 2023-11-17T06:31:37.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f256d2c4700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f256815a2b0 0x7f25680ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f256d2c4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f25680c98c0 0x7f25680cb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f256d2c4700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25680cca40 con 0x7f2568159ed0 2023-11-17T06:31:37.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f256d2c4700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25680ccdb0 con 0x7f256815a2b0 2023-11-17T06:31:37.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f256d2c4700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25680caef0 con 0x7f25680c98c0 2023-11-17T06:31:37.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f255ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f256815a2b0 0x7f25680ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f255ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f256815a2b0 0x7f25680ca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41688/0 (socket says 172.21.15.69:41688) 2023-11-17T06:31:37.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f255ffff700 1 -- 172.21.15.69:0/233116358 learned_addr learned my addr 172.21.15.69:0/233116358 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:37.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f25677fe700 1 --2- 172.21.15.69:0/233116358 >> v2:172.21.15.93:3300/0 conn(0x7f25680c98c0 0x7f25680cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f25667fc700 1 -- 172.21.15.69:0/233116358 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530316995 0 0) 0x7f25680cca40 con 0x7f2568159ed0 2023-11-17T06:31:37.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f25667fc700 1 -- 172.21.15.69:0/233116358 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25540057e0 con 0x7f2568159ed0 2023-11-17T06:31:37.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f255ffff700 1 -- 172.21.15.69:0/233116358 >> v2:172.21.15.93:3300/0 conn(0x7f25680c98c0 msgr2=0x7f25680cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f255ffff700 1 --2- 172.21.15.69:0/233116358 >> v2:172.21.15.93:3300/0 conn(0x7f25680c98c0 0x7f25680cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f255ffff700 1 -- 172.21.15.69:0/233116358 >> v1:172.21.15.93:6789/0 conn(0x7f2568159ed0 legacy=0x7f25680706f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f255ffff700 1 -- 172.21.15.69:0/233116358 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25680cdf60 con 0x7f256815a2b0 2023-11-17T06:31:37.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f255ffff700 1 --2- 172.21.15.69:0/233116358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f256815a2b0 0x7f25680ca9b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f25680ae820 tx=0x7f2550009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292a63749727530 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f25667fc700 1 -- 172.21.15.69:0/233116358 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550011830 con 0x7f256815a2b0 2023-11-17T06:31:37.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f25667fc700 1 -- 172.21.15.69:0/233116358 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2550011990 con 0x7f256815a2b0 2023-11-17T06:31:37.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f25667fc700 1 -- 172.21.15.69:0/233116358 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550011d20 con 0x7f256815a2b0 2023-11-17T06:31:37.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f256d2c4700 1 -- 172.21.15.69:0/233116358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f256815a2b0 msgr2=0x7f25680ca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.390+0000 7f256d2c4700 1 --2- 172.21.15.69:0/233116358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f256815a2b0 0x7f25680ca9b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f25680ae820 tx=0x7f2550009bf0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.394+0000 7f256d2c4700 1 -- 172.21.15.69:0/233116358 shutdown_connections 2023-11-17T06:31:37.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.394+0000 7f256d2c4700 1 --2- 172.21.15.69:0/233116358 >> v2:172.21.15.93:3300/0 conn(0x7f25680c98c0 0x7f25680cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.394+0000 7f256d2c4700 1 --2- 172.21.15.69:0/233116358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f256815a2b0 0x7f25680ca9b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.394+0000 7f256d2c4700 1 -- 172.21.15.69:0/233116358 >> 172.21.15.69:0/233116358 conn(0x7f25680b0900 msgr2=0x7f25680b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.394+0000 7f256d2c4700 1 -- 172.21.15.69:0/233116358 shutdown_connections 2023-11-17T06:31:37.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.394+0000 7f256d2c4700 1 -- 172.21.15.69:0/233116358 wait complete. 2023-11-17T06:31:37.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.394+0000 7f256d2c4700 1 Processor -- start 2023-11-17T06:31:37.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.394+0000 7f256d2c4700 1 -- start start 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f256d2c4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25680c98c0 0x7f25680b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f256d2c4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568159ed0 0x7f25680c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f256d2c4700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f256815a2b0 0x7f25680b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f256d2c4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2568157940 con 0x7f2568159ed0 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f256d2c4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25680b29e0 con 0x7f25680c98c0 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f256d2c4700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25680b2cc0 con 0x7f256815a2b0 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568159ed0 0x7f25680c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568159ed0 0x7f25680c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41696/0 (socket says 172.21.15.69:41696) 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255ffff700 1 -- 172.21.15.69:0/2661740474 learned_addr learned my addr 172.21.15.69:0/2661740474 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f2566ffd700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25680c98c0 0x7f25680b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f25677fe700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f256815a2b0 0x7f25680b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255ffff700 1 -- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f256815a2b0 msgr2=0x7f25680b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255ffff700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f256815a2b0 0x7f25680b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255ffff700 1 -- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25680c98c0 msgr2=0x7f25680b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255ffff700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25680c98c0 0x7f25680b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255ffff700 1 -- 172.21.15.69:0/2661740474 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2550009570 con 0x7f2568159ed0 2023-11-17T06:31:37.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255ffff700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568159ed0 0x7f25680c8e80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2550000c00 tx=0x7f2550004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255f7fe700 1 -- 172.21.15.69:0/2661740474 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550004510 con 0x7f2568159ed0 2023-11-17T06:31:37.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255f7fe700 1 -- 172.21.15.69:0/2661740474 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255001e070 con 0x7f2568159ed0 2023-11-17T06:31:37.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f256d2c4700 1 -- 172.21.15.69:0/2661740474 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25680b2fa0 con 0x7f2568159ed0 2023-11-17T06:31:37.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f255f7fe700 1 -- 172.21.15.69:0/2661740474 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550003900 con 0x7f2568159ed0 2023-11-17T06:31:37.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.398+0000 7f256d2c4700 1 -- 172.21.15.69:0/2661740474 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25680b3560 con 0x7f2568159ed0 2023-11-17T06:31:37.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.402+0000 7f255f7fe700 1 -- 172.21.15.69:0/2661740474 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2550003a60 con 0x7f2568159ed0 2023-11-17T06:31:37.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f255f7fe700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2548066510 0x7f25480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f255f7fe700 1 -- 172.21.15.69:0/2661740474 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2550020070 con 0x7f2568159ed0 2023-11-17T06:31:37.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f257058f740 1 Processor -- start 2023-11-17T06:31:37.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f2566ffd700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2548066510 0x7f25480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f257058f740 1 -- start start 2023-11-17T06:31:37.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f2566ffd700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2548066510 0x7f25480689d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f25580011e0 tx=0x7f2558009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f257058f740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130f6f0 0x130fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f257058f740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130d9a0 0x1310010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f257058f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1310930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f257058f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x123f620 con 0x1310550 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f257058f740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x123cd10 con 0x130d9a0 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f257058f740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x1238600 con 0x130f6f0 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f25677fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1310930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f25677fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1310930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41698/0 (socket says 172.21.15.69:41698) 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f25677fe700 1 -- 172.21.15.69:0/1946592619 learned_addr learned my addr 172.21.15.69:0/1946592619 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f2566ffd700 1 --2- 172.21.15.69:0/1946592619 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130f6f0 0x130fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f255ffff700 1 --2- 172.21.15.69:0/1946592619 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130d9a0 0x1310010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f25677fe700 1 -- 172.21.15.69:0/1946592619 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130f6f0 msgr2=0x130fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f25677fe700 1 --2- 172.21.15.69:0/1946592619 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130f6f0 0x130fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f25677fe700 1 -- 172.21.15.69:0/1946592619 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130d9a0 msgr2=0x1310010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f25677fe700 1 --2- 172.21.15.69:0/1946592619 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130d9a0 0x1310010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f25677fe700 1 -- 172.21.15.69:0/1946592619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x125d850 con 0x1310550 2023-11-17T06:31:37.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f255ffff700 1 --2- 172.21.15.69:0/1946592619 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130d9a0 0x1310010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:31:37.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.406+0000 7f25677fe700 1 --2- 172.21.15.69:0/1946592619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1310930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f25600115b0 tx=0x7f2560009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc756e38915cdc93 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f255cff9700 1 -- 172.21.15.69:0/1946592619 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e040 con 0x1310550 2023-11-17T06:31:37.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f255cff9700 1 -- 172.21.15.69:0/1946592619 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000f040 con 0x1310550 2023-11-17T06:31:37.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f255cff9700 1 -- 172.21.15.69:0/1946592619 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560015a40 con 0x1310550 2023-11-17T06:31:37.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 -- 172.21.15.69:0/1946592619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 msgr2=0x1310930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 --2- 172.21.15.69:0/1946592619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1310930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f25600115b0 tx=0x7f2560009750 comp rx=0 tx=0).stop 2023-11-17T06:31:37.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 -- 172.21.15.69:0/1946592619 shutdown_connections 2023-11-17T06:31:37.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 --2- 172.21.15.69:0/1946592619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1310930 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 --2- 172.21.15.69:0/1946592619 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130d9a0 0x1310010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 --2- 172.21.15.69:0/1946592619 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130f6f0 0x130fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 -- 172.21.15.69:0/1946592619 >> 172.21.15.69:0/1946592619 conn(0x105d4d0 msgr2=0x12f8160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 -- 172.21.15.69:0/1946592619 shutdown_connections 2023-11-17T06:31:37.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 -- 172.21.15.69:0/1946592619 wait complete. 2023-11-17T06:31:37.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 -- start start 2023-11-17T06:31:37.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.410+0000 7f257058f740 1 Processor -- start 2023-11-17T06:31:37.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130d9a0 0x12d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 0x12f5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x1310550 0x12f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f66e0 con 0x130d9a0 2023-11-17T06:31:37.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f6380 con 0x130f6f0 2023-11-17T06:31:37.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x10e1aa0 con 0x1310550 2023-11-17T06:31:37.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 10 client.0 _ll_register_callbacks cb 0x11e5a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2566ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130d9a0 0x12d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2566ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130d9a0 0x12d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41710/0 (socket says 172.21.15.69:41710) 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2566ffd700 1 -- 172.21.15.69:0/3330227272 learned_addr learned my addr 172.21.15.69:0/3330227272 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f255ffff700 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 0x12f5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f25677fe700 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x1310550 0x12f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2566ffd700 1 -- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x1310550 msgr2=0x12f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2566ffd700 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x1310550 0x12f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2566ffd700 1 -- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 msgr2=0x12f5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2566ffd700 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 0x12f5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2566ffd700 1 -- 172.21.15.69:0/3330227272 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2560011230 con 0x130d9a0 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2566ffd700 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130d9a0 0x12d07f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f25580073b0 tx=0x7f2558001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d836a32c7563243 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2545ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-11-17T06:31:37.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2545ffb700 1 -- 172.21.15.69:0/3330227272 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255800f8a0 con 0x130d9a0 2023-11-17T06:31:37.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2545ffb700 1 -- 172.21.15.69:0/3330227272 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f255801b070 con 0x130d9a0 2023-11-17T06:31:37.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 1 -- 172.21.15.69:0/3330227272 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x12315e0 con 0x130d9a0 2023-11-17T06:31:37.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2545ffb700 1 -- 172.21.15.69:0/3330227272 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f255800fa00 con 0x130d9a0 2023-11-17T06:31:37.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 10 client.5379 fetch_fsmap learned FSMap version 15 2023-11-17T06:31:37.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 1 -- 172.21.15.69:0/3330227272 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x10a8960 con 0x130d9a0 2023-11-17T06:31:37.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2545ffb700 1 -- 172.21.15.69:0/3330227272 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x12315e0 con 0x130d9a0 2023-11-17T06:31:37.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f2545ffb700 1 -- 172.21.15.69:0/3330227272 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f255800fb60 con 0x130d9a0 2023-11-17T06:31:37.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 10 client.5379 fetch_fsmap finished waiting for FSMap version 15 2023-11-17T06:31:37.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 10 client.5379 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-17T06:31:37.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 20 client.5379 populate_metadata read hostname 'smithi069' 2023-11-17T06:31:37.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:6836/4181304583,v1:172.21.15.93:6837/4181304583] conn(0x12cdc80 0x12ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 4 client.5379 mds_command: new command op to 5260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-17T06:31:37.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.414+0000 7f257058f740 1 -- 172.21.15.69:0/3330227272 --> [v2:172.21.15.93:6836/4181304583,v1:172.21.15.93:6837/4181304583] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11f1470 con 0x12cdc80 2023-11-17T06:31:37.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f255ffff700 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:6836/4181304583,v1:172.21.15.93:6837/4181304583] conn(0x12cdc80 0x12ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f255ffff700 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:6836/4181304583,v1:172.21.15.93:6837/4181304583] conn(0x12cdc80 0x12ce060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83053cd68da7ab71 server_cookie=2845f3fd7013ec63 in_seq=0 out_seq=0 2023-11-17T06:31:37.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f2545ffb700 10 client.5379 ms_handle_connect on v2:172.21.15.93:6836/4181304583 2023-11-17T06:31:37.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f2545ffb700 1 -- 172.21.15.69:0/3330227272 <== mds.0 v2:172.21.15.93:6836/4181304583 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x11f1470 con 0x12cdc80 2023-11-17T06:31:37.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f2545ffb700 10 client.5379 handle_command_reply: tid=0 2023-11-17T06:31:37.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f257058f740 1 client.5379 shutdown 2023-11-17T06:31:37.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f257058f740 1 -- 172.21.15.69:0/3330227272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130d9a0 msgr2=0x12d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f257058f740 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130d9a0 0x12d07f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f25580073b0 tx=0x7f2558001150 comp rx=0 tx=0).stop 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f257058f740 1 -- 172.21.15.69:0/3330227272 shutdown_connections 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f257058f740 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:6836/4181304583,v1:172.21.15.93:6837/4181304583] conn(0x12cdc80 0x12ce060 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f257058f740 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x1310550 0x12f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f257058f740 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 0x12f5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f257058f740 1 --2- 172.21.15.69:0/3330227272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130d9a0 0x12d07f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f257058f740 1 -- 172.21.15.69:0/3330227272 >> 172.21.15.69:0/3330227272 conn(0x105d4d0 msgr2=0x130e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.418+0000 7f2545ffb700 0 client.5379 ms_handle_reset on v2:172.21.15.93:6836/4181304583 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.422+0000 7f257058f740 1 -- 172.21.15.69:0/3330227272 shutdown_connections 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.422+0000 7f257058f740 1 -- 172.21.15.69:0/3330227272 wait complete. 2023-11-17T06:31:37.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.422+0000 7f257058f740 20 client.5379 trim_cache size 0 max 16384 2023-11-17T06:31:37.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f257058f740 1 Processor -- start 2023-11-17T06:31:37.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f257058f740 1 -- start start 2023-11-17T06:31:37.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f257058f740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130d9a0 0x130e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f257058f740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 0x130ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f257058f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1326590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f257058f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x12034f0 con 0x1310550 2023-11-17T06:31:37.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f257058f740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x1232900 con 0x130f6f0 2023-11-17T06:31:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f257058f740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x11fc560 con 0x130d9a0 2023-11-17T06:31:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f25677fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1326590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f255ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 0x130ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f2566ffd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130d9a0 0x130e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f25677fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1326590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41712/0 (socket says 172.21.15.69:41712) 2023-11-17T06:31:37.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.442+0000 7f25677fe700 1 -- 172.21.15.69:0/1139429093 learned_addr learned my addr 172.21.15.69:0/1139429093 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:37.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f255ffff700 1 -- 172.21.15.69:0/1139429093 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130d9a0 msgr2=0x130e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f255ffff700 1 --2- 172.21.15.69:0/1139429093 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130d9a0 0x130e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f255ffff700 1 -- 172.21.15.69:0/1139429093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 msgr2=0x1326590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f255ffff700 1 --2- 172.21.15.69:0/1139429093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1326590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f255ffff700 1 -- 172.21.15.69:0/1139429093 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11fb4f0 con 0x130f6f0 2023-11-17T06:31:37.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f255ffff700 1 --2- 172.21.15.69:0/1139429093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 0x130ee10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2550083750 tx=0x7f255001c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b557cabe5b0735 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f255d7fa700 1 -- 172.21.15.69:0/1139429093 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500562e0 con 0x130f6f0 2023-11-17T06:31:37.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f255d7fa700 1 -- 172.21.15.69:0/1139429093 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255005a430 con 0x130f6f0 2023-11-17T06:31:37.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f255d7fa700 1 -- 172.21.15.69:0/1139429093 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255005e5e0 con 0x130f6f0 2023-11-17T06:31:37.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f257058f740 1 -- 172.21.15.69:0/1139429093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 msgr2=0x130ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f257058f740 1 --2- 172.21.15.69:0/1139429093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 0x130ee10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2550083750 tx=0x7f255001c040 comp rx=0 tx=0).stop 2023-11-17T06:31:37.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f257058f740 1 -- 172.21.15.69:0/1139429093 shutdown_connections 2023-11-17T06:31:37.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f257058f740 1 --2- 172.21.15.69:0/1139429093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x1310550 0x1326590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f257058f740 1 --2- 172.21.15.69:0/1139429093 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x130f6f0 0x130ee10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f257058f740 1 --2- 172.21.15.69:0/1139429093 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130d9a0 0x130e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f257058f740 1 -- 172.21.15.69:0/1139429093 >> 172.21.15.69:0/1139429093 conn(0x105d4d0 msgr2=0x12cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f257058f740 1 -- 172.21.15.69:0/1139429093 shutdown_connections 2023-11-17T06:31:37.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.446+0000 7f257058f740 1 -- 172.21.15.69:0/1139429093 wait complete. 2023-11-17T06:31:37.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f257058f740 1 -- start start 2023-11-17T06:31:37.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f257058f740 1 Processor -- start 2023-11-17T06:31:37.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f257058f740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130d9a0 0x1376b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f257058f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130f6f0 0x1377620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f257058f740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x1310550 0x1377b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f257058f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x1235e10 con 0x130f6f0 2023-11-17T06:31:37.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f257058f740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x1233f70 con 0x1310550 2023-11-17T06:31:37.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f257058f740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x123b160 con 0x130d9a0 2023-11-17T06:31:37.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f257058f740 10 client.0 _ll_register_callbacks cb 0x11fd4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:31:37.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f255ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130f6f0 0x1377620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f255ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130f6f0 0x1377620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41714/0 (socket says 172.21.15.69:41714) 2023-11-17T06:31:37.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f255ffff700 1 -- 172.21.15.69:0/764901408 learned_addr learned my addr 172.21.15.69:0/764901408 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:37.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f2566ffd700 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130d9a0 0x1376b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.450+0000 7f25677fe700 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x1310550 0x1377b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f255ffff700 1 -- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130d9a0 msgr2=0x1376b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f255ffff700 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130d9a0 0x1376b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f255ffff700 1 -- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x1310550 msgr2=0x1377b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f255ffff700 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x1310550 0x1377b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f255ffff700 1 -- 172.21.15.69:0/764901408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25680b3560 con 0x130f6f0 2023-11-17T06:31:37.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f255ffff700 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130f6f0 0x1377620 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f255000a010 tx=0x7f2558012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca62a93efd3c279 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f2545ffb700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-11-17T06:31:37.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f2545ffb700 1 -- 172.21.15.69:0/764901408 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255005e5e0 con 0x130f6f0 2023-11-17T06:31:37.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f2545ffb700 1 -- 172.21.15.69:0/764901408 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2550054680 con 0x130f6f0 2023-11-17T06:31:37.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f257058f740 1 -- 172.21.15.69:0/764901408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f256000f040 con 0x130f6f0 2023-11-17T06:31:37.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f2545ffb700 1 -- 172.21.15.69:0/764901408 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25500837d0 con 0x130f6f0 2023-11-17T06:31:37.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f257058f740 10 client.5385 fetch_fsmap learned FSMap version 15 2023-11-17T06:31:37.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f257058f740 1 -- 172.21.15.69:0/764901408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x11e18d0 con 0x130f6f0 2023-11-17T06:31:37.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f2545ffb700 1 -- 172.21.15.69:0/764901408 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000f040 con 0x130f6f0 2023-11-17T06:31:37.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f2545ffb700 1 -- 172.21.15.69:0/764901408 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f25500740c0 con 0x130f6f0 2023-11-17T06:31:37.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f257058f740 10 client.5385 fetch_fsmap finished waiting for FSMap version 15 2023-11-17T06:31:37.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f257058f740 10 client.5385 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-17T06:31:37.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f257058f740 20 client.5385 populate_metadata read hostname 'smithi069' 2023-11-17T06:31:37.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f257058f740 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:6836/4181304583,v1:172.21.15.93:6837/4181304583] conn(0x13780a0 0x1378480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f257058f740 4 client.5385 mds_command: new command op to 5260 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-17T06:31:37.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f257058f740 1 -- 172.21.15.69:0/764901408 --> [v2:172.21.15.93:6836/4181304583,v1:172.21.15.93:6837/4181304583] -- command(tid 0: {"prefix": "status"}) v1 -- 0x10b4460 con 0x13780a0 2023-11-17T06:31:37.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.454+0000 7f2566ffd700 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:6836/4181304583,v1:172.21.15.93:6837/4181304583] conn(0x13780a0 0x1378480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f2566ffd700 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:6836/4181304583,v1:172.21.15.93:6837/4181304583] conn(0x13780a0 0x1378480 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f681582a71850ac6 server_cookie=dc969217d04bf5b2 in_seq=0 out_seq=0 2023-11-17T06:31:37.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f2545ffb700 10 client.5385 ms_handle_connect on v2:172.21.15.93:6836/4181304583 2023-11-17T06:31:37.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f2545ffb700 1 -- 172.21.15.69:0/764901408 <== mds.0 v2:172.21.15.93:6836/4181304583 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x10b4460 con 0x13780a0 2023-11-17T06:31:37.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f2545ffb700 10 client.5385 handle_command_reply: tid=0 2023-11-17T06:31:37.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 client.5385 shutdown 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 -- 172.21.15.69:0/764901408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130f6f0 msgr2=0x1377620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130f6f0 0x1377620 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f255000a010 tx=0x7f2558012000 comp rx=0 tx=0).stop 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 -- 172.21.15.69:0/764901408 shutdown_connections 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:6836/4181304583,v1:172.21.15.93:6837/4181304583] conn(0x13780a0 0x1378480 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x1310550 0x1377b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x130f6f0 0x1377620 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f2545ffb700 0 client.5385 ms_handle_reset on v2:172.21.15.93:6836/4181304583 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 --2- 172.21.15.69:0/764901408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x130d9a0 0x1376b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 -- 172.21.15.69:0/764901408 >> 172.21.15.69:0/764901408 conn(0x105d4d0 msgr2=0x12cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 -- 172.21.15.69:0/764901408 shutdown_connections 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 1 -- 172.21.15.69:0/764901408 wait complete. 2023-11-17T06:31:37.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f257058f740 20 client.5385 trim_cache size 0 max 16384 2023-11-17T06:31:37.466 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:31:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "473113af-218f-4c66-9eb3-2c30c3150d71", 2023-11-17T06:31:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2023-11-17T06:31:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 5260, 2023-11-17T06:31:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-11-17T06:31:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-11-17T06:31:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-11-17T06:31:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 11.171346677000001, 2023-11-17T06:31:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 15, 2023-11-17T06:31:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 37, 2023-11-17T06:31:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 37, 2023-11-17T06:31:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 21.081932865999999 2023-11-17T06:31:37.467 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 -- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2548066510 msgr2=0x7f25480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2548066510 0x7f25480689d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f25580011e0 tx=0x7f2558009040 comp rx=0 tx=0).stop 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 -- 172.21.15.69:0/2661740474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568159ed0 msgr2=0x7f25680c8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568159ed0 0x7f25680c8e80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f2550000c00 tx=0x7f2550004770 comp rx=0 tx=0).stop 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 -- 172.21.15.69:0/2661740474 shutdown_connections 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2548066510 0x7f25480689d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f256815a2b0 0x7f25680b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2568159ed0 0x7f25680c8e80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 --2- 172.21.15.69:0/2661740474 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25680c98c0 0x7f25680b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 -- 172.21.15.69:0/2661740474 >> 172.21.15.69:0/2661740474 conn(0x7f25680b0900 msgr2=0x7f2568159430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 -- 172.21.15.69:0/2661740474 shutdown_connections 2023-11-17T06:31:37.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.458+0000 7f256d2c4700 1 -- 172.21.15.69:0/2661740474 wait complete. 2023-11-17T06:31:37.488 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:31:37.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd9113700 1 Processor -- start 2023-11-17T06:31:37.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd9113700 1 -- start start 2023-11-17T06:31:37.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd9113700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9dd40cea40 0x7f9dd40c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd9113700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9dd40cee80 0x7f9dd40ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd9113700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd406ae50 con 0x7f9dd4159940 2023-11-17T06:31:37.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd9113700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd40665a0 con 0x7f9dd40cea40 2023-11-17T06:31:37.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd9113700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd406b0f0 con 0x7f9dd40cee80 2023-11-17T06:31:37.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd3fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f9dd4159940 0x7f9dd4065e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37274/0 (socket says 172.21.15.69:37274) 2023-11-17T06:31:37.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd3fff700 1 -- 172.21.15.69:0/921686028 learned_addr learned my addr 172.21.15.69:0/921686028 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:31:37.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd8912700 1 --2- 172.21.15.69:0/921686028 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9dd40cee80 0x7f9dd40ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd37fe700 1 --2- 172.21.15.69:0/921686028 >> v2:172.21.15.93:3300/0 conn(0x7f9dd40cea40 0x7f9dd40c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd2ffd700 1 -- 172.21.15.69:0/921686028 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190253238 0 0) 0x7f9dd406ae50 con 0x7f9dd4159940 2023-11-17T06:31:37.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.678+0000 7f9dd2ffd700 1 -- 172.21.15.69:0/921686028 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dbc0035d0 con 0x7f9dd4159940 2023-11-17T06:31:37.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd37fe700 1 -- 172.21.15.69:0/921686028 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9dd40cee80 msgr2=0x7f9dd40ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:31:37.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd37fe700 1 --2- 172.21.15.69:0/921686028 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9dd40cee80 0x7f9dd40ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd37fe700 1 -- 172.21.15.69:0/921686028 >> v1:172.21.15.69:6789/0 conn(0x7f9dd4159940 legacy=0x7f9dd4065e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd37fe700 1 -- 172.21.15.69:0/921686028 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd406b3d0 con 0x7f9dd40cea40 2023-11-17T06:31:37.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd37fe700 1 --2- 172.21.15.69:0/921686028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9dd40cea40 0x7f9dd40c9cd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009880 tx=0x7f9dc8009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=160fd6affb707728 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd2ffd700 1 -- 172.21.15.69:0/921686028 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8011830 con 0x7f9dd40cea40 2023-11-17T06:31:37.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd2ffd700 1 -- 172.21.15.69:0/921686028 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc8011990 con 0x7f9dd40cea40 2023-11-17T06:31:37.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd2ffd700 1 -- 172.21.15.69:0/921686028 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8011d20 con 0x7f9dd40cea40 2023-11-17T06:31:37.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd9113700 1 -- 172.21.15.69:0/921686028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9dd40cea40 msgr2=0x7f9dd40c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd9113700 1 --2- 172.21.15.69:0/921686028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9dd40cea40 0x7f9dd40c9cd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009880 tx=0x7f9dc8009b90 comp rx=0 tx=0).stop 2023-11-17T06:31:37.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd9113700 1 -- 172.21.15.69:0/921686028 shutdown_connections 2023-11-17T06:31:37.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd9113700 1 --2- 172.21.15.69:0/921686028 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9dd40cee80 0x7f9dd40ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd9113700 1 --2- 172.21.15.69:0/921686028 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9dd40cea40 0x7f9dd40c9cd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd9113700 1 -- 172.21.15.69:0/921686028 >> 172.21.15.69:0/921686028 conn(0x7f9dd40cf470 msgr2=0x7f9dd40cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd9113700 1 -- 172.21.15.69:0/921686028 shutdown_connections 2023-11-17T06:31:37.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.682+0000 7f9dd9113700 1 -- 172.21.15.69:0/921686028 wait complete. 2023-11-17T06:31:37.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd9113700 1 Processor -- start 2023-11-17T06:31:37.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd9113700 1 -- start start 2023-11-17T06:31:37.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd9113700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9dd40cea40 0x7f9dd4166ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd9113700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dd40cee80 0x7f9dd414b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd9113700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9dd4159940 0x7f9dd414ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd9113700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4150440 con 0x7f9dd40cee80 2023-11-17T06:31:37.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd9113700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd414f830 con 0x7f9dd40cea40 2023-11-17T06:31:37.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd9113700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd414fb10 con 0x7f9dd4159940 2023-11-17T06:31:37.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dd40cee80 0x7f9dd414b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dd40cee80 0x7f9dd414b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41726/0 (socket says 172.21.15.69:41726) 2023-11-17T06:31:37.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd37fe700 1 -- 172.21.15.69:0/3422116552 learned_addr learned my addr 172.21.15.69:0/3422116552 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:31:37.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd3fff700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9dd40cea40 0x7f9dd4166ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.686+0000 7f9dd8912700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9dd4159940 0x7f9dd414ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd37fe700 1 -- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9dd4159940 msgr2=0x7f9dd414ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd37fe700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9dd4159940 0x7f9dd414ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd37fe700 1 -- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9dd40cea40 msgr2=0x7f9dd4166ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd37fe700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9dd40cea40 0x7f9dd4166ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd37fe700 1 -- 172.21.15.69:0/3422116552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc80094b0 con 0x7f9dd40cee80 2023-11-17T06:31:37.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd37fe700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dd40cee80 0x7f9dd414b530 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009bd0 tx=0x7f9dc8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd0ff9700 1 -- 172.21.15.69:0/3422116552 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8004400 con 0x7f9dd40cee80 2023-11-17T06:31:37.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd0ff9700 1 -- 172.21.15.69:0/3422116552 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc801f070 con 0x7f9dd40cee80 2023-11-17T06:31:37.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd9113700 1 -- 172.21.15.69:0/3422116552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd414fdf0 con 0x7f9dd40cee80 2023-11-17T06:31:37.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd0ff9700 1 -- 172.21.15.69:0/3422116552 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc80036c0 con 0x7f9dd40cee80 2023-11-17T06:31:37.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd9113700 1 -- 172.21.15.69:0/3422116552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd414aed0 con 0x7f9dd40cee80 2023-11-17T06:31:37.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.690+0000 7f9dd9113700 1 -- 172.21.15.69:0/3422116552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd40686a0 con 0x7f9dd40cee80 2023-11-17T06:31:37.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.694+0000 7f9dd0ff9700 1 -- 172.21.15.69:0/3422116552 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9dc8021030 con 0x7f9dd40cee80 2023-11-17T06:31:37.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.694+0000 7f9dd0ff9700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9dc0066510 0x7f9dc00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:31:37.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.694+0000 7f9dd0ff9700 1 -- 172.21.15.69:0/3422116552 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dc8084cd0 con 0x7f9dd40cee80 2023-11-17T06:31:37.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.694+0000 7f9dd3fff700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9dc0066510 0x7f9dc00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:31:37.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.698+0000 7f9dd3fff700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9dc0066510 0x7f9dc00689d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4007fd0 tx=0x7f9dc4007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:31:37.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.702+0000 7f9dd0ff9700 1 -- 172.21.15.69:0/3422116552 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9dc80520b0 con 0x7f9dd40cee80 2023-11-17T06:31:37.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.918+0000 7f9dd9113700 1 -- 172.21.15.69:0/3422116552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9dd40b28e0 con 0x7f9dd40cee80 2023-11-17T06:31:37.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.918+0000 7f9dd0ff9700 1 -- 172.21.15.69:0/3422116552 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9dc80556d0 con 0x7f9dd40cee80 2023-11-17T06:31:37.924 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:31:37.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.918+0000 7f9dd9113700 1 -- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9dc0066510 msgr2=0x7f9dc00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9dc0066510 0x7f9dc00689d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4007fd0 tx=0x7f9dc4007de0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 -- 172.21.15.69:0/3422116552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dd40cee80 msgr2=0x7f9dd414b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:31:37.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dd40cee80 0x7f9dd414b530 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009bd0 tx=0x7f9dc8004770 comp rx=0 tx=0).stop 2023-11-17T06:31:37.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 -- 172.21.15.69:0/3422116552 shutdown_connections 2023-11-17T06:31:37.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9dc0066510 0x7f9dc00689d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9dd4159940 0x7f9dd414ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dd40cee80 0x7f9dd414b530 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 --2- 172.21.15.69:0/3422116552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9dd40cea40 0x7f9dd4166ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:31:37.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 -- 172.21.15.69:0/3422116552 >> 172.21.15.69:0/3422116552 conn(0x7f9dd40cf470 msgr2=0x7f9dd40b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:31:37.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 -- 172.21.15.69:0/3422116552 shutdown_connections 2023-11-17T06:31:37.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:31:37.922+0000 7f9dd9113700 1 -- 172.21.15.69:0/3422116552 wait complete. 2023-11-17T06:31:37.949 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:31:37.949 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:31:37.949 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2023-11-17T06:31:37.949 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-17T06:31:37.949 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-17T06:31:37.949 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:31:37.949 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:31:37.949 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:31:37.949 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:31:37.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:37.949 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2023-11-17T06:31:37.966 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:31:37.966 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:31:37.966 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:31:37.966 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:37.966 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42145sec preferred_lft 42145sec 2023-11-17T06:31:37.967 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 02:42:2e:aa:f1:0b brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 62:b7:9e:10:0f:21 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::3479:73ff:fe34:bc0f/64 scope link 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:31:37.968 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 62:b7:9e:10:0f:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:31:37.969 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::60b7:9eff:fe10:f21/64 scope link 2023-11-17T06:31:37.969 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:37.969 INFO:teuthology.orchestra.run.smithi069.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:31:37.969 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 92:c9:1c:aa:d1:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:31:37.969 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::90c9:1cff:feaa:d12c/64 scope link 2023-11-17T06:31:37.969 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:31:37.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:37.970 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:31:38.052 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-11-17T06:31:38.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:38.056 DEBUG:teuthology.orchestra.run.smithi069:> route 2023-11-17T06:31:38.119 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2023-11-17T06:31:44.814 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:31:44.814 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:31:44.814 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:31:44.815 INFO:teuthology.orchestra.run.smithi069.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:31:44.815 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:31:44.815 INFO:teuthology.orchestra.run.smithi069.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:31:44.815 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:31:44.816 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:31:44.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:44.817 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:31:44.817 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:31:44.817 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:31:44.817 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:31:44.817 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:31:44.818 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:31:44.866 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:31:44.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:44.947 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-11-17T06:31:45.010 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-17T06:31:45.011 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-17T06:31:45.012 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:31:45.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:31:45.012 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2023-11-17T06:31:45.089 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-17T06:32:57.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:32:57.681 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-17T06:32:57.683 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:32:57.697 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:32:57.703 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:32:57.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:32:57.704 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:32:57.767 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:32:57.849 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:32:57.916 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:32:57.917 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:32:57.917 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:32:57.917 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:32:57.917 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:32:57.917 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:32:57.917 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:32:57.918 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:32:57.918 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:32:57.918 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:32:57.918 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:32:57.918 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:32:57.918 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:32:57.919 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:32:57.919 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:32:57.919 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:32:57.919 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:32:57.919 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:32:57.919 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:32:57.920 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:32:57.920 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:32:57.920 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:32:57.920 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:32:57.920 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:32:57.920 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:32:57.921 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:32:57.921 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:32:57.921 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:32:57.921 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:32:57.921 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:32:57.921 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:32:57.922 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:32:57.922 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:32:57.922 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:32:57.922 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:32:57.922 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:32:57.922 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:32:57.923 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:32:57.923 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:32:57.923 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:32:57.923 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:32:57.923 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:32:57.923 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:32:57.923 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:32:57.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:57.925 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:32:57.984 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-17T06:32:57.984 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-17T06:32:58.034 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:32:58.069 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:32:58.133 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:32:58.133 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:32:58.133 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:32:58.133 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:32:58.134 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:32:58.135 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:32:58.136 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:32:58.137 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:32:58.137 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:32:58.137 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:32:58.137 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:32:58.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:58.138 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:32:58.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:2023-11-17T06:32:58.168+0000 7f7e72b90640 -1 init, newargv = 0x560bbf7149a0 newargc=15 2023-11-17T06:32:58.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[46598]: starting ceph client 2023-11-17T06:32:58.186 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[46598]: starting fuse 2023-11-17T06:32:58.188 INFO:teuthology.orchestra.run.smithi069.stdout:49 2023-11-17T06:32:58.189 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-17T06:32:58.189 DEBUG:teuthology.orchestra.run.smithi069:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:32:58.189 DEBUG:teuthology.orchestra.run.smithi069:> import glob 2023-11-17T06:32:58.189 DEBUG:teuthology.orchestra.run.smithi069:> import re 2023-11-17T06:32:58.189 DEBUG:teuthology.orchestra.run.smithi069:> import os 2023-11-17T06:32:58.189 DEBUG:teuthology.orchestra.run.smithi069:> import subprocess 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> def _find_admin_socket(client_name): 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> files = glob.glob(asok_path) 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> # Given a non-glob path, it better be there 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> if "*" not in asok_path: 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> assert(len(files) == 1) 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> return files[0] 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> for f in files: 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:32:58.190 DEBUG:teuthology.orchestra.run.smithi069:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:32:58.191 DEBUG:teuthology.orchestra.run.smithi069:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:32:58.191 DEBUG:teuthology.orchestra.run.smithi069:> contents = proc_f.read() 2023-11-17T06:32:58.191 DEBUG:teuthology.orchestra.run.smithi069:> if mountpoint in contents: 2023-11-17T06:32:58.191 DEBUG:teuthology.orchestra.run.smithi069:> return f 2023-11-17T06:32:58.191 DEBUG:teuthology.orchestra.run.smithi069:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:32:58.191 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:32:58.191 DEBUG:teuthology.orchestra.run.smithi069:> print(_find_admin_socket("client.0")) 2023-11-17T06:32:58.191 DEBUG:teuthology.orchestra.run.smithi069:> ' 2023-11-17T06:32:58.353 INFO:teuthology.orchestra.run.smithi069.stdout:/var/run/ceph/ceph-client.0.46598.asok 2023-11-17T06:32:58.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:32:58.372 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46598.asok 2023-11-17T06:32:58.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:58.372 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46598.asok status 2023-11-17T06:32:58.573 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:32:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "metadata": { 2023-11-17T06:32:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:32:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:32:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "entity_id": "0", 2023-11-17T06:32:58.574 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": "smithi069", 2023-11-17T06:32:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-17T06:32:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "pid": "46598", 2023-11-17T06:32:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "root": "/" 2023-11-17T06:32:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:32:58.575 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_count": 0, 2023-11-17T06:32:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_pinned_count": 0, 2023-11-17T06:32:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 5394, 2023-11-17T06:32:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "inst": { 2023-11-17T06:32:58.576 INFO:teuthology.orchestra.run.smithi069.stdout: "name": { 2023-11-17T06:32:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "client", 2023-11-17T06:32:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "num": 5394 2023-11-17T06:32:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:32:58.577 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-11-17T06:32:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-11-17T06:32:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:32:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 2159118600 2023-11-17T06:32:58.578 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:32:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:32:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-11-17T06:32:58.579 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-11-17T06:32:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:32:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 2159118600 2023-11-17T06:32:58.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:32:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "inst_str": "client.5394 192.168.0.1:0/2159118600", 2023-11-17T06:32:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "addr_str": "192.168.0.1:0/2159118600", 2023-11-17T06:32:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "inode_count": 1, 2023-11-17T06:32:58.581 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_epoch": 15, 2023-11-17T06:32:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch": 39, 2023-11-17T06:32:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:32:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "blocklisted": false, 2023-11-17T06:32:58.582 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs" 2023-11-17T06:32:58.582 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:32:58.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:58.588 DEBUG:teuthology.orchestra.run.smithi069:> stat --file-system '--printf=%T 2023-11-17T06:32:58.588 DEBUG:teuthology.orchestra.run.smithi069:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-17T06:32:58.608 INFO:teuthology.orchestra.run.smithi069.stdout:fuseblk 2023-11-17T06:32:58.608 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-17T06:32:58.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:32:58.608 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:32:58.689 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:32:58.737 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2023-11-17T06:32:58.810 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2023-11-17T06:32:58.811 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.811 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2023-11-17T06:32:58.811 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2023-11-17T06:32:58.811 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.811 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:32:58.811 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2023-11-17T06:32:58.811 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.811 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:32:58.811 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:32:58.811 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.812 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2023-11-17T06:32:58.812 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.812 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2023-11-17T06:32:58.812 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2023-11-17T06:32:58.812 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:32:58.812 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:32:58.812 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2023-11-17T06:32:58.812 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:32:58.812 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2023-11-17T06:32:58.812 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2023-11-17T06:32:58.813 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = "172.21.15.69,172.21.15.93,[v2:172.21.15.93:3301,v1:172.21.15.93:6790]" 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = 473113af-218f-4c66-9eb3-2c30c3150d71 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.814 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.815 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: bdev async discard = True 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: bdev enable discard = True 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore allocator = bitmap 2023-11-17T06:32:58.816 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore block size = 96636764160 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore fsck on mount = True 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluefs = 1/20 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluestore = 1/20 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 20 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: debug rocksdb = 4/10 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd full ratio = 0.9 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: osd objectstore = bluestore 2023-11-17T06:32:58.817 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.818 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.819 INFO:teuthology.orchestra.run.smithi093.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: # 1m isn't quite enough 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:32:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: mon op complaint time = 120 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: client mount timeout = 600 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: debug client = 20 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = "" 2023-11-17T06:32:58.821 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.b] 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.c] 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout:[mds] 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds = 20 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds balancer = 20 2023-11-17T06:32:58.822 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:32:58.823 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug frag = True 2023-11-17T06:32:58.823 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug scatterstat = True 2023-11-17T06:32:58.823 INFO:teuthology.orchestra.run.smithi093.stdout: mds op complaint time = 180 2023-11-17T06:32:58.823 INFO:teuthology.orchestra.run.smithi093.stdout: mds verify scatter = True 2023-11-17T06:32:58.823 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2023-11-17T06:32:58.823 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2023-11-17T06:32:58.823 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2023-11-17T06:32:58.823 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal merge size = 0 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: chdir = "" 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: auth supported = cephx 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: filestore xattr use omap = true 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: mon clock drift allowed = 1.000 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: osd crush chooseleaf type = 0 2023-11-17T06:32:58.824 INFO:teuthology.orchestra.run.smithi069.stdout: auth debug = true 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on old message = true 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on bug = true 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn max object skew = 0 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default size = 2 2023-11-17T06:32:58.825 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow primary affinity = true 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow pg remap = true 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on no sortbitwise = false 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on too few osds = false 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: mon_allow_pool_size_one = true 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.826 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: osd default data pool replay window = 5 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: mon allow pool delete = true 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: mon cluster log file level = debug 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: debug asserts on shutdown = true 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: mon health detail to clog = false 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: mon host = "172.21.15.69,172.21.15.93,[v2:172.21.15.93:3301,v1:172.21.15.93:6790]" 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = 473113af-218f-4c66-9eb3-2c30c3150d71 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout:[osd] 2023-11-17T06:32:58.827 INFO:teuthology.orchestra.run.smithi069.stdout: osd journal size = 100 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub load threshold = 5.0 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub max interval = 600 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: osd recover clone overlap = true 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: osd recovery max chunk = 1048576 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug shutdown = true 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug op order = true 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug verify stray on activate = true 2023-11-17T06:32:58.828 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: osd open classes on start = true 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug pg log writeout = true 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: osd map max advance = 10 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: journal zero on create = true 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: filestore apply finisher threads = 3 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.829 INFO:teuthology.orchestra.run.smithi069.stdout: bdev debug aio = true 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug misdirected ops = true 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: bdev async discard = True 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: bdev enable discard = True 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore allocator = bitmap 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore block size = 96636764160 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore fsck on mount = True 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluefs = 1/20 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluestore = 1/20 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: debug osd = 20 2023-11-17T06:32:58.830 INFO:teuthology.orchestra.run.smithi069.stdout: debug rocksdb = 4/10 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd full ratio = 0.9 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: osd objectstore = bluestore 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr] 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: debug mgr = 20 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:32:58.831 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: mgr/telemetry/nag = false 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout:[mon] 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: debug paxos = 20 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: mon data avail warn = 5 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: mon mgr mkfs grace = 240 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd reporter subtree level = osd 2023-11-17T06:32:58.832 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd prime pg temp = true 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: # 1m isn't quite enough 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.833 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:32:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: mon op complaint time = 120 2023-11-17T06:32:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.834 INFO:teuthology.orchestra.run.smithi069.stdout:[client] 2023-11-17T06:32:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: rgw cache enabled = true 2023-11-17T06:32:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable ops log = true 2023-11-17T06:32:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable usage log = true 2023-11-17T06:32:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:32:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:32:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: client mount timeout = 600 2023-11-17T06:32:58.834 INFO:teuthology.orchestra.run.smithi069.stdout: debug client = 20 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = "" 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.a] 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.b] 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.c] 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d] 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout:[mds] 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds = 20 2023-11-17T06:32:58.835 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds balancer = 20 2023-11-17T06:32:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:32:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug frag = True 2023-11-17T06:32:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug scatterstat = True 2023-11-17T06:32:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: mds op complaint time = 180 2023-11-17T06:32:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: mds verify scatter = True 2023-11-17T06:32:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-11-17T06:32:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-11-17T06:32:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-11-17T06:32:58.836 INFO:teuthology.orchestra.run.smithi069.stdout: mds bal merge size = 0 2023-11-17T06:32:58.838 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:32:58.885 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-17T06:32:58.958 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2023-11-17T06:32:58.958 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2023-11-17T06:32:58.959 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:32:58.959 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2023-11-17T06:32:58.959 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.959 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2023-11-17T06:32:58.959 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.959 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2023-11-17T06:32:58.959 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.959 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2023-11-17T06:32:58.959 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2023-11-17T06:32:58.959 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.960 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2023-11-17T06:32:58.960 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2023-11-17T06:32:58.960 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.960 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:32:58.960 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2023-11-17T06:32:58.960 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.960 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:32:58.960 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:32:58.960 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.960 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2023-11-17T06:32:58.961 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.961 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2023-11-17T06:32:58.961 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2023-11-17T06:32:58.961 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:32:58.961 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:32:58.961 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2023-11-17T06:32:58.961 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:32:58.961 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2023-11-17T06:32:58.961 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:32:58.961 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:32:58.962 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2023-11-17T06:32:58.962 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.962 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:32:58.962 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.962 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2023-11-17T06:32:58.962 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.962 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2023-11-17T06:32:58.962 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.962 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2023-11-17T06:32:58.962 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2023-11-17T06:32:58.963 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2023-11-17T06:32:58.963 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = "172.21.15.69,172.21.15.93,[v2:172.21.15.93:3301,v1:172.21.15.93:6790]" 2023-11-17T06:32:58.963 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = 473113af-218f-4c66-9eb3-2c30c3150d71 2023-11-17T06:32:58.963 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.963 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2023-11-17T06:32:58.963 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2023-11-17T06:32:58.963 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.963 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2023-11-17T06:32:58.963 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2023-11-17T06:32:58.964 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2023-11-17T06:32:58.965 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.965 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:32:58.965 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.965 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2023-11-17T06:32:58.965 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.965 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2023-11-17T06:32:58.965 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.965 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:32:58.965 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2023-11-17T06:32:58.965 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: bdev async discard = True 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: bdev enable discard = True 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore allocator = bitmap 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore block size = 96636764160 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore fsck on mount = True 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluefs = 1/20 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluestore = 1/20 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:32:58.966 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 20 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: debug rocksdb = 4/10 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd full ratio = 0.9 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: osd objectstore = bluestore 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2023-11-17T06:32:58.967 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2023-11-17T06:32:58.968 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:32:58.969 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: # 1m isn't quite enough 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: mon op complaint time = 120 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:32:58.970 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout: client mount timeout = 600 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout: debug client = 20 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = "" 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.b] 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.c] 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2023-11-17T06:32:58.971 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.d] 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout:[mds] 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds = 20 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds balancer = 20 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug frag = True 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug scatterstat = True 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: mds op complaint time = 180 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: mds verify scatter = True 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 900 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 900 2023-11-17T06:32:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal merge size = 0 2023-11-17T06:32:58.973 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal split size = 10000 2023-11-17T06:32:58.973 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2023-11-17T06:32:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: chdir = "" 2023-11-17T06:32:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-17T06:32:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: auth supported = cephx 2023-11-17T06:32:58.973 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: filestore xattr use omap = true 2023-11-17T06:32:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: mon clock drift allowed = 1.000 2023-11-17T06:32:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: osd crush chooseleaf type = 0 2023-11-17T06:32:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: auth debug = true 2023-11-17T06:32:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on old message = true 2023-11-17T06:32:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on bug = true 2023-11-17T06:32:58.974 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-17T06:32:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn max object skew = 0 2023-11-17T06:32:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: # disable pg_autoscaler by default for new pools 2023-11-17T06:32:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-17T06:32:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default size = 2 2023-11-17T06:32:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow primary affinity = true 2023-11-17T06:32:58.975 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow pg remap = true 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on legacy crush tunables = false 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on crush straw calc version zero = false 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on no sortbitwise = false 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on osd down out interval zero = false 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on too few osds = false 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: mon_allow_pool_size_one = true 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.976 INFO:teuthology.orchestra.run.smithi069.stdout: osd default data pool replay window = 5 2023-11-17T06:32:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: mon allow pool delete = true 2023-11-17T06:32:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: mon cluster log file level = debug 2023-11-17T06:32:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: debug asserts on shutdown = true 2023-11-17T06:32:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: mon health detail to clog = false 2023-11-17T06:32:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: mon host = "172.21.15.69,172.21.15.93,[v2:172.21.15.93:3301,v1:172.21.15.93:6790]" 2023-11-17T06:32:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = 473113af-218f-4c66-9eb3-2c30c3150d71 2023-11-17T06:32:58.977 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.977 INFO:teuthology.orchestra.run.smithi069.stdout:[osd] 2023-11-17T06:32:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: osd journal size = 100 2023-11-17T06:32:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub load threshold = 5.0 2023-11-17T06:32:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub max interval = 600 2023-11-17T06:32:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: osd mclock profile = high_recovery_ops 2023-11-17T06:32:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: osd recover clone overlap = true 2023-11-17T06:32:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: osd recovery max chunk = 1048576 2023-11-17T06:32:58.978 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug shutdown = true 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug op order = true 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug verify stray on activate = true 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: osd open classes on start = true 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug pg log writeout = true 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: osd deep scrub update digest min age = 30 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: osd map max advance = 10 2023-11-17T06:32:58.979 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: journal zero on create = true 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: filestore ondisk finisher threads = 3 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: filestore apply finisher threads = 3 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: bdev debug aio = true 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug misdirected ops = true 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: bdev async discard = True 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: bdev enable discard = True 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore allocator = bitmap 2023-11-17T06:32:58.980 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore block size = 96636764160 2023-11-17T06:32:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore fsck on mount = True 2023-11-17T06:32:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluefs = 1/20 2023-11-17T06:32:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluestore = 1/20 2023-11-17T06:32:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:32:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: debug osd = 20 2023-11-17T06:32:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: debug rocksdb = 4/10 2023-11-17T06:32:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd backfillfull_ratio = 0.85 2023-11-17T06:32:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd full ratio = 0.9 2023-11-17T06:32:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd nearfull ratio = 0.8 2023-11-17T06:32:58.981 INFO:teuthology.orchestra.run.smithi069.stdout: osd failsafe full ratio = 0.95 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: osd objectstore = bluestore 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr] 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: debug mgr = 20 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: mgr/telemetry/nag = false 2023-11-17T06:32:58.982 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout:[mon] 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: debug paxos = 20 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: mon data avail warn = 5 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: mon mgr mkfs grace = 240 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd reporter subtree level = osd 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd prime pg temp = true 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-11-17T06:32:58.983 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: auth mon ticket ttl = 660 # 11m 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: auth service ticket ttl = 240 # 4m 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: # don't complain about insecure global_id in the test suite 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: # 1m isn't quite enough 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: mon_down_mkfs_grace = 2m 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_filestore_osds = false 2023-11-17T06:32:58.984 INFO:teuthology.orchestra.run.smithi069.stdout: mon op complaint time = 120 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout:[client] 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: rgw cache enabled = true 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable ops log = true 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable usage log = true 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: client mount timeout = 600 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: debug client = 20 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = "" 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-11-17T06:32:58.985 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.a] 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.b] 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.c] 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d] 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout:[mds] 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds = 20 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds balancer = 20 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug frag = True 2023-11-17T06:32:58.986 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug scatterstat = True 2023-11-17T06:32:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: mds op complaint time = 180 2023-11-17T06:32:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: mds verify scatter = True 2023-11-17T06:32:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-11-17T06:32:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-11-17T06:32:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-11-17T06:32:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: mds bal merge size = 0 2023-11-17T06:32:58.987 INFO:teuthology.orchestra.run.smithi069.stdout: mds bal split size = 10000 2023-11-17T06:32:58.990 DEBUG:teuthology.orchestra.run.smithi069:> stdin-killer -- python3 -c ' 2023-11-17T06:32:58.991 DEBUG:teuthology.orchestra.run.smithi069:> import os 2023-11-17T06:32:58.991 DEBUG:teuthology.orchestra.run.smithi069:> path = os.path.join("/home/ubuntu/cephtest/mnt.0", "subdir") 2023-11-17T06:32:58.991 DEBUG:teuthology.orchestra.run.smithi069:> os.mkdir(path) 2023-11-17T06:32:58.991 DEBUG:teuthology.orchestra.run.smithi069:> for n in range(0, 100): 2023-11-17T06:32:58.991 DEBUG:teuthology.orchestra.run.smithi069:> open(os.path.join(path, "%s" % n), '"'"'w'"'"').write("%s" % n) 2023-11-17T06:32:58.991 DEBUG:teuthology.orchestra.run.smithi069:> ' 2023-11-17T06:32:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:32:59.577 DEBUG:teuthology.orchestra.run.smithi069:> stdin-killer -- python3 -c ' 2023-11-17T06:32:59.578 DEBUG:teuthology.orchestra.run.smithi069:> import os 2023-11-17T06:32:59.578 DEBUG:teuthology.orchestra.run.smithi069:> import stat 2023-11-17T06:32:59.578 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:32:59.578 DEBUG:teuthology.orchestra.run.smithi069:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2023-11-17T06:32:59.578 DEBUG:teuthology.orchestra.run.smithi069:> ' 2023-11-17T06:32:59.718 INFO:teuthology.orchestra.run.smithi069.stdout:1099511627776 2023-11-17T06:32:59.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:32:59.737 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:32:59.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.952+0000 7f598ef6c700 1 Processor -- start 2023-11-17T06:32:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.952+0000 7f598ef6c700 1 -- start start 2023-11-17T06:32:59.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.952+0000 7f598ef6c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5988165e80 0x7f5988165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.952+0000 7f598ef6c700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59880ccfc0 con 0x7f59880c23f0 2023-11-17T06:32:59.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.952+0000 7f598ef6c700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59880cde30 con 0x7f59881656d0 2023-11-17T06:32:59.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.952+0000 7f598ef6c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5988165af0 con 0x7f5988165e80 2023-11-17T06:32:59.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598df6a700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f59880c23f0 0x7f59880cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:51210/0 (socket says 172.21.15.69:51210) 2023-11-17T06:32:59.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598df6a700 1 -- 172.21.15.69:0/4127251682 learned_addr learned my addr 172.21.15.69:0/4127251682 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:32:59.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598d769700 1 --2- 172.21.15.69:0/4127251682 >> v2:172.21.15.69:3300/0 conn(0x7f5988165e80 0x7f5988165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598cf68700 1 -- 172.21.15.69:0/4127251682 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678182316 0 0) 0x7f59880ccfc0 con 0x7f59880c23f0 2023-11-17T06:32:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598cf68700 1 -- 172.21.15.69:0/4127251682 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59740035d0 con 0x7f59880c23f0 2023-11-17T06:32:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598d769700 1 -- 172.21.15.69:0/4127251682 >> v1:172.21.15.93:6789/0 conn(0x7f59881656d0 legacy=0x7f59880c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598d769700 1 -- 172.21.15.69:0/4127251682 >> v1:172.21.15.69:6789/0 conn(0x7f59880c23f0 legacy=0x7f59880cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598d769700 1 -- 172.21.15.69:0/4127251682 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59880cd220 con 0x7f5988165e80 2023-11-17T06:32:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598d769700 1 --2- 172.21.15.69:0/4127251682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5988165e80 0x7f5988165190 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5978009850 tx=0x7f5978009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a905857daeea8957 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:32:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598cf68700 1 -- 172.21.15.69:0/4127251682 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978011830 con 0x7f5988165e80 2023-11-17T06:32:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598cf68700 1 -- 172.21.15.69:0/4127251682 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5978011990 con 0x7f5988165e80 2023-11-17T06:32:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598cf68700 1 -- 172.21.15.69:0/4127251682 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978011d40 con 0x7f5988165e80 2023-11-17T06:32:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598ef6c700 1 -- 172.21.15.69:0/4127251682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5988165e80 msgr2=0x7f5988165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598ef6c700 1 --2- 172.21.15.69:0/4127251682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5988165e80 0x7f5988165190 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5978009850 tx=0x7f5978009b60 comp rx=0 tx=0).stop 2023-11-17T06:32:59.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598ef6c700 1 -- 172.21.15.69:0/4127251682 shutdown_connections 2023-11-17T06:32:59.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598ef6c700 1 --2- 172.21.15.69:0/4127251682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5988165e80 0x7f5988165190 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598ef6c700 1 -- 172.21.15.69:0/4127251682 >> 172.21.15.69:0/4127251682 conn(0x7f59880cece0 msgr2=0x7f59880cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:32:59.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.956+0000 7f598ef6c700 1 -- 172.21.15.69:0/4127251682 shutdown_connections 2023-11-17T06:32:59.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.960+0000 7f598ef6c700 1 -- 172.21.15.69:0/4127251682 wait complete. 2023-11-17T06:32:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.960+0000 7f598ef6c700 1 Processor -- start 2023-11-17T06:32:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.960+0000 7f598ef6c700 1 -- start start 2023-11-17T06:32:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.960+0000 7f598ef6c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59880c23f0 0x7f5988152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.960+0000 7f598ef6c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59881656d0 0x7f59880c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.960+0000 7f598ef6c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5988165e80 0x7f59880c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.960+0000 7f598ef6c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59880c4460 con 0x7f59881656d0 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.960+0000 7f598ef6c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59881526d0 con 0x7f5988165e80 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.960+0000 7f598ef6c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59880c7060 con 0x7f59880c23f0 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.960+0000 7f598d769700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59881656d0 0x7f59880c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598d769700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59881656d0 0x7f59880c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52042/0 (socket says 172.21.15.69:52042) 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598d769700 1 -- 172.21.15.69:0/862321199 learned_addr learned my addr 172.21.15.69:0/862321199 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598df6a700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59880c23f0 0x7f5988152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598e76b700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5988165e80 0x7f59880c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598d769700 1 -- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59880c23f0 msgr2=0x7f5988152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598d769700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59880c23f0 0x7f5988152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598d769700 1 -- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5988165e80 msgr2=0x7f59880c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598d769700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5988165e80 0x7f59880c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:32:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598d769700 1 -- 172.21.15.69:0/862321199 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59780094b0 con 0x7f59881656d0 2023-11-17T06:32:59.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598e76b700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5988165e80 0x7f59880c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:32:59.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598d769700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59881656d0 0x7f59880c5090 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5978000c00 tx=0x7f5978004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:32:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f597e7fc700 1 -- 172.21.15.69:0/862321199 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978019a00 con 0x7f59881656d0 2023-11-17T06:32:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f597e7fc700 1 -- 172.21.15.69:0/862321199 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597801e070 con 0x7f59881656d0 2023-11-17T06:32:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f597e7fc700 1 -- 172.21.15.69:0/862321199 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978019da0 con 0x7f59881656d0 2023-11-17T06:32:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598ef6c700 1 -- 172.21.15.69:0/862321199 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59880c33c0 con 0x7f59881656d0 2023-11-17T06:32:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598ef6c700 1 -- 172.21.15.69:0/862321199 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59880c3980 con 0x7f59881656d0 2023-11-17T06:32:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.964+0000 7f598ef6c700 1 -- 172.21.15.69:0/862321199 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598804e650 con 0x7f59881656d0 2023-11-17T06:32:59.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.968+0000 7f597e7fc700 1 -- 172.21.15.69:0/862321199 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f597802d450 con 0x7f59881656d0 2023-11-17T06:32:59.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.968+0000 7f597e7fc700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f596c066510 0x7f596c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:32:59.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.968+0000 7f597e7fc700 1 -- 172.21.15.69:0/862321199 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5978084eb0 con 0x7f59881656d0 2023-11-17T06:32:59.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.968+0000 7f598df6a700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f596c066510 0x7f596c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:32:59.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.968+0000 7f598df6a700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f596c066510 0x7f596c0689d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5984007fd0 tx=0x7f5984009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:32:59.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:32:59.976+0000 7f597e7fc700 1 -- 172.21.15.69:0/862321199 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5978052340 con 0x7f59881656d0 2023-11-17T06:33:00.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.192+0000 7f598ef6c700 1 -- 172.21.15.69:0/862321199 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59880cafe0 con 0x7f59881656d0 2023-11-17T06:33:00.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.192+0000 7f597e7fc700 1 -- 172.21.15.69:0/862321199 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f5978006ce0 con 0x7f59881656d0 2023-11-17T06:33:00.198 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:00.198 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5202,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1050522275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1050522275},{"type":"v1","addr":"172.21.15.69:6835","nonce":1050522275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:31:28.746851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.93:6837/4181304583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":4181304583},{"type":"v1","addr":"172.21.15.93:6837","nonce":4181304583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:00.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 -- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f596c066510 msgr2=0x7f596c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f596c066510 0x7f596c0689d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5984007fd0 tx=0x7f5984009040 comp rx=0 tx=0).stop 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 -- 172.21.15.69:0/862321199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59881656d0 msgr2=0x7f59880c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59881656d0 0x7f59880c5090 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5978000c00 tx=0x7f5978004770 comp rx=0 tx=0).stop 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 -- 172.21.15.69:0/862321199 shutdown_connections 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f596c066510 0x7f596c0689d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5988165e80 0x7f59880c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f59881656d0 0x7f59880c5090 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 --2- 172.21.15.69:0/862321199 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f59880c23f0 0x7f5988152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 -- 172.21.15.69:0/862321199 >> 172.21.15.69:0/862321199 conn(0x7f59880cece0 msgr2=0x7f598815faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 -- 172.21.15.69:0/862321199 shutdown_connections 2023-11-17T06:33:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.196+0000 7f598ef6c700 1 -- 172.21.15.69:0/862321199 wait complete. 2023-11-17T06:33:00.203 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 15 2023-11-17T06:33:00.222 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:00.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.388+0000 7f8b227bc700 1 Processor -- start 2023-11-17T06:33:00.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.392+0000 7f8b227bc700 1 -- start start 2023-11-17T06:33:00.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.392+0000 7f8b227bc700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f8b1c0b4bd0 0x7f8b1c0d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.392+0000 7f8b227bc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8b1c0b4fb0 0x7f8b1c0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.392+0000 7f8b227bc700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b1c0d1890 con 0x7f8b1c15d6e0 2023-11-17T06:33:00.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.392+0000 7f8b227bc700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c0d1b70 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.392+0000 7f8b227bc700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b1c0d1e50 con 0x7f8b1c0b4bd0 2023-11-17T06:33:00.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b20fb9700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8b1c15d6e0 0x7f8b1c0d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:51220/0 (socket says 172.21.15.69:51220) 2023-11-17T06:33:00.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b20fb9700 1 -- 172.21.15.69:0/1664165116 learned_addr learned my addr 172.21.15.69:0/1664165116 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:00.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b217ba700 1 --2- 172.21.15.69:0/1664165116 >> v2:172.21.15.93:3300/0 conn(0x7f8b1c0b4bd0 0x7f8b1c0d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b21fbb700 1 --2- 172.21.15.69:0/1664165116 >> v2:172.21.15.69:3300/0 conn(0x7f8b1c0b4fb0 0x7f8b1c0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b217ba700 1 -- 172.21.15.69:0/1664165116 >> v2:172.21.15.69:3300/0 conn(0x7f8b1c0b4fb0 msgr2=0x7f8b1c0b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:00.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b217ba700 1 --2- 172.21.15.69:0/1664165116 >> v2:172.21.15.69:3300/0 conn(0x7f8b1c0b4fb0 0x7f8b1c0b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b217ba700 1 -- 172.21.15.69:0/1664165116 >> v1:172.21.15.69:6789/0 conn(0x7f8b1c15d6e0 legacy=0x7f8b1c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b217ba700 1 -- 172.21.15.69:0/1664165116 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1c0d2130 con 0x7f8b1c0b4bd0 2023-11-17T06:33:00.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b13fff700 1 -- 172.21.15.69:0/1664165116 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2157844282 0 0) 0x7f8b1c0d1890 con 0x7f8b1c15d6e0 2023-11-17T06:33:00.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b217ba700 1 --2- 172.21.15.69:0/1664165116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b1c0b4bd0 0x7f8b1c0d1200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c067780 tx=0x7f8b18009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6674bc1759ffd4fc server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:00.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b13fff700 1 -- 172.21.15.69:0/1664165116 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011830 con 0x7f8b1c0b4bd0 2023-11-17T06:33:00.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b13fff700 1 -- 172.21.15.69:0/1664165116 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b18011990 con 0x7f8b1c0b4bd0 2023-11-17T06:33:00.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b13fff700 1 -- 172.21.15.69:0/1664165116 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b18011d40 con 0x7f8b1c0b4bd0 2023-11-17T06:33:00.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b227bc700 1 -- 172.21.15.69:0/1664165116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b1c0b4bd0 msgr2=0x7f8b1c0d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b227bc700 1 --2- 172.21.15.69:0/1664165116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b1c0b4bd0 0x7f8b1c0d1200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c067780 tx=0x7f8b18009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:00.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b227bc700 1 -- 172.21.15.69:0/1664165116 shutdown_connections 2023-11-17T06:33:00.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b227bc700 1 --2- 172.21.15.69:0/1664165116 >> v2:172.21.15.69:3300/0 conn(0x7f8b1c0b4fb0 0x7f8b1c0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b227bc700 1 --2- 172.21.15.69:0/1664165116 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b1c0b4bd0 0x7f8b1c0d1200 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b227bc700 1 -- 172.21.15.69:0/1664165116 >> 172.21.15.69:0/1664165116 conn(0x7f8b1c0d3150 msgr2=0x7f8b1c0d3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:00.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b227bc700 1 -- 172.21.15.69:0/1664165116 shutdown_connections 2023-11-17T06:33:00.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.396+0000 7f8b227bc700 1 -- 172.21.15.69:0/1664165116 wait complete. 2023-11-17T06:33:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b227bc700 1 Processor -- start 2023-11-17T06:33:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b227bc700 1 -- start start 2023-11-17T06:33:00.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b227bc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8b1c0b4bd0 0x7f8b1c160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b227bc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b1c0b4fb0 0x7f8b1c1f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b227bc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b1c15d6e0 0x7f8b1c1f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b227bc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c1e7390 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b227bc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c1e64d0 con 0x7f8b1c15d6e0 2023-11-17T06:33:00.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b227bc700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c160950 con 0x7f8b1c0b4bd0 2023-11-17T06:33:00.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b20fb9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b1c0b4fb0 0x7f8b1c1f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b20fb9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b1c0b4fb0 0x7f8b1c1f1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52070/0 (socket says 172.21.15.69:52070) 2023-11-17T06:33:00.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b20fb9700 1 -- 172.21.15.69:0/225188622 learned_addr learned my addr 172.21.15.69:0/225188622 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:00.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b217ba700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8b1c0b4bd0 0x7f8b1c160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b21fbb700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b1c15d6e0 0x7f8b1c1f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b20fb9700 1 -- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8b1c0b4bd0 msgr2=0x7f8b1c160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b20fb9700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8b1c0b4bd0 0x7f8b1c160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b20fb9700 1 -- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b1c15d6e0 msgr2=0x7f8b1c1f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b20fb9700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b1c15d6e0 0x7f8b1c1f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.400+0000 7f8b20fb9700 1 -- 172.21.15.69:0/225188622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b180094b0 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.404+0000 7f8b20fb9700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b1c0b4fb0 0x7f8b1c1f1f00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00c4e0 tx=0x7f8b0c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:00.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.404+0000 7f8b11ffb700 1 -- 172.21.15.69:0/225188622 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c004ca0 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.404+0000 7f8b227bc700 1 -- 172.21.15.69:0/225188622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c1e6710 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.404+0000 7f8b11ffb700 1 -- 172.21.15.69:0/225188622 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0c004e20 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.404+0000 7f8b11ffb700 1 -- 172.21.15.69:0/225188622 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c007310 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.404+0000 7f8b227bc700 1 -- 172.21.15.69:0/225188622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c1e6cd0 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.404+0000 7f8b227bc700 1 -- 172.21.15.69:0/225188622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c04e650 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.408+0000 7f8b11ffb700 1 -- 172.21.15.69:0/225188622 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8b0c007470 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.408+0000 7f8b11ffb700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8b00066510 0x7f8b000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:00.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.408+0000 7f8b11ffb700 1 -- 172.21.15.69:0/225188622 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8b0c083bf0 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.408+0000 7f8b217ba700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8b00066510 0x7f8b000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:00.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.408+0000 7f8b217ba700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8b00066510 0x7f8b000689d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b180090b0 tx=0x7f8b18008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:00.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.412+0000 7f8b11ffb700 1 -- 172.21.15.69:0/225188622 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8b0c050ed0 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.624+0000 7f8b227bc700 1 -- 172.21.15.69:0/225188622 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b1c15ce90 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.624+0000 7f8b11ffb700 1 -- 172.21.15.69:0/225188622 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f8b0c007720 con 0x7f8b1c0b4fb0 2023-11-17T06:33:00.630 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:00.630 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5202,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1050522275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1050522275},{"type":"v1","addr":"172.21.15.69:6835","nonce":1050522275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:31:28.746851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5260":{"gid":5260,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.93:6837/4181304583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":4181304583},{"type":"v1","addr":"172.21.15.93:6837","nonce":4181304583}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:00.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 -- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8b00066510 msgr2=0x7f8b000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8b00066510 0x7f8b000689d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8b180090b0 tx=0x7f8b18008030 comp rx=0 tx=0).stop 2023-11-17T06:33:00.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 -- 172.21.15.69:0/225188622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b1c0b4fb0 msgr2=0x7f8b1c1f1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:00.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b1c0b4fb0 0x7f8b1c1f1f00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00c4e0 tx=0x7f8b0c00c7f0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 -- 172.21.15.69:0/225188622 shutdown_connections 2023-11-17T06:33:00.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8b00066510 0x7f8b000689d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8b1c15d6e0 0x7f8b1c1f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8b1c0b4fb0 0x7f8b1c1f1f00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 --2- 172.21.15.69:0/225188622 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8b1c0b4bd0 0x7f8b1c160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:00.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 -- 172.21.15.69:0/225188622 >> 172.21.15.69:0/225188622 conn(0x7f8b1c0d3150 msgr2=0x7f8b1c0cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:00.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 -- 172.21.15.69:0/225188622 shutdown_connections 2023-11-17T06:33:00.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:00.628+0000 7f8b227bc700 1 -- 172.21.15.69:0/225188622 wait complete. 2023-11-17T06:33:00.635 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 15 2023-11-17T06:33:00.654 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json dirfrag split /subdir 0/0 1 2023-11-17T06:33:00.840 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-11-17T06:33:00.841 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:33:00.841 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:00.859 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:01.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.076+0000 7f8d29363700 1 Processor -- start 2023-11-17T06:33:01.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.076+0000 7f8d29363700 1 -- start start 2023-11-17T06:33:01.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.076+0000 7f8d29363700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d240ce8f0 0x7f8d240d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.076+0000 7f8d29363700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8d241614d0 0x7f8d24161930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.076+0000 7f8d29363700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d240d21a0 con 0x7f8d2415d870 2023-11-17T06:33:01.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.076+0000 7f8d29363700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2415dc50 con 0x7f8d241614d0 2023-11-17T06:33:01.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.076+0000 7f8d29363700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d240d1870 con 0x7f8d240ce8f0 2023-11-17T06:33:01.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d1bfff700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d240ce8f0 0x7f8d240d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.076+0000 7f8d237fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8d241614d0 0x7f8d24161930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d22ffd700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8d2415d870 0x7f8d240ce1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:41600/0 (socket says 172.21.15.69:41600) 2023-11-17T06:33:01.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d22ffd700 1 -- 172.21.15.69:0/662400312 learned_addr learned my addr 172.21.15.69:0/662400312 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:01.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d1bfff700 1 -- 172.21.15.69:0/662400312 >> v2:172.21.15.69:3300/0 conn(0x7f8d241614d0 msgr2=0x7f8d24161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:01.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d1bfff700 1 --2- 172.21.15.69:0/662400312 >> v2:172.21.15.69:3300/0 conn(0x7f8d241614d0 0x7f8d24161930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d1bfff700 1 -- 172.21.15.69:0/662400312 >> v1:172.21.15.93:6789/0 conn(0x7f8d2415d870 legacy=0x7f8d240ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d1bfff700 1 -- 172.21.15.69:0/662400312 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d240d1b50 con 0x7f8d240ce8f0 2023-11-17T06:33:01.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d1bfff700 1 --2- 172.21.15.69:0/662400312 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d240ce8f0 0x7f8d240d2630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009850 tx=0x7f8d0c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3ce80c5a59a15cf server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d227fc700 1 -- 172.21.15.69:0/662400312 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c011830 con 0x7f8d240ce8f0 2023-11-17T06:33:01.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d227fc700 1 -- 172.21.15.69:0/662400312 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c011990 con 0x7f8d240ce8f0 2023-11-17T06:33:01.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d227fc700 1 -- 172.21.15.69:0/662400312 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c011d40 con 0x7f8d240ce8f0 2023-11-17T06:33:01.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d29363700 1 -- 172.21.15.69:0/662400312 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d240ce8f0 msgr2=0x7f8d240d2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d29363700 1 --2- 172.21.15.69:0/662400312 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d240ce8f0 0x7f8d240d2630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c009850 tx=0x7f8d0c009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:01.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d29363700 1 -- 172.21.15.69:0/662400312 shutdown_connections 2023-11-17T06:33:01.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d29363700 1 --2- 172.21.15.69:0/662400312 >> v2:172.21.15.69:3300/0 conn(0x7f8d241614d0 0x7f8d24161930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d29363700 1 --2- 172.21.15.69:0/662400312 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d240ce8f0 0x7f8d240d2630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d29363700 1 -- 172.21.15.69:0/662400312 >> 172.21.15.69:0/662400312 conn(0x7f8d240d3250 msgr2=0x7f8d240d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:01.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d29363700 1 -- 172.21.15.69:0/662400312 shutdown_connections 2023-11-17T06:33:01.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.080+0000 7f8d29363700 1 -- 172.21.15.69:0/662400312 wait complete. 2023-11-17T06:33:01.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.084+0000 7f8d29363700 1 Processor -- start 2023-11-17T06:33:01.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.084+0000 7f8d29363700 1 -- start start 2023-11-17T06:33:01.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d29363700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d240ce8f0 0x7f8d2415dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d29363700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d2415d870 0x7f8d241f6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d29363700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d241614d0 0x7f8d241f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d29363700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d240c82e0 con 0x7f8d240ce8f0 2023-11-17T06:33:01.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d29363700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d240c85c0 con 0x7f8d241614d0 2023-11-17T06:33:01.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d29363700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24160640 con 0x7f8d2415d870 2023-11-17T06:33:01.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d22ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d240ce8f0 0x7f8d2415dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d22ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d240ce8f0 0x7f8d2415dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52078/0 (socket says 172.21.15.69:52078) 2023-11-17T06:33:01.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d22ffd700 1 -- 172.21.15.69:0/4040733759 learned_addr learned my addr 172.21.15.69:0/4040733759 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:01.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d1bfff700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d2415d870 0x7f8d241f6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d237fe700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d241614d0 0x7f8d241f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d22ffd700 1 -- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d2415d870 msgr2=0x7f8d241f6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d22ffd700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d2415d870 0x7f8d241f6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d22ffd700 1 -- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d241614d0 msgr2=0x7f8d241f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d22ffd700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d241614d0 0x7f8d241f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d22ffd700 1 -- 172.21.15.69:0/4040733759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0094b0 con 0x7f8d240ce8f0 2023-11-17T06:33:01.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d1bfff700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d2415d870 0x7f8d241f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:01.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d22ffd700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d240ce8f0 0x7f8d2415dd90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400c730 tx=0x7f8d1400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d1b7fe700 1 -- 172.21.15.69:0/4040733759 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14005d90 con 0x7f8d240ce8f0 2023-11-17T06:33:01.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d1b7fe700 1 -- 172.21.15.69:0/4040733759 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d140070d0 con 0x7f8d240ce8f0 2023-11-17T06:33:01.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d29363700 1 -- 172.21.15.69:0/4040733759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d24160920 con 0x7f8d240ce8f0 2023-11-17T06:33:01.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d1b7fe700 1 -- 172.21.15.69:0/4040733759 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14007440 con 0x7f8d240ce8f0 2023-11-17T06:33:01.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.088+0000 7f8d29363700 1 -- 172.21.15.69:0/4040733759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d241f3e10 con 0x7f8d240ce8f0 2023-11-17T06:33:01.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.092+0000 7f8d29363700 1 -- 172.21.15.69:0/4040733759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2404e650 con 0x7f8d240ce8f0 2023-11-17T06:33:01.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.092+0000 7f8d1b7fe700 1 -- 172.21.15.69:0/4040733759 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d140075a0 con 0x7f8d240ce8f0 2023-11-17T06:33:01.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.092+0000 7f8d1b7fe700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d04066540 0x7f8d04068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.092+0000 7f8d1b7fe700 1 -- 172.21.15.69:0/4040733759 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8d14083260 con 0x7f8d240ce8f0 2023-11-17T06:33:01.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.092+0000 7f8d1bfff700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d04066540 0x7f8d04068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.096+0000 7f8d1bfff700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d04066540 0x7f8d04068a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0090b0 tx=0x7f8d0c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.100+0000 7f8d1b7fe700 1 -- 172.21.15.69:0/4040733759 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d140507a0 con 0x7f8d240ce8f0 2023-11-17T06:33:01.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.284+0000 7f8d29363700 1 -- 172.21.15.69:0/4040733759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d240cd540 con 0x7f8d240ce8f0 2023-11-17T06:33:01.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.288+0000 7f8d1b7fe700 1 -- 172.21.15.69:0/4040733759 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16674 (secure 0 0 0) 0x7f8d14053dc0 con 0x7f8d240ce8f0 2023-11-17T06:33:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:01.292 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":39,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:31:41.091351+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:01.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 -- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d04066540 msgr2=0x7f8d04068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d04066540 0x7f8d04068a00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0090b0 tx=0x7f8d0c008030 comp rx=0 tx=0).stop 2023-11-17T06:33:01.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 -- 172.21.15.69:0/4040733759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d240ce8f0 msgr2=0x7f8d2415dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d240ce8f0 0x7f8d2415dd90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400c730 tx=0x7f8d1400caf0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 -- 172.21.15.69:0/4040733759 shutdown_connections 2023-11-17T06:33:01.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d04066540 0x7f8d04068a00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d241614d0 0x7f8d241f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d2415d870 0x7f8d241f6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 --2- 172.21.15.69:0/4040733759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d240ce8f0 0x7f8d2415dd90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 -- 172.21.15.69:0/4040733759 >> 172.21.15.69:0/4040733759 conn(0x7f8d240d3250 msgr2=0x7f8d240ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:01.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 -- 172.21.15.69:0/4040733759 shutdown_connections 2023-11-17T06:33:01.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.292+0000 7f8d29363700 1 -- 172.21.15.69:0/4040733759 wait complete. 2023-11-17T06:33:01.320 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:23.624321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:24.717590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:33:01.321 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:33:01.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.492+0000 7f9716f67700 1 Processor -- start 2023-11-17T06:33:01.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.492+0000 7f9716f67700 1 -- start start 2023-11-17T06:33:01.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f9716f67700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f97100cd5a0 0x7f97100cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f9716f67700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f97100c9530 0x7f9710161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f9716f67700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f971006dc80 con 0x7f97100ccab0 2023-11-17T06:33:01.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f9716f67700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97100cb1e0 con 0x7f97100cd5a0 2023-11-17T06:33:01.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f9716f67700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971006d9a0 con 0x7f97100c9530 2023-11-17T06:33:01.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f9714d03700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f97100ccab0 0x7f97100cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:51236/0 (socket says 172.21.15.69:51236) 2023-11-17T06:33:01.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f9714d03700 1 -- 172.21.15.69:0/2951636147 learned_addr learned my addr 172.21.15.69:0/2951636147 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:01.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970ffff700 1 --2- 172.21.15.69:0/2951636147 >> v2:172.21.15.93:3300/0 conn(0x7f97100cd5a0 0x7f97100cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f9715504700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f97100c9530 0x7f9710161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844021910 0 0) 0x7f971006dc80 con 0x7f97100ccab0 2023-11-17T06:33:01.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97000035d0 con 0x7f97100ccab0 2023-11-17T06:33:01.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 693924991 0 0) 0x7f97000035d0 con 0x7f97100ccab0 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f97100c9530 msgr2=0x7f9710161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f97100c9530 0x7f9710161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 >> v2:172.21.15.93:3300/0 conn(0x7f97100cd5a0 msgr2=0x7f97100cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 --2- 172.21.15.69:0/2951636147 >> v2:172.21.15.93:3300/0 conn(0x7f97100cd5a0 0x7f97100cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971015e7a0 con 0x7f97100ccab0 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f9704001670 con 0x7f97100ccab0 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 >> v1:172.21.15.69:6789/0 conn(0x7f97100ccab0 legacy=0x7f97100cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9700003a20 0x7f9700003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9700004870 0x7f9700004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f97100c9530 0x7f9700005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97100cb1e0 con 0x7f9700003a20 2023-11-17T06:33:01.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971006d9a0 con 0x7f9700004870 2023-11-17T06:33:01.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970000ba80 con 0x7f97100c9530 2023-11-17T06:33:01.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.496+0000 7f9714d03700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9700003a20 0x7f9700003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9715504700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f97100c9530 0x7f9700005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f970ffff700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9700004870 0x7f9700004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9714d03700 1 -- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f97100c9530 msgr2=0x7f9700005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:01.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9714d03700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f97100c9530 0x7f9700005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9714d03700 1 -- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9700004870 msgr2=0x7f9700004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9714d03700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9700004870 0x7f9700004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9714d03700 1 -- 172.21.15.69:0/2951636147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97000035d0 con 0x7f9700003a20 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9715504700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f97100c9530 0x7f9700005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f970ffff700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9700004870 0x7f9700004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9714d03700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9700003a20 0x7f9700003e40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f970400c270 tx=0x7f97000058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69f05e581fc40259 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704007b90 con 0x7f9700003a20 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f970400cdb0 con 0x7f9700003a20 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f970f7fe700 1 -- 172.21.15.69:0/2951636147 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9704005bc0 con 0x7f9700003a20 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9716f67700 1 -- 172.21.15.69:0/2951636147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9700003a20 msgr2=0x7f9700003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9716f67700 1 --2- 172.21.15.69:0/2951636147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9700003a20 0x7f9700003e40 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f970400c270 tx=0x7f97000058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9715504700 1 -- 172.21.15.69:0/2951636147 reap_dead start 2023-11-17T06:33:01.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9716f67700 1 -- 172.21.15.69:0/2951636147 shutdown_connections 2023-11-17T06:33:01.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9716f67700 1 -- 172.21.15.69:0/2951636147 >> 172.21.15.69:0/2951636147 conn(0x7f97100ceee0 msgr2=0x7f97100cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:01.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9716f67700 1 -- 172.21.15.69:0/2951636147 shutdown_connections 2023-11-17T06:33:01.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.500+0000 7f9716f67700 1 -- 172.21.15.69:0/2951636147 wait complete. 2023-11-17T06:33:01.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9716f67700 1 Processor -- start 2023-11-17T06:33:01.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9716f67700 1 -- start start 2023-11-17T06:33:01.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9716f67700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9700003a20 0x7f97100c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9716f67700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9710155230 0x7f97100c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9716f67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97101556b0 0x7f97100c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9716f67700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97100c6980 con 0x7f97101556b0 2023-11-17T06:33:01.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9716f67700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97100c7890 con 0x7f9700003a20 2023-11-17T06:33:01.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9716f67700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97100c6050 con 0x7f9710155230 2023-11-17T06:33:01.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9715504700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97101556b0 0x7f97100c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9715504700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97101556b0 0x7f97100c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52096/0 (socket says 172.21.15.69:52096) 2023-11-17T06:33:01.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9715504700 1 -- 172.21.15.69:0/1914655301 learned_addr learned my addr 172.21.15.69:0/1914655301 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:01.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9714d03700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9700003a20 0x7f97100c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f970ffff700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9710155230 0x7f97100c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9715504700 1 -- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9710155230 msgr2=0x7f97100c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9715504700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9710155230 0x7f97100c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9715504700 1 -- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9700003a20 msgr2=0x7f97100c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9715504700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9700003a20 0x7f97100c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9715504700 1 -- 172.21.15.69:0/1914655301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97100c6330 con 0x7f97101556b0 2023-11-17T06:33:01.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.504+0000 7f9715504700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97101556b0 0x7f97100c7350 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9710072810 tx=0x7f970800f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.508+0000 7f970d7fa700 1 -- 172.21.15.69:0/1914655301 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f970800fca0 con 0x7f97101556b0 2023-11-17T06:33:01.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.508+0000 7f970d7fa700 1 -- 172.21.15.69:0/1914655301 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9708011040 con 0x7f97101556b0 2023-11-17T06:33:01.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.508+0000 7f970d7fa700 1 -- 172.21.15.69:0/1914655301 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708017400 con 0x7f97101556b0 2023-11-17T06:33:01.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.508+0000 7f9716f67700 1 -- 172.21.15.69:0/1914655301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97100c6610 con 0x7f97101556b0 2023-11-17T06:33:01.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.508+0000 7f9716f67700 1 -- 172.21.15.69:0/1914655301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97100c7c70 con 0x7f97101556b0 2023-11-17T06:33:01.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.508+0000 7f9716f67700 1 -- 172.21.15.69:0/1914655301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97100c6b30 con 0x7f97101556b0 2023-11-17T06:33:01.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.508+0000 7f970d7fa700 1 -- 172.21.15.69:0/1914655301 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f97080203b0 con 0x7f97101556b0 2023-11-17T06:33:01.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.512+0000 7f970d7fa700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96f4066510 0x7f96f40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.512+0000 7f970d7fa700 1 -- 172.21.15.69:0/1914655301 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9708083e00 con 0x7f97101556b0 2023-11-17T06:33:01.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.512+0000 7f9714d03700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96f4066510 0x7f96f40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.512+0000 7f9714d03700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96f4066510 0x7f96f40689d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f970400c270 tx=0x7f970400a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.516+0000 7f970d7fa700 1 -- 172.21.15.69:0/1914655301 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f97100c6b30 con 0x7f97101556b0 2023-11-17T06:33:01.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.692+0000 7f9716f67700 1 -- 172.21.15.69:0/1914655301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97100c67a0 con 0x7f97101556b0 2023-11-17T06:33:01.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.692+0000 7f970d7fa700 1 -- 172.21.15.69:0/1914655301 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9708051200 con 0x7f97101556b0 2023-11-17T06:33:01.698 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:33:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 -- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96f4066510 msgr2=0x7f96f40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96f4066510 0x7f96f40689d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f970400c270 tx=0x7f970400a000 comp rx=0 tx=0).stop 2023-11-17T06:33:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 -- 172.21.15.69:0/1914655301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97101556b0 msgr2=0x7f97100c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97101556b0 0x7f97100c7350 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9710072810 tx=0x7f970800f3b0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 -- 172.21.15.69:0/1914655301 shutdown_connections 2023-11-17T06:33:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f96f4066510 0x7f96f40689d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97101556b0 0x7f97100c7350 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9710155230 0x7f97100c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 --2- 172.21.15.69:0/1914655301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9700003a20 0x7f97100c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 -- 172.21.15.69:0/1914655301 >> 172.21.15.69:0/1914655301 conn(0x7f97100ceee0 msgr2=0x7f971015d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 -- 172.21.15.69:0/1914655301 shutdown_connections 2023-11-17T06:33:01.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.696+0000 7f9716f67700 1 -- 172.21.15.69:0/1914655301 wait complete. 2023-11-17T06:33:01.725 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:33:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.892+0000 7f77c0f4a700 1 Processor -- start 2023-11-17T06:33:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.892+0000 7f77c0f4a700 1 -- start start 2023-11-17T06:33:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77c0f4a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f77bc1617a0 0x7f77bc0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77c0f4a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f77bc0cdc30 0x7f77bc06fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77c0f4a700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77bc0ce070 con 0x7f77bc070330 2023-11-17T06:33:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77c0f4a700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77bc0707c0 con 0x7f77bc1617a0 2023-11-17T06:33:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77c0f4a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0c95b0 con 0x7f77bc0cdc30 2023-11-17T06:33:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77bb7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f77bc1617a0 0x7f77bc0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77bb7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f77bc1617a0 0x7f77bc0cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52100/0 (socket says 172.21.15.69:52100) 2023-11-17T06:33:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77bb7fe700 1 -- 172.21.15.69:0/3482883989 learned_addr learned my addr 172.21.15.69:0/3482883989 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77baffd700 1 --2- 172.21.15.69:0/3482883989 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f77bc0cdc30 0x7f77bc06fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77bb7fe700 1 -- 172.21.15.69:0/3482883989 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f77bc0cdc30 msgr2=0x7f77bc06fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77bb7fe700 1 --2- 172.21.15.69:0/3482883989 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f77bc0cdc30 0x7f77bc06fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77bb7fe700 1 -- 172.21.15.69:0/3482883989 >> v1:172.21.15.93:6789/0 conn(0x7f77bc070330 legacy=0x7f77bc165460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77bb7fe700 1 -- 172.21.15.69:0/3482883989 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc0cb660 con 0x7f77bc1617a0 2023-11-17T06:33:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.896+0000 7f77bb7fe700 1 --2- 172.21.15.69:0/3482883989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc1617a0 0x7f77bc0cd6f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009910 tx=0x7f77ac009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e7e53e6d5ce4d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77ba7fc700 1 -- 172.21.15.69:0/3482883989 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac011830 con 0x7f77bc1617a0 2023-11-17T06:33:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77ba7fc700 1 -- 172.21.15.69:0/3482883989 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac011990 con 0x7f77bc1617a0 2023-11-17T06:33:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77ba7fc700 1 -- 172.21.15.69:0/3482883989 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac011d40 con 0x7f77bc1617a0 2023-11-17T06:33:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3482883989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc1617a0 msgr2=0x7f77bc0cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77c0f4a700 1 --2- 172.21.15.69:0/3482883989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc1617a0 0x7f77bc0cd6f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009910 tx=0x7f77ac009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3482883989 shutdown_connections 2023-11-17T06:33:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77c0f4a700 1 --2- 172.21.15.69:0/3482883989 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f77bc0cdc30 0x7f77bc06fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77c0f4a700 1 --2- 172.21.15.69:0/3482883989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc1617a0 0x7f77bc0cd6f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3482883989 >> 172.21.15.69:0/3482883989 conn(0x7f77bc0cedc0 msgr2=0x7f77bc0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3482883989 shutdown_connections 2023-11-17T06:33:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.900+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3482883989 wait complete. 2023-11-17T06:33:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77c0f4a700 1 Processor -- start 2023-11-17T06:33:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77c0f4a700 1 -- start start 2023-11-17T06:33:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77c0f4a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f77bc070330 0x7f77bc0c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77c0f4a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc0cdc30 0x7f77bc0b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77c0f4a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77bc1617a0 0x7f77bc14d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77c0f4a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0b45e0 con 0x7f77bc0cdc30 2023-11-17T06:33:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77c0f4a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc14d880 con 0x7f77bc1617a0 2023-11-17T06:33:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77c0f4a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0c2f60 con 0x7f77bc070330 2023-11-17T06:33:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77baffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc0cdc30 0x7f77bc0b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77baffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc0cdc30 0x7f77bc0b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52104/0 (socket says 172.21.15.69:52104) 2023-11-17T06:33:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77baffd700 1 -- 172.21.15.69:0/3407159777 learned_addr learned my addr 172.21.15.69:0/3407159777 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:01.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77baffd700 1 -- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f77bc070330 msgr2=0x7f77bc0c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77baffd700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f77bc070330 0x7f77bc0c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77baffd700 1 -- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77bc1617a0 msgr2=0x7f77bc14d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77baffd700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77bc1617a0 0x7f77bc14d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77baffd700 1 -- 172.21.15.69:0/3407159777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac009570 con 0x7f77bc0cdc30 2023-11-17T06:33:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.904+0000 7f77baffd700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc0cdc30 0x7f77bc0b40a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f77b000e9d0 tx=0x7f77b000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.908+0000 7f77a3fff700 1 -- 172.21.15.69:0/3407159777 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b0009720 con 0x7f77bc0cdc30 2023-11-17T06:33:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.908+0000 7f77a3fff700 1 -- 172.21.15.69:0/3407159777 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b000c850 con 0x7f77bc0cdc30 2023-11-17T06:33:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.908+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3407159777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77bc0c3240 con 0x7f77bc0cdc30 2023-11-17T06:33:01.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.908+0000 7f77a3fff700 1 -- 172.21.15.69:0/3407159777 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b000cbc0 con 0x7f77bc0cdc30 2023-11-17T06:33:01.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.908+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3407159777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc0c3800 con 0x7f77bc0cdc30 2023-11-17T06:33:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.908+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3407159777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77bc04e650 con 0x7f77bc0cdc30 2023-11-17T06:33:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.908+0000 7f77a3fff700 1 -- 172.21.15.69:0/3407159777 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f77b000cd20 con 0x7f77bc0cdc30 2023-11-17T06:33:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.912+0000 7f77a3fff700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f77a8066510 0x7f77a80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.912+0000 7f77a3fff700 1 -- 172.21.15.69:0/3407159777 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f77b0083fe0 con 0x7f77bc0cdc30 2023-11-17T06:33:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.912+0000 7f77bb7fe700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f77a8066510 0x7f77a80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:01.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.912+0000 7f77bb7fe700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f77a8066510 0x7f77a80689d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009c60 tx=0x7f77ac010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:01.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:01.916+0000 7f77a3fff700 1 -- 172.21.15.69:0/3407159777 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f77b0051430 con 0x7f77bc0cdc30 2023-11-17T06:33:02.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.088+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3407159777 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77bc0b4d40 con 0x7f77bc0cdc30 2023-11-17T06:33:02.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77a3fff700 1 -- 172.21.15.69:0/3407159777 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77b0054a50 con 0x7f77bc0cdc30 2023-11-17T06:33:02.095 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:33:02.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f77a8066510 msgr2=0x7f77a80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f77a8066510 0x7f77a80689d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009c60 tx=0x7f77ac010000 comp rx=0 tx=0).stop 2023-11-17T06:33:02.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3407159777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc0cdc30 msgr2=0x7f77bc0b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc0cdc30 0x7f77bc0b40a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f77b000e9d0 tx=0x7f77b000ed90 comp rx=0 tx=0).stop 2023-11-17T06:33:02.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3407159777 shutdown_connections 2023-11-17T06:33:02.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f77a8066510 0x7f77a80689d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f77bc1617a0 0x7f77bc14d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77bc0cdc30 0x7f77bc0b40a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 --2- 172.21.15.69:0/3407159777 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f77bc070330 0x7f77bc0c28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3407159777 >> 172.21.15.69:0/3407159777 conn(0x7f77bc0cedc0 msgr2=0x7f77bc1607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:02.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3407159777 shutdown_connections 2023-11-17T06:33:02.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.092+0000 7f77c0f4a700 1 -- 172.21.15.69:0/3407159777 wait complete. 2023-11-17T06:33:02.118 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:33:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.296+0000 7f4d5194a700 1 Processor -- start 2023-11-17T06:33:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.296+0000 7f4d5194a700 1 -- start start 2023-11-17T06:33:02.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d4c06cc90 0x7f4d4c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4d4c0b6580 0x7f4d4c0b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d4c06d630 con 0x7f4d4c15d550 2023-11-17T06:33:02.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0cf400 con 0x7f4d4c06cc90 2023-11-17T06:33:02.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4c0d2340 con 0x7f4d4c0b6580 2023-11-17T06:33:02.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d4c06cc90 0x7f4d4c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d50948700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f4d4c15d550 0x7f4d4c0d2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:41630/0 (socket says 172.21.15.69:41630) 2023-11-17T06:33:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d50948700 1 -- 172.21.15.69:0/4016922071 learned_addr learned my addr 172.21.15.69:0/4016922071 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d51149700 1 --2- 172.21.15.69:0/4016922071 >> v2:172.21.15.93:3300/0 conn(0x7f4d4c0b6580 0x7f4d4c0b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4b7fe700 1 -- 172.21.15.69:0/4016922071 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920125704 0 0) 0x7f4d4c06d630 con 0x7f4d4c15d550 2023-11-17T06:33:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4b7fe700 1 -- 172.21.15.69:0/4016922071 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d3c0035d0 con 0x7f4d4c15d550 2023-11-17T06:33:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4bfff700 1 -- 172.21.15.69:0/4016922071 >> v2:172.21.15.93:3300/0 conn(0x7f4d4c0b6580 msgr2=0x7f4d4c0b69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4bfff700 1 --2- 172.21.15.69:0/4016922071 >> v2:172.21.15.93:3300/0 conn(0x7f4d4c0b6580 0x7f4d4c0b69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4bfff700 1 -- 172.21.15.69:0/4016922071 >> v1:172.21.15.93:6789/0 conn(0x7f4d4c15d550 legacy=0x7f4d4c0d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4bfff700 1 -- 172.21.15.69:0/4016922071 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0d1730 con 0x7f4d4c06cc90 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4bfff700 1 --2- 172.21.15.69:0/4016922071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c06cc90 0x7f4d4c06d0f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c08b050 tx=0x7f4d38009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56795efb1ab144da server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4b7fe700 1 -- 172.21.15.69:0/4016922071 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38011830 con 0x7f4d4c06cc90 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4b7fe700 1 -- 172.21.15.69:0/4016922071 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d38011990 con 0x7f4d4c06cc90 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d4b7fe700 1 -- 172.21.15.69:0/4016922071 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38011d20 con 0x7f4d4c06cc90 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 -- 172.21.15.69:0/4016922071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c06cc90 msgr2=0x7f4d4c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 --2- 172.21.15.69:0/4016922071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c06cc90 0x7f4d4c06d0f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c08b050 tx=0x7f4d38009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 -- 172.21.15.69:0/4016922071 shutdown_connections 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 --2- 172.21.15.69:0/4016922071 >> v2:172.21.15.93:3300/0 conn(0x7f4d4c0b6580 0x7f4d4c0b69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 --2- 172.21.15.69:0/4016922071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c06cc90 0x7f4d4c06d0f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.300+0000 7f4d5194a700 1 -- 172.21.15.69:0/4016922071 >> 172.21.15.69:0/4016922071 conn(0x7f4d4c0b4cb0 msgr2=0x7f4d4c0b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.304+0000 7f4d5194a700 1 -- 172.21.15.69:0/4016922071 shutdown_connections 2023-11-17T06:33:02.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.304+0000 7f4d5194a700 1 -- 172.21.15.69:0/4016922071 wait complete. 2023-11-17T06:33:02.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.304+0000 7f4d5194a700 1 Processor -- start 2023-11-17T06:33:02.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.304+0000 7f4d5194a700 1 -- start start 2023-11-17T06:33:02.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d5194a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d4c06cc90 0x7f4d4c0c9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d5194a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c0b6580 0x7f4d4c1481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d5194a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d4c15d550 0x7f4d4c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d5194a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c1507f0 con 0x7f4d4c0b6580 2023-11-17T06:33:02.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d5194a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c1e5db0 con 0x7f4d4c06cc90 2023-11-17T06:33:02.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d5194a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c1e6050 con 0x7f4d4c15d550 2023-11-17T06:33:02.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c0b6580 0x7f4d4c1481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c0b6580 0x7f4d4c1481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52136/0 (socket says 172.21.15.69:52136) 2023-11-17T06:33:02.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d4bfff700 1 -- 172.21.15.69:0/3437283764 learned_addr learned my addr 172.21.15.69:0/3437283764 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:02.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d51149700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d4c15d550 0x7f4d4c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d50948700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d4c06cc90 0x7f4d4c0c9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d4bfff700 1 -- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d4c15d550 msgr2=0x7f4d4c0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d4bfff700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d4c15d550 0x7f4d4c0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d4bfff700 1 -- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d4c06cc90 msgr2=0x7f4d4c0c9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d4bfff700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d4c06cc90 0x7f4d4c0c9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d4bfff700 1 -- 172.21.15.69:0/3437283764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380094b0 con 0x7f4d4c0b6580 2023-11-17T06:33:02.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d4bfff700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c0b6580 0x7f4d4c1481f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009b70 tx=0x7f4d38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d497fa700 1 -- 172.21.15.69:0/3437283764 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38004380 con 0x7f4d4c0b6580 2023-11-17T06:33:02.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d497fa700 1 -- 172.21.15.69:0/3437283764 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3801f070 con 0x7f4d4c0b6580 2023-11-17T06:33:02.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d497fa700 1 -- 172.21.15.69:0/3437283764 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380036c0 con 0x7f4d4c0b6580 2023-11-17T06:33:02.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d5194a700 1 -- 172.21.15.69:0/3437283764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c1e6330 con 0x7f4d4c0b6580 2023-11-17T06:33:02.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d5194a700 1 -- 172.21.15.69:0/3437283764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c0c9fd0 con 0x7f4d4c0b6580 2023-11-17T06:33:02.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.308+0000 7f4d5194a700 1 -- 172.21.15.69:0/3437283764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c1e6850 con 0x7f4d4c0b6580 2023-11-17T06:33:02.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.312+0000 7f4d497fa700 1 -- 172.21.15.69:0/3437283764 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4d38021030 con 0x7f4d4c0b6580 2023-11-17T06:33:02.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.312+0000 7f4d497fa700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d30066510 0x7f4d300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.312+0000 7f4d497fa700 1 -- 172.21.15.69:0/3437283764 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4d380851f0 con 0x7f4d4c0b6580 2023-11-17T06:33:02.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.312+0000 7f4d50948700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d30066510 0x7f4d300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.312+0000 7f4d50948700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d30066510 0x7f4d300689d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4d40007fd0 tx=0x7f4d40007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.320+0000 7f4d497fa700 1 -- 172.21.15.69:0/3437283764 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d4c1e6850 con 0x7f4d4c0b6580 2023-11-17T06:33:02.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.492+0000 7f4d5194a700 1 -- 172.21.15.69:0/3437283764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d4c1e6850 con 0x7f4d4c0b6580 2023-11-17T06:33:02.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.492+0000 7f4d497fa700 1 -- 172.21.15.69:0/3437283764 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d4c1e6850 con 0x7f4d4c0b6580 2023-11-17T06:33:02.498 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 -- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d30066510 msgr2=0x7f4d300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d30066510 0x7f4d300689d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4d40007fd0 tx=0x7f4d40007de0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 -- 172.21.15.69:0/3437283764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c0b6580 msgr2=0x7f4d4c1481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c0b6580 0x7f4d4c1481f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009b70 tx=0x7f4d38004770 comp rx=0 tx=0).stop 2023-11-17T06:33:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 -- 172.21.15.69:0/3437283764 shutdown_connections 2023-11-17T06:33:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d30066510 0x7f4d300689d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d4c15d550 0x7f4d4c0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d4c0b6580 0x7f4d4c1481f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 --2- 172.21.15.69:0/3437283764 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d4c06cc90 0x7f4d4c0c9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 -- 172.21.15.69:0/3437283764 >> 172.21.15.69:0/3437283764 conn(0x7f4d4c0b4cb0 msgr2=0x7f4d4c0b6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 -- 172.21.15.69:0/3437283764 shutdown_connections 2023-11-17T06:33:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.496+0000 7f4d5194a700 1 -- 172.21.15.69:0/3437283764 wait complete. 2023-11-17T06:33:02.524 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:33:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.696+0000 7f57e0a4d700 1 Processor -- start 2023-11-17T06:33:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57e0a4d700 1 -- start start 2023-11-17T06:33:02.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57e0a4d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f57dc142000 0x7f57dc142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57e0a4d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 0x7f57dc06b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57e0a4d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc0cca30 con 0x7f57dc06bd70 2023-11-17T06:33:02.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57e0a4d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc0ccd10 con 0x7f57dc142000 2023-11-17T06:33:02.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57e0a4d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0ccff0 con 0x7f57dc06d5d0 2023-11-17T06:33:02.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57db7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f57dc142000 0x7f57dc142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57d2ffd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 0x7f57dc06b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57db7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f57dc142000 0x7f57dc142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52144/0 (socket says 172.21.15.69:52144) 2023-11-17T06:33:02.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57db7fe700 1 -- 172.21.15.69:0/2675140901 learned_addr learned my addr 172.21.15.69:0/2675140901 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:02.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57db7fe700 1 -- 172.21.15.69:0/2675140901 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 msgr2=0x7f57dc06b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:02.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57db7fe700 1 --2- 172.21.15.69:0/2675140901 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 0x7f57dc06b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57db7fe700 1 -- 172.21.15.69:0/2675140901 >> v1:172.21.15.93:6789/0 conn(0x7f57dc06bd70 legacy=0x7f57dc155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.700+0000 7f57db7fe700 1 -- 172.21.15.69:0/2675140901 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc0cd2d0 con 0x7f57dc142000 2023-11-17T06:33:02.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57db7fe700 1 --2- 172.21.15.69:0/2675140901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc142000 0x7f57dc142e10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009910 tx=0x7f57cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f904ddf4790017be server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57daffd700 1 -- 172.21.15.69:0/2675140901 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc011830 con 0x7f57dc142000 2023-11-17T06:33:02.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57daffd700 1 -- 172.21.15.69:0/2675140901 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc011990 con 0x7f57dc142000 2023-11-17T06:33:02.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57daffd700 1 -- 172.21.15.69:0/2675140901 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc011d40 con 0x7f57dc142000 2023-11-17T06:33:02.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57e0a4d700 1 -- 172.21.15.69:0/2675140901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc142000 msgr2=0x7f57dc142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57e0a4d700 1 --2- 172.21.15.69:0/2675140901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc142000 0x7f57dc142e10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009910 tx=0x7f57cc009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:02.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57e0a4d700 1 -- 172.21.15.69:0/2675140901 shutdown_connections 2023-11-17T06:33:02.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57e0a4d700 1 --2- 172.21.15.69:0/2675140901 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 0x7f57dc06b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57e0a4d700 1 --2- 172.21.15.69:0/2675140901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc142000 0x7f57dc142e10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57e0a4d700 1 -- 172.21.15.69:0/2675140901 >> 172.21.15.69:0/2675140901 conn(0x7f57dc0cedc0 msgr2=0x7f57dc0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:02.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57e0a4d700 1 -- 172.21.15.69:0/2675140901 shutdown_connections 2023-11-17T06:33:02.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.704+0000 7f57e0a4d700 1 -- 172.21.15.69:0/2675140901 wait complete. 2023-11-17T06:33:02.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57e0a4d700 1 Processor -- start 2023-11-17T06:33:02.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57e0a4d700 1 -- start start 2023-11-17T06:33:02.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57e0a4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc06bd70 0x7f57dc0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57e0a4d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 0x7f57dc0c5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57e0a4d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57dc142000 0x7f57dc0c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57e0a4d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c8e90 con 0x7f57dc06bd70 2023-11-17T06:33:02.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57e0a4d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c28f0 con 0x7f57dc142000 2023-11-17T06:33:02.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57e0a4d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0c2eb0 con 0x7f57dc06d5d0 2023-11-17T06:33:02.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57db7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc06bd70 0x7f57dc0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57db7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc06bd70 0x7f57dc0c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52154/0 (socket says 172.21.15.69:52154) 2023-11-17T06:33:02.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57db7fe700 1 -- 172.21.15.69:0/4093116386 learned_addr learned my addr 172.21.15.69:0/4093116386 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:02.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57d2ffd700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 0x7f57dc0c5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57dbfff700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57dc142000 0x7f57dc0c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57db7fe700 1 -- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 msgr2=0x7f57dc0c5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57db7fe700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 0x7f57dc0c5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57db7fe700 1 -- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57dc142000 msgr2=0x7f57dc0c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57db7fe700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57dc142000 0x7f57dc0c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57db7fe700 1 -- 172.21.15.69:0/4093116386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc009570 con 0x7f57dc06bd70 2023-11-17T06:33:02.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.708+0000 7f57d2ffd700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 0x7f57dc0c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:02.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.712+0000 7f57db7fe700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc06bd70 0x7f57dc0c7fd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f57dc067650 tx=0x7f57cc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.712+0000 7f57d8ff9700 1 -- 172.21.15.69:0/4093116386 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc004510 con 0x7f57dc06bd70 2023-11-17T06:33:02.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.712+0000 7f57d8ff9700 1 -- 172.21.15.69:0/4093116386 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc01e070 con 0x7f57dc06bd70 2023-11-17T06:33:02.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.712+0000 7f57e0a4d700 1 -- 172.21.15.69:0/4093116386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc0c88d0 con 0x7f57dc06bd70 2023-11-17T06:33:02.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.712+0000 7f57d8ff9700 1 -- 172.21.15.69:0/4093116386 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc003900 con 0x7f57dc06bd70 2023-11-17T06:33:02.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.712+0000 7f57e0a4d700 1 -- 172.21.15.69:0/4093116386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc0c2b40 con 0x7f57dc06bd70 2023-11-17T06:33:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.712+0000 7f57e0a4d700 1 -- 172.21.15.69:0/4093116386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc04e650 con 0x7f57dc06bd70 2023-11-17T06:33:02.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.712+0000 7f57d8ff9700 1 -- 172.21.15.69:0/4093116386 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f57cc003a60 con 0x7f57dc06bd70 2023-11-17T06:33:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.716+0000 7f57d8ff9700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57bc066540 0x7f57bc068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:02.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.716+0000 7f57d8ff9700 1 -- 172.21.15.69:0/4093116386 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f57cc084f50 con 0x7f57dc06bd70 2023-11-17T06:33:02.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.716+0000 7f57d2ffd700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57bc066540 0x7f57bc068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:02.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.716+0000 7f57d2ffd700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57bc066540 0x7f57bc068a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0c7380 tx=0x7f57c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:02.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.724+0000 7f57d8ff9700 1 -- 172.21.15.69:0/4093116386 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f57cc0523e0 con 0x7f57dc06bd70 2023-11-17T06:33:02.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.912+0000 7f57e0a4d700 1 -- 172.21.15.69:0/4093116386 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f57dc0cd580 con 0x7f57dc06bd70 2023-11-17T06:33:02.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.912+0000 7f57d8ff9700 1 -- 172.21.15.69:0/4093116386 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f57cc020080 con 0x7f57dc06bd70 2023-11-17T06:33:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 -- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57bc066540 msgr2=0x7f57bc068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57bc066540 0x7f57bc068a00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f57dc0c7380 tx=0x7f57c4008040 comp rx=0 tx=0).stop 2023-11-17T06:33:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 -- 172.21.15.69:0/4093116386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc06bd70 msgr2=0x7f57dc0c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:02.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc06bd70 0x7f57dc0c7fd0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f57dc067650 tx=0x7f57cc004770 comp rx=0 tx=0).stop 2023-11-17T06:33:02.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 -- 172.21.15.69:0/4093116386 shutdown_connections 2023-11-17T06:33:02.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f57bc066540 0x7f57bc068a00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f57dc142000 0x7f57dc0c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f57dc06d5d0 0x7f57dc0c5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 --2- 172.21.15.69:0/4093116386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc06bd70 0x7f57dc0c7fd0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:02.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 -- 172.21.15.69:0/4093116386 >> 172.21.15.69:0/4093116386 conn(0x7f57dc0cedc0 msgr2=0x7f57dc0ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:02.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 -- 172.21.15.69:0/4093116386 shutdown_connections 2023-11-17T06:33:02.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:02.916+0000 7f57e0a4d700 1 -- 172.21.15.69:0/4093116386 wait complete. 2023-11-17T06:33:02.923 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2023-11-17T06:33:02.945 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:33:02.946 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:02.962 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:03.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64ed597700 1 Processor -- start 2023-11-17T06:33:03.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64ed597700 1 -- start start 2023-11-17T06:33:03.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64ed597700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f64e815d620 0x7f64e80b6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64ed597700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f64e80b4bf0 0x7f64e80b5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64ed597700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e80b5540 con 0x7f64e8161340 2023-11-17T06:33:03.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64ed597700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e80ce170 con 0x7f64e815d620 2023-11-17T06:33:03.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64ed597700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e80ce360 con 0x7f64e80b4bf0 2023-11-17T06:33:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64e6ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f64e815d620 0x7f64e80b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64e6ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f64e815d620 0x7f64e80b6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52168/0 (socket says 172.21.15.69:52168) 2023-11-17T06:33:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64e6ffd700 1 -- 172.21.15.69:0/2248043700 learned_addr learned my addr 172.21.15.69:0/2248043700 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.180+0000 7f64e77fe700 1 --2- 172.21.15.69:0/2248043700 >> v2:172.21.15.93:3300/0 conn(0x7f64e80b4bf0 0x7f64e80b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64e6ffd700 1 -- 172.21.15.69:0/2248043700 >> v2:172.21.15.93:3300/0 conn(0x7f64e80b4bf0 msgr2=0x7f64e80b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:03.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64e6ffd700 1 --2- 172.21.15.69:0/2248043700 >> v2:172.21.15.93:3300/0 conn(0x7f64e80b4bf0 0x7f64e80b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64e6ffd700 1 -- 172.21.15.69:0/2248043700 >> v1:172.21.15.93:6789/0 conn(0x7f64e8161340 legacy=0x7f64e80cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64e6ffd700 1 -- 172.21.15.69:0/2248043700 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e80ce640 con 0x7f64e815d620 2023-11-17T06:33:03.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64e6ffd700 1 --2- 172.21.15.69:0/2248043700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64e815d620 0x7f64e80b6450 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f64e80cd770 tx=0x7f64d8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0f8677224d6c20 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64e5ffb700 1 -- 172.21.15.69:0/2248043700 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8011830 con 0x7f64e815d620 2023-11-17T06:33:03.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64e5ffb700 1 -- 172.21.15.69:0/2248043700 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d8011990 con 0x7f64e815d620 2023-11-17T06:33:03.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64e5ffb700 1 -- 172.21.15.69:0/2248043700 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8011d20 con 0x7f64e815d620 2023-11-17T06:33:03.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64ed597700 1 -- 172.21.15.69:0/2248043700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64e815d620 msgr2=0x7f64e80b6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64ed597700 1 --2- 172.21.15.69:0/2248043700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64e815d620 0x7f64e80b6450 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f64e80cd770 tx=0x7f64d8009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64ed597700 1 -- 172.21.15.69:0/2248043700 shutdown_connections 2023-11-17T06:33:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64ed597700 1 --2- 172.21.15.69:0/2248043700 >> v2:172.21.15.93:3300/0 conn(0x7f64e80b4bf0 0x7f64e80b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64ed597700 1 --2- 172.21.15.69:0/2248043700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64e815d620 0x7f64e80b6450 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64ed597700 1 -- 172.21.15.69:0/2248043700 >> 172.21.15.69:0/2248043700 conn(0x7f64e80cfbf0 msgr2=0x7f64e80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64ed597700 1 -- 172.21.15.69:0/2248043700 shutdown_connections 2023-11-17T06:33:03.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.184+0000 7f64ed597700 1 -- 172.21.15.69:0/2248043700 wait complete. 2023-11-17T06:33:03.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64ed597700 1 Processor -- start 2023-11-17T06:33:03.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64ed597700 1 -- start start 2023-11-17T06:33:03.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64ed597700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64e80b4bf0 0x7f64e81f2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64ed597700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64e815d620 0x7f64e80cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64ed597700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64e8161340 0x7f64e80b7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64ed597700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80cc320 con 0x7f64e8161340 2023-11-17T06:33:03.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64ed597700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80ca5b0 con 0x7f64e80b4bf0 2023-11-17T06:33:03.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64ed597700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e80ca890 con 0x7f64e815d620 2023-11-17T06:33:03.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64e77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64e8161340 0x7f64e80b7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64e67fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64e815d620 0x7f64e80cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64e6ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64e80b4bf0 0x7f64e81f2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64e67fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64e815d620 0x7f64e80cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:42774/0 (socket says 172.21.15.69:42774) 2023-11-17T06:33:03.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64e67fc700 1 -- 172.21.15.69:0/2056811229 learned_addr learned my addr 172.21.15.69:0/2056811229 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:03.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.188+0000 7f64e77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64e8161340 0x7f64e80b7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52176/0 (socket says 172.21.15.69:52176) 2023-11-17T06:33:03.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64e6ffd700 1 -- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64e815d620 msgr2=0x7f64e80cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64e6ffd700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64e815d620 0x7f64e80cbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64e6ffd700 1 -- 172.21.15.69:0/2056811229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64e8161340 msgr2=0x7f64e80b7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64e6ffd700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64e8161340 0x7f64e80b7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64e6ffd700 1 -- 172.21.15.69:0/2056811229 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8009570 con 0x7f64e80b4bf0 2023-11-17T06:33:03.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64e6ffd700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64e80b4bf0 0x7f64e81f2c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f64d8016000 tx=0x7f64d8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64cf7fe700 1 -- 172.21.15.69:0/2056811229 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8004450 con 0x7f64e80b4bf0 2023-11-17T06:33:03.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64cf7fe700 1 -- 172.21.15.69:0/2056811229 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d801f070 con 0x7f64e80b4bf0 2023-11-17T06:33:03.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64ed597700 1 -- 172.21.15.69:0/2056811229 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e80cab70 con 0x7f64e80b4bf0 2023-11-17T06:33:03.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64cf7fe700 1 -- 172.21.15.69:0/2056811229 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8003900 con 0x7f64e80b4bf0 2023-11-17T06:33:03.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64ed597700 1 -- 172.21.15.69:0/2056811229 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e80cb130 con 0x7f64e80b4bf0 2023-11-17T06:33:03.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.192+0000 7f64ed597700 1 -- 172.21.15.69:0/2056811229 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e80d13c0 con 0x7f64e80b4bf0 2023-11-17T06:33:03.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.196+0000 7f64cf7fe700 1 -- 172.21.15.69:0/2056811229 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f64d8003a60 con 0x7f64e80b4bf0 2023-11-17T06:33:03.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.196+0000 7f64cf7fe700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d4066510 0x7f64d40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.196+0000 7f64cf7fe700 1 -- 172.21.15.69:0/2056811229 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f64d8021070 con 0x7f64e80b4bf0 2023-11-17T06:33:03.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.196+0000 7f64e67fc700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d4066510 0x7f64d40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.200+0000 7f64e67fc700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d4066510 0x7f64d40689d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f64e81f6630 tx=0x7f64dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.204+0000 7f64cf7fe700 1 -- 172.21.15.69:0/2056811229 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64d8052890 con 0x7f64e80b4bf0 2023-11-17T06:33:03.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.380+0000 7f64ed597700 1 -- 172.21.15.69:0/2056811229 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64e80d13c0 con 0x7f64e80b4bf0 2023-11-17T06:33:03.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.384+0000 7f64cf7fe700 1 -- 172.21.15.69:0/2056811229 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16674 (secure 0 0 0) 0x7f64e80d13c0 con 0x7f64e80b4bf0 2023-11-17T06:33:03.390 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:03.390 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":39,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:31:41.091351+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:03.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 -- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d4066510 msgr2=0x7f64d40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d4066510 0x7f64d40689d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f64e81f6630 tx=0x7f64dc009040 comp rx=0 tx=0).stop 2023-11-17T06:33:03.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 -- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64e80b4bf0 msgr2=0x7f64e81f2c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64e80b4bf0 0x7f64e81f2c20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f64d8016000 tx=0x7f64d8004770 comp rx=0 tx=0).stop 2023-11-17T06:33:03.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 -- 172.21.15.69:0/2056811229 shutdown_connections 2023-11-17T06:33:03.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d4066510 0x7f64d40689d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64e8161340 0x7f64e80b7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64e815d620 0x7f64e80cbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 --2- 172.21.15.69:0/2056811229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64e80b4bf0 0x7f64e81f2c20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 -- 172.21.15.69:0/2056811229 >> 172.21.15.69:0/2056811229 conn(0x7f64e80cfbf0 msgr2=0x7f64e80b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:03.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 -- 172.21.15.69:0/2056811229 shutdown_connections 2023-11-17T06:33:03.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.388+0000 7f64ed597700 1 -- 172.21.15.69:0/2056811229 wait complete. 2023-11-17T06:33:03.414 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:23.624321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:24.717590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:33:03.415 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:33:03.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.580+0000 7f54cf214700 1 Processor -- start 2023-11-17T06:33:03.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.580+0000 7f54cf214700 1 -- start start 2023-11-17T06:33:03.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cf214700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f54c8142000 0x7f54c8142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cf214700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f54c806d5d0 0x7f54c806b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cf214700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c80cca30 con 0x7f54c806bd70 2023-11-17T06:33:03.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cf214700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c80ccd10 con 0x7f54c806d5d0 2023-11-17T06:33:03.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cf214700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c80ccff0 con 0x7f54c8142000 2023-11-17T06:33:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cda11700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f54c806d5d0 0x7f54c806b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cda11700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f54c806d5d0 0x7f54c806b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52188/0 (socket says 172.21.15.69:52188) 2023-11-17T06:33:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cda11700 1 -- 172.21.15.69:0/2025536366 learned_addr learned my addr 172.21.15.69:0/2025536366 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54ce212700 1 --2- 172.21.15.69:0/2025536366 >> v2:172.21.15.93:3300/0 conn(0x7f54c8142000 0x7f54c8142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cda11700 1 -- 172.21.15.69:0/2025536366 >> v2:172.21.15.93:3300/0 conn(0x7f54c8142000 msgr2=0x7f54c8142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cda11700 1 --2- 172.21.15.69:0/2025536366 >> v2:172.21.15.93:3300/0 conn(0x7f54c8142000 0x7f54c8142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cda11700 1 -- 172.21.15.69:0/2025536366 >> v1:172.21.15.93:6789/0 conn(0x7f54c806bd70 legacy=0x7f54c8155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cda11700 1 -- 172.21.15.69:0/2025536366 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c80cd2d0 con 0x7f54c806d5d0 2023-11-17T06:33:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cda11700 1 --2- 172.21.15.69:0/2025536366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c806d5d0 0x7f54c806b830 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f54c80cfec0 tx=0x7f54b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8cc3aff4d4603b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cd210700 1 -- 172.21.15.69:0/2025536366 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b8004230 con 0x7f54c806d5d0 2023-11-17T06:33:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cd210700 1 -- 172.21.15.69:0/2025536366 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b8004390 con 0x7f54c806d5d0 2023-11-17T06:33:03.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.584+0000 7f54cd210700 1 -- 172.21.15.69:0/2025536366 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b80036c0 con 0x7f54c806d5d0 2023-11-17T06:33:03.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.588+0000 7f54cf214700 1 -- 172.21.15.69:0/2025536366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c806d5d0 msgr2=0x7f54c806b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.588+0000 7f54cf214700 1 --2- 172.21.15.69:0/2025536366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c806d5d0 0x7f54c806b830 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f54c80cfec0 tx=0x7f54b8009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.588+0000 7f54cf214700 1 -- 172.21.15.69:0/2025536366 shutdown_connections 2023-11-17T06:33:03.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.588+0000 7f54cf214700 1 --2- 172.21.15.69:0/2025536366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c806d5d0 0x7f54c806b830 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.588+0000 7f54cf214700 1 --2- 172.21.15.69:0/2025536366 >> v2:172.21.15.93:3300/0 conn(0x7f54c8142000 0x7f54c8142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.588+0000 7f54cf214700 1 -- 172.21.15.69:0/2025536366 >> 172.21.15.69:0/2025536366 conn(0x7f54c80cedc0 msgr2=0x7f54c80cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.588+0000 7f54cf214700 1 -- 172.21.15.69:0/2025536366 shutdown_connections 2023-11-17T06:33:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.588+0000 7f54cf214700 1 -- 172.21.15.69:0/2025536366 wait complete. 2023-11-17T06:33:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.588+0000 7f54cf214700 1 Processor -- start 2023-11-17T06:33:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.588+0000 7f54cf214700 1 -- start start 2023-11-17T06:33:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cf214700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54c806bd70 0x7f54c815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cf214700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f54c806d5d0 0x7f54c80c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cf214700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c8142000 0x7f54c80b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cf214700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c6a80 con 0x7f54c8142000 2023-11-17T06:33:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cf214700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c8bd0 con 0x7f54c806bd70 2023-11-17T06:33:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cf214700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8154530 con 0x7f54c806d5d0 2023-11-17T06:33:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cea13700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c8142000 0x7f54c80b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cea13700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c8142000 0x7f54c80b3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52194/0 (socket says 172.21.15.69:52194) 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cea13700 1 -- 172.21.15.69:0/2490972566 learned_addr learned my addr 172.21.15.69:0/2490972566 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54ce212700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54c806bd70 0x7f54c815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cda11700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f54c806d5d0 0x7f54c80c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cea13700 1 -- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f54c806d5d0 msgr2=0x7f54c80c8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cea13700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f54c806d5d0 0x7f54c80c8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cea13700 1 -- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54c806bd70 msgr2=0x7f54c815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cea13700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54c806bd70 0x7f54c815de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cea13700 1 -- 172.21.15.69:0/2490972566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b8009570 con 0x7f54c8142000 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cea13700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c8142000 0x7f54c80b3ac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f54c000cc70 tx=0x7f54c000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54beffd700 1 -- 172.21.15.69:0/2490972566 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0004c10 con 0x7f54c8142000 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54beffd700 1 -- 172.21.15.69:0/2490972566 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c0004d70 con 0x7f54c8142000 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cf214700 1 -- 172.21.15.69:0/2490972566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c80c5e90 con 0x7f54c8142000 2023-11-17T06:33:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54beffd700 1 -- 172.21.15.69:0/2490972566 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c000ab70 con 0x7f54c8142000 2023-11-17T06:33:03.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.592+0000 7f54cf214700 1 -- 172.21.15.69:0/2490972566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c80c63c0 con 0x7f54c8142000 2023-11-17T06:33:03.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.596+0000 7f54cf214700 1 -- 172.21.15.69:0/2490972566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c80c6bc0 con 0x7f54c8142000 2023-11-17T06:33:03.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.596+0000 7f54beffd700 1 -- 172.21.15.69:0/2490972566 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f54c000acd0 con 0x7f54c8142000 2023-11-17T06:33:03.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.600+0000 7f54beffd700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54ac066510 0x7f54ac0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.600+0000 7f54beffd700 1 -- 172.21.15.69:0/2490972566 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f54c0084570 con 0x7f54c8142000 2023-11-17T06:33:03.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.600+0000 7f54ce212700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54ac066510 0x7f54ac0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.600+0000 7f54ce212700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54ac066510 0x7f54ac0689d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f54c81554e0 tx=0x7f54c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.604+0000 7f54beffd700 1 -- 172.21.15.69:0/2490972566 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f54c80c6bc0 con 0x7f54c8142000 2023-11-17T06:33:03.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.776+0000 7f54cf214700 1 -- 172.21.15.69:0/2490972566 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54c80c6bc0 con 0x7f54c8142000 2023-11-17T06:33:03.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.776+0000 7f54beffd700 1 -- 172.21.15.69:0/2490972566 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f54c80c6bc0 con 0x7f54c8142000 2023-11-17T06:33:03.782 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:33:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 -- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54ac066510 msgr2=0x7f54ac0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54ac066510 0x7f54ac0689d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f54c81554e0 tx=0x7f54c4008040 comp rx=0 tx=0).stop 2023-11-17T06:33:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 -- 172.21.15.69:0/2490972566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c8142000 msgr2=0x7f54c80b3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c8142000 0x7f54c80b3ac0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f54c000cc70 tx=0x7f54c000cf80 comp rx=0 tx=0).stop 2023-11-17T06:33:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 -- 172.21.15.69:0/2490972566 shutdown_connections 2023-11-17T06:33:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f54ac066510 0x7f54ac0689d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f54c8142000 0x7f54c80b3ac0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f54c806d5d0 0x7f54c80c8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 --2- 172.21.15.69:0/2490972566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f54c806bd70 0x7f54c815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 -- 172.21.15.69:0/2490972566 >> 172.21.15.69:0/2490972566 conn(0x7f54c80cedc0 msgr2=0x7f54c8142df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 -- 172.21.15.69:0/2490972566 shutdown_connections 2023-11-17T06:33:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.780+0000 7f54cf214700 1 -- 172.21.15.69:0/2490972566 wait complete. 2023-11-17T06:33:03.807 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:33:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.976+0000 7f6484fe4700 1 Processor -- start 2023-11-17T06:33:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.976+0000 7f6484fe4700 1 -- start start 2023-11-17T06:33:03.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f6484fe4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f648006bd80 0x7f6480071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f6484fe4700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f648006c160 0x7f648006c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f6484fe4700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6480144e80 con 0x7f648006cb00 2023-11-17T06:33:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f6484fe4700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64800c95d0 con 0x7f648006bd80 2023-11-17T06:33:03.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f6484fe4700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648006d400 con 0x7f648006c160 2023-11-17T06:33:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f647ed9d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f648006cb00 0x7f64800c9ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42402/0 (socket says 172.21.15.69:42402) 2023-11-17T06:33:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f647ed9d700 1 -- 172.21.15.69:0/173067291 learned_addr learned my addr 172.21.15.69:0/173067291 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f647e59c700 1 --2- 172.21.15.69:0/173067291 >> v2:172.21.15.93:3300/0 conn(0x7f648006bd80 0x7f6480071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f6475d9b700 1 --2- 172.21.15.69:0/173067291 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f648006c160 0x7f648006c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f647e59c700 1 -- 172.21.15.69:0/173067291 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f648006c160 msgr2=0x7f648006c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:03.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f647e59c700 1 --2- 172.21.15.69:0/173067291 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f648006c160 0x7f648006c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f647e59c700 1 -- 172.21.15.69:0/173067291 >> v1:172.21.15.69:6789/0 conn(0x7f648006cb00 legacy=0x7f64800c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f647e59c700 1 -- 172.21.15.69:0/173067291 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648006d6e0 con 0x7f648006bd80 2023-11-17T06:33:03.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f647dd9b700 1 -- 172.21.15.69:0/173067291 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398423100 0 0) 0x7f6480144e80 con 0x7f648006cb00 2023-11-17T06:33:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.980+0000 7f647e59c700 1 --2- 172.21.15.69:0/173067291 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648006bd80 0x7f6480071db0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6470009850 tx=0x7f6470009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fbeb06bc168b29f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f647dd9b700 1 -- 172.21.15.69:0/173067291 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470011830 con 0x7f648006bd80 2023-11-17T06:33:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f647dd9b700 1 -- 172.21.15.69:0/173067291 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6470011990 con 0x7f648006bd80 2023-11-17T06:33:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f647dd9b700 1 -- 172.21.15.69:0/173067291 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6470011d40 con 0x7f648006bd80 2023-11-17T06:33:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f6484fe4700 1 -- 172.21.15.69:0/173067291 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648006bd80 msgr2=0x7f6480071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f6484fe4700 1 --2- 172.21.15.69:0/173067291 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648006bd80 0x7f6480071db0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6470009850 tx=0x7f6470009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f6484fe4700 1 -- 172.21.15.69:0/173067291 shutdown_connections 2023-11-17T06:33:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f6484fe4700 1 --2- 172.21.15.69:0/173067291 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f648006c160 0x7f648006c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f6484fe4700 1 --2- 172.21.15.69:0/173067291 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648006bd80 0x7f6480071db0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f6484fe4700 1 -- 172.21.15.69:0/173067291 >> 172.21.15.69:0/173067291 conn(0x7f64800ceee0 msgr2=0x7f64800cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:03.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f6484fe4700 1 -- 172.21.15.69:0/173067291 shutdown_connections 2023-11-17T06:33:03.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.984+0000 7f6484fe4700 1 -- 172.21.15.69:0/173067291 wait complete. 2023-11-17T06:33:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f6484fe4700 1 Processor -- start 2023-11-17T06:33:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f6484fe4700 1 -- start start 2023-11-17T06:33:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f6484fe4700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f648006bd80 0x7f6480156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f6484fe4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648006c160 0x7f6480143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f6484fe4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648006cb00 0x7f6480143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f6484fe4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800c8da0 con 0x7f648006cb00 2023-11-17T06:33:03.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f6484fe4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64800baaa0 con 0x7f648006c160 2023-11-17T06:33:03.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f6484fe4700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64800bad80 con 0x7f648006bd80 2023-11-17T06:33:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f647ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648006cb00 0x7f6480143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f647ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648006cb00 0x7f6480143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48184/0 (socket says 172.21.15.69:48184) 2023-11-17T06:33:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.988+0000 7f647ed9d700 1 -- 172.21.15.69:0/3578278852 learned_addr learned my addr 172.21.15.69:0/3578278852 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f6475d9b700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648006c160 0x7f6480143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f647e59c700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f648006bd80 0x7f6480156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f647ed9d700 1 -- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f648006bd80 msgr2=0x7f6480156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f647ed9d700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f648006bd80 0x7f6480156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f647ed9d700 1 -- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648006c160 msgr2=0x7f6480143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:03.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f647ed9d700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648006c160 0x7f6480143a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f647ed9d700 1 -- 172.21.15.69:0/3578278852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64700094b0 con 0x7f648006cb00 2023-11-17T06:33:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f647ed9d700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648006cb00 0x7f6480143f80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6478002230 tx=0x7f647800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f64777fe700 1 -- 172.21.15.69:0/3578278852 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647800aac0 con 0x7f648006cb00 2023-11-17T06:33:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f64777fe700 1 -- 172.21.15.69:0/3578278852 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647800ac40 con 0x7f648006cb00 2023-11-17T06:33:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f64777fe700 1 -- 172.21.15.69:0/3578278852 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64780070d0 con 0x7f648006cb00 2023-11-17T06:33:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f6484fe4700 1 -- 172.21.15.69:0/3578278852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648015cca0 con 0x7f648006cb00 2023-11-17T06:33:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f6484fe4700 1 -- 172.21.15.69:0/3578278852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648015d260 con 0x7f648006cb00 2023-11-17T06:33:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.992+0000 7f6484fe4700 1 -- 172.21.15.69:0/3578278852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648015d450 con 0x7f648006cb00 2023-11-17T06:33:03.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.996+0000 7f64777fe700 1 -- 172.21.15.69:0/3578278852 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6478007250 con 0x7f648006cb00 2023-11-17T06:33:04.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.996+0000 7f64777fe700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6460066560 0x7f6460068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.996+0000 7f64777fe700 1 -- 172.21.15.69:0/3578278852 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6478083c70 con 0x7f648006cb00 2023-11-17T06:33:04.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:03.996+0000 7f647e59c700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6460066560 0x7f6460068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.000+0000 7f647e59c700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6460066560 0x7f6460068a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f64700090b0 tx=0x7f647001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:04.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.004+0000 7f64777fe700 1 -- 172.21.15.69:0/3578278852 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f64780511e0 con 0x7f648006cb00 2023-11-17T06:33:04.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.180+0000 7f6484fe4700 1 -- 172.21.15.69:0/3578278852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64800c9310 con 0x7f648006cb00 2023-11-17T06:33:04.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.180+0000 7f64777fe700 1 -- 172.21.15.69:0/3578278852 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f64780180a0 con 0x7f648006cb00 2023-11-17T06:33:04.187 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:33:04.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 -- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6460066560 msgr2=0x7f6460068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6460066560 0x7f6460068a20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f64700090b0 tx=0x7f647001c040 comp rx=0 tx=0).stop 2023-11-17T06:33:04.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 -- 172.21.15.69:0/3578278852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648006cb00 msgr2=0x7f6480143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648006cb00 0x7f6480143f80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6478002230 tx=0x7f647800cf50 comp rx=0 tx=0).stop 2023-11-17T06:33:04.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 -- 172.21.15.69:0/3578278852 shutdown_connections 2023-11-17T06:33:04.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6460066560 0x7f6460068a20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648006cb00 0x7f6480143f80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f648006c160 0x7f6480143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 --2- 172.21.15.69:0/3578278852 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f648006bd80 0x7f6480156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 -- 172.21.15.69:0/3578278852 >> 172.21.15.69:0/3578278852 conn(0x7f64800ceee0 msgr2=0x7f6480070120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 -- 172.21.15.69:0/3578278852 shutdown_connections 2023-11-17T06:33:04.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.184+0000 7f6484fe4700 1 -- 172.21.15.69:0/3578278852 wait complete. 2023-11-17T06:33:04.213 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:33:04.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.396+0000 7fe713344700 1 Processor -- start 2023-11-17T06:33:04.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.396+0000 7fe713344700 1 -- start start 2023-11-17T06:33:04.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe713344700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe70c15d4a0 0x7fe70c15d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe713344700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0b8c40 0x7fe70c0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe713344700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c15ddc0 con 0x7fe70c0b9080 2023-11-17T06:33:04.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe713344700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c15e050 con 0x7fe70c15d4a0 2023-11-17T06:33:04.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe713344700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c15e330 con 0x7fe70c0b8c40 2023-11-17T06:33:04.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe7118e1700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe70c0b9080 0x7fe70c0b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42410/0 (socket says 172.21.15.69:42410) 2023-11-17T06:33:04.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe7118e1700 1 -- 172.21.15.69:0/1859825751 learned_addr learned my addr 172.21.15.69:0/1859825751 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:04.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe7110e0700 1 --2- 172.21.15.69:0/1859825751 >> v2:172.21.15.93:3300/0 conn(0x7fe70c15d4a0 0x7fe70c15d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe7108df700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0b8c40 0x7fe70c0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2061574044 0 0) 0x7fe70c15ddc0 con 0x7fe70c0b9080 2023-11-17T06:33:04.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.400+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f80035d0 con 0x7fe70c0b9080 2023-11-17T06:33:04.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3222377417 0 0) 0x7fe6f80035d0 con 0x7fe70c0b9080 2023-11-17T06:33:04.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0b8c40 msgr2=0x7fe70c0ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:04.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0b8c40 0x7fe70c0ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 >> v2:172.21.15.93:3300/0 conn(0x7fe70c15d4a0 msgr2=0x7fe70c15d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 --2- 172.21.15.69:0/1859825751 >> v2:172.21.15.93:3300/0 conn(0x7fe70c15d4a0 0x7fe70c15d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c15e610 con 0x7fe70c0b9080 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7108df700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0b8c40 0x7fe70c0ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7fe7040019f0 con 0x7fe70c0b9080 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 >> v1:172.21.15.69:6789/0 conn(0x7fe70c0b9080 legacy=0x7fe70c0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f8003a20 0x7fe6f8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0b8c40 0x7fe6f8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6f8004db0 0x7fe6f8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c15e050 con 0x7fe6f8004db0 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c15e330 con 0x7fe6f8003a20 2023-11-17T06:33:04.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8004690 con 0x7fe70c0b8c40 2023-11-17T06:33:04.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7118e1700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6f8004db0 0x7fe6f8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7108df700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0b8c40 0x7fe6f8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7110e0700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f8003a20 0x7fe6f8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7118e1700 1 -- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0b8c40 msgr2=0x7fe6f8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:04.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7118e1700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0b8c40 0x7fe6f8004870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7118e1700 1 -- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f8003a20 msgr2=0x7fe6f8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:04.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7118e1700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f8003a20 0x7fe6f8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7118e1700 1 -- 172.21.15.69:0/1859825751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc0094b0 con 0x7fe6f8004db0 2023-11-17T06:33:04.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7110e0700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6f8003a20 0x7fe6f8003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:04.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7118e1700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6f8004db0 0x7fe6f8005230 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe704005b50 tx=0x7fe6f80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f501b03aafc53ef server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:04.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7040055c0 con 0x7fe6f8004db0 2023-11-17T06:33:04.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70400dab0 con 0x7fe6f8004db0 2023-11-17T06:33:04.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe703fff700 1 -- 172.21.15.69:0/1859825751 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70400de60 con 0x7fe6f8004db0 2023-11-17T06:33:04.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe713344700 1 -- 172.21.15.69:0/1859825751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6f8004db0 msgr2=0x7fe6f8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe713344700 1 --2- 172.21.15.69:0/1859825751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6f8004db0 0x7fe6f8005230 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe704005b50 tx=0x7fe6f80058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe7118e1700 1 -- 172.21.15.69:0/1859825751 reap_dead start 2023-11-17T06:33:04.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe713344700 1 -- 172.21.15.69:0/1859825751 shutdown_connections 2023-11-17T06:33:04.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe713344700 1 -- 172.21.15.69:0/1859825751 >> 172.21.15.69:0/1859825751 conn(0x7fe70c06b830 msgr2=0x7fe70c06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:04.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe713344700 1 -- 172.21.15.69:0/1859825751 shutdown_connections 2023-11-17T06:33:04.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.404+0000 7fe713344700 1 -- 172.21.15.69:0/1859825751 wait complete. 2023-11-17T06:33:04.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.408+0000 7fe713344700 1 Processor -- start 2023-11-17T06:33:04.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.408+0000 7fe713344700 1 -- start start 2023-11-17T06:33:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe713344700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe70c0c9650 0x7fe70c0c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe713344700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0c9a30 0x7fe70c0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe713344700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe70c0cb980 0x7fe70c15ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe713344700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0cbe90 con 0x7fe70c0c9650 2023-11-17T06:33:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe713344700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0cc170 con 0x7fe70c0cb980 2023-11-17T06:33:04.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe713344700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0c6ff0 con 0x7fe70c0c9a30 2023-11-17T06:33:04.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7110e0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe70c0c9650 0x7fe70c0c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7110e0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe70c0c9650 0x7fe70c0c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48208/0 (socket says 172.21.15.69:48208) 2023-11-17T06:33:04.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7110e0700 1 -- 172.21.15.69:0/2646773884 learned_addr learned my addr 172.21.15.69:0/2646773884 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:04.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7118e1700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe70c0cb980 0x7fe70c15ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7108df700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0c9a30 0x7fe70c0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7110e0700 1 -- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0c9a30 msgr2=0x7fe70c0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7110e0700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0c9a30 0x7fe70c0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7110e0700 1 -- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe70c0cb980 msgr2=0x7fe70c15ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7110e0700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe70c0cb980 0x7fe70c15ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7110e0700 1 -- 172.21.15.69:0/2646773884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c0c72d0 con 0x7fe70c0c9650 2023-11-17T06:33:04.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7118e1700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe70c0cb980 0x7fe70c15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:04.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe7110e0700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe70c0c9650 0x7fe70c0c8710 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe7080109f0 tx=0x7fe708010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:04.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.412+0000 7fe701ffb700 1 -- 172.21.15.69:0/2646773884 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708004220 con 0x7fe70c0c9650 2023-11-17T06:33:04.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.416+0000 7fe701ffb700 1 -- 172.21.15.69:0/2646773884 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe708004380 con 0x7fe70c0c9650 2023-11-17T06:33:04.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.416+0000 7fe713344700 1 -- 172.21.15.69:0/2646773884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c0c8c50 con 0x7fe70c0c9650 2023-11-17T06:33:04.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.416+0000 7fe701ffb700 1 -- 172.21.15.69:0/2646773884 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708010e90 con 0x7fe70c0c9650 2023-11-17T06:33:04.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.416+0000 7fe713344700 1 -- 172.21.15.69:0/2646773884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c15f3a0 con 0x7fe70c0c9650 2023-11-17T06:33:04.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.416+0000 7fe713344700 1 -- 172.21.15.69:0/2646773884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe70c0c7460 con 0x7fe70c0c9650 2023-11-17T06:33:04.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.416+0000 7fe701ffb700 1 -- 172.21.15.69:0/2646773884 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe70800e870 con 0x7fe70c0c9650 2023-11-17T06:33:04.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.420+0000 7fe701ffb700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe6f0066510 0x7fe6f00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.420+0000 7fe701ffb700 1 -- 172.21.15.69:0/2646773884 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe708084030 con 0x7fe70c0c9650 2023-11-17T06:33:04.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.420+0000 7fe7108df700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe6f0066510 0x7fe6f00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.420+0000 7fe7108df700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe6f0066510 0x7fe6f00689d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0c9e70 tx=0x7fe6fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:04.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.424+0000 7fe701ffb700 1 -- 172.21.15.69:0/2646773884 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe708051430 con 0x7fe70c0c9650 2023-11-17T06:33:04.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 -- 172.21.15.69:0/2646773884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe70c0c6e10 con 0x7fe70c0c9650 2023-11-17T06:33:04.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe701ffb700 1 -- 172.21.15.69:0/2646773884 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe708054a50 con 0x7fe70c0c9650 2023-11-17T06:33:04.604 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:33:04.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 -- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe6f0066510 msgr2=0x7fe6f00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe6f0066510 0x7fe6f00689d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0c9e70 tx=0x7fe6fc008040 comp rx=0 tx=0).stop 2023-11-17T06:33:04.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 -- 172.21.15.69:0/2646773884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe70c0c9650 msgr2=0x7fe70c0c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe70c0c9650 0x7fe70c0c8710 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe7080109f0 tx=0x7fe708010d00 comp rx=0 tx=0).stop 2023-11-17T06:33:04.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 -- 172.21.15.69:0/2646773884 shutdown_connections 2023-11-17T06:33:04.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe6f0066510 0x7fe6f00689d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe70c0cb980 0x7fe70c15ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe70c0c9a30 0x7fe70c0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 --2- 172.21.15.69:0/2646773884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe70c0c9650 0x7fe70c0c8710 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.600+0000 7fe713344700 1 -- 172.21.15.69:0/2646773884 >> 172.21.15.69:0/2646773884 conn(0x7fe70c06b830 msgr2=0x7fe70c15b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:04.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.604+0000 7fe713344700 1 -- 172.21.15.69:0/2646773884 shutdown_connections 2023-11-17T06:33:04.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.604+0000 7fe713344700 1 -- 172.21.15.69:0/2646773884 wait complete. 2023-11-17T06:33:04.628 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:33:04.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.796+0000 7f509a501700 1 Processor -- start 2023-11-17T06:33:04.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.796+0000 7f509a501700 1 -- start start 2023-11-17T06:33:04.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f509a501700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 0x7f50940ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f509a501700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f50940ccd30 0x7f5094160fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f509a501700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50940cd770 con 0x7f509415d440 2023-11-17T06:33:04.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f509a501700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50940cd230 con 0x7f50940ccd30 2023-11-17T06:33:04.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f509a501700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50940cd440 con 0x7f50940ac8d0 2023-11-17T06:33:04.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f50994ff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f509415d440 0x7f50940c9b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42426/0 (socket says 172.21.15.69:42426) 2023-11-17T06:33:04.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f50994ff700 1 -- 172.21.15.69:0/224894386 learned_addr learned my addr 172.21.15.69:0/224894386 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:04.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f5098cfe700 1 --2- 172.21.15.69:0/224894386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 0x7f50940ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f5099d00700 1 --2- 172.21.15.69:0/224894386 >> v2:172.21.15.93:3300/0 conn(0x7f50940ccd30 0x7f5094160fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f508bfff700 1 -- 172.21.15.69:0/224894386 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775040163 0 0) 0x7f50940cd770 con 0x7f509415d440 2023-11-17T06:33:04.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f508bfff700 1 -- 172.21.15.69:0/224894386 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50800035d0 con 0x7f509415d440 2023-11-17T06:33:04.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f5098cfe700 1 -- 172.21.15.69:0/224894386 >> v2:172.21.15.93:3300/0 conn(0x7f50940ccd30 msgr2=0x7f5094160fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:04.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f5098cfe700 1 --2- 172.21.15.69:0/224894386 >> v2:172.21.15.93:3300/0 conn(0x7f50940ccd30 0x7f5094160fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f5098cfe700 1 -- 172.21.15.69:0/224894386 >> v1:172.21.15.69:6789/0 conn(0x7f509415d440 legacy=0x7f50940c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.800+0000 7f5098cfe700 1 -- 172.21.15.69:0/224894386 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940cb2e0 con 0x7f50940ac8d0 2023-11-17T06:33:04.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f5098cfe700 1 --2- 172.21.15.69:0/224894386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 0x7f50940ca280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5084009850 tx=0x7f5084009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5348c833517d956a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:04.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f508bfff700 1 -- 172.21.15.69:0/224894386 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084011830 con 0x7f50940ac8d0 2023-11-17T06:33:04.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f508bfff700 1 -- 172.21.15.69:0/224894386 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084011990 con 0x7f50940ac8d0 2023-11-17T06:33:04.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f508bfff700 1 -- 172.21.15.69:0/224894386 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084011d40 con 0x7f50940ac8d0 2023-11-17T06:33:04.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f509a501700 1 -- 172.21.15.69:0/224894386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 msgr2=0x7f50940ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f509a501700 1 --2- 172.21.15.69:0/224894386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 0x7f50940ca280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5084009850 tx=0x7f5084009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:04.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f509a501700 1 -- 172.21.15.69:0/224894386 shutdown_connections 2023-11-17T06:33:04.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f509a501700 1 --2- 172.21.15.69:0/224894386 >> v2:172.21.15.93:3300/0 conn(0x7f50940ccd30 0x7f5094160fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f509a501700 1 --2- 172.21.15.69:0/224894386 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 0x7f50940ca280 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f509a501700 1 -- 172.21.15.69:0/224894386 >> 172.21.15.69:0/224894386 conn(0x7f50940cedc0 msgr2=0x7f50940cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:04.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f509a501700 1 -- 172.21.15.69:0/224894386 shutdown_connections 2023-11-17T06:33:04.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.804+0000 7f509a501700 1 -- 172.21.15.69:0/224894386 wait complete. 2023-11-17T06:33:04.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f509a501700 1 Processor -- start 2023-11-17T06:33:04.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f509a501700 1 -- start start 2023-11-17T06:33:04.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f509a501700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 0x7f50941571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f509a501700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50940ccd30 0x7f509415d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f509a501700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f509415d440 0x7f50940b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f509a501700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50940b2da0 con 0x7f50940ccd30 2023-11-17T06:33:04.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f509a501700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50940b3080 con 0x7f509415d440 2023-11-17T06:33:04.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f509a501700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50940b3360 con 0x7f50940ac8d0 2023-11-17T06:33:04.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f5098cfe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50940ccd30 0x7f509415d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f5098cfe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50940ccd30 0x7f509415d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48212/0 (socket says 172.21.15.69:48212) 2023-11-17T06:33:04.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f5098cfe700 1 -- 172.21.15.69:0/462476845 learned_addr learned my addr 172.21.15.69:0/462476845 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:04.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f5099d00700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f509415d440 0x7f50940b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f50994ff700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 0x7f50941571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f5098cfe700 1 -- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 msgr2=0x7f50941571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f5098cfe700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 0x7f50941571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f5098cfe700 1 -- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f509415d440 msgr2=0x7f50940b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:04.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f5098cfe700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f509415d440 0x7f50940b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:04.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f5098cfe700 1 -- 172.21.15.69:0/462476845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50840094b0 con 0x7f50940ccd30 2023-11-17T06:33:04.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.808+0000 7f5099d00700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f509415d440 0x7f50940b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:04.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.812+0000 7f5098cfe700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50940ccd30 0x7f509415d9a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f50840090b0 tx=0x7f5084004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:04.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.812+0000 7f5089ffb700 1 -- 172.21.15.69:0/462476845 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084004480 con 0x7f50940ccd30 2023-11-17T06:33:04.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.812+0000 7f5089ffb700 1 -- 172.21.15.69:0/462476845 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508401f070 con 0x7f50940ccd30 2023-11-17T06:33:04.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.812+0000 7f5089ffb700 1 -- 172.21.15.69:0/462476845 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084003900 con 0x7f50940ccd30 2023-11-17T06:33:04.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.812+0000 7f509a501700 1 -- 172.21.15.69:0/462476845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50940b3640 con 0x7f50940ccd30 2023-11-17T06:33:04.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.812+0000 7f509a501700 1 -- 172.21.15.69:0/462476845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5094157720 con 0x7f50940ccd30 2023-11-17T06:33:04.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.812+0000 7f509a501700 1 -- 172.21.15.69:0/462476845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50940b3b60 con 0x7f50940ccd30 2023-11-17T06:33:04.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.816+0000 7f5089ffb700 1 -- 172.21.15.69:0/462476845 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5084021030 con 0x7f50940ccd30 2023-11-17T06:33:04.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.816+0000 7f5089ffb700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5078066510 0x7f50780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:04.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.816+0000 7f5089ffb700 1 -- 172.21.15.69:0/462476845 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5084085270 con 0x7f50940ccd30 2023-11-17T06:33:04.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.816+0000 7f50994ff700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5078066510 0x7f50780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:04.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.820+0000 7f50994ff700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5078066510 0x7f50780689d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f50900011e0 tx=0x7f5090009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:04.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:04.820+0000 7f5089ffb700 1 -- 172.21.15.69:0/462476845 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f50940b3b60 con 0x7f50940ccd30 2023-11-17T06:33:05.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.008+0000 7f509a501700 1 -- 172.21.15.69:0/462476845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f50940b3b60 con 0x7f50940ccd30 2023-11-17T06:33:05.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.008+0000 7f5089ffb700 1 -- 172.21.15.69:0/462476845 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f50940b3b60 con 0x7f50940ccd30 2023-11-17T06:33:05.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 -- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5078066510 msgr2=0x7f50780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:05.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5078066510 0x7f50780689d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f50900011e0 tx=0x7f5090009040 comp rx=0 tx=0).stop 2023-11-17T06:33:05.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 -- 172.21.15.69:0/462476845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50940ccd30 msgr2=0x7f509415d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:05.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50940ccd30 0x7f509415d9a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f50840090b0 tx=0x7f5084004770 comp rx=0 tx=0).stop 2023-11-17T06:33:05.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 -- 172.21.15.69:0/462476845 shutdown_connections 2023-11-17T06:33:05.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5078066510 0x7f50780689d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:05.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f509415d440 0x7f50940b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:05.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50940ccd30 0x7f509415d9a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:05.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 --2- 172.21.15.69:0/462476845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f50940ac8d0 0x7f50941571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:05.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 -- 172.21.15.69:0/462476845 >> 172.21.15.69:0/462476845 conn(0x7f50940cedc0 msgr2=0x7f509415c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:05.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 -- 172.21.15.69:0/462476845 shutdown_connections 2023-11-17T06:33:05.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:05.012+0000 7f509a501700 1 -- 172.21.15.69:0/462476845 wait complete. 2023-11-17T06:33:05.019 INFO:teuthology.orchestra.run.smithi069.stderr:listed 0 entries 2023-11-17T06:33:05.037 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi069.front.sepia.ceph.com... 2023-11-17T06:33:05.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:05.037 DEBUG:teuthology.orchestra.run.smithi069:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:05.069 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[46598]: fuse finished with error 0 and tester_r 0 2023-11-17T06:33:05.073 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:33:11.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:33:11.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:11.176 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-17T06:33:11.198 DEBUG:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-11-17T06:33:11.429 INFO:teuthology.orchestra.run.smithi093.stdout:{"message":"","return_code":0} 2023-11-17T06:33:11.429 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-11-17T06:33:11.429 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-17T06:33:11.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.612+0000 7f24b219c700 1 Processor -- start 2023-11-17T06:33:11.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.612+0000 7f24b219c700 1 -- start start 2023-11-17T06:33:11.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b219c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24ac1617a0 0x7f24ac0cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b219c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f24ac070500 0x7f24ac0ca650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b219c700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac0ce070 con 0x7f24ac0cdc30 2023-11-17T06:33:11.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b219c700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac0c95b0 con 0x7f24ac070500 2023-11-17T06:33:11.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b219c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0c9890 con 0x7f24ac1617a0 2023-11-17T06:33:11.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b0999700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f24ac0cdc30 0x7f24ac06fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42432/0 (socket says 172.21.15.69:42432) 2023-11-17T06:33:11.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b0999700 1 -- 172.21.15.69:0/3193540355 learned_addr learned my addr 172.21.15.69:0/3193540355 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:11.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b199b700 1 --2- 172.21.15.69:0/3193540355 >> v2:172.21.15.93:3300/0 conn(0x7f24ac070500 0x7f24ac0ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b119a700 1 --2- 172.21.15.69:0/3193540355 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24ac1617a0 0x7f24ac0cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24a3fff700 1 -- 172.21.15.69:0/3193540355 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111265066 0 0) 0x7f24ac0ce070 con 0x7f24ac0cdc30 2023-11-17T06:33:11.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24a3fff700 1 -- 172.21.15.69:0/3193540355 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24980035d0 con 0x7f24ac0cdc30 2023-11-17T06:33:11.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b199b700 1 -- 172.21.15.69:0/3193540355 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24ac1617a0 msgr2=0x7f24ac0cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b199b700 1 --2- 172.21.15.69:0/3193540355 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24ac1617a0 0x7f24ac0cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b199b700 1 -- 172.21.15.69:0/3193540355 >> v1:172.21.15.69:6789/0 conn(0x7f24ac0cdc30 legacy=0x7f24ac06fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b199b700 1 -- 172.21.15.69:0/3193540355 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0c9b70 con 0x7f24ac070500 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24b199b700 1 --2- 172.21.15.69:0/3193540355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24ac070500 0x7f24ac0ca650 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009d90 tx=0x7f24a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db8de5519360b167 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24a3fff700 1 -- 172.21.15.69:0/3193540355 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400e070 con 0x7f24ac070500 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24a3fff700 1 -- 172.21.15.69:0/3193540355 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a400bb20 con 0x7f24ac070500 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.616+0000 7f24a3fff700 1 -- 172.21.15.69:0/3193540355 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4012430 con 0x7f24ac070500 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.620+0000 7f24b219c700 1 -- 172.21.15.69:0/3193540355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24ac070500 msgr2=0x7f24ac0ca650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.620+0000 7f24b219c700 1 --2- 172.21.15.69:0/3193540355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24ac070500 0x7f24ac0ca650 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009d90 tx=0x7f24a400b330 comp rx=0 tx=0).stop 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.620+0000 7f24b219c700 1 -- 172.21.15.69:0/3193540355 shutdown_connections 2023-11-17T06:33:11.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.620+0000 7f24b219c700 1 --2- 172.21.15.69:0/3193540355 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24ac070500 0x7f24ac0ca650 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.620+0000 7f24b219c700 1 --2- 172.21.15.69:0/3193540355 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24ac1617a0 0x7f24ac0cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.620+0000 7f24b219c700 1 -- 172.21.15.69:0/3193540355 >> 172.21.15.69:0/3193540355 conn(0x7f24ac0cedc0 msgr2=0x7f24ac0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:11.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.620+0000 7f24b219c700 1 -- 172.21.15.69:0/3193540355 shutdown_connections 2023-11-17T06:33:11.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.620+0000 7f24b219c700 1 -- 172.21.15.69:0/3193540355 wait complete. 2023-11-17T06:33:11.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b219c700 1 Processor -- start 2023-11-17T06:33:11.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b219c700 1 -- start start 2023-11-17T06:33:11.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b219c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24ac070500 0x7f24ac1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b219c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24ac0cdc30 0x7f24ac157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b219c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24ac1617a0 0x7f24ac0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b219c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac158920 con 0x7f24ac0cdc30 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b219c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac158db0 con 0x7f24ac1617a0 2023-11-17T06:33:11.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b219c700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac157d10 con 0x7f24ac070500 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b0999700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24ac0cdc30 0x7f24ac157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b0999700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24ac0cdc30 0x7f24ac157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48226/0 (socket says 172.21.15.69:48226) 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b0999700 1 -- 172.21.15.69:0/1150039432 learned_addr learned my addr 172.21.15.69:0/1150039432 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b199b700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24ac1617a0 0x7f24ac0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.624+0000 7f24b119a700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24ac070500 0x7f24ac1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24b0999700 1 -- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24ac070500 msgr2=0x7f24ac1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24b0999700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24ac070500 0x7f24ac1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24b0999700 1 -- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24ac1617a0 msgr2=0x7f24ac0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24b0999700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24ac1617a0 0x7f24ac0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24b0999700 1 -- 172.21.15.69:0/1150039432 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a4009a70 con 0x7f24ac0cdc30 2023-11-17T06:33:11.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24b0999700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24ac0cdc30 0x7f24ac157290 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c730 tx=0x7f249c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24a1ffb700 1 -- 172.21.15.69:0/1150039432 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c005d90 con 0x7f24ac0cdc30 2023-11-17T06:33:11.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24a1ffb700 1 -- 172.21.15.69:0/1150039432 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c0070d0 con 0x7f24ac0cdc30 2023-11-17T06:33:11.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24a1ffb700 1 -- 172.21.15.69:0/1150039432 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c007460 con 0x7f24ac0cdc30 2023-11-17T06:33:11.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24b219c700 1 -- 172.21.15.69:0/1150039432 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac157ff0 con 0x7f24ac0cdc30 2023-11-17T06:33:11.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24b219c700 1 -- 172.21.15.69:0/1150039432 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac1585b0 con 0x7f24ac0cdc30 2023-11-17T06:33:11.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.628+0000 7f24b219c700 1 -- 172.21.15.69:0/1150039432 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ac04e650 con 0x7f24ac0cdc30 2023-11-17T06:33:11.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.632+0000 7f24a1ffb700 1 -- 172.21.15.69:0/1150039432 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f249c0075c0 con 0x7f24ac0cdc30 2023-11-17T06:33:11.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.632+0000 7f24a1ffb700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2490066510 0x7f24900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.632+0000 7f24a1ffb700 1 -- 172.21.15.69:0/1150039432 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f249c0833e0 con 0x7f24ac0cdc30 2023-11-17T06:33:11.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.632+0000 7f24b119a700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2490066510 0x7f24900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.636+0000 7f24b119a700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2490066510 0x7f24900689d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009b50 tx=0x7f24a8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.640+0000 7f24a1ffb700 1 -- 172.21.15.69:0/1150039432 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f249c050760 con 0x7f24ac0cdc30 2023-11-17T06:33:11.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.852+0000 7f24b219c700 1 -- 172.21.15.69:0/1150039432 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f24ac0b4d40 con 0x7f24ac0cdc30 2023-11-17T06:33:11.859 INFO:tasks.ceph.mon.a.smithi069.stderr:2023-11-17T06:33:11.856+0000 7f1481df4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-17T06:33:11.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.860+0000 7f24a1ffb700 1 -- 172.21.15.69:0/1150039432 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) v1 ==== 161+0+0 (secure 0 0 0) 0x7f249c053d80 con 0x7f24ac0cdc30 2023-11-17T06:33:11.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 -- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2490066510 msgr2=0x7f24900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2490066510 0x7f24900689d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f24a8009b50 tx=0x7f24a8009240 comp rx=0 tx=0).stop 2023-11-17T06:33:11.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 -- 172.21.15.69:0/1150039432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24ac0cdc30 msgr2=0x7f24ac157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24ac0cdc30 0x7f24ac157290 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c730 tx=0x7f249c00ca40 comp rx=0 tx=0).stop 2023-11-17T06:33:11.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 -- 172.21.15.69:0/1150039432 shutdown_connections 2023-11-17T06:33:11.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2490066510 0x7f24900689d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24ac1617a0 0x7f24ac0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24ac0cdc30 0x7f24ac157290 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 --2- 172.21.15.69:0/1150039432 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f24ac070500 0x7f24ac1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 -- 172.21.15.69:0/1150039432 >> 172.21.15.69:0/1150039432 conn(0x7f24ac0cedc0 msgr2=0x7f24ac06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:11.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 -- 172.21.15.69:0/1150039432 shutdown_connections 2023-11-17T06:33:11.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.864+0000 7f24b219c700 1 -- 172.21.15.69:0/1150039432 wait complete. 2023-11-17T06:33:11.869 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-17T06:33:11.890 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.01000000 2023-11-17T06:33:11.951 INFO:tasks.ceph.mds.d.smithi093.stdout:starting mds.d at 2023-11-17T06:33:11.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.952+0000 7fcdbb682140 1 Processor -- start 2023-11-17T06:33:11.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.952+0000 7fcdbb682140 1 -- start start 2023-11-17T06:33:11.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.952+0000 7fcdbb682140 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 0x563dd709e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.952+0000 7fcdbb682140 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x563dd70a58e0 0x563dd708b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.952+0000 7fcdbb682140 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd709c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd6fabba0 con 0x563dd712f540 2023-11-17T06:33:11.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd6faa4e0 con 0x563dd7057830 2023-11-17T06:33:11.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dd6f7d240 con 0x563dd70a58e0 2023-11-17T06:33:11.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb99bd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd709c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb91bc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 0x563dd709e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb99bd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd709c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48238/0 (socket says 172.21.15.69:48238) 2023-11-17T06:33:11.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb91bc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 0x563dd709e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:56516/0 (socket says 172.21.15.69:56516) 2023-11-17T06:33:11.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb99bd700 1 -- 172.21.15.69:0/1682122927 learned_addr learned my addr 172.21.15.69:0/1682122927 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:11.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb89bb700 1 --2- 172.21.15.69:0/1682122927 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x563dd70a58e0 0x563dd708b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb99bd700 1 -- 172.21.15.69:0/1682122927 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x563dd70a58e0 msgr2=0x563dd708b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:11.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb99bd700 1 --2- 172.21.15.69:0/1682122927 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x563dd70a58e0 0x563dd708b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb99bd700 1 -- 172.21.15.69:0/1682122927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 msgr2=0x563dd709e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:11.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb99bd700 1 --2- 172.21.15.69:0/1682122927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 0x563dd709e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb99bd700 1 -- 172.21.15.69:0/1682122927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb0005d20 con 0x563dd712f540 2023-11-17T06:33:11.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb91bc700 1 --2- 172.21.15.69:0/1682122927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 0x563dd709e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:11.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdb99bd700 1 --2- 172.21.15.69:0/1682122927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd709c890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4001c50 tx=0x7fcdb400b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e376ae9b7bb16b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdab7fe700 1 -- 172.21.15.69:0/1682122927 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4001da0 con 0x563dd712f540 2023-11-17T06:33:11.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdab7fe700 1 -- 172.21.15.69:0/1682122927 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400bd70 con 0x563dd712f540 2023-11-17T06:33:11.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdab7fe700 1 -- 172.21.15.69:0/1682122927 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400e6b0 con 0x563dd712f540 2023-11-17T06:33:11.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 -- 172.21.15.69:0/1682122927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 msgr2=0x563dd709c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 --2- 172.21.15.69:0/1682122927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd709c890 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4001c50 tx=0x7fcdb400b5d0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 -- 172.21.15.69:0/1682122927 shutdown_connections 2023-11-17T06:33:11.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 --2- 172.21.15.69:0/1682122927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd709c890 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 --2- 172.21.15.69:0/1682122927 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x563dd70a58e0 0x563dd708b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 --2- 172.21.15.69:0/1682122927 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 0x563dd709e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 -- 172.21.15.69:0/1682122927 >> 172.21.15.69:0/1682122927 conn(0x563dd705da10 msgr2=0x563dd705ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:11.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 -- 172.21.15.69:0/1682122927 shutdown_connections 2023-11-17T06:33:11.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.956+0000 7fcdbb682140 1 -- 172.21.15.69:0/1682122927 wait complete. 2023-11-17T06:33:11.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdbb682140 1 Processor -- start 2023-11-17T06:33:11.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdbb682140 1 -- start start 2023-11-17T06:33:11.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdbb682140 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 0x563dd710ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdbb682140 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x563dd70a58e0 0x563dd7124830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdbb682140 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd710e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdbb682140 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd710d660 con 0x563dd712f540 2023-11-17T06:33:11.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdbb682140 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dd710d900 con 0x563dd7057830 2023-11-17T06:33:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdbb682140 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dd710dba0 con 0x563dd70a58e0 2023-11-17T06:33:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb99bd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd710e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb99bd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd710e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48246/0 (socket says 172.21.15.69:48246) 2023-11-17T06:33:11.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb99bd700 1 -- 172.21.15.69:0/1490043186 learned_addr learned my addr 172.21.15.69:0/1490043186 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:11.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb89bb700 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x563dd70a58e0 0x563dd7124830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb91bc700 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 0x563dd710ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:11.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb99bd700 1 -- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x563dd70a58e0 msgr2=0x563dd7124830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb99bd700 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x563dd70a58e0 0x563dd7124830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb99bd700 1 -- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 msgr2=0x563dd710ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:11.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb99bd700 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563dd7057830 0x563dd710ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:11.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb99bd700 1 -- 172.21.15.69:0/1490043186 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dd6faf390 con 0x563dd712f540 2023-11-17T06:33:11.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.960+0000 7fcdb99bd700 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd710e4f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400b610 tx=0x7fcdb4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:11.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.964+0000 7fcdaa7fc700 1 -- 172.21.15.69:0/1490043186 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb401e070 con 0x563dd712f540 2023-11-17T06:33:11.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.964+0000 7fcdaa7fc700 1 -- 172.21.15.69:0/1490043186 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400bb70 con 0x563dd712f540 2023-11-17T06:33:11.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.964+0000 7fcdaa7fc700 1 -- 172.21.15.69:0/1490043186 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4001da0 con 0x563dd712f540 2023-11-17T06:33:11.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.964+0000 7fcdbb682140 1 -- 172.21.15.69:0/1490043186 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda4001e10 con 0x563dd712f540 2023-11-17T06:33:11.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.964+0000 7fcdbb682140 1 -- 172.21.15.69:0/1490043186 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac00a100 con 0x563dd712f540 2023-11-17T06:33:11.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.964+0000 7fcdaa7fc700 1 -- 172.21.15.69:0/1490043186 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcdb4017850 con 0x563dd712f540 2023-11-17T06:33:11.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.968+0000 7fcdaa7fc700 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd9c064e70 0x7fcd9c067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:11.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.968+0000 7fcdaa7fc700 1 -- 172.21.15.69:0/1490043186 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fcdb4083c40 con 0x563dd712f540 2023-11-17T06:33:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.968+0000 7fcdbb682140 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x563dd7124d70 0x563dd7129880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.968+0000 7fcdbb682140 1 -- 172.21.15.69:0/1490043186 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:1 4.5 4:a40620de:::10000000000.01000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e40) v8 -- 0x563dd7129dc0 con 0x563dd7124d70 2023-11-17T06:33:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.968+0000 7fcdb91bc700 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd9c064e70 0x7fcd9c067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.968+0000 7fcdb89bb700 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x563dd7124d70 0x563dd7129880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.968+0000 7fcdb89bb700 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x563dd7124d70 0x563dd7129880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.968+0000 7fcdb91bc700 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd9c064e70 0x7fcd9c067330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcdac013040 tx=0x7fcdac007030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdb89bb700 1 -- 172.21.15.69:0/1490043186 <== osd.3 v2:172.21.15.69:6824/183679214 1 ==== osd_op_reply(1 10000000000.01000000 [omap-get-keys out=560b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+560 (crc 0 0 0) 0x7fcdb0012040 con 0x563dd7124d70 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi069.stdout:10_head 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi069.stdout:11_head 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi069.stdout:12_head 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi069.stdout:15_head 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi069.stdout:19_head 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi069.stdout:1_head 2023-11-17T06:33:12.002 INFO:teuthology.orchestra.run.smithi069.stdout:20_head 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi069.stdout:21_head 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi069.stdout:27_head 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi069.stdout:28_head 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi069.stdout:2_head 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi069.stdout:31_head 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi069.stdout:34_head 2023-11-17T06:33:12.003 INFO:teuthology.orchestra.run.smithi069.stdout:36_head 2023-11-17T06:33:12.004 INFO:teuthology.orchestra.run.smithi069.stdout:38_head 2023-11-17T06:33:12.004 INFO:teuthology.orchestra.run.smithi069.stdout:39_head 2023-11-17T06:33:12.004 INFO:teuthology.orchestra.run.smithi069.stdout:3_head 2023-11-17T06:33:12.004 INFO:teuthology.orchestra.run.smithi069.stdout:42_head 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi069.stdout:43_head 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi069.stdout:46_head 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi069.stdout:4_head 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi069.stdout:50_head 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi069.stdout:52_head 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi069.stdout:53_head 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi069.stdout:55_head 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi069.stdout:59_head 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi069.stdout:61_head 2023-11-17T06:33:12.005 INFO:teuthology.orchestra.run.smithi069.stdout:63_head 2023-11-17T06:33:12.006 INFO:teuthology.orchestra.run.smithi069.stdout:64_head 2023-11-17T06:33:12.006 INFO:teuthology.orchestra.run.smithi069.stdout:65_head 2023-11-17T06:33:12.006 INFO:teuthology.orchestra.run.smithi069.stdout:66_head 2023-11-17T06:33:12.006 INFO:teuthology.orchestra.run.smithi069.stdout:69_head 2023-11-17T06:33:12.006 INFO:teuthology.orchestra.run.smithi069.stdout:70_head 2023-11-17T06:33:12.006 INFO:teuthology.orchestra.run.smithi069.stdout:73_head 2023-11-17T06:33:12.006 INFO:teuthology.orchestra.run.smithi069.stdout:74_head 2023-11-17T06:33:12.006 INFO:teuthology.orchestra.run.smithi069.stdout:75_head 2023-11-17T06:33:12.006 INFO:teuthology.orchestra.run.smithi069.stdout:77_head 2023-11-17T06:33:12.006 INFO:teuthology.orchestra.run.smithi069.stdout:80_head 2023-11-17T06:33:12.007 INFO:teuthology.orchestra.run.smithi069.stdout:83_head 2023-11-17T06:33:12.007 INFO:teuthology.orchestra.run.smithi069.stdout:84_head 2023-11-17T06:33:12.007 INFO:teuthology.orchestra.run.smithi069.stdout:85_head 2023-11-17T06:33:12.007 INFO:teuthology.orchestra.run.smithi069.stdout:86_head 2023-11-17T06:33:12.007 INFO:teuthology.orchestra.run.smithi069.stdout:87_head 2023-11-17T06:33:12.007 INFO:teuthology.orchestra.run.smithi069.stdout:88_head 2023-11-17T06:33:12.007 INFO:teuthology.orchestra.run.smithi069.stdout:8_head 2023-11-17T06:33:12.007 INFO:teuthology.orchestra.run.smithi069.stdout:90_head 2023-11-17T06:33:12.007 INFO:teuthology.orchestra.run.smithi069.stdout:92_head 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi069.stdout:95_head 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi069.stdout:96_head 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi069.stdout:97_head 2023-11-17T06:33:12.008 INFO:teuthology.orchestra.run.smithi069.stdout:9_head 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdbb682140 1 -- 172.21.15.69:0/1490043186 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x563dd7124d70 msgr2=0x563dd7129880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdbb682140 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x563dd7124d70 0x563dd7129880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdbb682140 1 -- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd9c064e70 msgr2=0x7fcd9c067330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdbb682140 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcd9c064e70 0x7fcd9c067330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcdac013040 tx=0x7fcdac007030 comp rx=0 tx=0).stop 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdbb682140 1 -- 172.21.15.69:0/1490043186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 msgr2=0x563dd710e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdbb682140 1 --2- 172.21.15.69:0/1490043186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563dd712f540 0x563dd710e4f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400b610 tx=0x7fcdb4000bc0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdb99bd700 1 -- 172.21.15.69:0/1490043186 reap_dead start 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdbb682140 1 -- 172.21.15.69:0/1490043186 shutdown_connections 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdbb682140 1 -- 172.21.15.69:0/1490043186 >> 172.21.15.69:0/1490043186 conn(0x563dd705da10 msgr2=0x563dd705ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdbb682140 1 -- 172.21.15.69:0/1490043186 shutdown_connections 2023-11-17T06:33:12.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:11.972+0000 7fcdbb682140 1 -- 172.21.15.69:0/1490043186 wait complete. 2023-11-17T06:33:12.010 INFO:tasks.cephfs.test_data_scan:victim_key=21_head 2023-11-17T06:33:12.010 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.01000000 21_head 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8cfc3140 1 Processor -- start 2023-11-17T06:33:12.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8cfc3140 1 -- start start 2023-11-17T06:33:12.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8cfc3140 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5593acb34b90 0x5593acc09b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8cfc3140 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x5593acb34f70 0x5593acbf9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8cfc3140 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb7be30 0x5593acb2f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8cfc3140 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593aca83ba0 con 0x5593acb7be30 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8cfc3140 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593aca824e0 con 0x5593acb34b90 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8cfc3140 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593aca55240 con 0x5593acb34f70 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8b2fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb7be30 0x5593acb2f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8b2fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb7be30 0x5593acb2f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48262/0 (socket says 172.21.15.69:48262) 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8b2fe700 1 -- 172.21.15.69:0/2672735845 learned_addr learned my addr 172.21.15.69:0/2672735845 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8aafd700 1 --2- 172.21.15.69:0/2672735845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5593acb34b90 0x5593acc09b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e83fff700 1 --2- 172.21.15.69:0/2672735845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x5593acb34f70 0x5593acbf9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8b2fe700 1 -- 172.21.15.69:0/2672735845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x5593acb34f70 msgr2=0x5593acbf9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8b2fe700 1 --2- 172.21.15.69:0/2672735845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x5593acb34f70 0x5593acbf9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8b2fe700 1 -- 172.21.15.69:0/2672735845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5593acb34b90 msgr2=0x5593acc09b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8b2fe700 1 --2- 172.21.15.69:0/2672735845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5593acb34b90 0x5593acc09b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8b2fe700 1 -- 172.21.15.69:0/2672735845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8400a100 con 0x5593acb7be30 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e83fff700 1 --2- 172.21.15.69:0/2672735845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x5593acb34f70 0x5593acbf9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:12.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.080+0000 7f3e8b2fe700 1 --2- 172.21.15.69:0/2672735845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb7be30 0x5593acb2f170 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x5593acb381f0 tx=0x7f3e8400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d65170b5a043db0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e89afb700 1 -- 172.21.15.69:0/2672735845 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8400f590 con 0x5593acb7be30 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e89afb700 1 -- 172.21.15.69:0/2672735845 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8400f710 con 0x5593acb7be30 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e89afb700 1 -- 172.21.15.69:0/2672735845 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8400fca0 con 0x5593acb7be30 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/2672735845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb7be30 msgr2=0x5593acb2f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 --2- 172.21.15.69:0/2672735845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb7be30 0x5593acb2f170 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x5593acb381f0 tx=0x7f3e8400f000 comp rx=0 tx=0).stop 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/2672735845 shutdown_connections 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 --2- 172.21.15.69:0/2672735845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb7be30 0x5593acb2f170 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 --2- 172.21.15.69:0/2672735845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x5593acb34f70 0x5593acbf9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 --2- 172.21.15.69:0/2672735845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5593acb34b90 0x5593acc09b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/2672735845 >> 172.21.15.69:0/2672735845 conn(0x5593acb35a10 msgr2=0x5593acb338c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/2672735845 shutdown_connections 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/2672735845 wait complete. 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 Processor -- start 2023-11-17T06:33:12.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.084+0000 7f3e8cfc3140 1 -- start start 2023-11-17T06:33:12.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8cfc3140 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x5593acb34b90 0x5593acbf3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8cfc3140 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb34f70 0x5593acb756b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8cfc3140 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5593acb7be30 0x5593acb76bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8cfc3140 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593acb76110 con 0x5593acb34f70 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8cfc3140 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593acb763b0 con 0x5593acb7be30 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8cfc3140 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593acbf5bc0 con 0x5593acb34b90 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e83fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb34f70 0x5593acb756b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e83fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb34f70 0x5593acb756b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48264/0 (socket says 172.21.15.69:48264) 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e83fff700 1 -- 172.21.15.69:0/3848781925 learned_addr learned my addr 172.21.15.69:0/3848781925 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8aafd700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x5593acb34b90 0x5593acbf3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8b2fe700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5593acb7be30 0x5593acb76bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e83fff700 1 -- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x5593acb34b90 msgr2=0x5593acbf3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e83fff700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x5593acb34b90 0x5593acbf3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e83fff700 1 -- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5593acb7be30 msgr2=0x5593acb76bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e83fff700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5593acb7be30 0x5593acb76bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e83fff700 1 -- 172.21.15.69:0/3848781925 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593aca87390 con 0x5593acb34f70 2023-11-17T06:33:12.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8b2fe700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5593acb7be30 0x5593acb76bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:12.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e83fff700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb34f70 0x5593acb756b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3e74001c30 tx=0x7f3e7400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e88af9700 1 -- 172.21.15.69:0/3848781925 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e74001d80 con 0x5593acb34f70 2023-11-17T06:33:12.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e88af9700 1 -- 172.21.15.69:0/3848781925 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7400e440 con 0x5593acb34f70 2023-11-17T06:33:12.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/3848781925 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5593aca6d3a0 con 0x5593acb34f70 2023-11-17T06:33:12.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e88af9700 1 -- 172.21.15.69:0/3848781925 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7400e7f0 con 0x5593acb34f70 2023-11-17T06:33:12.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.088+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/3848781925 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5593aca60550 con 0x5593acb34f70 2023-11-17T06:33:12.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.092+0000 7f3e88af9700 1 -- 172.21.15.69:0/3848781925 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f3e7400e950 con 0x5593acb34f70 2023-11-17T06:33:12.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.092+0000 7f3e88af9700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3e6c064e70 0x7f3e6c067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.092+0000 7f3e88af9700 1 -- 172.21.15.69:0/3848781925 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f3e74082d90 con 0x5593acb34f70 2023-11-17T06:33:12.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.092+0000 7f3e8cfc3140 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x5593acb75bf0 0x5593acb790c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.092+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/3848781925 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:1 4.5 4:a40620de:::10000000000.01000000:head [omap-rm-keys in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40) v8 -- 0x5593acc9d0a0 con 0x5593acb75bf0 2023-11-17T06:33:12.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.092+0000 7f3e8aafd700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3e6c064e70 0x7f3e6c067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.092+0000 7f3e8b2fe700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x5593acb75bf0 0x5593acb790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8aafd700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3e6c064e70 0x7f3e6c067330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c005610 tx=0x7f3e7c00c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8b2fe700 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x5593acb75bf0 0x5593acb790c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8b2fe700 1 -- 172.21.15.69:0/3848781925 <== osd.3 v2:172.21.15.69:6824/183679214 1 ==== osd_op_reply(1 10000000000.01000000 [omap-rm-keys] v40'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f3e8402b040 con 0x5593acb75bf0 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/3848781925 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x5593acb75bf0 msgr2=0x5593acb790c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8cfc3140 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x5593acb75bf0 0x5593acb790c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3e6c064e70 msgr2=0x7f3e6c067330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8cfc3140 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3e6c064e70 0x7f3e6c067330 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c005610 tx=0x7f3e7c00c040 comp rx=0 tx=0).stop 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/3848781925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb34f70 msgr2=0x5593acb756b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8cfc3140 1 --2- 172.21.15.69:0/3848781925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593acb34f70 0x5593acb756b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3e74001c30 tx=0x7f3e7400a5c0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8b2fe700 1 -- 172.21.15.69:0/3848781925 reap_dead start 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/3848781925 shutdown_connections 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/3848781925 >> 172.21.15.69:0/3848781925 conn(0x5593acb35a10 msgr2=0x5593acb7b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:12.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/3848781925 shutdown_connections 2023-11-17T06:33:12.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.096+0000 7f3e8cfc3140 1 -- 172.21.15.69:0/3848781925 wait complete. 2023-11-17T06:33:12.110 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-11-17T06:33:12.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.284+0000 7fe0be55d700 1 Processor -- start 2023-11-17T06:33:12.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.284+0000 7fe0be55d700 1 -- start start 2023-11-17T06:33:12.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0be55d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0b806cc90 0x7fe0b806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0be55d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe0b80b6580 0x7fe0b80b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0be55d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b806d630 con 0x7fe0b815d550 2023-11-17T06:33:12.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0be55d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b80cf400 con 0x7fe0b80b6580 2023-11-17T06:33:12.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0be55d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80d2340 con 0x7fe0b806cc90 2023-11-17T06:33:12.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0bdd5c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe0b80b6580 0x7fe0b80b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0bdd5c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe0b80b6580 0x7fe0b80b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48270/0 (socket says 172.21.15.69:48270) 2023-11-17T06:33:12.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0bdd5c700 1 -- 172.21.15.69:0/1622703877 learned_addr learned my addr 172.21.15.69:0/1622703877 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:12.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0bcd5a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0b806cc90 0x7fe0b806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0bdd5c700 1 -- 172.21.15.69:0/1622703877 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0b806cc90 msgr2=0x7fe0b806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:12.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0bdd5c700 1 --2- 172.21.15.69:0/1622703877 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0b806cc90 0x7fe0b806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0bdd5c700 1 -- 172.21.15.69:0/1622703877 >> v1:172.21.15.93:6789/0 conn(0x7fe0b815d550 legacy=0x7fe0b80d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0bdd5c700 1 -- 172.21.15.69:0/1622703877 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b80d1730 con 0x7fe0b80b6580 2023-11-17T06:33:12.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0bdd5c700 1 --2- 172.21.15.69:0/1622703877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 0x7fe0b80b6a10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0009e50 tx=0x7fe0b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ef5ba2a116608f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0affff700 1 -- 172.21.15.69:0/1622703877 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000e070 con 0x7fe0b80b6580 2023-11-17T06:33:12.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0affff700 1 -- 172.21.15.69:0/1622703877 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000b910 con 0x7fe0b80b6580 2023-11-17T06:33:12.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.288+0000 7fe0affff700 1 -- 172.21.15.69:0/1622703877 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000bcc0 con 0x7fe0b80b6580 2023-11-17T06:33:12.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.292+0000 7fe0be55d700 1 -- 172.21.15.69:0/1622703877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 msgr2=0x7fe0b80b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.292+0000 7fe0be55d700 1 --2- 172.21.15.69:0/1622703877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 0x7fe0b80b6a10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0009e50 tx=0x7fe0b000b330 comp rx=0 tx=0).stop 2023-11-17T06:33:12.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.292+0000 7fe0be55d700 1 -- 172.21.15.69:0/1622703877 shutdown_connections 2023-11-17T06:33:12.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.292+0000 7fe0be55d700 1 --2- 172.21.15.69:0/1622703877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 0x7fe0b80b6a10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.292+0000 7fe0be55d700 1 --2- 172.21.15.69:0/1622703877 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0b806cc90 0x7fe0b806d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.292+0000 7fe0be55d700 1 -- 172.21.15.69:0/1622703877 >> 172.21.15.69:0/1622703877 conn(0x7fe0b80b4cb0 msgr2=0x7fe0b80b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:12.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.292+0000 7fe0be55d700 1 -- 172.21.15.69:0/1622703877 shutdown_connections 2023-11-17T06:33:12.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.292+0000 7fe0be55d700 1 -- 172.21.15.69:0/1622703877 wait complete. 2023-11-17T06:33:12.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0be55d700 1 Processor -- start 2023-11-17T06:33:12.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0be55d700 1 -- start start 2023-11-17T06:33:12.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0be55d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0b806cc90 0x7fe0b815e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0be55d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 0x7fe0b8153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0be55d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0b815d550 0x7fe0b80b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0be55d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b80cc9a0 con 0x7fe0b80b6580 2023-11-17T06:33:12.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0be55d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b815e610 con 0x7fe0b815d550 2023-11-17T06:33:12.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0be55d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b8153c80 con 0x7fe0b806cc90 2023-11-17T06:33:12.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bcd5a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 0x7fe0b8153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bcd5a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 0x7fe0b8153740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48282/0 (socket says 172.21.15.69:48282) 2023-11-17T06:33:12.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bcd5a700 1 -- 172.21.15.69:0/3482728788 learned_addr learned my addr 172.21.15.69:0/3482728788 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:12.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bd55b700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0b806cc90 0x7fe0b815e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bdd5c700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0b815d550 0x7fe0b80b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bcd5a700 1 -- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0b806cc90 msgr2=0x7fe0b815e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bcd5a700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0b806cc90 0x7fe0b815e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bcd5a700 1 -- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0b815d550 msgr2=0x7fe0b80b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bcd5a700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0b815d550 0x7fe0b80b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bcd5a700 1 -- 172.21.15.69:0/3482728788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0009b30 con 0x7fe0b80b6580 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bdd5c700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0b815d550 0x7fe0b80b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.296+0000 7fe0bcd5a700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 0x7fe0b8153740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800ea00 tx=0x7fe0a800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.300+0000 7fe0adffb700 1 -- 172.21.15.69:0/3482728788 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8009720 con 0x7fe0b80b6580 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.300+0000 7fe0adffb700 1 -- 172.21.15.69:0/3482728788 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a800c850 con 0x7fe0b80b6580 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.300+0000 7fe0be55d700 1 -- 172.21.15.69:0/3482728788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b81f6300 con 0x7fe0b80b6580 2023-11-17T06:33:12.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.300+0000 7fe0adffb700 1 -- 172.21.15.69:0/3482728788 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a800cbc0 con 0x7fe0b80b6580 2023-11-17T06:33:12.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.300+0000 7fe0be55d700 1 -- 172.21.15.69:0/3482728788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b81f68c0 con 0x7fe0b80b6580 2023-11-17T06:33:12.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.300+0000 7fe0be55d700 1 -- 172.21.15.69:0/3482728788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b804e650 con 0x7fe0b80b6580 2023-11-17T06:33:12.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.304+0000 7fe0adffb700 1 -- 172.21.15.69:0/3482728788 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe0a800cd20 con 0x7fe0b80b6580 2023-11-17T06:33:12.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.304+0000 7fe0adffb700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe09c066510 0x7fe09c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:12.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.304+0000 7fe0adffb700 1 -- 172.21.15.69:0/3482728788 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fe0a8083ea0 con 0x7fe0b80b6580 2023-11-17T06:33:12.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.304+0000 7fe0bd55b700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe09c066510 0x7fe09c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:12.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.304+0000 7fe0bd55b700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe09c066510 0x7fe09c0689d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4000f60 tx=0x7fe0b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:12.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.312+0000 7fe0adffb700 1 -- 172.21.15.69:0/3482728788 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe0a80512e0 con 0x7fe0b80b6580 2023-11-17T06:33:12.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.524+0000 7fe0be55d700 1 -- 172.21.15.69:0/3482728788 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fe0b80ce090 con 0x7fe0b80b6580 2023-11-17T06:33:12.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.864+0000 7fe0adffb700 1 -- 172.21.15.69:0/3482728788 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v17) v1 ==== 162+0+0 (secure 0 0 0) 0x7fe0a8054900 con 0x7fe0b80b6580 2023-11-17T06:33:12.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 -- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe09c066510 msgr2=0x7fe09c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe09c066510 0x7fe09c0689d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4000f60 tx=0x7fe0b4009040 comp rx=0 tx=0).stop 2023-11-17T06:33:12.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 -- 172.21.15.69:0/3482728788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 msgr2=0x7fe0b8153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:12.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 0x7fe0b8153740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe0a800ea00 tx=0x7fe0a800ed10 comp rx=0 tx=0).stop 2023-11-17T06:33:12.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 -- 172.21.15.69:0/3482728788 shutdown_connections 2023-11-17T06:33:12.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe09c066510 0x7fe09c0689d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe0b815d550 0x7fe0b80b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe0b80b6580 0x7fe0b8153740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 --2- 172.21.15.69:0/3482728788 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe0b806cc90 0x7fe0b815e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:12.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 -- 172.21.15.69:0/3482728788 >> 172.21.15.69:0/3482728788 conn(0x7fe0b80b4cb0 msgr2=0x7fe0b80b6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:12.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 -- 172.21.15.69:0/3482728788 shutdown_connections 2023-11-17T06:33:12.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:12.868+0000 7fe0be55d700 1 -- 172.21.15.69:0/3482728788 wait complete. 2023-11-17T06:33:12.875 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked joinable; MDS may join as newly active. 2023-11-17T06:33:12.897 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:13.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.060+0000 7ff4f82d4700 1 Processor -- start 2023-11-17T06:33:13.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f82d4700 1 -- start start 2023-11-17T06:33:13.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f82d4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff4f0165b90 0x7ff4f00cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f82d4700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f0161d80 con 0x7ff4f00cded0 2023-11-17T06:33:13.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f82d4700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f01661c0 con 0x7ff4f01619a0 2023-11-17T06:33:13.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f82d4700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f00c9490 con 0x7ff4f0165b90 2023-11-17T06:33:13.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f586f700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ff4f00cded0 0x7ff4f006bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:42460/0 (socket says 172.21.15.69:42460) 2023-11-17T06:33:13.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f6070700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff4f01619a0 0x7ff4f0165480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:57610/0 (socket says 172.21.15.69:57610) 2023-11-17T06:33:13.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f586f700 1 -- 172.21.15.69:0/4073141432 learned_addr learned my addr 172.21.15.69:0/4073141432 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:13.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f6871700 1 --2- 172.21.15.69:0/4073141432 >> v2:172.21.15.93:3300/0 conn(0x7ff4f0165b90 0x7ff4f00cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f506e700 1 -- 172.21.15.69:0/4073141432 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2867322906 0 0) 0x7ff4f0161d80 con 0x7ff4f00cded0 2023-11-17T06:33:13.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.064+0000 7ff4f506e700 1 -- 172.21.15.69:0/4073141432 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4dc0035d0 con 0x7ff4f00cded0 2023-11-17T06:33:13.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f506e700 1 -- 172.21.15.69:0/4073141432 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210371651 0 0) 0x7ff4f01661c0 con 0x7ff4f01619a0 2023-11-17T06:33:13.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f506e700 1 -- 172.21.15.69:0/4073141432 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f0161d80 con 0x7ff4f01619a0 2023-11-17T06:33:13.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f6871700 1 -- 172.21.15.69:0/4073141432 >> v1:172.21.15.93:6789/0 conn(0x7ff4f01619a0 legacy=0x7ff4f0165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f6871700 1 -- 172.21.15.69:0/4073141432 >> v1:172.21.15.69:6789/0 conn(0x7ff4f00cded0 legacy=0x7ff4f006bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f6871700 1 -- 172.21.15.69:0/4073141432 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f00c96a0 con 0x7ff4f0165b90 2023-11-17T06:33:13.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f6871700 1 --2- 172.21.15.69:0/4073141432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4f0165b90 0x7ff4f00cb170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009850 tx=0x7ff4e8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fde9b2e8fc1ec8f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:13.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f506e700 1 -- 172.21.15.69:0/4073141432 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8011830 con 0x7ff4f0165b90 2023-11-17T06:33:13.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f506e700 1 -- 172.21.15.69:0/4073141432 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e8011990 con 0x7ff4f0165b90 2023-11-17T06:33:13.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f506e700 1 -- 172.21.15.69:0/4073141432 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8011d40 con 0x7ff4f0165b90 2023-11-17T06:33:13.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f82d4700 1 -- 172.21.15.69:0/4073141432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4f0165b90 msgr2=0x7ff4f00cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f82d4700 1 --2- 172.21.15.69:0/4073141432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4f0165b90 0x7ff4f00cb170 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009850 tx=0x7ff4e8009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:13.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f82d4700 1 -- 172.21.15.69:0/4073141432 shutdown_connections 2023-11-17T06:33:13.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f82d4700 1 --2- 172.21.15.69:0/4073141432 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4f0165b90 0x7ff4f00cb170 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f82d4700 1 -- 172.21.15.69:0/4073141432 >> 172.21.15.69:0/4073141432 conn(0x7ff4f00cee40 msgr2=0x7ff4f00cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:13.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f82d4700 1 -- 172.21.15.69:0/4073141432 shutdown_connections 2023-11-17T06:33:13.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.068+0000 7ff4f82d4700 1 -- 172.21.15.69:0/4073141432 wait complete. 2023-11-17T06:33:13.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f82d4700 1 Processor -- start 2023-11-17T06:33:13.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f82d4700 1 -- start start 2023-11-17T06:33:13.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f82d4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4f00cded0 0x7ff4f0161f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f82d4700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4f01619a0 0x7ff4f0163d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f82d4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4f0165b90 0x7ff4f015b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f82d4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f0162560 con 0x7ff4f0165b90 2023-11-17T06:33:13.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f82d4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f0162840 con 0x7ff4f00cded0 2023-11-17T06:33:13.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f82d4700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f0162b20 con 0x7ff4f01619a0 2023-11-17T06:33:13.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f6871700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4f0165b90 0x7ff4f015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f6871700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4f0165b90 0x7ff4f015b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48284/0 (socket says 172.21.15.69:48284) 2023-11-17T06:33:13.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f6871700 1 -- 172.21.15.69:0/2158296572 learned_addr learned my addr 172.21.15.69:0/2158296572 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:13.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f586f700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4f01619a0 0x7ff4f0163d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.072+0000 7ff4f6070700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4f00cded0 0x7ff4f0161f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4f6871700 1 -- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4f01619a0 msgr2=0x7ff4f0163d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4f6871700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4f01619a0 0x7ff4f0163d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4f6871700 1 -- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4f00cded0 msgr2=0x7ff4f0161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4f6871700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4f00cded0 0x7ff4f0161f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4f6871700 1 -- 172.21.15.69:0/2158296572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e80094b0 con 0x7ff4f0165b90 2023-11-17T06:33:13.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4f6871700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4f0165b90 0x7ff4f015b490 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80090b0 tx=0x7ff4e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:13.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4e6ffd700 1 -- 172.21.15.69:0/2158296572 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e801a830 con 0x7ff4f0165b90 2023-11-17T06:33:13.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4e6ffd700 1 -- 172.21.15.69:0/2158296572 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4e801e070 con 0x7ff4f0165b90 2023-11-17T06:33:13.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4f82d4700 1 -- 172.21.15.69:0/2158296572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f0162e00 con 0x7ff4f0165b90 2023-11-17T06:33:13.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4e6ffd700 1 -- 172.21.15.69:0/2158296572 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e801abf0 con 0x7ff4f0165b90 2023-11-17T06:33:13.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4f82d4700 1 -- 172.21.15.69:0/2158296572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f0164290 con 0x7ff4f0165b90 2023-11-17T06:33:13.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.076+0000 7ff4f82d4700 1 -- 172.21.15.69:0/2158296572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f004e650 con 0x7ff4f0165b90 2023-11-17T06:33:13.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.080+0000 7ff4e6ffd700 1 -- 172.21.15.69:0/2158296572 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff4e801ad50 con 0x7ff4f0165b90 2023-11-17T06:33:13.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.080+0000 7ff4e6ffd700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff4d4066510 0x7ff4d40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:13.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.080+0000 7ff4e6ffd700 1 -- 172.21.15.69:0/2158296572 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7ff4e8084e20 con 0x7ff4f0165b90 2023-11-17T06:33:13.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.080+0000 7ff4f6070700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff4d4066510 0x7ff4d40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:13.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.080+0000 7ff4f6070700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff4d4066510 0x7ff4d40689d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec001330 tx=0x7ff4ec001ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:13.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.084+0000 7ff4e6ffd700 1 -- 172.21.15.69:0/2158296572 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff4e8052140 con 0x7ff4f0165b90 2023-11-17T06:33:13.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.300+0000 7ff4f82d4700 1 -- 172.21.15.69:0/2158296572 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4f00b4dc0 con 0x7ff4f0165b90 2023-11-17T06:33:13.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.300+0000 7ff4e6ffd700 1 -- 172.21.15.69:0/2158296572 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4914 (secure 0 0 0) 0x7ff4e8055760 con 0x7ff4f0165b90 2023-11-17T06:33:13.304 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:13.305 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:33:12.871910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5202":{"gid":5202,"name":"c","rank":0,"incarnation":18,"state":"up:replay","state_seq":1,"addr":"172.21.15.69:6835/1050522275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1050522275},{"type":"v1","addr":"172.21.15.69:6835","nonce":1050522275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:13.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 -- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff4d4066510 msgr2=0x7ff4d40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff4d4066510 0x7ff4d40689d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec001330 tx=0x7ff4ec001ac0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 -- 172.21.15.69:0/2158296572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4f0165b90 msgr2=0x7ff4f015b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:13.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4f0165b90 0x7ff4f015b490 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff4e80090b0 tx=0x7ff4e8004770 comp rx=0 tx=0).stop 2023-11-17T06:33:13.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 -- 172.21.15.69:0/2158296572 shutdown_connections 2023-11-17T06:33:13.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff4d4066510 0x7ff4d40689d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4f0165b90 0x7ff4f015b490 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff4f01619a0 0x7ff4f0163d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 --2- 172.21.15.69:0/2158296572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff4f00cded0 0x7ff4f0161f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:13.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 -- 172.21.15.69:0/2158296572 >> 172.21.15.69:0/2158296572 conn(0x7ff4f00cee40 msgr2=0x7ff4f00b0120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:13.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 -- 172.21.15.69:0/2158296572 shutdown_connections 2023-11-17T06:33:13.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:13.304+0000 7ff4f82d4700 1 -- 172.21.15.69:0/2158296572 wait complete. 2023-11-17T06:33:13.309 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 18 2023-11-17T06:33:13.735 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:25.683625+0000', 'modified': '2023-11-17T06:33:12.871910+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5202}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5202': {'gid': 5202, 'name': 'c', 'rank': 0, 'incarnation': 18, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.69:6835/1050522275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6834', 'nonce': 1050522275}, {'type': 'v1', 'addr': '172.21.15.69:6835', 'nonce': 1050522275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:33:13.735 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5202:up:replay 2023-11-17T06:33:14.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:14.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.908+0000 7f7cb6b38700 1 Processor -- start 2023-11-17T06:33:14.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.908+0000 7f7cb6b38700 1 -- start start 2023-11-17T06:33:14.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7cb6b38700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 0x7f7cb00ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:14.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7cb6b38700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb0161fd0 con 0x7f7cb00cca10 2023-11-17T06:33:14.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7cb6b38700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb015e620 con 0x7f7cb006d7d0 2023-11-17T06:33:14.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7cb6b38700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb015eab0 con 0x7f7cb0161ad0 2023-11-17T06:33:14.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7cb48d4700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7cb00cca10 0x7f7cb00ccdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55852/0 (socket says 172.21.15.69:55852) 2023-11-17T06:33:14.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7cb48d4700 1 -- 172.21.15.69:0/516570808 learned_addr learned my addr 172.21.15.69:0/516570808 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:14.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7caffff700 1 --2- 172.21.15.69:0/516570808 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 0x7f7cb00ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:14.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7caffff700 1 -- 172.21.15.69:0/516570808 >> v1:172.21.15.93:6789/0 conn(0x7f7cb006d7d0 legacy=0x7f7cb00ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:14.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7caffff700 1 -- 172.21.15.69:0/516570808 >> v1:172.21.15.69:6789/0 conn(0x7f7cb00cca10 legacy=0x7f7cb00ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:14.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7caffff700 1 -- 172.21.15.69:0/516570808 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb015dcf0 con 0x7f7cb0161ad0 2023-11-17T06:33:14.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7caf7fe700 1 -- 172.21.15.69:0/516570808 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985391679 0 0) 0x7f7cb0161fd0 con 0x7f7cb00cca10 2023-11-17T06:33:14.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7caffff700 1 --2- 172.21.15.69:0/516570808 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 0x7f7cb00ac8d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009880 tx=0x7f7c9c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d64c9a2327485e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:14.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7caf7fe700 1 -- 172.21.15.69:0/516570808 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c011830 con 0x7f7cb0161ad0 2023-11-17T06:33:14.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7caf7fe700 1 -- 172.21.15.69:0/516570808 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c011990 con 0x7f7cb0161ad0 2023-11-17T06:33:14.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7caf7fe700 1 -- 172.21.15.69:0/516570808 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c011d20 con 0x7f7cb0161ad0 2023-11-17T06:33:14.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7cb6b38700 1 -- 172.21.15.69:0/516570808 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 msgr2=0x7f7cb00ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:14.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.912+0000 7f7cb6b38700 1 --2- 172.21.15.69:0/516570808 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 0x7f7cb00ac8d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c009880 tx=0x7f7c9c009b90 comp rx=0 tx=0).stop 2023-11-17T06:33:14.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 -- 172.21.15.69:0/516570808 shutdown_connections 2023-11-17T06:33:14.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 --2- 172.21.15.69:0/516570808 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 0x7f7cb00ac8d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:14.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 -- 172.21.15.69:0/516570808 >> 172.21.15.69:0/516570808 conn(0x7f7cb00cee40 msgr2=0x7f7cb00cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:14.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 -- 172.21.15.69:0/516570808 shutdown_connections 2023-11-17T06:33:14.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 -- 172.21.15.69:0/516570808 wait complete. 2023-11-17T06:33:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 Processor -- start 2023-11-17T06:33:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 -- start start 2023-11-17T06:33:14.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb006d7d0 0x7f7cb014e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:14.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb00cca10 0x7f7cb00c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:14.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 0x7f7cb00c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:14.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb00c46f0 con 0x7f7cb006d7d0 2023-11-17T06:33:14.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb00c3ae0 con 0x7f7cb00cca10 2023-11-17T06:33:14.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.916+0000 7f7cb6b38700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb00c3dc0 con 0x7f7cb0161ad0 2023-11-17T06:33:14.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb48d4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb006d7d0 0x7f7cb014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb48d4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb006d7d0 0x7f7cb014e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46924/0 (socket says 172.21.15.69:46924) 2023-11-17T06:33:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb48d4700 1 -- 172.21.15.69:0/3229235810 learned_addr learned my addr 172.21.15.69:0/3229235810 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7caffff700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb00cca10 0x7f7cb00c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb50d5700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 0x7f7cb00c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb48d4700 1 -- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 msgr2=0x7f7cb00c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb48d4700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 0x7f7cb00c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb48d4700 1 -- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb00cca10 msgr2=0x7f7cb00c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb48d4700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb00cca10 0x7f7cb00c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb48d4700 1 -- 172.21.15.69:0/3229235810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0094b0 con 0x7f7cb006d7d0 2023-11-17T06:33:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7caffff700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb00cca10 0x7f7cb00c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb48d4700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb006d7d0 0x7f7cb014e700 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400c4a0 tx=0x7f7ca400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:14.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cad7fa700 1 -- 172.21.15.69:0/3229235810 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4005c60 con 0x7f7cb006d7d0 2023-11-17T06:33:14.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cad7fa700 1 -- 172.21.15.69:0/3229235810 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca4005dc0 con 0x7f7cb006d7d0 2023-11-17T06:33:14.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb6b38700 1 -- 172.21.15.69:0/3229235810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb00c40a0 con 0x7f7cb006d7d0 2023-11-17T06:33:14.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cad7fa700 1 -- 172.21.15.69:0/3229235810 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4007310 con 0x7f7cb006d7d0 2023-11-17T06:33:14.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb6b38700 1 -- 172.21.15.69:0/3229235810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb00c9070 con 0x7f7cb006d7d0 2023-11-17T06:33:14.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.920+0000 7f7cb6b38700 1 -- 172.21.15.69:0/3229235810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb004e650 con 0x7f7cb006d7d0 2023-11-17T06:33:14.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.924+0000 7f7cad7fa700 1 -- 172.21.15.69:0/3229235810 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ca4007470 con 0x7f7cb006d7d0 2023-11-17T06:33:14.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.924+0000 7f7cad7fa700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c94066510 0x7f7c940689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:14.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.924+0000 7f7cad7fa700 1 -- 172.21.15.69:0/3229235810 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f7ca4083400 con 0x7f7cb006d7d0 2023-11-17T06:33:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.924+0000 7f7caffff700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c94066510 0x7f7c940689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:14.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.928+0000 7f7caffff700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c94066510 0x7f7c940689d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0090b0 tx=0x7f7c9c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:14.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:14.932+0000 7f7cad7fa700 1 -- 172.21.15.69:0/3229235810 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ca4050710 con 0x7f7cb006d7d0 2023-11-17T06:33:15.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.144+0000 7f7cb6b38700 1 -- 172.21.15.69:0/3229235810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cb00c9260 con 0x7f7cb006d7d0 2023-11-17T06:33:15.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.144+0000 7f7cad7fa700 1 -- 172.21.15.69:0/3229235810 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f7cb00c9260 con 0x7f7cb006d7d0 2023-11-17T06:33:15.151 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:15.151 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:33:13.887011+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5202":{"gid":5202,"name":"c","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":32,"addr":"172.21.15.69:6835/1050522275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1050522275},{"type":"v1","addr":"172.21.15.69:6835","nonce":1050522275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:15.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 -- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c94066510 msgr2=0x7f7c940689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:15.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c94066510 0x7f7c940689d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0090b0 tx=0x7f7c9c008030 comp rx=0 tx=0).stop 2023-11-17T06:33:15.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 -- 172.21.15.69:0/3229235810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb006d7d0 msgr2=0x7f7cb014e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:15.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb006d7d0 0x7f7cb014e700 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400c4a0 tx=0x7f7ca400c7b0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 -- 172.21.15.69:0/3229235810 shutdown_connections 2023-11-17T06:33:15.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7c94066510 0x7f7c940689d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cb0161ad0 0x7f7cb00c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cb00cca10 0x7f7cb00c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 --2- 172.21.15.69:0/3229235810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cb006d7d0 0x7f7cb014e700 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:15.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 -- 172.21.15.69:0/3229235810 >> 172.21.15.69:0/3229235810 conn(0x7f7cb00cee40 msgr2=0x7f7cb0158060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:15.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 -- 172.21.15.69:0/3229235810 shutdown_connections 2023-11-17T06:33:15.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:15.148+0000 7f7cb6b38700 1 -- 172.21.15.69:0/3229235810 wait complete. 2023-11-17T06:33:15.156 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 20 2023-11-17T06:33:15.577 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 20, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:25.683625+0000', 'modified': '2023-11-17T06:33:13.887011+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5202}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5202': {'gid': 5202, 'name': 'c', 'rank': 0, 'incarnation': 18, 'state': 'up:rejoin', 'state_seq': 32, 'addr': '172.21.15.69:6835/1050522275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6834', 'nonce': 1050522275}, {'type': 'v1', 'addr': '172.21.15.69:6835', 'nonce': 1050522275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:33:15.577 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5202:up:rejoin 2023-11-17T06:33:16.578 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:16.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.756+0000 7f06e28b0700 1 Processor -- start 2023-11-17T06:33:16.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.756+0000 7f06e28b0700 1 -- start start 2023-11-17T06:33:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.756+0000 7f06e28b0700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f06dc0c23f0 0x7f06dc0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:16.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.756+0000 7f06e28b0700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f06dc1658a0 0x7f06dc0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.756+0000 7f06e28b0700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc0cde30 con 0x7f06dc165e80 2023-11-17T06:33:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.756+0000 7f06e28b0700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0cd220 con 0x7f06dc1658a0 2023-11-17T06:33:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.756+0000 7f06e28b0700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc0cd500 con 0x7f06dc0c23f0 2023-11-17T06:33:16.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e10ad700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f06dc165e80 0x7f06dc165190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55856/0 (socket says 172.21.15.69:55856) 2023-11-17T06:33:16.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e10ad700 1 -- 172.21.15.69:0/2394309754 learned_addr learned my addr 172.21.15.69:0/2394309754 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:16.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e20af700 1 --2- 172.21.15.69:0/2394309754 >> v2:172.21.15.69:3300/0 conn(0x7f06dc1658a0 0x7f06dc0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:16.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e18ae700 1 --2- 172.21.15.69:0/2394309754 >> v2:172.21.15.93:3300/0 conn(0x7f06dc0c23f0 0x7f06dc0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:16.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612993164 0 0) 0x7f06dc0cde30 con 0x7f06dc165e80 2023-11-17T06:33:16.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c80035d0 con 0x7f06dc165e80 2023-11-17T06:33:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4094732083 0 0) 0x7f06c80035d0 con 0x7f06dc165e80 2023-11-17T06:33:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 >> v2:172.21.15.93:3300/0 conn(0x7f06dc0c23f0 msgr2=0x7f06dc0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 --2- 172.21.15.69:0/2394309754 >> v2:172.21.15.93:3300/0 conn(0x7f06dc0c23f0 0x7f06dc0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:16.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 >> v2:172.21.15.69:3300/0 conn(0x7f06dc1658a0 msgr2=0x7f06dc0c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 --2- 172.21.15.69:0/2394309754 >> v2:172.21.15.69:3300/0 conn(0x7f06dc1658a0 0x7f06dc0c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0cd7e0 con 0x7f06dc165e80 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f06cc001670 con 0x7f06dc165e80 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e20af700 1 --2- 172.21.15.69:0/2394309754 >> v2:172.21.15.69:3300/0 conn(0x7f06dc1658a0 0x7f06dc0c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 >> v1:172.21.15.69:6789/0 conn(0x7f06dc165e80 legacy=0x7f06dc165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06c8003a70 0x7f06c8003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06c8004870 0x7f06c8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06c8005230 0x7f06c800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0cd220 con 0x7f06c8005230 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0cd500 con 0x7f06c8003a70 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c800c020 con 0x7f06c8004870 2023-11-17T06:33:16.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e20af700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06c8005230 0x7f06c800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:16.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e18ae700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06c8003a70 0x7f06c8003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:16.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e10ad700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06c8004870 0x7f06c8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e20af700 1 -- 172.21.15.69:0/2394309754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06c8004870 msgr2=0x7f06c8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e20af700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06c8004870 0x7f06c8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e20af700 1 -- 172.21.15.69:0/2394309754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06c8003a70 msgr2=0x7f06c8003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e20af700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06c8003a70 0x7f06c8003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e20af700 1 -- 172.21.15.69:0/2394309754 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80035d0 con 0x7f06c8005230 2023-11-17T06:33:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e18ae700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06c8003a70 0x7f06c8003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e20af700 1 -- 172.21.15.69:0/2394309754 reap_dead start 2023-11-17T06:33:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.760+0000 7f06e20af700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06c8005230 0x7f06c800ba30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f06d400e350 tx=0x7f06c80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1e7ead99a6170f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.764+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d400edf0 con 0x7f06c8005230 2023-11-17T06:33:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.764+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d400f040 con 0x7f06c8005230 2023-11-17T06:33:16.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.764+0000 7f06e08ac700 1 -- 172.21.15.69:0/2394309754 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40146c0 con 0x7f06c8005230 2023-11-17T06:33:16.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.764+0000 7f06e28b0700 1 -- 172.21.15.69:0/2394309754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06c8005230 msgr2=0x7f06c800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:16.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.764+0000 7f06e28b0700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06c8005230 0x7f06c800ba30 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f06d400e350 tx=0x7f06c80058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:16.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.764+0000 7f06e28b0700 1 -- 172.21.15.69:0/2394309754 shutdown_connections 2023-11-17T06:33:16.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.764+0000 7f06e28b0700 1 --2- 172.21.15.69:0/2394309754 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06c8005230 0x7f06c800ba30 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:16.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.764+0000 7f06e28b0700 1 -- 172.21.15.69:0/2394309754 >> 172.21.15.69:0/2394309754 conn(0x7f06dc0cece0 msgr2=0x7f06dc0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:16.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.764+0000 7f06e28b0700 1 -- 172.21.15.69:0/2394309754 shutdown_connections 2023-11-17T06:33:16.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.764+0000 7f06e28b0700 1 -- 172.21.15.69:0/2394309754 wait complete. 2023-11-17T06:33:16.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e28b0700 1 Processor -- start 2023-11-17T06:33:16.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e28b0700 1 -- start start 2023-11-17T06:33:16.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e28b0700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06c8005230 0x7f06dc0b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:16.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e28b0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06dc0c4140 0x7f06dc0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:16.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e28b0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06dc15f380 0x7f06dc0b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:16.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e28b0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0c28a0 con 0x7f06dc0c4140 2023-11-17T06:33:16.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e28b0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0b3c10 con 0x7f06dc15f380 2023-11-17T06:33:16.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e28b0700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0b3ef0 con 0x7f06c8005230 2023-11-17T06:33:16.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e10ad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06dc0c4140 0x7f06dc0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:16.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e10ad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06dc0c4140 0x7f06dc0c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46950/0 (socket says 172.21.15.69:46950) 2023-11-17T06:33:16.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e10ad700 1 -- 172.21.15.69:0/3804913495 learned_addr learned my addr 172.21.15.69:0/3804913495 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:16.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e18ae700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06c8005230 0x7f06dc0b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:16.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e20af700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06dc15f380 0x7f06dc0b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:16.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e10ad700 1 -- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06c8005230 msgr2=0x7f06dc0b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:16.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e10ad700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06c8005230 0x7f06dc0b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:16.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e10ad700 1 -- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06dc15f380 msgr2=0x7f06dc0b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:16.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e10ad700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06dc15f380 0x7f06dc0b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:16.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e10ad700 1 -- 172.21.15.69:0/3804913495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0b41d0 con 0x7f06dc0c4140 2023-11-17T06:33:16.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e10ad700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06dc0c4140 0x7f06dc0c8020 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c00 tx=0x7f06cc00eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:16.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06d27fc700 1 -- 172.21.15.69:0/3804913495 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc012590 con 0x7f06dc0c4140 2023-11-17T06:33:16.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06d27fc700 1 -- 172.21.15.69:0/3804913495 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc012710 con 0x7f06dc0c4140 2023-11-17T06:33:16.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06d27fc700 1 -- 172.21.15.69:0/3804913495 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc012ac0 con 0x7f06dc0c4140 2023-11-17T06:33:16.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e28b0700 1 -- 172.21.15.69:0/3804913495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc0b44b0 con 0x7f06dc0c4140 2023-11-17T06:33:16.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.768+0000 7f06e28b0700 1 -- 172.21.15.69:0/3804913495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc0c45c0 con 0x7f06dc0c4140 2023-11-17T06:33:16.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.772+0000 7f06e28b0700 1 -- 172.21.15.69:0/3804913495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc04e650 con 0x7f06dc0c4140 2023-11-17T06:33:16.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.772+0000 7f06d27fc700 1 -- 172.21.15.69:0/3804913495 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f06cc012c20 con 0x7f06dc0c4140 2023-11-17T06:33:16.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.772+0000 7f06d27fc700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f06c0066510 0x7f06c00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:16.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.772+0000 7f06d27fc700 1 -- 172.21.15.69:0/3804913495 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f06cc083d70 con 0x7f06dc0c4140 2023-11-17T06:33:16.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.776+0000 7f06e18ae700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f06c0066510 0x7f06c00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:16.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.776+0000 7f06e18ae700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f06c0066510 0x7f06c00689d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009aa0 tx=0x7f06d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:16.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.780+0000 7f06d27fc700 1 -- 172.21.15.69:0/3804913495 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f06cc051080 con 0x7f06dc0c4140 2023-11-17T06:33:16.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.992+0000 7f06e28b0700 1 -- 172.21.15.69:0/3804913495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06dc0b4a20 con 0x7f06dc0c4140 2023-11-17T06:33:17.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06d27fc700 1 -- 172.21.15.69:0/3804913495 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+4915 (secure 0 0 0) 0x7f06cc012ed0 con 0x7f06dc0c4140 2023-11-17T06:33:17.000 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:17.000 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:33:14.890727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":40,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5202":{"gid":5202,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":33,"addr":"172.21.15.69:6835/1050522275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1050522275},{"type":"v1","addr":"172.21.15.69:6835","nonce":1050522275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:17.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06e28b0700 1 -- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f06c0066510 msgr2=0x7f06c00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06e28b0700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f06c0066510 0x7f06c00689d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009aa0 tx=0x7f06d8008040 comp rx=0 tx=0).stop 2023-11-17T06:33:17.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06e28b0700 1 -- 172.21.15.69:0/3804913495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06dc0c4140 msgr2=0x7f06dc0c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06e28b0700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06dc0c4140 0x7f06dc0c8020 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f06cc000c00 tx=0x7f06cc00eb10 comp rx=0 tx=0).stop 2023-11-17T06:33:17.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06e28b0700 1 -- 172.21.15.69:0/3804913495 shutdown_connections 2023-11-17T06:33:17.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06e28b0700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f06c0066510 0x7f06c00689d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06e28b0700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06dc15f380 0x7f06dc0b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06e28b0700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06dc0c4140 0x7f06dc0c8020 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06e28b0700 1 --2- 172.21.15.69:0/3804913495 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06c8005230 0x7f06dc0b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:16.996+0000 7f06e28b0700 1 -- 172.21.15.69:0/3804913495 >> 172.21.15.69:0/3804913495 conn(0x7f06dc0cece0 msgr2=0x7f06dc1642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.000+0000 7f06e28b0700 1 -- 172.21.15.69:0/3804913495 shutdown_connections 2023-11-17T06:33:17.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.000+0000 7f06e28b0700 1 -- 172.21.15.69:0/3804913495 wait complete. 2023-11-17T06:33:17.005 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 21 2023-11-17T06:33:17.169 INFO:tasks.ceph.mds.c.smithi069.stderr:2023-11-17T06:33:17.164+0000 7f90d159e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:33:17.426 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:25.683625+0000', 'modified': '2023-11-17T06:33:14.890727+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 40, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5202}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5202': {'gid': 5202, 'name': 'c', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 33, 'addr': '172.21.15.69:6835/1050522275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6834', 'nonce': 1050522275}, {'type': 'v1', 'addr': '172.21.15.69:6835', 'nonce': 1050522275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:33:17.426 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-17T06:33:17.426 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-17T06:33:17.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.604+0000 7efc31fad700 1 Processor -- start 2023-11-17T06:33:17.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.604+0000 7efc31fad700 1 -- start start 2023-11-17T06:33:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.604+0000 7efc31fad700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efc2c15d440 0x7efc2c0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.604+0000 7efc31fad700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efc2c0ac8d0 0x7efc2c0ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.604+0000 7efc31fad700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c0cd770 con 0x7efc2c0ccd30 2023-11-17T06:33:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc31fad700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0cd230 con 0x7efc2c0ac8d0 2023-11-17T06:33:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc31fad700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0cd440 con 0x7efc2c15d440 2023-11-17T06:33:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc317ac700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7efc2c0ccd30 0x7efc2c070ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55862/0 (socket says 172.21.15.69:55862) 2023-11-17T06:33:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc317ac700 1 -- 172.21.15.69:0/1170227300 learned_addr learned my addr 172.21.15.69:0/1170227300 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:17.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc23fff700 1 --2- 172.21.15.69:0/1170227300 >> v2:172.21.15.69:3300/0 conn(0x7efc2c0ac8d0 0x7efc2c0ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc30fab700 1 --2- 172.21.15.69:0/1170227300 >> v2:172.21.15.93:3300/0 conn(0x7efc2c15d440 0x7efc2c0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc237fe700 1 -- 172.21.15.69:0/1170227300 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338781488 0 0) 0x7efc2c0cd770 con 0x7efc2c0ccd30 2023-11-17T06:33:17.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc237fe700 1 -- 172.21.15.69:0/1170227300 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc140035d0 con 0x7efc2c0ccd30 2023-11-17T06:33:17.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc23fff700 1 -- 172.21.15.69:0/1170227300 >> v2:172.21.15.93:3300/0 conn(0x7efc2c15d440 msgr2=0x7efc2c0c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc23fff700 1 --2- 172.21.15.69:0/1170227300 >> v2:172.21.15.93:3300/0 conn(0x7efc2c15d440 0x7efc2c0c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc23fff700 1 -- 172.21.15.69:0/1170227300 >> v1:172.21.15.69:6789/0 conn(0x7efc2c0ccd30 legacy=0x7efc2c070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc23fff700 1 -- 172.21.15.69:0/1170227300 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0cb2e0 con 0x7efc2c0ac8d0 2023-11-17T06:33:17.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc23fff700 1 --2- 172.21.15.69:0/1170227300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c0ac8d0 0x7efc2c0ca0b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0c28c0 tx=0x7efc1c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488b60124a744c36 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc237fe700 1 -- 172.21.15.69:0/1170227300 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c011830 con 0x7efc2c0ac8d0 2023-11-17T06:33:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc237fe700 1 -- 172.21.15.69:0/1170227300 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c011990 con 0x7efc2c0ac8d0 2023-11-17T06:33:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc237fe700 1 -- 172.21.15.69:0/1170227300 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1c011d20 con 0x7efc2c0ac8d0 2023-11-17T06:33:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc31fad700 1 -- 172.21.15.69:0/1170227300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c0ac8d0 msgr2=0x7efc2c0ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.608+0000 7efc31fad700 1 --2- 172.21.15.69:0/1170227300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c0ac8d0 0x7efc2c0ca0b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0c28c0 tx=0x7efc1c009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.612+0000 7efc31fad700 1 -- 172.21.15.69:0/1170227300 shutdown_connections 2023-11-17T06:33:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.612+0000 7efc31fad700 1 --2- 172.21.15.69:0/1170227300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c0ac8d0 0x7efc2c0ca0b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.612+0000 7efc31fad700 1 --2- 172.21.15.69:0/1170227300 >> v2:172.21.15.93:3300/0 conn(0x7efc2c15d440 0x7efc2c0c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.612+0000 7efc31fad700 1 -- 172.21.15.69:0/1170227300 >> 172.21.15.69:0/1170227300 conn(0x7efc2c0cedc0 msgr2=0x7efc2c0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.612+0000 7efc31fad700 1 -- 172.21.15.69:0/1170227300 shutdown_connections 2023-11-17T06:33:17.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.612+0000 7efc31fad700 1 -- 172.21.15.69:0/1170227300 wait complete. 2023-11-17T06:33:17.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc31fad700 1 Processor -- start 2023-11-17T06:33:17.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc31fad700 1 -- start start 2023-11-17T06:33:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc31fad700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc2c0ac8d0 0x7efc2c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc31fad700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc2c0ccd30 0x7efc2c0c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc31fad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c15d440 0x7efc2c0c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc31fad700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c155c00 con 0x7efc2c15d440 2023-11-17T06:33:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc31fad700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c06cec0 con 0x7efc2c0ccd30 2023-11-17T06:33:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc31fad700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c06d1a0 con 0x7efc2c0ac8d0 2023-11-17T06:33:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc317ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c15d440 0x7efc2c0c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc317ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c15d440 0x7efc2c0c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46970/0 (socket says 172.21.15.69:46970) 2023-11-17T06:33:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc317ac700 1 -- 172.21.15.69:0/1896017627 learned_addr learned my addr 172.21.15.69:0/1896017627 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc30fab700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc2c0ac8d0 0x7efc2c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.616+0000 7efc23fff700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc2c0ccd30 0x7efc2c0c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc317ac700 1 -- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc2c0ac8d0 msgr2=0x7efc2c06c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc317ac700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc2c0ac8d0 0x7efc2c06c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc317ac700 1 -- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc2c0ccd30 msgr2=0x7efc2c0c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc317ac700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc2c0ccd30 0x7efc2c0c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc317ac700 1 -- 172.21.15.69:0/1896017627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1c0094b0 con 0x7efc2c15d440 2023-11-17T06:33:17.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc317ac700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c15d440 0x7efc2c0c4540 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efc2400cae0 tx=0x7efc2400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc217fa700 1 -- 172.21.15.69:0/1896017627 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24007480 con 0x7efc2c15d440 2023-11-17T06:33:17.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc217fa700 1 -- 172.21.15.69:0/1896017627 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc240075e0 con 0x7efc2c15d440 2023-11-17T06:33:17.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc31fad700 1 -- 172.21.15.69:0/1896017627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c06d480 con 0x7efc2c15d440 2023-11-17T06:33:17.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc217fa700 1 -- 172.21.15.69:0/1896017627 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24007990 con 0x7efc2c15d440 2023-11-17T06:33:17.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.620+0000 7efc31fad700 1 -- 172.21.15.69:0/1896017627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c15e010 con 0x7efc2c15d440 2023-11-17T06:33:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc217fa700 1 -- 172.21.15.69:0/1896017627 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efc2401b3b0 con 0x7efc2c15d440 2023-11-17T06:33:17.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc364d8740 1 Processor -- start 2023-11-17T06:33:17.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc364d8740 1 -- start start 2023-11-17T06:33:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc217fa700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc18066510 0x7efc180689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc217fa700 1 -- 172.21.15.69:0/1896017627 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7efc240838e0 con 0x7efc2c15d440 2023-11-17T06:33:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc364d8740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191c6f0 0x191cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc364d8740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x191d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc364d8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x191d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc364d8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x184c620 con 0x191d550 2023-11-17T06:33:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc364d8740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x1849d10 con 0x191a9a0 2023-11-17T06:33:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc364d8740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x1845600 con 0x191c6f0 2023-11-17T06:33:17.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc23fff700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc18066510 0x7efc180689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc317ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x191d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc317ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x191d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46976/0 (socket says 172.21.15.69:46976) 2023-11-17T06:33:17.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc317ac700 1 -- 172.21.15.69:0/2279030673 learned_addr learned my addr 172.21.15.69:0/2279030673 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:17.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc23fff700 1 --2- 172.21.15.69:0/2279030673 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x191d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc30fab700 1 --2- 172.21.15.69:0/2279030673 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191c6f0 0x191cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc317ac700 1 -- 172.21.15.69:0/2279030673 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191c6f0 msgr2=0x191cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc317ac700 1 --2- 172.21.15.69:0/2279030673 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191c6f0 0x191cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc317ac700 1 -- 172.21.15.69:0/2279030673 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 msgr2=0x191d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc317ac700 1 --2- 172.21.15.69:0/2279030673 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x191d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc317ac700 1 -- 172.21.15.69:0/2279030673 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x186a850 con 0x191d550 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.624+0000 7efc30fab700 1 --2- 172.21.15.69:0/2279030673 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191c6f0 0x191cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc317ac700 1 --2- 172.21.15.69:0/2279030673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x191d930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc24001580 tx=0x7efc2400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af58b7a115a6ea1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc23fff700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc18066510 0x7efc180689d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0accb0 tx=0x7efc1c010000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc127fc700 1 -- 172.21.15.69:0/2279030673 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2405cbb0 con 0x191d550 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc127fc700 1 -- 172.21.15.69:0/2279030673 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24007af0 con 0x191d550 2023-11-17T06:33:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc127fc700 1 -- 172.21.15.69:0/2279030673 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc24052c50 con 0x191d550 2023-11-17T06:33:17.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 -- 172.21.15.69:0/2279030673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 msgr2=0x191d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 --2- 172.21.15.69:0/2279030673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x191d930 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc24001580 tx=0x7efc2400cf90 comp rx=0 tx=0).stop 2023-11-17T06:33:17.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 -- 172.21.15.69:0/2279030673 shutdown_connections 2023-11-17T06:33:17.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 --2- 172.21.15.69:0/2279030673 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x191d930 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 --2- 172.21.15.69:0/2279030673 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x191d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 --2- 172.21.15.69:0/2279030673 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191c6f0 0x191cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 -- 172.21.15.69:0/2279030673 >> 172.21.15.69:0/2279030673 conn(0x166a4d0 msgr2=0x1905160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 -- 172.21.15.69:0/2279030673 shutdown_connections 2023-11-17T06:33:17.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 -- 172.21.15.69:0/2279030673 wait complete. 2023-11-17T06:33:17.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 -- start start 2023-11-17T06:33:17.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.628+0000 7efc364d8740 1 Processor -- start 2023-11-17T06:33:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191a9a0 0x18dd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191c6f0 0x18ddd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x1902350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x18036e0 con 0x191d550 2023-11-17T06:33:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x1803380 con 0x191c6f0 2023-11-17T06:33:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x16eeaa0 con 0x191a9a0 2023-11-17T06:33:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 10 client.0 _ll_register_callbacks cb 0x17f2a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:33:17.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc317ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x1902350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc317ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x1902350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46980/0 (socket says 172.21.15.69:46980) 2023-11-17T06:33:17.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc317ac700 1 -- 172.21.15.69:0/877193796 learned_addr learned my addr 172.21.15.69:0/877193796 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:17.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc23fff700 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191c6f0 0x18ddd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc30fab700 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191a9a0 0x18dd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc317ac700 1 -- 172.21.15.69:0/877193796 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191a9a0 msgr2=0x18dd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc317ac700 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191a9a0 0x18dd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc317ac700 1 -- 172.21.15.69:0/877193796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191c6f0 msgr2=0x18ddd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc317ac700 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191c6f0 0x18ddd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc317ac700 1 -- 172.21.15.69:0/877193796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c15e010 con 0x191d550 2023-11-17T06:33:17.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc30fab700 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191a9a0 0x18dd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc317ac700 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x1902350 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc24001580 tx=0x7efc24001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae5b9877459ad90 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc0b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc0b7fe700 1 -- 172.21.15.69:0/877193796 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2405cbb0 con 0x191d550 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc0b7fe700 1 -- 172.21.15.69:0/877193796 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7efc24053da0 con 0x191d550 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 1 -- 172.21.15.69:0/877193796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x183e5e0 con 0x191d550 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc0b7fe700 1 -- 172.21.15.69:0/877193796 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc24053f60 con 0x191d550 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 10 client.5550 fetch_fsmap learned FSMap version 21 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 1 -- 172.21.15.69:0/877193796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x16b5960 con 0x191d550 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc0b7fe700 1 -- 172.21.15.69:0/877193796 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x183e5e0 con 0x191d550 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc0b7fe700 1 -- 172.21.15.69:0/877193796 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efc24077070 con 0x191d550 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 10 client.5550 fetch_fsmap finished waiting for FSMap version 21 2023-11-17T06:33:17.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 10 client.5550 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-17T06:33:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 20 client.5550 populate_metadata read hostname 'smithi069' 2023-11-17T06:33:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.69:6834/1050522275,v1:172.21.15.69:6835/1050522275] conn(0x18da4b0 0x18da890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 4 client.5550 mds_command: new command op to 5202 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-17T06:33:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc364d8740 1 -- 172.21.15.69:0/877193796 --> [v2:172.21.15.69:6834/1050522275,v1:172.21.15.69:6835/1050522275] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x17fe470 con 0x18da4b0 2023-11-17T06:33:17.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc30fab700 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.69:6834/1050522275,v1:172.21.15.69:6835/1050522275] conn(0x18da4b0 0x18da890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc0b7fe700 10 client.5550 ms_handle_connect on v2:172.21.15.69:6834/1050522275 2023-11-17T06:33:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.632+0000 7efc30fab700 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.69:6834/1050522275,v1:172.21.15.69:6835/1050522275] conn(0x18da4b0 0x18da890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4252df989460f636 server_cookie=34fdf4234557766b in_seq=0 out_seq=0 2023-11-17T06:33:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc0b7fe700 1 -- 172.21.15.69:0/877193796 <== mds.0 v2:172.21.15.69:6834/1050522275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x17fe470 con 0x18da4b0 2023-11-17T06:33:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc0b7fe700 10 client.5550 handle_command_reply: tid=0 2023-11-17T06:33:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 client.5550 shutdown 2023-11-17T06:33:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 -- 172.21.15.69:0/877193796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 msgr2=0x1902350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x1902350 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc24001580 tx=0x7efc24001250 comp rx=0 tx=0).stop 2023-11-17T06:33:17.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 -- 172.21.15.69:0/877193796 shutdown_connections 2023-11-17T06:33:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.69:6834/1050522275,v1:172.21.15.69:6835/1050522275] conn(0x18da4b0 0x18da890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191d550 0x1902350 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191c6f0 0x18ddd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 --2- 172.21.15.69:0/877193796 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x191a9a0 0x18dd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 -- 172.21.15.69:0/877193796 >> 172.21.15.69:0/877193796 conn(0x166a4d0 msgr2=0x191b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc0b7fe700 0 client.5550 ms_handle_reset on v2:172.21.15.69:6834/1050522275 2023-11-17T06:33:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 -- 172.21.15.69:0/877193796 shutdown_connections 2023-11-17T06:33:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 1 -- 172.21.15.69:0/877193796 wait complete. 2023-11-17T06:33:17.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.636+0000 7efc364d8740 20 client.5550 trim_cache size 0 max 16384 2023-11-17T06:33:17.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.656+0000 7efc364d8740 1 Processor -- start 2023-11-17T06:33:17.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.656+0000 7efc364d8740 1 -- start start 2023-11-17T06:33:17.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.656+0000 7efc364d8740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 0x1933220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.656+0000 7efc364d8740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x1933760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.656+0000 7efc364d8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1933ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.656+0000 7efc364d8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x1929f20 con 0x191c6f0 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.656+0000 7efc364d8740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x1848160 con 0x191a9a0 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.656+0000 7efc364d8740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x1842a00 con 0x166a4d0 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc317ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1933ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc317ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1933ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46990/0 (socket says 172.21.15.69:46990) 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc317ac700 1 -- 172.21.15.69:0/3408589741 learned_addr learned my addr 172.21.15.69:0/3408589741 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc30fab700 1 --2- 172.21.15.69:0/3408589741 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 0x1933220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc23fff700 1 --2- 172.21.15.69:0/3408589741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x1933760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc317ac700 1 -- 172.21.15.69:0/3408589741 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 msgr2=0x1933220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc317ac700 1 --2- 172.21.15.69:0/3408589741 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 0x1933220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc317ac700 1 -- 172.21.15.69:0/3408589741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 msgr2=0x1933760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc317ac700 1 --2- 172.21.15.69:0/3408589741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x1933760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc317ac700 1 -- 172.21.15.69:0/3408589741 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x18084f0 con 0x191c6f0 2023-11-17T06:33:17.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc317ac700 1 --2- 172.21.15.69:0/3408589741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1933ca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efc24050db0 tx=0x7efc2407d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45182e7358fc81b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc12ffd700 1 -- 172.21.15.69:0/3408589741 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400e040 con 0x191c6f0 2023-11-17T06:33:17.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc12ffd700 1 -- 172.21.15.69:0/3408589741 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2405c9a0 con 0x191c6f0 2023-11-17T06:33:17.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc12ffd700 1 -- 172.21.15.69:0/3408589741 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2405cbb0 con 0x191c6f0 2023-11-17T06:33:17.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 -- 172.21.15.69:0/3408589741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 msgr2=0x1933ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 --2- 172.21.15.69:0/3408589741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1933ca0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7efc24050db0 tx=0x7efc2407d040 comp rx=0 tx=0).stop 2023-11-17T06:33:17.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 -- 172.21.15.69:0/3408589741 shutdown_connections 2023-11-17T06:33:17.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 --2- 172.21.15.69:0/3408589741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1933ca0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 --2- 172.21.15.69:0/3408589741 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x1933760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 --2- 172.21.15.69:0/3408589741 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 0x1933220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 -- 172.21.15.69:0/3408589741 >> 172.21.15.69:0/3408589741 conn(0x18dc070 msgr2=0x191b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 -- 172.21.15.69:0/3408589741 shutdown_connections 2023-11-17T06:33:17.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 -- 172.21.15.69:0/3408589741 wait complete. 2023-11-17T06:33:17.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 -- start start 2023-11-17T06:33:17.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.660+0000 7efc364d8740 1 Processor -- start 2023-11-17T06:33:17.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 0x1982f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x1940a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1983f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x1803380 con 0x191c6f0 2023-11-17T06:33:17.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x18036e0 con 0x191a9a0 2023-11-17T06:33:17.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x1816970 con 0x166a4d0 2023-11-17T06:33:17.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 10 client.0 _ll_register_callbacks cb 0x180a4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:33:17.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc317ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1983f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc317ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1983f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47002/0 (socket says 172.21.15.69:47002) 2023-11-17T06:33:17.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc317ac700 1 -- 172.21.15.69:0/2506824913 learned_addr learned my addr 172.21.15.69:0/2506824913 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:17.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc23fff700 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x1940a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc30fab700 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 0x1982f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc317ac700 1 -- 172.21.15.69:0/2506824913 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 msgr2=0x1982f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc317ac700 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 0x1982f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc317ac700 1 -- 172.21.15.69:0/2506824913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 msgr2=0x1940a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:17.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc317ac700 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x1940a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc317ac700 1 -- 172.21.15.69:0/2506824913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x16b5960 con 0x191c6f0 2023-11-17T06:33:17.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc30fab700 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 0x1982f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:17.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc23fff700 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x1940a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:17.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc317ac700 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1983f90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efc24001580 tx=0x7efc240014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab4bc76d4b0d373 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc0b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-11-17T06:33:17.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc0b7fe700 1 -- 172.21.15.69:0/2506824913 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2400e040 con 0x191c6f0 2023-11-17T06:33:17.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc0b7fe700 1 -- 172.21.15.69:0/2506824913 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7efc24058a00 con 0x191c6f0 2023-11-17T06:33:17.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 1 -- 172.21.15.69:0/2506824913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc24007af0 con 0x191c6f0 2023-11-17T06:33:17.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc0b7fe700 1 -- 172.21.15.69:0/2506824913 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc2405cbb0 con 0x191c6f0 2023-11-17T06:33:17.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 10 client.5556 fetch_fsmap learned FSMap version 21 2023-11-17T06:33:17.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 1 -- 172.21.15.69:0/2506824913 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) v3 -- 0x17ee8d0 con 0x191c6f0 2023-11-17T06:33:17.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc0b7fe700 1 -- 172.21.15.69:0/2506824913 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24007af0 con 0x191c6f0 2023-11-17T06:33:17.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc0b7fe700 1 -- 172.21.15.69:0/2506824913 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 21) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efc24077040 con 0x191c6f0 2023-11-17T06:33:17.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 10 client.5556 fetch_fsmap finished waiting for FSMap version 21 2023-11-17T06:33:17.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 10 client.5556 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-17T06:33:17.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 20 client.5556 populate_metadata read hostname 'smithi069' 2023-11-17T06:33:17.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.69:6834/1050522275,v1:172.21.15.69:6835/1050522275] conn(0x191d550 0x19844d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 4 client.5556 mds_command: new command op to 5202 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-17T06:33:17.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc364d8740 1 -- 172.21.15.69:0/2506824913 --> [v2:172.21.15.69:6834/1050522275,v1:172.21.15.69:6835/1050522275] -- command(tid 0: {"prefix": "status"}) v1 -- 0x16c1460 con 0x191d550 2023-11-17T06:33:17.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.664+0000 7efc30fab700 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.69:6834/1050522275,v1:172.21.15.69:6835/1050522275] conn(0x191d550 0x19844d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc30fab700 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.69:6834/1050522275,v1:172.21.15.69:6835/1050522275] conn(0x191d550 0x19844d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=600a2bb3774ee57f server_cookie=696e7aab02b6aad2 in_seq=0 out_seq=0 2023-11-17T06:33:17.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc0b7fe700 10 client.5556 ms_handle_connect on v2:172.21.15.69:6834/1050522275 2023-11-17T06:33:17.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc0b7fe700 1 -- 172.21.15.69:0/2506824913 <== mds.0 v2:172.21.15.69:6834/1050522275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x16c1460 con 0x191d550 2023-11-17T06:33:17.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc0b7fe700 10 client.5556 handle_command_reply: tid=0 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 client.5556 shutdown 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 -- 172.21.15.69:0/2506824913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 msgr2=0x1983f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1983f90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efc24001580 tx=0x7efc240014d0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 -- 172.21.15.69:0/2506824913 shutdown_connections 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.69:6834/1050522275,v1:172.21.15.69:6835/1050522275] conn(0x191d550 0x19844d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x191c6f0 0x1983f90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x191a9a0 0x1940a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 --2- 172.21.15.69:0/2506824913 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x166a4d0 0x1982f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc0b7fe700 0 client.5556 ms_handle_reset on v2:172.21.15.69:6834/1050522275 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 -- 172.21.15.69:0/2506824913 >> 172.21.15.69:0/2506824913 conn(0x18dc070 msgr2=0x1904ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 -- 172.21.15.69:0/2506824913 shutdown_connections 2023-11-17T06:33:17.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 1 -- 172.21.15.69:0/2506824913 wait complete. 2023-11-17T06:33:17.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc364d8740 20 client.5556 trim_cache size 0 max 16384 2023-11-17T06:33:17.681 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:33:17.681 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "473113af-218f-4c66-9eb3-2c30c3150d71", 2023-11-17T06:33:17.681 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2023-11-17T06:33:17.681 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 5202, 2023-11-17T06:33:17.681 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-11-17T06:33:17.681 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-11-17T06:33:17.681 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-11-17T06:33:17.681 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 4.7926582849999999, 2023-11-17T06:33:17.681 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 21, 2023-11-17T06:33:17.682 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 40, 2023-11-17T06:33:17.682 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 40, 2023-11-17T06:33:17.682 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 121.309547288 2023-11-17T06:33:17.682 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:33:17.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 -- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc18066510 msgr2=0x7efc180689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc18066510 0x7efc180689d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7efc2c0accb0 tx=0x7efc1c010000 comp rx=0 tx=0).stop 2023-11-17T06:33:17.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 -- 172.21.15.69:0/1896017627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c15d440 msgr2=0x7efc2c0c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c15d440 0x7efc2c0c4540 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efc2400cae0 tx=0x7efc2400cb10 comp rx=0 tx=0).stop 2023-11-17T06:33:17.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 -- 172.21.15.69:0/1896017627 shutdown_connections 2023-11-17T06:33:17.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc18066510 0x7efc180689d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc2c15d440 0x7efc2c0c4540 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc2c0ccd30 0x7efc2c0c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 --2- 172.21.15.69:0/1896017627 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc2c0ac8d0 0x7efc2c06c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 -- 172.21.15.69:0/1896017627 >> 172.21.15.69:0/1896017627 conn(0x7efc2c0cedc0 msgr2=0x7efc2c0b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 -- 172.21.15.69:0/1896017627 shutdown_connections 2023-11-17T06:33:17.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.668+0000 7efc31fad700 1 -- 172.21.15.69:0/1896017627 wait complete. 2023-11-17T06:33:17.697 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:33:17.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.872+0000 7f2b97cb1700 1 Processor -- start 2023-11-17T06:33:17.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.872+0000 7f2b97cb1700 1 -- start start 2023-11-17T06:33:17.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.872+0000 7f2b97cb1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2b900b2520 0x7f2b900b6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.872+0000 7f2b97cb1700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b9015d8c0 con 0x7f2b900b68d0 2023-11-17T06:33:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.872+0000 7f2b97cb1700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b900d1410 con 0x7f2b9015d4e0 2023-11-17T06:33:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.872+0000 7f2b97cb1700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b900b9290 con 0x7f2b900b2520 2023-11-17T06:33:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.872+0000 7f2b9624e700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f2b900b68d0 0x7f2b900d31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55874/0 (socket says 172.21.15.69:55874) 2023-11-17T06:33:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.872+0000 7f2b9624e700 1 -- 172.21.15.69:0/2512738023 learned_addr learned my addr 172.21.15.69:0/2512738023 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.872+0000 7f2b9524c700 1 --2- 172.21.15.69:0/2512738023 >> v2:172.21.15.69:3300/0 conn(0x7f2b900b2520 0x7f2b900b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b94a4b700 1 -- 172.21.15.69:0/2512738023 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819112622 0 0) 0x7f2b88001490 con 0x7f2b900b68d0 2023-11-17T06:33:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b94a4b700 1 -- 172.21.15.69:0/2512738023 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b7c0035d0 con 0x7f2b900b68d0 2023-11-17T06:33:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b9524c700 1 -- 172.21.15.69:0/2512738023 >> v1:172.21.15.93:6789/0 conn(0x7f2b9015d4e0 legacy=0x7f2b900b8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b9524c700 1 -- 172.21.15.69:0/2512738023 >> v1:172.21.15.69:6789/0 conn(0x7f2b900b68d0 legacy=0x7f2b900d31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b9524c700 1 -- 172.21.15.69:0/2512738023 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b900d16f0 con 0x7f2b900b2520 2023-11-17T06:33:17.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b9524c700 1 --2- 172.21.15.69:0/2512738023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b2520 0x7f2b900b6390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2b900b93d0 tx=0x7f2b80009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d206bc542adb92 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b94a4b700 1 -- 172.21.15.69:0/2512738023 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80004020 con 0x7f2b900b2520 2023-11-17T06:33:17.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b94a4b700 1 -- 172.21.15.69:0/2512738023 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80004180 con 0x7f2b900b2520 2023-11-17T06:33:17.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b94a4b700 1 -- 172.21.15.69:0/2512738023 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80004530 con 0x7f2b900b2520 2023-11-17T06:33:17.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b97cb1700 1 -- 172.21.15.69:0/2512738023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b2520 msgr2=0x7f2b900b6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b97cb1700 1 --2- 172.21.15.69:0/2512738023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b2520 0x7f2b900b6390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2b900b93d0 tx=0x7f2b80009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:17.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b97cb1700 1 -- 172.21.15.69:0/2512738023 shutdown_connections 2023-11-17T06:33:17.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b97cb1700 1 --2- 172.21.15.69:0/2512738023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b2520 0x7f2b900b6390 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b97cb1700 1 -- 172.21.15.69:0/2512738023 >> 172.21.15.69:0/2512738023 conn(0x7f2b9006a6c0 msgr2=0x7f2b9006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:17.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b97cb1700 1 -- 172.21.15.69:0/2512738023 shutdown_connections 2023-11-17T06:33:17.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.876+0000 7f2b97cb1700 1 -- 172.21.15.69:0/2512738023 wait complete. 2023-11-17T06:33:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.880+0000 7f2b97cb1700 1 Processor -- start 2023-11-17T06:33:17.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.880+0000 7f2b97cb1700 1 -- start start 2023-11-17T06:33:17.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.880+0000 7f2b97cb1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b900b2520 0x7f2b90159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.880+0000 7f2b97cb1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b68d0 0x7f2b900caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.880+0000 7f2b97cb1700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b9015d4e0 0x7f2b9015ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.880+0000 7f2b97cb1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900cd500 con 0x7f2b900b68d0 2023-11-17T06:33:17.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.880+0000 7f2b97cb1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b901f27d0 con 0x7f2b900b2520 2023-11-17T06:33:17.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.880+0000 7f2b97cb1700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900cc880 con 0x7f2b9015d4e0 2023-11-17T06:33:17.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.880+0000 7f2b9524c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b68d0 0x7f2b900caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b9524c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b68d0 0x7f2b900caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47020/0 (socket says 172.21.15.69:47020) 2023-11-17T06:33:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b9524c700 1 -- 172.21.15.69:0/3841185213 learned_addr learned my addr 172.21.15.69:0/3841185213 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b95a4d700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b900b2520 0x7f2b90159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b9624e700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b9015d4e0 0x7f2b9015ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b9524c700 1 -- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b9015d4e0 msgr2=0x7f2b9015ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b9524c700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b9015d4e0 0x7f2b9015ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b9524c700 1 -- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b900b2520 msgr2=0x7f2b90159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:17.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b9524c700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b900b2520 0x7f2b90159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b9524c700 1 -- 172.21.15.69:0/3841185213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800094b0 con 0x7f2b900b68d0 2023-11-17T06:33:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b9524c700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b68d0 0x7f2b900caa40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009fd0 tx=0x7f2b80004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b867fc700 1 -- 172.21.15.69:0/3841185213 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80011cf0 con 0x7f2b900b68d0 2023-11-17T06:33:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b867fc700 1 -- 172.21.15.69:0/3841185213 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80011e70 con 0x7f2b900b68d0 2023-11-17T06:33:17.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b867fc700 1 -- 172.21.15.69:0/3841185213 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b800038e0 con 0x7f2b900b68d0 2023-11-17T06:33:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b97cb1700 1 -- 172.21.15.69:0/3841185213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b900ccb60 con 0x7f2b900b68d0 2023-11-17T06:33:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b97cb1700 1 -- 172.21.15.69:0/3841185213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b900cd120 con 0x7f2b900b68d0 2023-11-17T06:33:17.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.884+0000 7f2b97cb1700 1 -- 172.21.15.69:0/3841185213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b900cd640 con 0x7f2b900b68d0 2023-11-17T06:33:17.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.888+0000 7f2b867fc700 1 -- 172.21.15.69:0/3841185213 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2b80003a40 con 0x7f2b900b68d0 2023-11-17T06:33:17.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.888+0000 7f2b867fc700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b74066510 0x7f2b740689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:17.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.888+0000 7f2b867fc700 1 -- 172.21.15.69:0/3841185213 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f2b80085220 con 0x7f2b900b68d0 2023-11-17T06:33:17.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.888+0000 7f2b95a4d700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b74066510 0x7f2b740689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:17.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.888+0000 7f2b95a4d700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b74066510 0x7f2b740689d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c001800 tx=0x7f2b8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:17.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:17.896+0000 7f2b867fc700 1 -- 172.21.15.69:0/3841185213 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b900cd640 con 0x7f2b900b68d0 2023-11-17T06:33:18.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.104+0000 7f2b97cb1700 1 -- 172.21.15.69:0/3841185213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2b900cd640 con 0x7f2b900b68d0 2023-11-17T06:33:18.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.104+0000 7f2b867fc700 1 -- 172.21.15.69:0/3841185213 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2b8002a060 con 0x7f2b900b68d0 2023-11-17T06:33:18.110 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:33:18.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 -- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b74066510 msgr2=0x7f2b740689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b74066510 0x7f2b740689d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c001800 tx=0x7f2b8c009040 comp rx=0 tx=0).stop 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 -- 172.21.15.69:0/3841185213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b68d0 msgr2=0x7f2b900caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b68d0 0x7f2b900caa40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009fd0 tx=0x7f2b80004770 comp rx=0 tx=0).stop 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 -- 172.21.15.69:0/3841185213 shutdown_connections 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b74066510 0x7f2b740689d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b9015d4e0 0x7f2b9015ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b900b68d0 0x7f2b900caa40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 --2- 172.21.15.69:0/3841185213 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b900b2520 0x7f2b90159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 -- 172.21.15.69:0/3841185213 >> 172.21.15.69:0/3841185213 conn(0x7f2b9006a6c0 msgr2=0x7f2b900d3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 -- 172.21.15.69:0/3841185213 shutdown_connections 2023-11-17T06:33:18.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:18.108+0000 7f2b97cb1700 1 -- 172.21.15.69:0/3841185213 wait complete. 2023-11-17T06:33:18.132 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:33:18.133 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:33:18.133 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2023-11-17T06:33:18.133 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-17T06:33:18.133 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:18.133 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:33:18.133 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:33:18.133 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:33:18.133 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:33:18.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.133 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2023-11-17T06:33:18.151 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:33:18.151 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:33:18.151 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:33:18.151 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.151 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-11-17T06:33:18.151 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.151 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42045sec preferred_lft 42045sec 2023-11-17T06:33:18.152 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 02:42:2e:aa:f1:0b brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 62:b7:9e:10:0f:21 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::3479:73ff:fe34:bc0f/64 scope link 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:33:18.153 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 62:b7:9e:10:0f:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:18.154 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::60b7:9eff:fe10:f21/64 scope link 2023-11-17T06:33:18.154 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.154 INFO:teuthology.orchestra.run.smithi069.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:33:18.154 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 92:c9:1c:aa:d1:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:18.154 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::90c9:1cff:feaa:d12c/64 scope link 2023-11-17T06:33:18.154 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:18.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.155 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:33:18.235 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-11-17T06:33:18.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.239 DEBUG:teuthology.orchestra.run.smithi069:> route 2023-11-17T06:33:18.308 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2023-11-17T06:33:18.308 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:33:18.308 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:33:18.309 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:33:18.309 INFO:teuthology.orchestra.run.smithi069.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:33:18.309 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:33:18.309 INFO:teuthology.orchestra.run.smithi069.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:33:18.309 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:33:18.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.309 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:33:18.309 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:33:18.309 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:33:18.310 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:33:18.310 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:33:18.310 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:33:18.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.440 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-11-17T06:33:18.458 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-17T06:33:18.458 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-17T06:33:18.459 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:33:18.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.459 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2023-11-17T06:33:18.539 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-17T06:33:18.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:33:18.539 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:18.600 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:33:18.600 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:33:18.600 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:18.660 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:33:18.739 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:33:18.811 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:33:18.811 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:33:18.811 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:33:18.811 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:33:18.812 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:33:18.813 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:33:18.814 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:18.815 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:18.815 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:18.815 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:18.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:18.816 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:33:18.888 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-17T06:33:18.889 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-17T06:33:18.942 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:33:18.975 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:33:19.042 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:33:19.042 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:33:19.042 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:33:19.043 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:33:19.043 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:33:19.043 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:33:19.043 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:33:19.043 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:33:19.043 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:33:19.043 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:33:19.044 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:33:19.044 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:33:19.044 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:33:19.044 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:33:19.045 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:33:19.045 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:33:19.045 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:33:19.045 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:33:19.045 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:33:19.046 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:33:19.046 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:33:19.046 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:33:19.046 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:33:19.046 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:33:19.046 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:33:19.047 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:33:19.047 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:33:19.047 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:33:19.047 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:33:19.047 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:33:19.047 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:33:19.047 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:33:19.047 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:33:19.048 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:33:19.048 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:33:19.048 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:33:19.048 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:33:19.048 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:33:19.049 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:33:19.049 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:33:19.049 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:19.049 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:19.049 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:19.049 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:19.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.051 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:33:19.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:2023-11-17T06:33:19.084+0000 7fa78038c640 -1 init, newargv = 0x55681d012b30 newargc=15 2023-11-17T06:33:19.089 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[47300]: starting ceph client 2023-11-17T06:33:19.100 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[47300]: starting fuse 2023-11-17T06:33:19.103 INFO:teuthology.orchestra.run.smithi069.stdout:49 2023-11-17T06:33:19.103 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-17T06:33:19.104 DEBUG:teuthology.orchestra.run.smithi069:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:33:19.104 DEBUG:teuthology.orchestra.run.smithi069:> import glob 2023-11-17T06:33:19.104 DEBUG:teuthology.orchestra.run.smithi069:> import re 2023-11-17T06:33:19.104 DEBUG:teuthology.orchestra.run.smithi069:> import os 2023-11-17T06:33:19.104 DEBUG:teuthology.orchestra.run.smithi069:> import subprocess 2023-11-17T06:33:19.104 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:33:19.104 DEBUG:teuthology.orchestra.run.smithi069:> def _find_admin_socket(client_name): 2023-11-17T06:33:19.104 DEBUG:teuthology.orchestra.run.smithi069:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-17T06:33:19.104 DEBUG:teuthology.orchestra.run.smithi069:> files = glob.glob(asok_path) 2023-11-17T06:33:19.104 DEBUG:teuthology.orchestra.run.smithi069:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> # Given a non-glob path, it better be there 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> if "*" not in asok_path: 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> assert(len(files) == 1) 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> return files[0] 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> for f in files: 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> contents = proc_f.read() 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> if mountpoint in contents: 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> return f 2023-11-17T06:33:19.105 DEBUG:teuthology.orchestra.run.smithi069:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:33:19.106 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:33:19.106 DEBUG:teuthology.orchestra.run.smithi069:> print(_find_admin_socket("client.0")) 2023-11-17T06:33:19.106 DEBUG:teuthology.orchestra.run.smithi069:> ' 2023-11-17T06:33:19.268 INFO:teuthology.orchestra.run.smithi069.stdout:/var/run/ceph/ceph-client.0.47300.asok 2023-11-17T06:33:19.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:33:19.289 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47300.asok 2023-11-17T06:33:19.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.290 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47300.asok status 2023-11-17T06:33:19.488 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:33:19.488 INFO:teuthology.orchestra.run.smithi069.stdout: "metadata": { 2023-11-17T06:33:19.488 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:33:19.489 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:33:19.489 INFO:teuthology.orchestra.run.smithi069.stdout: "entity_id": "0", 2023-11-17T06:33:19.489 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": "smithi069", 2023-11-17T06:33:19.489 INFO:teuthology.orchestra.run.smithi069.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-17T06:33:19.489 INFO:teuthology.orchestra.run.smithi069.stdout: "pid": "47300", 2023-11-17T06:33:19.489 INFO:teuthology.orchestra.run.smithi069.stdout: "root": "/" 2023-11-17T06:33:19.490 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:33:19.490 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_count": 0, 2023-11-17T06:33:19.490 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_pinned_count": 0, 2023-11-17T06:33:19.490 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 5571, 2023-11-17T06:33:19.491 INFO:teuthology.orchestra.run.smithi069.stdout: "inst": { 2023-11-17T06:33:19.491 INFO:teuthology.orchestra.run.smithi069.stdout: "name": { 2023-11-17T06:33:19.491 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "client", 2023-11-17T06:33:19.491 INFO:teuthology.orchestra.run.smithi069.stdout: "num": 5571 2023-11-17T06:33:19.491 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:33:19.491 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 2582200520 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 2582200520 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: "inst_str": "client.5571 192.168.0.1:0/2582200520", 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: "addr_str": "192.168.0.1:0/2582200520", 2023-11-17T06:33:19.492 INFO:teuthology.orchestra.run.smithi069.stdout: "inode_count": 1, 2023-11-17T06:33:19.493 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_epoch": 21, 2023-11-17T06:33:19.493 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch": 40, 2023-11-17T06:33:19.493 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:33:19.493 INFO:teuthology.orchestra.run.smithi069.stdout: "blocklisted": false, 2023-11-17T06:33:19.493 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs" 2023-11-17T06:33:19.493 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:33:19.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.503 DEBUG:teuthology.orchestra.run.smithi069:> stat --file-system '--printf=%T 2023-11-17T06:33:19.503 DEBUG:teuthology.orchestra.run.smithi069:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:19.522 INFO:teuthology.orchestra.run.smithi069.stdout:fuseblk 2023-11-17T06:33:19.522 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:19.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.522 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:19.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:19.597 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2023-11-17T06:33:19.688 INFO:teuthology.orchestra.run.smithi069.stdout:0 2023-11-17T06:33:19.688 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-11-17T06:33:19.688 INFO:teuthology.orchestra.run.smithi069.stdout:10 2023-11-17T06:33:19.689 INFO:teuthology.orchestra.run.smithi069.stdout:11 2023-11-17T06:33:19.689 INFO:teuthology.orchestra.run.smithi069.stdout:12 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:13 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:14 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:15 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:16 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:17 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:18 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:19 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:2 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:20 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:22 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:23 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:24 2023-11-17T06:33:19.690 INFO:teuthology.orchestra.run.smithi069.stdout:25 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:26 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:27 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:28 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:29 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:3 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:30 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:31 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:32 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:33 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:34 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:35 2023-11-17T06:33:19.691 INFO:teuthology.orchestra.run.smithi069.stdout:36 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:37 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:38 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:39 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:4 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:40 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:41 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:42 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:43 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:44 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:45 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:46 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:47 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:48 2023-11-17T06:33:19.692 INFO:teuthology.orchestra.run.smithi069.stdout:49 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:5 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:50 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:51 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:52 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:53 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:54 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:55 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:56 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:57 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:58 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:59 2023-11-17T06:33:19.693 INFO:teuthology.orchestra.run.smithi069.stdout:6 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:60 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:61 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:62 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:63 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:64 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:65 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:66 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:67 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:68 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:69 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:7 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:70 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:71 2023-11-17T06:33:19.694 INFO:teuthology.orchestra.run.smithi069.stdout:72 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:73 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:74 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:75 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:76 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:77 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:78 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:79 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:8 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:80 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:81 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:82 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:83 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:84 2023-11-17T06:33:19.695 INFO:teuthology.orchestra.run.smithi069.stdout:85 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:86 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:87 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:88 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:89 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:9 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:90 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:91 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:92 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:93 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:94 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:95 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:96 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:97 2023-11-17T06:33:19.696 INFO:teuthology.orchestra.run.smithi069.stdout:98 2023-11-17T06:33:19.697 INFO:teuthology.orchestra.run.smithi069.stdout:99 2023-11-17T06:33:19.697 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:33:19.697 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:19.715 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:19.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.920+0000 7fcae4a55700 1 Processor -- start 2023-11-17T06:33:19.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.920+0000 7fcae4a55700 1 -- start start 2023-11-17T06:33:19.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcae00b4bd0 0x7fcae00d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:19.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcae015d6e0 0x7fcae00d2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:19.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae00d2e90 con 0x7fcae00b4fb0 2023-11-17T06:33:19.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae00d1890 con 0x7fcae00b4bd0 2023-11-17T06:33:19.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae00d1b70 con 0x7fcae015d6e0 2023-11-17T06:33:19.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcaded9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcae00b4bd0 0x7fcae00d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:19.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcadf59e700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fcae00b4fb0 0x7fcae006a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55886/0 (socket says 172.21.15.69:55886) 2023-11-17T06:33:19.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcadf59e700 1 -- 172.21.15.69:0/3645375172 learned_addr learned my addr 172.21.15.69:0/3645375172 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:19.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcad659c700 1 --2- 172.21.15.69:0/3645375172 >> v2:172.21.15.93:3300/0 conn(0x7fcae015d6e0 0x7fcae00d2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:19.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcaded9d700 1 -- 172.21.15.69:0/3645375172 >> v2:172.21.15.93:3300/0 conn(0x7fcae015d6e0 msgr2=0x7fcae00d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:19.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcaded9d700 1 --2- 172.21.15.69:0/3645375172 >> v2:172.21.15.93:3300/0 conn(0x7fcae015d6e0 0x7fcae00d2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:19.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcaded9d700 1 -- 172.21.15.69:0/3645375172 >> v1:172.21.15.69:6789/0 conn(0x7fcae00b4fb0 legacy=0x7fcae006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:19.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcaded9d700 1 -- 172.21.15.69:0/3645375172 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae00d1e50 con 0x7fcae00b4bd0 2023-11-17T06:33:19.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcade59c700 1 -- 172.21.15.69:0/3645375172 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137125356 0 0) 0x7fcae00d2e90 con 0x7fcae00b4fb0 2023-11-17T06:33:19.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcaded9d700 1 --2- 172.21.15.69:0/3645375172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae00b4bd0 0x7fcae00d1200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcae0074060 tx=0x7fcad0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0066c822b6bd38 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:19.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcade59c700 1 -- 172.21.15.69:0/3645375172 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0011830 con 0x7fcae00b4bd0 2023-11-17T06:33:19.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcade59c700 1 -- 172.21.15.69:0/3645375172 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad0011990 con 0x7fcae00b4bd0 2023-11-17T06:33:19.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcade59c700 1 -- 172.21.15.69:0/3645375172 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0011d40 con 0x7fcae00b4bd0 2023-11-17T06:33:19.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 -- 172.21.15.69:0/3645375172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae00b4bd0 msgr2=0x7fcae00d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:19.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 --2- 172.21.15.69:0/3645375172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae00b4bd0 0x7fcae00d1200 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcae0074060 tx=0x7fcad0009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:19.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 -- 172.21.15.69:0/3645375172 shutdown_connections 2023-11-17T06:33:19.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 --2- 172.21.15.69:0/3645375172 >> v2:172.21.15.93:3300/0 conn(0x7fcae015d6e0 0x7fcae00d2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:19.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 --2- 172.21.15.69:0/3645375172 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae00b4bd0 0x7fcae00d1200 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:19.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 -- 172.21.15.69:0/3645375172 >> 172.21.15.69:0/3645375172 conn(0x7fcae00d3150 msgr2=0x7fcae00d3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:19.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 -- 172.21.15.69:0/3645375172 shutdown_connections 2023-11-17T06:33:19.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.924+0000 7fcae4a55700 1 -- 172.21.15.69:0/3645375172 wait complete. 2023-11-17T06:33:19.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.928+0000 7fcae4a55700 1 Processor -- start 2023-11-17T06:33:19.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.928+0000 7fcae4a55700 1 -- start start 2023-11-17T06:33:19.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcae4a55700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcae00b4bd0 0x7fcae015e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:19.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcae4a55700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae00b4fb0 0x7fcae01f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:19.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcae4a55700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcae015d6e0 0x7fcae00cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:19.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcae4a55700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae014c0c0 con 0x7fcae00b4fb0 2023-11-17T06:33:19.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcae4a55700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae01f5e50 con 0x7fcae00b4bd0 2023-11-17T06:33:19.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcae4a55700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae015f740 con 0x7fcae015d6e0 2023-11-17T06:33:19.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcad659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae00b4fb0 0x7fcae01f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:19.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcaded9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcae00b4bd0 0x7fcae015e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:19.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcaded9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcae00b4bd0 0x7fcae015e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:51516/0 (socket says 172.21.15.69:51516) 2023-11-17T06:33:19.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcaded9d700 1 -- 172.21.15.69:0/57455577 learned_addr learned my addr 172.21.15.69:0/57455577 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:19.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcadf59e700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcae015d6e0 0x7fcae00cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:19.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcaded9d700 1 -- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcae015d6e0 msgr2=0x7fcae00cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:19.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcaded9d700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcae015d6e0 0x7fcae00cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:19.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcaded9d700 1 -- 172.21.15.69:0/57455577 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae00b4fb0 msgr2=0x7fcae01f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:19.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcaded9d700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae00b4fb0 0x7fcae01f5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:19.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcaded9d700 1 -- 172.21.15.69:0/57455577 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00094b0 con 0x7fcae00b4bd0 2023-11-17T06:33:19.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcaded9d700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcae00b4bd0 0x7fcae015e9a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcad0000c00 tx=0x7fcad0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:19.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcad7fff700 1 -- 172.21.15.69:0/57455577 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0019980 con 0x7fcae00b4bd0 2023-11-17T06:33:19.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcad7fff700 1 -- 172.21.15.69:0/57455577 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad001e070 con 0x7fcae00b4bd0 2023-11-17T06:33:19.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcad7fff700 1 -- 172.21.15.69:0/57455577 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0019d40 con 0x7fcae00b4bd0 2023-11-17T06:33:19.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcae4a55700 1 -- 172.21.15.69:0/57455577 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae015f9e0 con 0x7fcae00b4bd0 2023-11-17T06:33:19.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.932+0000 7fcae4a55700 1 -- 172.21.15.69:0/57455577 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae015ffa0 con 0x7fcae00b4bd0 2023-11-17T06:33:19.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.936+0000 7fcae4a55700 1 -- 172.21.15.69:0/57455577 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae004e650 con 0x7fcae00b4bd0 2023-11-17T06:33:19.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.936+0000 7fcad7fff700 1 -- 172.21.15.69:0/57455577 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fcad001a420 con 0x7fcae00b4bd0 2023-11-17T06:33:19.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.936+0000 7fcad7fff700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcac0066510 0x7fcac00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:19.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.936+0000 7fcad7fff700 1 -- 172.21.15.69:0/57455577 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fcad0084f10 con 0x7fcae00b4bd0 2023-11-17T06:33:19.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.940+0000 7fcad659c700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcac0066510 0x7fcac00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:19.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.940+0000 7fcad659c700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcac0066510 0x7fcac00689d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcae006c880 tx=0x7fcac8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:19.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:19.948+0000 7fcad7fff700 1 -- 172.21.15.69:0/57455577 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fcad00522b0 con 0x7fcae00b4bd0 2023-11-17T06:33:20.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.124+0000 7fcae4a55700 1 -- 172.21.15.69:0/57455577 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcae00cd990 con 0x7fcae00b4bd0 2023-11-17T06:33:20.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.128+0000 7fcad7fff700 1 -- 172.21.15.69:0/57455577 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16803 (secure 0 0 0) 0x7fcad0020090 con 0x7fcae00b4bd0 2023-11-17T06:33:20.134 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:20.134 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":40,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:33:11.857600+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.93:6837/4181304583":"2023-11-18T06:33:11.857552+0000","172.21.15.93:6836/4181304583":"2023-11-18T06:33:11.857552+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:20.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 -- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcac0066510 msgr2=0x7fcac00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcac0066510 0x7fcac00689d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcae006c880 tx=0x7fcac8008040 comp rx=0 tx=0).stop 2023-11-17T06:33:20.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 -- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcae00b4bd0 msgr2=0x7fcae015e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcae00b4bd0 0x7fcae015e9a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcad0000c00 tx=0x7fcad0004770 comp rx=0 tx=0).stop 2023-11-17T06:33:20.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 -- 172.21.15.69:0/57455577 shutdown_connections 2023-11-17T06:33:20.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fcac0066510 0x7fcac00689d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fcae015d6e0 0x7fcae00cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae00b4fb0 0x7fcae01f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 --2- 172.21.15.69:0/57455577 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcae00b4bd0 0x7fcae015e9a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 -- 172.21.15.69:0/57455577 >> 172.21.15.69:0/57455577 conn(0x7fcae00d3150 msgr2=0x7fcae00b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:20.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 -- 172.21.15.69:0/57455577 shutdown_connections 2023-11-17T06:33:20.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.132+0000 7fcae4a55700 1 -- 172.21.15.69:0/57455577 wait complete. 2023-11-17T06:33:20.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:23.624321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:24.717590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:33:20.159 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:33:20.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.336+0000 7f113e00f700 1 Processor -- start 2023-11-17T06:33:20.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.336+0000 7f113e00f700 1 -- start start 2023-11-17T06:33:20.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.336+0000 7f113e00f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f113806bd80 0x7f1138071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.336+0000 7f113e00f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1138144e80 con 0x7f113806c160 2023-11-17T06:33:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.336+0000 7f113e00f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11380c95d0 con 0x7f11380caac0 2023-11-17T06:33:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.336+0000 7f113e00f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113806d400 con 0x7f113806bd80 2023-11-17T06:33:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.336+0000 7f1136ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f113806c160 0x7f113806c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55892/0 (socket says 172.21.15.69:55892) 2023-11-17T06:33:20.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.336+0000 7f1136ffd700 1 -- 172.21.15.69:0/1089539449 learned_addr learned my addr 172.21.15.69:0/1089539449 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.336+0000 7f11377fe700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f113806bd80 0x7f1138071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372659054 0 0) 0x7f1138144e80 con 0x7f113806c160 2023-11-17T06:33:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11200035d0 con 0x7f113806c160 2023-11-17T06:33:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951485592 0 0) 0x7f11380c95d0 con 0x7f11380caac0 2023-11-17T06:33:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1138144e80 con 0x7f11380caac0 2023-11-17T06:33:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3343856579 0 0) 0x7f11200035d0 con 0x7f113806c160 2023-11-17T06:33:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f113806bd80 msgr2=0x7f1138071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f113806bd80 0x7f1138071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 >> v1:172.21.15.93:6789/0 conn(0x7f11380caac0 legacy=0x7f1138164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113806d6e0 con 0x7f113806c160 2023-11-17T06:33:20.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f112c001670 con 0x7f113806c160 2023-11-17T06:33:20.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 >> v1:172.21.15.69:6789/0 conn(0x7f113806c160 legacy=0x7f113806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1120003be0 0x7f1120003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f113806bd80 0x7f1120004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1120004db0 0x7f1120005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113806d400 con 0x7f1120004db0 2023-11-17T06:33:20.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112000bae0 con 0x7f1120003be0 2023-11-17T06:33:20.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112000bca0 con 0x7f113806bd80 2023-11-17T06:33:20.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f1137fff700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1120004db0 0x7f1120005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f1136ffd700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f113806bd80 0x7f1120004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11377fe700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1120003be0 0x7f1120003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f1137fff700 1 -- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f113806bd80 msgr2=0x7f1120004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:20.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f1137fff700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f113806bd80 0x7f1120004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f1137fff700 1 -- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1120003be0 msgr2=0x7f1120003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:20.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f1137fff700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1120003be0 0x7f1120003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f1137fff700 1 -- 172.21.15.69:0/1089539449 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200035d0 con 0x7f1120004db0 2023-11-17T06:33:20.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f1137fff700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1120004db0 0x7f1120005230 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f113000c2f0 tx=0x7f11200058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a43a6ef5610025 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130001f30 con 0x7f1120004db0 2023-11-17T06:33:20.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113000ce90 con 0x7f1120004db0 2023-11-17T06:33:20.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f11367fc700 1 -- 172.21.15.69:0/1089539449 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130003c60 con 0x7f1120004db0 2023-11-17T06:33:20.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f113e00f700 1 -- 172.21.15.69:0/1089539449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1120004db0 msgr2=0x7f1120005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f113e00f700 1 --2- 172.21.15.69:0/1089539449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1120004db0 0x7f1120005230 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f113000c2f0 tx=0x7f11200058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f1137fff700 1 -- 172.21.15.69:0/1089539449 reap_dead start 2023-11-17T06:33:20.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f113e00f700 1 -- 172.21.15.69:0/1089539449 shutdown_connections 2023-11-17T06:33:20.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f113e00f700 1 -- 172.21.15.69:0/1089539449 >> 172.21.15.69:0/1089539449 conn(0x7f11380ceee0 msgr2=0x7f11380cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:20.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.340+0000 7f113e00f700 1 -- 172.21.15.69:0/1089539449 shutdown_connections 2023-11-17T06:33:20.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.344+0000 7f113e00f700 1 -- 172.21.15.69:0/1089539449 wait complete. 2023-11-17T06:33:20.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.344+0000 7f113e00f700 1 Processor -- start 2023-11-17T06:33:20.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.344+0000 7f113e00f700 1 -- start start 2023-11-17T06:33:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f113e00f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1120004db0 0x7f11380ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f113e00f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11380ce700 0x7f11380af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f113e00f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11380afb80 0x7f1138159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f113e00f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11380b0000 con 0x7f11380ce700 2023-11-17T06:33:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f113e00f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1138158d50 con 0x7f11380afb80 2023-11-17T06:33:20.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f113e00f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11380cd6e0 con 0x7f1120004db0 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1136ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11380ce700 0x7f11380af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1136ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11380ce700 0x7f11380af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47060/0 (socket says 172.21.15.69:47060) 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1136ffd700 1 -- 172.21.15.69:0/2301595967 learned_addr learned my addr 172.21.15.69:0/2301595967 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1137fff700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11380afb80 0x7f1138159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f11377fe700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1120004db0 0x7f11380ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1136ffd700 1 -- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1120004db0 msgr2=0x7f11380ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1136ffd700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1120004db0 0x7f11380ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1136ffd700 1 -- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11380afb80 msgr2=0x7f1138159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1136ffd700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11380afb80 0x7f1138159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1136ffd700 1 -- 172.21.15.69:0/2301595967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11380cd9c0 con 0x7f11380ce700 2023-11-17T06:33:20.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1137fff700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11380afb80 0x7f1138159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f1136ffd700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11380ce700 0x7f11380af640 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f112c007290 tx=0x7f112c007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f111ffff700 1 -- 172.21.15.69:0/2301595967 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c00f6c0 con 0x7f11380ce700 2023-11-17T06:33:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f111ffff700 1 -- 172.21.15.69:0/2301595967 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c00f820 con 0x7f11380ce700 2023-11-17T06:33:20.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f113e00f700 1 -- 172.21.15.69:0/2301595967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11380cdca0 con 0x7f11380ce700 2023-11-17T06:33:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f111ffff700 1 -- 172.21.15.69:0/2301595967 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c00fbd0 con 0x7f11380ce700 2023-11-17T06:33:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f113e00f700 1 -- 172.21.15.69:0/2301595967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1138159890 con 0x7f11380ce700 2023-11-17T06:33:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.348+0000 7f113e00f700 1 -- 172.21.15.69:0/2301595967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11380cdee0 con 0x7f11380ce700 2023-11-17T06:33:20.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.352+0000 7f111ffff700 1 -- 172.21.15.69:0/2301595967 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f112c00fd30 con 0x7f11380ce700 2023-11-17T06:33:20.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.352+0000 7f111ffff700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1124066540 0x7f1124068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.352+0000 7f111ffff700 1 -- 172.21.15.69:0/2301595967 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f112c083fd0 con 0x7f11380ce700 2023-11-17T06:33:20.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.352+0000 7f11377fe700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1124066540 0x7f1124068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.356+0000 7f11377fe700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1124066540 0x7f1124068a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1128009ac0 tx=0x7f1128008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.360+0000 7f111ffff700 1 -- 172.21.15.69:0/2301595967 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f11380cdee0 con 0x7f11380ce700 2023-11-17T06:33:20.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.536+0000 7f113e00f700 1 -- 172.21.15.69:0/2301595967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11380cdee0 con 0x7f11380ce700 2023-11-17T06:33:20.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.536+0000 7f111ffff700 1 -- 172.21.15.69:0/2301595967 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f11380cdee0 con 0x7f11380ce700 2023-11-17T06:33:20.542 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:33:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 -- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1124066540 msgr2=0x7f1124068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1124066540 0x7f1124068a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1128009ac0 tx=0x7f1128008040 comp rx=0 tx=0).stop 2023-11-17T06:33:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 -- 172.21.15.69:0/2301595967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11380ce700 msgr2=0x7f11380af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11380ce700 0x7f11380af640 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f112c007290 tx=0x7f112c007650 comp rx=0 tx=0).stop 2023-11-17T06:33:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 -- 172.21.15.69:0/2301595967 shutdown_connections 2023-11-17T06:33:20.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1124066540 0x7f1124068a00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f11380afb80 0x7f1138159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11380ce700 0x7f11380af640 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 --2- 172.21.15.69:0/2301595967 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1120004db0 0x7f11380ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 -- 172.21.15.69:0/2301595967 >> 172.21.15.69:0/2301595967 conn(0x7f11380ceee0 msgr2=0x7f11380cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 -- 172.21.15.69:0/2301595967 shutdown_connections 2023-11-17T06:33:20.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.540+0000 7f113e00f700 1 -- 172.21.15.69:0/2301595967 wait complete. 2023-11-17T06:33:20.569 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:33:20.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.736+0000 7fad5d84f700 1 Processor -- start 2023-11-17T06:33:20.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.736+0000 7fad5d84f700 1 -- start start 2023-11-17T06:33:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.736+0000 7fad5d84f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fad5815da80 0x7fad580d2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.736+0000 7fad5d84f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 0x7fad5806a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.736+0000 7fad5d84f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad581624b0 con 0x7fad580d2e80 2023-11-17T06:33:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.736+0000 7fad5d84f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad580d24b0 con 0x7fad5815da80 2023-11-17T06:33:20.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.736+0000 7fad5d84f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5815de60 con 0x7fad580cea90 2023-11-17T06:33:20.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad56ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fad5815da80 0x7fad580d2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad567fc700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fad580d2e80 0x7fad580ce380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55902/0 (socket says 172.21.15.69:55902) 2023-11-17T06:33:20.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad567fc700 1 -- 172.21.15.69:0/1225568480 learned_addr learned my addr 172.21.15.69:0/1225568480 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:20.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad577fe700 1 --2- 172.21.15.69:0/1225568480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 0x7fad5806a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad55ffb700 1 -- 172.21.15.69:0/1225568480 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113144692 0 0) 0x7fad581624b0 con 0x7fad580d2e80 2023-11-17T06:33:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad55ffb700 1 -- 172.21.15.69:0/1225568480 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad400035d0 con 0x7fad580d2e80 2023-11-17T06:33:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad56ffd700 1 -- 172.21.15.69:0/1225568480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 msgr2=0x7fad5806a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad56ffd700 1 --2- 172.21.15.69:0/1225568480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 0x7fad5806a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad56ffd700 1 -- 172.21.15.69:0/1225568480 >> v1:172.21.15.69:6789/0 conn(0x7fad580d2e80 legacy=0x7fad580ce380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad56ffd700 1 -- 172.21.15.69:0/1225568480 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad580d18a0 con 0x7fad5815da80 2023-11-17T06:33:20.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad577fe700 1 --2- 172.21.15.69:0/1225568480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 0x7fad5806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad56ffd700 1 --2- 172.21.15.69:0/1225568480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 0x7fad580d2940 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fad48009850 tx=0x7fad48009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c37df7f3f874524 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad55ffb700 1 -- 172.21.15.69:0/1225568480 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48011830 con 0x7fad5815da80 2023-11-17T06:33:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad55ffb700 1 -- 172.21.15.69:0/1225568480 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad48011990 con 0x7fad5815da80 2023-11-17T06:33:20.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad55ffb700 1 -- 172.21.15.69:0/1225568480 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad48011d40 con 0x7fad5815da80 2023-11-17T06:33:20.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad5d84f700 1 -- 172.21.15.69:0/1225568480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 msgr2=0x7fad580d2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.740+0000 7fad5d84f700 1 --2- 172.21.15.69:0/1225568480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 0x7fad580d2940 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fad48009850 tx=0x7fad48009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:20.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.744+0000 7fad5d84f700 1 -- 172.21.15.69:0/1225568480 shutdown_connections 2023-11-17T06:33:20.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.744+0000 7fad5d84f700 1 --2- 172.21.15.69:0/1225568480 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 0x7fad5806a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.744+0000 7fad5d84f700 1 --2- 172.21.15.69:0/1225568480 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 0x7fad580d2940 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.744+0000 7fad5d84f700 1 -- 172.21.15.69:0/1225568480 >> 172.21.15.69:0/1225568480 conn(0x7fad5806bf10 msgr2=0x7fad580d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:20.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.744+0000 7fad5d84f700 1 -- 172.21.15.69:0/1225568480 shutdown_connections 2023-11-17T06:33:20.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.744+0000 7fad5d84f700 1 -- 172.21.15.69:0/1225568480 wait complete. 2023-11-17T06:33:20.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.744+0000 7fad5d84f700 1 Processor -- start 2023-11-17T06:33:20.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.744+0000 7fad5d84f700 1 -- start start 2023-11-17T06:33:20.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad5d84f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 0x7fad581f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad5d84f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad580d2e80 0x7fad58160d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad5d84f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 0x7fad5814bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad5d84f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad581f73b0 con 0x7fad5815da80 2023-11-17T06:33:20.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad5d84f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5814e880 con 0x7fad580d2e80 2023-11-17T06:33:20.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad5d84f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad5814dc70 con 0x7fad580cea90 2023-11-17T06:33:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad577fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 0x7fad5814bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad577fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 0x7fad5814bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47084/0 (socket says 172.21.15.69:47084) 2023-11-17T06:33:20.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad577fe700 1 -- 172.21.15.69:0/2756288598 learned_addr learned my addr 172.21.15.69:0/2756288598 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:20.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad56ffd700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 0x7fad581f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad567fc700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad580d2e80 0x7fad58160d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad577fe700 1 -- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 msgr2=0x7fad581f6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad577fe700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 0x7fad581f6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad577fe700 1 -- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad580d2e80 msgr2=0x7fad58160d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad577fe700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad580d2e80 0x7fad58160d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad577fe700 1 -- 172.21.15.69:0/2756288598 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009a70 con 0x7fad5815da80 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad577fe700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 0x7fad5814bff0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fad5000efc0 tx=0x7fad5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad3ffff700 1 -- 172.21.15.69:0/2756288598 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5000ce00 con 0x7fad5815da80 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad3ffff700 1 -- 172.21.15.69:0/2756288598 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5000f040 con 0x7fad5815da80 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad3ffff700 1 -- 172.21.15.69:0/2756288598 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500146c0 con 0x7fad5815da80 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad5d84f700 1 -- 172.21.15.69:0/2756288598 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad480094b0 con 0x7fad5815da80 2023-11-17T06:33:20.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad5d84f700 1 -- 172.21.15.69:0/2756288598 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5814e230 con 0x7fad5815da80 2023-11-17T06:33:20.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.748+0000 7fad5d84f700 1 -- 172.21.15.69:0/2756288598 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5814ea30 con 0x7fad5815da80 2023-11-17T06:33:20.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.752+0000 7fad3ffff700 1 -- 172.21.15.69:0/2756288598 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fad50014820 con 0x7fad5815da80 2023-11-17T06:33:20.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.752+0000 7fad3ffff700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fad44066540 0x7fad44068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:20.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.752+0000 7fad3ffff700 1 -- 172.21.15.69:0/2756288598 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fad50084c60 con 0x7fad5815da80 2023-11-17T06:33:20.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.752+0000 7fad56ffd700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fad44066540 0x7fad44068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:20.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.756+0000 7fad56ffd700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fad44066540 0x7fad44068a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fad480090b0 tx=0x7fad48008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:20.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.756+0000 7fad3ffff700 1 -- 172.21.15.69:0/2756288598 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fad5814ea30 con 0x7fad5815da80 2023-11-17T06:33:20.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.928+0000 7fad5d84f700 1 -- 172.21.15.69:0/2756288598 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad5814e9f0 con 0x7fad5815da80 2023-11-17T06:33:20.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad3ffff700 1 -- 172.21.15.69:0/2756288598 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad500180a0 con 0x7fad5815da80 2023-11-17T06:33:20.935 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:33:20.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 -- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fad44066540 msgr2=0x7fad44068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fad44066540 0x7fad44068a00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fad480090b0 tx=0x7fad48008030 comp rx=0 tx=0).stop 2023-11-17T06:33:20.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 -- 172.21.15.69:0/2756288598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 msgr2=0x7fad5814bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:20.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 0x7fad5814bff0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fad5000efc0 tx=0x7fad5000c3a0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 -- 172.21.15.69:0/2756288598 shutdown_connections 2023-11-17T06:33:20.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fad44066540 0x7fad44068a00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad5815da80 0x7fad5814bff0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad580d2e80 0x7fad58160d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 --2- 172.21.15.69:0/2756288598 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fad580cea90 0x7fad581f6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:20.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 -- 172.21.15.69:0/2756288598 >> 172.21.15.69:0/2756288598 conn(0x7fad5806bf10 msgr2=0x7fad580b8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:20.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 -- 172.21.15.69:0/2756288598 shutdown_connections 2023-11-17T06:33:20.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:20.932+0000 7fad5d84f700 1 -- 172.21.15.69:0/2756288598 wait complete. 2023-11-17T06:33:20.960 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:33:21.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.140+0000 7f1995c08700 1 Processor -- start 2023-11-17T06:33:21.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.140+0000 7f1995c08700 1 -- start start 2023-11-17T06:33:21.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.140+0000 7f1995c08700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f199015d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.140+0000 7f1995c08700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f19900b8c40 0x7f19900ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.140+0000 7f1995c08700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199015ddc0 con 0x7f19900b9080 2023-11-17T06:33:21.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.140+0000 7f1995c08700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199015e050 con 0x7f19900b8c40 2023-11-17T06:33:21.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.140+0000 7f1995c08700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199015e330 con 0x7f199015d4a0 2023-11-17T06:33:21.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198f7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f199015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198effd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f19900b8c40 0x7f19900ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198f7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f199015d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:42558/0 (socket says 172.21.15.69:42558) 2023-11-17T06:33:21.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198effd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f19900b8c40 0x7f19900ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:51544/0 (socket says 172.21.15.69:51544) 2023-11-17T06:33:21.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198f7fe700 1 -- 172.21.15.69:0/2212231546 learned_addr learned my addr 172.21.15.69:0/2212231546 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:21.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198f7fe700 1 -- 172.21.15.69:0/2212231546 >> v2:172.21.15.93:3300/0 conn(0x7f19900b8c40 msgr2=0x7f19900ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:21.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198f7fe700 1 --2- 172.21.15.69:0/2212231546 >> v2:172.21.15.93:3300/0 conn(0x7f19900b8c40 0x7f19900ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198f7fe700 1 -- 172.21.15.69:0/2212231546 >> v1:172.21.15.69:6789/0 conn(0x7f19900b9080 legacy=0x7f19900b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198f7fe700 1 -- 172.21.15.69:0/2212231546 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199015e610 con 0x7f199015d4a0 2023-11-17T06:33:21.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198effd700 1 --2- 172.21.15.69:0/2212231546 >> v2:172.21.15.93:3300/0 conn(0x7f19900b8c40 0x7f19900ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:21.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198f7fe700 1 --2- 172.21.15.69:0/2212231546 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f199015d880 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1980009910 tx=0x7f1980009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af854b0471edbe08 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198e7fc700 1 -- 172.21.15.69:0/2212231546 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980011830 con 0x7f199015d4a0 2023-11-17T06:33:21.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198e7fc700 1 -- 172.21.15.69:0/2212231546 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1980011990 con 0x7f199015d4a0 2023-11-17T06:33:21.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f198e7fc700 1 -- 172.21.15.69:0/2212231546 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980011d40 con 0x7f199015d4a0 2023-11-17T06:33:21.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f1995c08700 1 -- 172.21.15.69:0/2212231546 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 msgr2=0x7f199015d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f1995c08700 1 --2- 172.21.15.69:0/2212231546 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f199015d880 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1980009910 tx=0x7f1980009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:21.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f1995c08700 1 -- 172.21.15.69:0/2212231546 shutdown_connections 2023-11-17T06:33:21.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f1995c08700 1 --2- 172.21.15.69:0/2212231546 >> v2:172.21.15.93:3300/0 conn(0x7f19900b8c40 0x7f19900ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f1995c08700 1 --2- 172.21.15.69:0/2212231546 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f199015d880 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f1995c08700 1 -- 172.21.15.69:0/2212231546 >> 172.21.15.69:0/2212231546 conn(0x7f199006b830 msgr2=0x7f199006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:21.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f1995c08700 1 -- 172.21.15.69:0/2212231546 shutdown_connections 2023-11-17T06:33:21.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.144+0000 7f1995c08700 1 -- 172.21.15.69:0/2212231546 wait complete. 2023-11-17T06:33:21.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.148+0000 7f1995c08700 1 Processor -- start 2023-11-17T06:33:21.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.148+0000 7f1995c08700 1 -- start start 2023-11-17T06:33:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1995c08700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19900b8c40 0x7f1990154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1995c08700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f1990158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1995c08700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1990157760 0x7f199015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1995c08700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1990158e70 con 0x7f19900b8c40 2023-11-17T06:33:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1995c08700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1990159060 con 0x7f1990157760 2023-11-17T06:33:21.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1995c08700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1990159340 con 0x7f199015d4a0 2023-11-17T06:33:21.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19900b8c40 0x7f1990154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19900b8c40 0x7f1990154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47100/0 (socket says 172.21.15.69:47100) 2023-11-17T06:33:21.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198f7fe700 1 -- 172.21.15.69:0/3235982904 learned_addr learned my addr 172.21.15.69:0/3235982904 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:21.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198effd700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f1990158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198ffff700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1990157760 0x7f199015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198f7fe700 1 -- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 msgr2=0x7f1990158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198f7fe700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f1990158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198f7fe700 1 -- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1990157760 msgr2=0x7f199015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198f7fe700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1990157760 0x7f199015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198f7fe700 1 -- 172.21.15.69:0/3235982904 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840094b0 con 0x7f19900b8c40 2023-11-17T06:33:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198effd700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f1990158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f198f7fe700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19900b8c40 0x7f1990154a20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f199015e470 tx=0x7f1980004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1977fff700 1 -- 172.21.15.69:0/3235982904 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000b9f0 con 0x7f19900b8c40 2023-11-17T06:33:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1977fff700 1 -- 172.21.15.69:0/3235982904 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198001e070 con 0x7f19900b8c40 2023-11-17T06:33:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1995c08700 1 -- 172.21.15.69:0/3235982904 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1980009570 con 0x7f19900b8c40 2023-11-17T06:33:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1977fff700 1 -- 172.21.15.69:0/3235982904 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198000bd90 con 0x7f19900b8c40 2023-11-17T06:33:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.152+0000 7f1995c08700 1 -- 172.21.15.69:0/3235982904 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1990159900 con 0x7f19900b8c40 2023-11-17T06:33:21.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.156+0000 7f1995c08700 1 -- 172.21.15.69:0/3235982904 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199004e6c0 con 0x7f19900b8c40 2023-11-17T06:33:21.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.156+0000 7f1977fff700 1 -- 172.21.15.69:0/3235982904 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f198001a420 con 0x7f19900b8c40 2023-11-17T06:33:21.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.156+0000 7f1977fff700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f197c066510 0x7f197c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.160+0000 7f1977fff700 1 -- 172.21.15.69:0/3235982904 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f1980085140 con 0x7f19900b8c40 2023-11-17T06:33:21.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.160+0000 7f198effd700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f197c066510 0x7f197c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.160+0000 7f198effd700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f197c066510 0x7f197c0689d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1990072480 tx=0x7f1984008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.164+0000 7f1977fff700 1 -- 172.21.15.69:0/3235982904 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1980052590 con 0x7f19900b8c40 2023-11-17T06:33:21.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.348+0000 7f1995c08700 1 -- 172.21.15.69:0/3235982904 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19900c6fd0 con 0x7f19900b8c40 2023-11-17T06:33:21.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.348+0000 7f1977fff700 1 -- 172.21.15.69:0/3235982904 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1980055bb0 con 0x7f19900b8c40 2023-11-17T06:33:21.354 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:33:21.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.352+0000 7f1995c08700 1 -- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f197c066510 msgr2=0x7f197c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.352+0000 7f1995c08700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f197c066510 0x7f197c0689d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1990072480 tx=0x7f1984008040 comp rx=0 tx=0).stop 2023-11-17T06:33:21.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.352+0000 7f1995c08700 1 -- 172.21.15.69:0/3235982904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19900b8c40 msgr2=0x7f1990154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.352+0000 7f1995c08700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19900b8c40 0x7f1990154a20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f199015e470 tx=0x7f1980004770 comp rx=0 tx=0).stop 2023-11-17T06:33:21.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.356+0000 7f1995c08700 1 -- 172.21.15.69:0/3235982904 shutdown_connections 2023-11-17T06:33:21.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.356+0000 7f1995c08700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f197c066510 0x7f197c0689d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.356+0000 7f1995c08700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1990157760 0x7f199015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.356+0000 7f1995c08700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f199015d4a0 0x7f1990158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.356+0000 7f1995c08700 1 --2- 172.21.15.69:0/3235982904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19900b8c40 0x7f1990154a20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.356+0000 7f1995c08700 1 -- 172.21.15.69:0/3235982904 >> 172.21.15.69:0/3235982904 conn(0x7f199006b830 msgr2=0x7f19900c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:21.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.356+0000 7f1995c08700 1 -- 172.21.15.69:0/3235982904 shutdown_connections 2023-11-17T06:33:21.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.356+0000 7f1995c08700 1 -- 172.21.15.69:0/3235982904 wait complete. 2023-11-17T06:33:21.385 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:33:21.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.560+0000 7f07b5858700 1 Processor -- start 2023-11-17T06:33:21.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.560+0000 7f07b5858700 1 -- start start 2023-11-17T06:33:21.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.560+0000 7f07b5858700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f07b006d0f0 0x7f07b00b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.560+0000 7f07b5858700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b00d2340 con 0x7f07b015d550 2023-11-17T06:33:21.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.560+0000 7f07b5858700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b00d1730 con 0x7f07b006cc90 2023-11-17T06:33:21.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.560+0000 7f07b5858700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b00cf400 con 0x7f07b006d0f0 2023-11-17T06:33:21.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b4856700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f07b015d550 0x7f07b00d2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55918/0 (socket says 172.21.15.69:55918) 2023-11-17T06:33:21.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b4856700 1 -- 172.21.15.69:0/1516662968 learned_addr learned my addr 172.21.15.69:0/1516662968 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:21.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5057700 1 --2- 172.21.15.69:0/1516662968 >> v2:172.21.15.93:3300/0 conn(0x7f07b006d0f0 0x7f07b00b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07af7fe700 1 -- 172.21.15.69:0/1516662968 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599109931 0 0) 0x7f07b00d2340 con 0x7f07b015d550 2023-11-17T06:33:21.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07af7fe700 1 -- 172.21.15.69:0/1516662968 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a00035d0 con 0x7f07b015d550 2023-11-17T06:33:21.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5057700 1 -- 172.21.15.69:0/1516662968 >> v1:172.21.15.93:6789/0 conn(0x7f07b006cc90 legacy=0x7f07b00b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5057700 1 -- 172.21.15.69:0/1516662968 >> v1:172.21.15.69:6789/0 conn(0x7f07b015d550 legacy=0x7f07b00d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5057700 1 -- 172.21.15.69:0/1516662968 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00d1a10 con 0x7f07b006d0f0 2023-11-17T06:33:21.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5057700 1 --2- 172.21.15.69:0/1516662968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b006d0f0 0x7f07b00b6c90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009d90 tx=0x7f07a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=245b73c94eaffbb1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07af7fe700 1 -- 172.21.15.69:0/1516662968 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a800e070 con 0x7f07b006d0f0 2023-11-17T06:33:21.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07af7fe700 1 -- 172.21.15.69:0/1516662968 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a800bb20 con 0x7f07b006d0f0 2023-11-17T06:33:21.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07af7fe700 1 -- 172.21.15.69:0/1516662968 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8012430 con 0x7f07b006d0f0 2023-11-17T06:33:21.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5858700 1 -- 172.21.15.69:0/1516662968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b006d0f0 msgr2=0x7f07b00b6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5858700 1 --2- 172.21.15.69:0/1516662968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b006d0f0 0x7f07b00b6c90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009d90 tx=0x7f07a800b330 comp rx=0 tx=0).stop 2023-11-17T06:33:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5858700 1 -- 172.21.15.69:0/1516662968 shutdown_connections 2023-11-17T06:33:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5858700 1 --2- 172.21.15.69:0/1516662968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b006d0f0 0x7f07b00b6c90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5858700 1 -- 172.21.15.69:0/1516662968 >> 172.21.15.69:0/1516662968 conn(0x7f07b00b4cb0 msgr2=0x7f07b00b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.564+0000 7f07b5858700 1 -- 172.21.15.69:0/1516662968 shutdown_connections 2023-11-17T06:33:21.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.568+0000 7f07b5858700 1 -- 172.21.15.69:0/1516662968 wait complete. 2023-11-17T06:33:21.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.568+0000 7f07b5858700 1 Processor -- start 2023-11-17T06:33:21.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b5858700 1 -- start start 2023-11-17T06:33:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b5858700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b006cc90 0x7f07b00c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b5858700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b006d0f0 0x7f07b015fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b5858700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f07b015d550 0x7f07b01601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b5858700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b015e880 con 0x7f07b006cc90 2023-11-17T06:33:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b5858700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00c9ac0 con 0x7f07b006d0f0 2023-11-17T06:33:21.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b5858700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b015dc70 con 0x7f07b015d550 2023-11-17T06:33:21.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b4856700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b006cc90 0x7f07b00c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b4856700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b006cc90 0x7f07b00c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47110/0 (socket says 172.21.15.69:47110) 2023-11-17T06:33:21.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b4856700 1 -- 172.21.15.69:0/184049501 learned_addr learned my addr 172.21.15.69:0/184049501 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:21.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07affff700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b006d0f0 0x7f07b015fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b5057700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f07b015d550 0x7f07b01601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b4856700 1 -- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f07b015d550 msgr2=0x7f07b01601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b4856700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f07b015d550 0x7f07b01601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b4856700 1 -- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b006d0f0 msgr2=0x7f07b015fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b4856700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b006d0f0 0x7f07b015fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b4856700 1 -- 172.21.15.69:0/184049501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8009a70 con 0x7f07b006cc90 2023-11-17T06:33:21.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07affff700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b006d0f0 0x7f07b015fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:21.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b4856700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b006cc90 0x7f07b00c9580 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f07a400c4d0 tx=0x7f07a400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07ad7fa700 1 -- 172.21.15.69:0/184049501 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4005d90 con 0x7f07b006cc90 2023-11-17T06:33:21.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07ad7fa700 1 -- 172.21.15.69:0/184049501 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a40070d0 con 0x7f07b006cc90 2023-11-17T06:33:21.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b5858700 1 -- 172.21.15.69:0/184049501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b015df50 con 0x7f07b006cc90 2023-11-17T06:33:21.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07ad7fa700 1 -- 172.21.15.69:0/184049501 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4007480 con 0x7f07b006cc90 2023-11-17T06:33:21.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.572+0000 7f07b5858700 1 -- 172.21.15.69:0/184049501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b015e510 con 0x7f07b006cc90 2023-11-17T06:33:21.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.576+0000 7f07b5858700 1 -- 172.21.15.69:0/184049501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b004e650 con 0x7f07b006cc90 2023-11-17T06:33:21.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.576+0000 7f07ad7fa700 1 -- 172.21.15.69:0/184049501 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f07a40075e0 con 0x7f07b006cc90 2023-11-17T06:33:21.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.580+0000 7f07ad7fa700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0794066510 0x7f07940689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:21.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.580+0000 7f07ad7fa700 1 -- 172.21.15.69:0/184049501 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f07a40834b0 con 0x7f07b006cc90 2023-11-17T06:33:21.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.580+0000 7f07affff700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0794066510 0x7f07940689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:21.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.580+0000 7f07affff700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0794066510 0x7f07940689d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f07b015f450 tx=0x7f079c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:21.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.584+0000 7f07ad7fa700 1 -- 172.21.15.69:0/184049501 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f07a4050850 con 0x7f07b006cc90 2023-11-17T06:33:21.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.768+0000 7f07b5858700 1 -- 172.21.15.69:0/184049501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f07b00cecb0 con 0x7f07b006cc90 2023-11-17T06:33:21.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.772+0000 7f07ad7fa700 1 -- 172.21.15.69:0/184049501 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v40) v1 ==== 80+0+122 (secure 0 0 0) 0x7f07a4053e70 con 0x7f07b006cc90 2023-11-17T06:33:21.775 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.93:6837/4181304583 2023-11-18T06:33:11.857552+0000 2023-11-17T06:33:21.775 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.93:6836/4181304583 2023-11-18T06:33:11.857552+0000 2023-11-17T06:33:21.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 -- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0794066510 msgr2=0x7f07940689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0794066510 0x7f07940689d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f07b015f450 tx=0x7f079c009040 comp rx=0 tx=0).stop 2023-11-17T06:33:21.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 -- 172.21.15.69:0/184049501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b006cc90 msgr2=0x7f07b00c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:21.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b006cc90 0x7f07b00c9580 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f07a400c4d0 tx=0x7f07a400c890 comp rx=0 tx=0).stop 2023-11-17T06:33:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 -- 172.21.15.69:0/184049501 shutdown_connections 2023-11-17T06:33:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0794066510 0x7f07940689d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f07b015d550 0x7f07b01601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f07b006d0f0 0x7f07b015fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 --2- 172.21.15.69:0/184049501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b006cc90 0x7f07b00c9580 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 -- 172.21.15.69:0/184049501 >> 172.21.15.69:0/184049501 conn(0x7f07b00b4cb0 msgr2=0x7f07b015b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 -- 172.21.15.69:0/184049501 shutdown_connections 2023-11-17T06:33:21.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:21.776+0000 7f07b5858700 1 -- 172.21.15.69:0/184049501 wait complete. 2023-11-17T06:33:21.782 INFO:teuthology.orchestra.run.smithi069.stderr:listed 2 entries 2023-11-17T06:33:21.801 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:33:21.801 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:21.819 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:22.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc53083700 1 Processor -- start 2023-11-17T06:33:22.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc53083700 1 -- start start 2023-11-17T06:33:22.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc53083700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbc4c15d6e0 0x7fbc4c0d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc53083700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbc4c0b4fb0 0x7fbc4c0b66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc53083700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4c0d1890 con 0x7fbc4c0b4bd0 2023-11-17T06:33:22.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc53083700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c0d1b70 con 0x7fbc4c15d6e0 2023-11-17T06:33:22.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc53083700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4c0d1e50 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc51880700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbc4c15d6e0 0x7fbc4c0d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc52882700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbc4c0b4fb0 0x7fbc4c0b66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc52882700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbc4c0b4fb0 0x7fbc4c0b66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:51588/0 (socket says 172.21.15.69:51588) 2023-11-17T06:33:22.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.040+0000 7fbc52882700 1 -- 172.21.15.69:0/3143644446 learned_addr learned my addr 172.21.15.69:0/3143644446 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:22.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc51880700 1 -- 172.21.15.69:0/3143644446 >> v2:172.21.15.93:3300/0 conn(0x7fbc4c0b4fb0 msgr2=0x7fbc4c0b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:22.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc51880700 1 --2- 172.21.15.69:0/3143644446 >> v2:172.21.15.93:3300/0 conn(0x7fbc4c0b4fb0 0x7fbc4c0b66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc51880700 1 -- 172.21.15.69:0/3143644446 >> v1:172.21.15.93:6789/0 conn(0x7fbc4c0b4bd0 legacy=0x7fbc4c0d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc51880700 1 -- 172.21.15.69:0/3143644446 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4c0d2130 con 0x7fbc4c15d6e0 2023-11-17T06:33:22.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc52882700 1 --2- 172.21.15.69:0/3143644446 >> v2:172.21.15.93:3300/0 conn(0x7fbc4c0b4fb0 0x7fbc4c0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:22.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc51880700 1 --2- 172.21.15.69:0/3143644446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c15d6e0 0x7fbc4c0d1200 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c08c590 tx=0x7fbc3c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe60e0e31b44db9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc5107f700 1 -- 172.21.15.69:0/3143644446 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c011830 con 0x7fbc4c15d6e0 2023-11-17T06:33:22.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc5107f700 1 -- 172.21.15.69:0/3143644446 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c011990 con 0x7fbc4c15d6e0 2023-11-17T06:33:22.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc5107f700 1 -- 172.21.15.69:0/3143644446 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c011d20 con 0x7fbc4c15d6e0 2023-11-17T06:33:22.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc53083700 1 -- 172.21.15.69:0/3143644446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c15d6e0 msgr2=0x7fbc4c0d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc53083700 1 --2- 172.21.15.69:0/3143644446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c15d6e0 0x7fbc4c0d1200 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c08c590 tx=0x7fbc3c009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:22.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc53083700 1 -- 172.21.15.69:0/3143644446 shutdown_connections 2023-11-17T06:33:22.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc53083700 1 --2- 172.21.15.69:0/3143644446 >> v2:172.21.15.93:3300/0 conn(0x7fbc4c0b4fb0 0x7fbc4c0b66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc53083700 1 --2- 172.21.15.69:0/3143644446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c15d6e0 0x7fbc4c0d1200 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc53083700 1 -- 172.21.15.69:0/3143644446 >> 172.21.15.69:0/3143644446 conn(0x7fbc4c0d3150 msgr2=0x7fbc4c0d3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:22.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc53083700 1 -- 172.21.15.69:0/3143644446 shutdown_connections 2023-11-17T06:33:22.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.044+0000 7fbc53083700 1 -- 172.21.15.69:0/3143644446 wait complete. 2023-11-17T06:33:22.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.048+0000 7fbc53083700 1 Processor -- start 2023-11-17T06:33:22.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.048+0000 7fbc53083700 1 -- start start 2023-11-17T06:33:22.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc53083700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc4c0b4bd0 0x7fbc4c0ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc53083700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c0b4fb0 0x7fbc4c1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc53083700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc4c15d6e0 0x7fbc4c0b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc53083700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c157ac0 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc53083700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c1f6f90 con 0x7fbc4c15d6e0 2023-11-17T06:33:22.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc53083700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c159e40 con 0x7fbc4c0b4bd0 2023-11-17T06:33:22.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc51880700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c0b4fb0 0x7fbc4c1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc51880700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c0b4fb0 0x7fbc4c1f6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47118/0 (socket says 172.21.15.69:47118) 2023-11-17T06:33:22.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc51880700 1 -- 172.21.15.69:0/3942768616 learned_addr learned my addr 172.21.15.69:0/3942768616 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc52081700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc4c0b4bd0 0x7fbc4c0ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc52882700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc4c15d6e0 0x7fbc4c0b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc51880700 1 -- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc4c0b4bd0 msgr2=0x7fbc4c0ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc51880700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc4c0b4bd0 0x7fbc4c0ccca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc51880700 1 -- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc4c15d6e0 msgr2=0x7fbc4c0b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc51880700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc4c15d6e0 0x7fbc4c0b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc51880700 1 -- 172.21.15.69:0/3942768616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc44009b30 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc52081700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc4c0b4bd0 0x7fbc4c0ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc51880700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c0b4fb0 0x7fbc4c1f6a50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0090b0 tx=0x7fbc3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc42ffd700 1 -- 172.21.15.69:0/3942768616 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0036c0 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc42ffd700 1 -- 172.21.15.69:0/3942768616 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c01e070 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc53083700 1 -- 172.21.15.69:0/3942768616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c0094b0 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc42ffd700 1 -- 172.21.15.69:0/3942768616 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c003a40 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.052+0000 7fbc53083700 1 -- 172.21.15.69:0/3942768616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4c1577e0 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.056+0000 7fbc53083700 1 -- 172.21.15.69:0/3942768616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4c04e650 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.056+0000 7fbc42ffd700 1 -- 172.21.15.69:0/3942768616 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbc3c003ba0 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.056+0000 7fbc42ffd700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc30066510 0x7fbc300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.056+0000 7fbc42ffd700 1 -- 172.21.15.69:0/3942768616 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fbc3c084e20 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.060+0000 7fbc52081700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc30066510 0x7fbc300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.060+0000 7fbc52081700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc30066510 0x7fbc300689d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c072480 tx=0x7fbc48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.064+0000 7fbc42ffd700 1 -- 172.21.15.69:0/3942768616 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc3c0521c0 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.240+0000 7fbc53083700 1 -- 172.21.15.69:0/3942768616 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc4c153340 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.240+0000 7fbc42ffd700 1 -- 172.21.15.69:0/3942768616 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16803 (secure 0 0 0) 0x7fbc3c020090 con 0x7fbc4c0b4fb0 2023-11-17T06:33:22.246 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:22.247 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":40,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:33:11.857600+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.93:6837/4181304583":"2023-11-18T06:33:11.857552+0000","172.21.15.93:6836/4181304583":"2023-11-18T06:33:11.857552+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:22.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 -- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc30066510 msgr2=0x7fbc300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc30066510 0x7fbc300689d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c072480 tx=0x7fbc48009040 comp rx=0 tx=0).stop 2023-11-17T06:33:22.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 -- 172.21.15.69:0/3942768616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c0b4fb0 msgr2=0x7fbc4c1f6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c0b4fb0 0x7fbc4c1f6a50 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0090b0 tx=0x7fbc3c004770 comp rx=0 tx=0).stop 2023-11-17T06:33:22.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 -- 172.21.15.69:0/3942768616 shutdown_connections 2023-11-17T06:33:22.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc30066510 0x7fbc300689d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc4c15d6e0 0x7fbc4c0b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc4c0b4fb0 0x7fbc4c1f6a50 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 --2- 172.21.15.69:0/3942768616 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc4c0b4bd0 0x7fbc4c0ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 -- 172.21.15.69:0/3942768616 >> 172.21.15.69:0/3942768616 conn(0x7fbc4c0d3150 msgr2=0x7fbc4c0b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:22.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 -- 172.21.15.69:0/3942768616 shutdown_connections 2023-11-17T06:33:22.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.244+0000 7fbc53083700 1 -- 172.21.15.69:0/3942768616 wait complete. 2023-11-17T06:33:22.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:23.624321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:24.717590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:33:22.274 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:33:22.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.448+0000 7ffa9f8ec700 1 Processor -- start 2023-11-17T06:33:22.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9f8ec700 1 -- start start 2023-11-17T06:33:22.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9f8ec700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffa980caac0 0x7ffa98071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9f8ec700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa98144e80 con 0x7ffa9806c870 2023-11-17T06:33:22.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9f8ec700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa980c95d0 con 0x7ffa9806bd80 2023-11-17T06:33:22.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9f8ec700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9806d400 con 0x7ffa980caac0 2023-11-17T06:33:22.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9de89700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ffa9806c870 0x7ffa98164e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55930/0 (socket says 172.21.15.69:55930) 2023-11-17T06:33:22.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9ce87700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffa980caac0 0x7ffa98071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9de89700 1 -- 172.21.15.69:0/3130633201 learned_addr learned my addr 172.21.15.69:0/3130633201 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:22.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9ce87700 1 -- 172.21.15.69:0/3130633201 >> v1:172.21.15.93:6789/0 conn(0x7ffa9806bd80 legacy=0x7ffa9806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9ce87700 1 -- 172.21.15.69:0/3130633201 >> v1:172.21.15.69:6789/0 conn(0x7ffa9806c870 legacy=0x7ffa98164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa8ffff700 1 -- 172.21.15.69:0/3130633201 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796974117 0 0) 0x7ffa98144e80 con 0x7ffa9806c870 2023-11-17T06:33:22.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.452+0000 7ffa9ce87700 1 -- 172.21.15.69:0/3130633201 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9806d6e0 con 0x7ffa980caac0 2023-11-17T06:33:22.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa9ce87700 1 --2- 172.21.15.69:0/3130633201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 0x7ffa98071db0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009850 tx=0x7ffa88009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7ecc30b32580b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa8ffff700 1 -- 172.21.15.69:0/3130633201 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88011830 con 0x7ffa980caac0 2023-11-17T06:33:22.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa8ffff700 1 -- 172.21.15.69:0/3130633201 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa88011990 con 0x7ffa980caac0 2023-11-17T06:33:22.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa8ffff700 1 -- 172.21.15.69:0/3130633201 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88011d20 con 0x7ffa980caac0 2023-11-17T06:33:22.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/3130633201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 msgr2=0x7ffa98071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa9f8ec700 1 --2- 172.21.15.69:0/3130633201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 0x7ffa98071db0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ffa88009850 tx=0x7ffa88009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:22.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/3130633201 shutdown_connections 2023-11-17T06:33:22.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa9f8ec700 1 --2- 172.21.15.69:0/3130633201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 0x7ffa98071db0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/3130633201 >> 172.21.15.69:0/3130633201 conn(0x7ffa980ceee0 msgr2=0x7ffa980cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:22.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/3130633201 shutdown_connections 2023-11-17T06:33:22.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.456+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/3130633201 wait complete. 2023-11-17T06:33:22.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.460+0000 7ffa9f8ec700 1 Processor -- start 2023-11-17T06:33:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.460+0000 7ffa9f8ec700 1 -- start start 2023-11-17T06:33:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9f8ec700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffa9806bd80 0x7ffa980c3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9f8ec700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa9806c870 0x7ffa9815e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9f8ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 0x7ffa980c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9f8ec700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980c8e60 con 0x7ffa980caac0 2023-11-17T06:33:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9f8ec700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9815d020 con 0x7ffa9806c870 2023-11-17T06:33:22.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9f8ec700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980c3940 con 0x7ffa9806bd80 2023-11-17T06:33:22.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9de89700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 0x7ffa980c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9de89700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 0x7ffa980c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47140/0 (socket says 172.21.15.69:47140) 2023-11-17T06:33:22.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9de89700 1 -- 172.21.15.69:0/2682759534 learned_addr learned my addr 172.21.15.69:0/2682759534 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:22.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9ce87700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa9806c870 0x7ffa9815e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9d688700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffa9806bd80 0x7ffa980c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9de89700 1 -- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffa9806bd80 msgr2=0x7ffa980c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9de89700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffa9806bd80 0x7ffa980c3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9de89700 1 -- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa9806c870 msgr2=0x7ffa9815e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9de89700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa9806c870 0x7ffa9815e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9de89700 1 -- 172.21.15.69:0/2682759534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa880094b0 con 0x7ffa980caac0 2023-11-17T06:33:22.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9de89700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 0x7ffa980c8000 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ffa90002230 tx=0x7ffa9000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa8dffb700 1 -- 172.21.15.69:0/2682759534 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000aac0 con 0x7ffa980caac0 2023-11-17T06:33:22.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa8dffb700 1 -- 172.21.15.69:0/2682759534 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9000ac40 con 0x7ffa980caac0 2023-11-17T06:33:22.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/2682759534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9815d2c0 con 0x7ffa980caac0 2023-11-17T06:33:22.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa8dffb700 1 -- 172.21.15.69:0/2682759534 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa900070d0 con 0x7ffa980caac0 2023-11-17T06:33:22.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.464+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/2682759534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9815d880 con 0x7ffa980caac0 2023-11-17T06:33:22.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.468+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/2682759534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa981419c0 con 0x7ffa980caac0 2023-11-17T06:33:22.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.468+0000 7ffa8dffb700 1 -- 172.21.15.69:0/2682759534 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffa90007250 con 0x7ffa980caac0 2023-11-17T06:33:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.468+0000 7ffa8dffb700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa7c066510 0x7ffa7c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.468+0000 7ffa8dffb700 1 -- 172.21.15.69:0/2682759534 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7ffa90083d10 con 0x7ffa980caac0 2023-11-17T06:33:22.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.472+0000 7ffa9d688700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa7c066510 0x7ffa7c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.472+0000 7ffa9d688700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa7c066510 0x7ffa7c0689d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000f60 tx=0x7ffa94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.472+0000 7ffa8dffb700 1 -- 172.21.15.69:0/2682759534 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffa900510c0 con 0x7ffa980caac0 2023-11-17T06:33:22.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.644+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/2682759534 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa980713d0 con 0x7ffa980caac0 2023-11-17T06:33:22.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.644+0000 7ffa8dffb700 1 -- 172.21.15.69:0/2682759534 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa900180a0 con 0x7ffa980caac0 2023-11-17T06:33:22.649 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:33:22.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa7c066510 msgr2=0x7ffa7c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa7c066510 0x7ffa7c0689d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffa94000f60 tx=0x7ffa94009040 comp rx=0 tx=0).stop 2023-11-17T06:33:22.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/2682759534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 msgr2=0x7ffa980c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 0x7ffa980c8000 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ffa90002230 tx=0x7ffa9000cf50 comp rx=0 tx=0).stop 2023-11-17T06:33:22.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/2682759534 shutdown_connections 2023-11-17T06:33:22.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa7c066510 0x7ffa7c0689d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa980caac0 0x7ffa980c8000 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffa9806c870 0x7ffa9815e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 --2- 172.21.15.69:0/2682759534 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffa9806bd80 0x7ffa980c3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/2682759534 >> 172.21.15.69:0/2682759534 conn(0x7ffa980ceee0 msgr2=0x7ffa980c5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:22.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/2682759534 shutdown_connections 2023-11-17T06:33:22.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.648+0000 7ffa9f8ec700 1 -- 172.21.15.69:0/2682759534 wait complete. 2023-11-17T06:33:22.674 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:33:22.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.844+0000 7f87609e6700 1 Processor -- start 2023-11-17T06:33:22.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.844+0000 7f87609e6700 1 -- start start 2023-11-17T06:33:22.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f87609e6700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f875c06cc90 0x7f875c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f87609e6700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875c06d630 con 0x7f875c0b6580 2023-11-17T06:33:22.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f87609e6700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875c0d2340 con 0x7f875c15d550 2023-11-17T06:33:22.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f87609e6700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875c0cf400 con 0x7f875c06cc90 2023-11-17T06:33:22.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f875affd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f875c06cc90 0x7f875c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f875bfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f875c0b6580 0x7f875c0b69d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55932/0 (socket says 172.21.15.69:55932) 2023-11-17T06:33:22.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f875bfff700 1 -- 172.21.15.69:0/3862139260 learned_addr learned my addr 172.21.15.69:0/3862139260 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:22.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f875a7fc700 1 -- 172.21.15.69:0/3862139260 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083586186 0 0) 0x7f875c06d630 con 0x7f875c0b6580 2023-11-17T06:33:22.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f875a7fc700 1 -- 172.21.15.69:0/3862139260 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87440035d0 con 0x7f875c0b6580 2023-11-17T06:33:22.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f875affd700 1 -- 172.21.15.69:0/3862139260 >> v1:172.21.15.93:6789/0 conn(0x7f875c15d550 legacy=0x7f875c0d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f875affd700 1 -- 172.21.15.69:0/3862139260 >> v1:172.21.15.69:6789/0 conn(0x7f875c0b6580 legacy=0x7f875c0b69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f875affd700 1 -- 172.21.15.69:0/3862139260 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c0d1730 con 0x7f875c06cc90 2023-11-17T06:33:22.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.848+0000 7f875affd700 1 --2- 172.21.15.69:0/3862139260 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f875c06cc90 0x7f875c06d0f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8750009850 tx=0x7f8750009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81971f63caedec9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.852+0000 7f875a7fc700 1 -- 172.21.15.69:0/3862139260 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750011830 con 0x7f875c06cc90 2023-11-17T06:33:22.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.852+0000 7f875a7fc700 1 -- 172.21.15.69:0/3862139260 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750011990 con 0x7f875c06cc90 2023-11-17T06:33:22.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.852+0000 7f875a7fc700 1 -- 172.21.15.69:0/3862139260 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750011d40 con 0x7f875c06cc90 2023-11-17T06:33:22.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.852+0000 7f87609e6700 1 -- 172.21.15.69:0/3862139260 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f875c06cc90 msgr2=0x7f875c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.852+0000 7f87609e6700 1 --2- 172.21.15.69:0/3862139260 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f875c06cc90 0x7f875c06d0f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8750009850 tx=0x7f8750009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:22.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.852+0000 7f87609e6700 1 -- 172.21.15.69:0/3862139260 shutdown_connections 2023-11-17T06:33:22.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.852+0000 7f87609e6700 1 --2- 172.21.15.69:0/3862139260 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f875c06cc90 0x7f875c06d0f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.852+0000 7f87609e6700 1 -- 172.21.15.69:0/3862139260 >> 172.21.15.69:0/3862139260 conn(0x7f875c0b4cb0 msgr2=0x7f875c0b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:22.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.852+0000 7f87609e6700 1 -- 172.21.15.69:0/3862139260 shutdown_connections 2023-11-17T06:33:22.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.852+0000 7f87609e6700 1 -- 172.21.15.69:0/3862139260 wait complete. 2023-11-17T06:33:22.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f87609e6700 1 Processor -- start 2023-11-17T06:33:22.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f87609e6700 1 -- start start 2023-11-17T06:33:22.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f87609e6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f875c06cc90 0x7f875c15d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f87609e6700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f875c0b6580 0x7f875c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f87609e6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f875c15d550 0x7f875c1f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f87609e6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c1f6290 con 0x7f875c06cc90 2023-11-17T06:33:22.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f87609e6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c1f5f90 con 0x7f875c15d550 2023-11-17T06:33:22.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f87609e6700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875c15de70 con 0x7f875c0b6580 2023-11-17T06:33:22.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f875b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f875c06cc90 0x7f875c15d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f875b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f875c06cc90 0x7f875c15d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47154/0 (socket says 172.21.15.69:47154) 2023-11-17T06:33:22.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.856+0000 7f875b7fe700 1 -- 172.21.15.69:0/1867332866 learned_addr learned my addr 172.21.15.69:0/1867332866 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:22.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f875bfff700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f875c15d550 0x7f875c1f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f875affd700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f875c0b6580 0x7f875c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f875b7fe700 1 -- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f875c0b6580 msgr2=0x7f875c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f875b7fe700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f875c0b6580 0x7f875c156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f875b7fe700 1 -- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f875c15d550 msgr2=0x7f875c1f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:22.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f875b7fe700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f875c15d550 0x7f875c1f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:22.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f875b7fe700 1 -- 172.21.15.69:0/1867332866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500094b0 con 0x7f875c06cc90 2023-11-17T06:33:22.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f875bfff700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f875c15d550 0x7f875c1f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:22.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f875affd700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f875c0b6580 0x7f875c156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:22.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f875b7fe700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f875c06cc90 0x7f875c15d930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f874c00c530 tx=0x7f874c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f8743fff700 1 -- 172.21.15.69:0/1867332866 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0052d0 con 0x7f875c06cc90 2023-11-17T06:33:22.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f8743fff700 1 -- 172.21.15.69:0/1867332866 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c005430 con 0x7f875c06cc90 2023-11-17T06:33:22.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f87609e6700 1 -- 172.21.15.69:0/1867332866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f875c15e110 con 0x7f875c06cc90 2023-11-17T06:33:22.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f8743fff700 1 -- 172.21.15.69:0/1867332866 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c0055a0 con 0x7f875c06cc90 2023-11-17T06:33:22.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f87609e6700 1 -- 172.21.15.69:0/1867332866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875c157100 con 0x7f875c06cc90 2023-11-17T06:33:22.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.860+0000 7f87609e6700 1 -- 172.21.15.69:0/1867332866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875c04e650 con 0x7f875c06cc90 2023-11-17T06:33:22.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.864+0000 7f8743fff700 1 -- 172.21.15.69:0/1867332866 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f874c0038e0 con 0x7f875c06cc90 2023-11-17T06:33:22.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.864+0000 7f8743fff700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8748066540 0x7f8748068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:22.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.864+0000 7f8743fff700 1 -- 172.21.15.69:0/1867332866 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f874c083410 con 0x7f875c06cc90 2023-11-17T06:33:22.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.864+0000 7f875affd700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8748066540 0x7f8748068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:22.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.868+0000 7f875affd700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8748066540 0x7f8748068a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f87500090b0 tx=0x7f8750008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:22.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:22.872+0000 7f8743fff700 1 -- 172.21.15.69:0/1867332866 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f874c050740 con 0x7f875c06cc90 2023-11-17T06:33:23.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.044+0000 7f87609e6700 1 -- 172.21.15.69:0/1867332866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f875c1f60d0 con 0x7f875c06cc90 2023-11-17T06:33:23.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f8743fff700 1 -- 172.21.15.69:0/1867332866 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f875c1f60d0 con 0x7f875c06cc90 2023-11-17T06:33:23.052 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:33:23.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f87609e6700 1 -- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8748066540 msgr2=0x7f8748068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f87609e6700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8748066540 0x7f8748068a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f87500090b0 tx=0x7f8750008030 comp rx=0 tx=0).stop 2023-11-17T06:33:23.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f87609e6700 1 -- 172.21.15.69:0/1867332866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f875c06cc90 msgr2=0x7f875c15d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f87609e6700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f875c06cc90 0x7f875c15d930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f874c00c530 tx=0x7f874c00c8f0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f87609e6700 1 -- 172.21.15.69:0/1867332866 shutdown_connections 2023-11-17T06:33:23.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f87609e6700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8748066540 0x7f8748068a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f87609e6700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f875c15d550 0x7f875c1f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f87609e6700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f875c0b6580 0x7f875c156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f87609e6700 1 --2- 172.21.15.69:0/1867332866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f875c06cc90 0x7f875c15d930 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.048+0000 7f87609e6700 1 -- 172.21.15.69:0/1867332866 >> 172.21.15.69:0/1867332866 conn(0x7f875c0b4cb0 msgr2=0x7f875c0b69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:23.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.052+0000 7f87609e6700 1 -- 172.21.15.69:0/1867332866 shutdown_connections 2023-11-17T06:33:23.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.052+0000 7f87609e6700 1 -- 172.21.15.69:0/1867332866 wait complete. 2023-11-17T06:33:23.078 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:33:23.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.248+0000 7f6fd47fe700 1 Processor -- start 2023-11-17T06:33:23.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.248+0000 7f6fd47fe700 1 -- start start 2023-11-17T06:33:23.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.248+0000 7f6fd47fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6fcc15d4a0 0x7f6fcc15d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.248+0000 7f6fd47fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0b8c40 0x7f6fcc0ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.248+0000 7f6fd47fe700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fcc15ddc0 con 0x7f6fcc0b9080 2023-11-17T06:33:23.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.248+0000 7f6fd47fe700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fcc15e050 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.248+0000 7f6fd47fe700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc15e330 con 0x7f6fcc0b8c40 2023-11-17T06:33:23.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd2d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6fcc0b9080 0x7f6fcc0b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55936/0 (socket says 172.21.15.69:55936) 2023-11-17T06:33:23.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd2d9b700 1 -- 172.21.15.69:0/1905316513 learned_addr learned my addr 172.21.15.69:0/1905316513 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:23.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1d99700 1 --2- 172.21.15.69:0/1905316513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0b8c40 0x7f6fcc0ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd259a700 1 --2- 172.21.15.69:0/1905316513 >> v2:172.21.15.93:3300/0 conn(0x7f6fcc15d4a0 0x7f6fcc15d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1598700 1 -- 172.21.15.69:0/1905316513 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322265965 0 0) 0x7f6fcc15ddc0 con 0x7f6fcc0b9080 2023-11-17T06:33:23.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1598700 1 -- 172.21.15.69:0/1905316513 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fb80035d0 con 0x7f6fcc0b9080 2023-11-17T06:33:23.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1598700 1 -- 172.21.15.69:0/1905316513 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076019889 0 0) 0x7f6fb80035d0 con 0x7f6fcc0b9080 2023-11-17T06:33:23.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1d99700 1 -- 172.21.15.69:0/1905316513 >> v2:172.21.15.93:3300/0 conn(0x7f6fcc15d4a0 msgr2=0x7f6fcc15d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:23.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1d99700 1 --2- 172.21.15.69:0/1905316513 >> v2:172.21.15.93:3300/0 conn(0x7f6fcc15d4a0 0x7f6fcc15d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1d99700 1 -- 172.21.15.69:0/1905316513 >> v1:172.21.15.69:6789/0 conn(0x7f6fcc0b9080 legacy=0x7f6fcc0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1d99700 1 -- 172.21.15.69:0/1905316513 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fcc15e610 con 0x7f6fcc0b8c40 2023-11-17T06:33:23.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1d99700 1 --2- 172.21.15.69:0/1905316513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0b8c40 0x7f6fcc0ce060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009850 tx=0x7f6fbc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c43b0062ea64f27 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1598700 1 -- 172.21.15.69:0/1905316513 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4001670 con 0x7f6fcc0b8c40 2023-11-17T06:33:23.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1598700 1 -- 172.21.15.69:0/1905316513 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc004030 con 0x7f6fcc0b8c40 2023-11-17T06:33:23.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.252+0000 7f6fd1598700 1 -- 172.21.15.69:0/1905316513 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc0043e0 con 0x7f6fcc0b8c40 2023-11-17T06:33:23.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 -- 172.21.15.69:0/1905316513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0b8c40 msgr2=0x7f6fcc0ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 --2- 172.21.15.69:0/1905316513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0b8c40 0x7f6fcc0ce060 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc009850 tx=0x7f6fbc009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:23.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 -- 172.21.15.69:0/1905316513 shutdown_connections 2023-11-17T06:33:23.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 --2- 172.21.15.69:0/1905316513 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0b8c40 0x7f6fcc0ce060 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 --2- 172.21.15.69:0/1905316513 >> v2:172.21.15.93:3300/0 conn(0x7f6fcc15d4a0 0x7f6fcc15d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 -- 172.21.15.69:0/1905316513 >> 172.21.15.69:0/1905316513 conn(0x7f6fcc06b830 msgr2=0x7f6fcc06bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:23.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 -- 172.21.15.69:0/1905316513 shutdown_connections 2023-11-17T06:33:23.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 -- 172.21.15.69:0/1905316513 wait complete. 2023-11-17T06:33:23.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 Processor -- start 2023-11-17T06:33:23.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 -- start start 2023-11-17T06:33:23.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fcc0b8c40 0x7f6fcc1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fcc15d4a0 0x7f6fcc1f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0cc180 0x7f6fcc0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0b5a70 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc0b51a0 con 0x7f6fcc0b8c40 2023-11-17T06:33:23.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.256+0000 7f6fd47fe700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fcc1592b0 con 0x7f6fcc0cc180 2023-11-17T06:33:23.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd1d99700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fcc15d4a0 0x7f6fcc1f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd1d99700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fcc15d4a0 0x7f6fcc1f2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47164/0 (socket says 172.21.15.69:47164) 2023-11-17T06:33:23.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd1d99700 1 -- 172.21.15.69:0/285248099 learned_addr learned my addr 172.21.15.69:0/285248099 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:23.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd259a700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fcc0b8c40 0x7f6fcc1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd2d9b700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0cc180 0x7f6fcc0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd1d99700 1 -- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0cc180 msgr2=0x7f6fcc0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd1d99700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0cc180 0x7f6fcc0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd1d99700 1 -- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fcc0b8c40 msgr2=0x7f6fcc1464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd1d99700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fcc0b8c40 0x7f6fcc1464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd1d99700 1 -- 172.21.15.69:0/285248099 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc0094b0 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd1d99700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fcc15d4a0 0x7f6fcc1f2520 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc000c00 tx=0x7f6fbc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fc2ffd700 1 -- 172.21.15.69:0/285248099 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc003d10 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fc2ffd700 1 -- 172.21.15.69:0/285248099 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fbc01f070 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fc2ffd700 1 -- 172.21.15.69:0/285248099 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc011870 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd47fe700 1 -- 172.21.15.69:0/285248099 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fcc0b5420 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd47fe700 1 -- 172.21.15.69:0/285248099 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fcc1f2a60 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.260+0000 7f6fd47fe700 1 -- 172.21.15.69:0/285248099 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fcc04e6c0 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.264+0000 7f6fc2ffd700 1 -- 172.21.15.69:0/285248099 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6fbc0119d0 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.264+0000 7f6fc2ffd700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fb0066510 0x7f6fb00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.264+0000 7f6fc2ffd700 1 -- 172.21.15.69:0/285248099 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f6fbc021070 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.264+0000 7f6fd259a700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fb0066510 0x7f6fb00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.268+0000 7f6fd259a700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fb0066510 0x7f6fb00689d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8011340 tx=0x7f6fc800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.272+0000 7f6fc2ffd700 1 -- 172.21.15.69:0/285248099 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f6fbc052aa0 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.444+0000 7f6fd47fe700 1 -- 172.21.15.69:0/285248099 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6fcc0d2f30 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fc2ffd700 1 -- 172.21.15.69:0/285248099 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6fbc0560c0 con 0x7f6fcc15d4a0 2023-11-17T06:33:23.451 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fd47fe700 1 -- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fb0066510 msgr2=0x7f6fb00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fd47fe700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fb0066510 0x7f6fb00689d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8011340 tx=0x7f6fc800b040 comp rx=0 tx=0).stop 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fd47fe700 1 -- 172.21.15.69:0/285248099 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fcc15d4a0 msgr2=0x7f6fcc1f2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fd47fe700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fcc15d4a0 0x7f6fcc1f2520 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc000c00 tx=0x7f6fbc004770 comp rx=0 tx=0).stop 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fd47fe700 1 -- 172.21.15.69:0/285248099 shutdown_connections 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fd47fe700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6fb0066510 0x7f6fb00689d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fd47fe700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6fcc0cc180 0x7f6fcc0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fd47fe700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fcc15d4a0 0x7f6fcc1f2520 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fd47fe700 1 --2- 172.21.15.69:0/285248099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6fcc0b8c40 0x7f6fcc1464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.448+0000 7f6fd47fe700 1 -- 172.21.15.69:0/285248099 >> 172.21.15.69:0/285248099 conn(0x7f6fcc06b830 msgr2=0x7f6fcc0ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:23.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.452+0000 7f6fd47fe700 1 -- 172.21.15.69:0/285248099 shutdown_connections 2023-11-17T06:33:23.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.452+0000 7f6fd47fe700 1 -- 172.21.15.69:0/285248099 wait complete. 2023-11-17T06:33:23.473 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:33:23.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.644+0000 7fde0359e700 1 Processor -- start 2023-11-17T06:33:23.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.644+0000 7fde0359e700 1 -- start start 2023-11-17T06:33:23.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 0x7fde0406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fde040b6580 0x7fde040b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0406d630 con 0x7fde0415d550 2023-11-17T06:33:23.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde040cf400 con 0x7fde040b6580 2023-11-17T06:33:23.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040d2340 con 0x7fde0406cc90 2023-11-17T06:33:23.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde02d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fde040b6580 0x7fde040b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde02d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fde040b6580 0x7fde040b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47168/0 (socket says 172.21.15.69:47168) 2023-11-17T06:33:23.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde02d9d700 1 -- 172.21.15.69:0/2321998543 learned_addr learned my addr 172.21.15.69:0/2321998543 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:23.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde01d9b700 1 --2- 172.21.15.69:0/2321998543 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 0x7fde0406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde02d9d700 1 -- 172.21.15.69:0/2321998543 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 msgr2=0x7fde0406d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:23.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde02d9d700 1 --2- 172.21.15.69:0/2321998543 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 0x7fde0406d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde02d9d700 1 -- 172.21.15.69:0/2321998543 >> v1:172.21.15.93:6789/0 conn(0x7fde0415d550 legacy=0x7fde040d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:23.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde02d9d700 1 -- 172.21.15.69:0/2321998543 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040d1730 con 0x7fde040b6580 2023-11-17T06:33:23.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde01d9b700 1 --2- 172.21.15.69:0/2321998543 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 0x7fde0406d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:23.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde02d9d700 1 --2- 172.21.15.69:0/2321998543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde040b6580 0x7fde040b6a10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009e50 tx=0x7fddfc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef34e13ab48dd1e9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0159a700 1 -- 172.21.15.69:0/2321998543 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00e070 con 0x7fde040b6580 2023-11-17T06:33:23.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0159a700 1 -- 172.21.15.69:0/2321998543 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc003a40 con 0x7fde040b6580 2023-11-17T06:33:23.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0159a700 1 -- 172.21.15.69:0/2321998543 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc003df0 con 0x7fde040b6580 2023-11-17T06:33:23.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 -- 172.21.15.69:0/2321998543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde040b6580 msgr2=0x7fde040b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 --2- 172.21.15.69:0/2321998543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde040b6580 0x7fde040b6a10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009e50 tx=0x7fddfc00b330 comp rx=0 tx=0).stop 2023-11-17T06:33:23.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 -- 172.21.15.69:0/2321998543 shutdown_connections 2023-11-17T06:33:23.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 --2- 172.21.15.69:0/2321998543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde040b6580 0x7fde040b6a10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 --2- 172.21.15.69:0/2321998543 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 0x7fde0406d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 -- 172.21.15.69:0/2321998543 >> 172.21.15.69:0/2321998543 conn(0x7fde040b4cb0 msgr2=0x7fde040b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:23.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 -- 172.21.15.69:0/2321998543 shutdown_connections 2023-11-17T06:33:23.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.648+0000 7fde0359e700 1 -- 172.21.15.69:0/2321998543 wait complete. 2023-11-17T06:33:23.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.652+0000 7fde0359e700 1 Processor -- start 2023-11-17T06:33:23.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.652+0000 7fde0359e700 1 -- start start 2023-11-17T06:33:23.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde0359e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 0x7fde041e7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde0359e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde040b6580 0x7fde040cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde0359e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde0415d550 0x7fde0415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde0359e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040cb9c0 con 0x7fde0415d550 2023-11-17T06:33:23.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde0359e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040cc260 con 0x7fde040b6580 2023-11-17T06:33:23.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde0359e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040cb190 con 0x7fde0406cc90 2023-11-17T06:33:23.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde02d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde0415d550 0x7fde0415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde02d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde0415d550 0x7fde0415a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47178/0 (socket says 172.21.15.69:47178) 2023-11-17T06:33:23.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde02d9d700 1 -- 172.21.15.69:0/1425627408 learned_addr learned my addr 172.21.15.69:0/1425627408 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:23.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde01d9b700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde040b6580 0x7fde040cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde0259c700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 0x7fde041e7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde02d9d700 1 -- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 msgr2=0x7fde041e7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde02d9d700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 0x7fde041e7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde02d9d700 1 -- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde040b6580 msgr2=0x7fde040cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde02d9d700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde040b6580 0x7fde040cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde02d9d700 1 -- 172.21.15.69:0/1425627408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc009b30 con 0x7fde0415d550 2023-11-17T06:33:23.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde02d9d700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde0415d550 0x7fde0415a490 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00beb0 tx=0x7fddfc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fddf2ffd700 1 -- 172.21.15.69:0/1425627408 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc0092e0 con 0x7fde0415d550 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fddf2ffd700 1 -- 172.21.15.69:0/1425627408 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc004240 con 0x7fde0415d550 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde0359e700 1 -- 172.21.15.69:0/1425627408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde040cb410 con 0x7fde0415d550 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fddf2ffd700 1 -- 172.21.15.69:0/1425627408 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc0045f0 con 0x7fde0415d550 2023-11-17T06:33:23.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.656+0000 7fde0359e700 1 -- 172.21.15.69:0/1425627408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde040cbef0 con 0x7fde0415d550 2023-11-17T06:33:23.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.660+0000 7fde0359e700 1 -- 172.21.15.69:0/1425627408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0404e650 con 0x7fde0415d550 2023-11-17T06:33:23.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.660+0000 7fddf2ffd700 1 -- 172.21.15.69:0/1425627408 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fddfc019070 con 0x7fde0415d550 2023-11-17T06:33:23.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.660+0000 7fddf2ffd700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdde4066510 0x7fdde40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:23.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.660+0000 7fddf2ffd700 1 -- 172.21.15.69:0/1425627408 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fddfc085130 con 0x7fde0415d550 2023-11-17T06:33:23.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.660+0000 7fde0259c700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdde4066510 0x7fdde40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:23.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.664+0000 7fde0259c700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdde4066510 0x7fdde40689d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009980 tx=0x7fddf40090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:23.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.668+0000 7fddf2ffd700 1 -- 172.21.15.69:0/1425627408 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fddfc055f60 con 0x7fde0415d550 2023-11-17T06:33:23.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.856+0000 7fde0359e700 1 -- 172.21.15.69:0/1425627408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fde040cc3a0 con 0x7fde0415d550 2023-11-17T06:33:23.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.856+0000 7fddf2ffd700 1 -- 172.21.15.69:0/1425627408 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v40) v1 ==== 80+0+122 (secure 0 0 0) 0x7fddfc055af0 con 0x7fde0415d550 2023-11-17T06:33:23.862 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.93:6837/4181304583 2023-11-18T06:33:11.857552+0000 2023-11-17T06:33:23.863 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.93:6836/4181304583 2023-11-18T06:33:11.857552+0000 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 -- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdde4066510 msgr2=0x7fdde40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdde4066510 0x7fdde40689d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fddf4009980 tx=0x7fddf40090e0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 -- 172.21.15.69:0/1425627408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde0415d550 msgr2=0x7fde0415a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:23.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde0415d550 0x7fde0415a490 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00beb0 tx=0x7fddfc004af0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 -- 172.21.15.69:0/1425627408 shutdown_connections 2023-11-17T06:33:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdde4066510 0x7fdde40689d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde0415d550 0x7fde0415a490 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde040b6580 0x7fde040cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 --2- 172.21.15.69:0/1425627408 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fde0406cc90 0x7fde041e7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 -- 172.21.15.69:0/1425627408 >> 172.21.15.69:0/1425627408 conn(0x7fde040b4cb0 msgr2=0x7fde040b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 -- 172.21.15.69:0/1425627408 shutdown_connections 2023-11-17T06:33:23.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:23.864+0000 7fde0359e700 1 -- 172.21.15.69:0/1425627408 wait complete. 2023-11-17T06:33:23.869 INFO:teuthology.orchestra.run.smithi069.stderr:listed 2 entries 2023-11-17T06:33:23.889 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi069.front.sepia.ceph.com... 2023-11-17T06:33:23.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:23.890 DEBUG:teuthology.orchestra.run.smithi069:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:23.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[47300]: fuse finished with error 0 and tester_r 0 2023-11-17T06:33:23.922 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:33:27.768 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:33:27.775 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:33:30.023 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:33:30.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:30.023 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-17T06:33:30.045 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-17T06:33:30.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.271+0000 7efef154b700 1 Processor -- start 2023-11-17T06:33:30.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.271+0000 7efef154b700 1 -- start start 2023-11-17T06:33:30.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef154b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efeec06cc90 0x7efeec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef154b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efeec0b6580 0x7efeec0b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef154b700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeec06d630 con 0x7efeec15d550 2023-11-17T06:33:30.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef154b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeec0cf400 con 0x7efeec0b6580 2023-11-17T06:33:30.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef154b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0d2340 con 0x7efeec06cc90 2023-11-17T06:33:30.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef0d4a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efeec0b6580 0x7efeec0b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef0d4a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7efeec0b6580 0x7efeec0b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34762/0 (socket says 172.21.15.69:34762) 2023-11-17T06:33:30.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef0d4a700 1 -- 172.21.15.69:0/1325121600 learned_addr learned my addr 172.21.15.69:0/1325121600 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:30.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efee37fe700 1 --2- 172.21.15.69:0/1325121600 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efeec06cc90 0x7efeec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef0d4a700 1 -- 172.21.15.69:0/1325121600 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efeec06cc90 msgr2=0x7efeec06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:30.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef0d4a700 1 --2- 172.21.15.69:0/1325121600 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efeec06cc90 0x7efeec06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef0d4a700 1 -- 172.21.15.69:0/1325121600 >> v1:172.21.15.93:6789/0 conn(0x7efeec15d550 legacy=0x7efeec0d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:30.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef0d4a700 1 -- 172.21.15.69:0/1325121600 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec0d1730 con 0x7efeec0b6580 2023-11-17T06:33:30.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efef0d4a700 1 --2- 172.21.15.69:0/1325121600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec0b6580 0x7efeec0b6a10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efee4009e50 tx=0x7efee400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53e12d9279a4b6b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efeeb7fe700 1 -- 172.21.15.69:0/1325121600 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee400e070 con 0x7efeec0b6580 2023-11-17T06:33:30.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efeeb7fe700 1 -- 172.21.15.69:0/1325121600 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee400b910 con 0x7efeec0b6580 2023-11-17T06:33:30.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.275+0000 7efeeb7fe700 1 -- 172.21.15.69:0/1325121600 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee400bcc0 con 0x7efeec0b6580 2023-11-17T06:33:30.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.279+0000 7efef154b700 1 -- 172.21.15.69:0/1325121600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec0b6580 msgr2=0x7efeec0b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:30.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.279+0000 7efef154b700 1 --2- 172.21.15.69:0/1325121600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec0b6580 0x7efeec0b6a10 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efee4009e50 tx=0x7efee400b330 comp rx=0 tx=0).stop 2023-11-17T06:33:30.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.279+0000 7efef154b700 1 -- 172.21.15.69:0/1325121600 shutdown_connections 2023-11-17T06:33:30.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.279+0000 7efef154b700 1 --2- 172.21.15.69:0/1325121600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec0b6580 0x7efeec0b6a10 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.279+0000 7efef154b700 1 --2- 172.21.15.69:0/1325121600 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efeec06cc90 0x7efeec06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.279+0000 7efef154b700 1 -- 172.21.15.69:0/1325121600 >> 172.21.15.69:0/1325121600 conn(0x7efeec0b4cb0 msgr2=0x7efeec0b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:30.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.279+0000 7efef154b700 1 -- 172.21.15.69:0/1325121600 shutdown_connections 2023-11-17T06:33:30.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.279+0000 7efef154b700 1 -- 172.21.15.69:0/1325121600 wait complete. 2023-11-17T06:33:30.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.279+0000 7efef154b700 1 Processor -- start 2023-11-17T06:33:30.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.279+0000 7efef154b700 1 -- start start 2023-11-17T06:33:30.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efef154b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec06cc90 0x7efeec15e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efef154b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efeec0b6580 0x7efeec153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efef154b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efeec15d550 0x7efeec0b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efef154b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec0cc9a0 con 0x7efeec06cc90 2023-11-17T06:33:30.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efef154b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeec15e610 con 0x7efeec15d550 2023-11-17T06:33:30.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efef154b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeec153c80 con 0x7efeec0b6580 2023-11-17T06:33:30.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efeebfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec06cc90 0x7efeec15e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efeebfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec06cc90 0x7efeec15e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34768/0 (socket says 172.21.15.69:34768) 2023-11-17T06:33:30.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efeebfff700 1 -- 172.21.15.69:0/2108755953 learned_addr learned my addr 172.21.15.69:0/2108755953 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:30.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efee37fe700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efeec0b6580 0x7efeec153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efef0d4a700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efeec15d550 0x7efeec0b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efeebfff700 1 -- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efeec0b6580 msgr2=0x7efeec153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:30.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efeebfff700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efeec0b6580 0x7efeec153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efeebfff700 1 -- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efeec15d550 msgr2=0x7efeec0b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:30.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efeebfff700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efeec15d550 0x7efeec0b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efeebfff700 1 -- 172.21.15.69:0/2108755953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee4009b30 con 0x7efeec06cc90 2023-11-17T06:33:30.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efeebfff700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec06cc90 0x7efeec15e0d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c530 tx=0x7efedc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efee97fa700 1 -- 172.21.15.69:0/2108755953 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00cea0 con 0x7efeec06cc90 2023-11-17T06:33:30.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efee97fa700 1 -- 172.21.15.69:0/2108755953 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc0052d0 con 0x7efeec06cc90 2023-11-17T06:33:30.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efef154b700 1 -- 172.21.15.69:0/2108755953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeec1f6300 con 0x7efeec06cc90 2023-11-17T06:33:30.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efee97fa700 1 -- 172.21.15.69:0/2108755953 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc0036a0 con 0x7efeec06cc90 2023-11-17T06:33:30.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.283+0000 7efef154b700 1 -- 172.21.15.69:0/2108755953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeec1f68c0 con 0x7efeec06cc90 2023-11-17T06:33:30.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.287+0000 7efef154b700 1 -- 172.21.15.69:0/2108755953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeec04e650 con 0x7efeec06cc90 2023-11-17T06:33:30.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.287+0000 7efee97fa700 1 -- 172.21.15.69:0/2108755953 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efedc003800 con 0x7efeec06cc90 2023-11-17T06:33:30.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.291+0000 7efee97fa700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efecc066510 0x7efecc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.291+0000 7efee97fa700 1 -- 172.21.15.69:0/2108755953 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5911+0+0 (secure 0 0 0) 0x7efedc0831c0 con 0x7efeec06cc90 2023-11-17T06:33:30.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.291+0000 7efee37fe700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efecc066510 0x7efecc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.291+0000 7efee37fe700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efecc066510 0x7efecc0689d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efeec1f5ef0 tx=0x7efed4009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.295+0000 7efee97fa700 1 -- 172.21.15.69:0/2108755953 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efedc050560 con 0x7efeec06cc90 2023-11-17T06:33:30.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.511+0000 7efef154b700 1 -- 172.21.15.69:0/2108755953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efeec0ca270 con 0x7efeec06cc90 2023-11-17T06:33:30.516 INFO:tasks.ceph.mon.a.smithi069.stderr:2023-11-17T06:33:30.511+0000 7f1481df4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-17T06:33:30.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.515+0000 7efee97fa700 1 -- 172.21.15.69:0/2108755953 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7efedc053b80 con 0x7efeec06cc90 2023-11-17T06:33:30.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 -- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efecc066510 msgr2=0x7efecc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:30.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efecc066510 0x7efecc0689d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efeec1f5ef0 tx=0x7efed4009240 comp rx=0 tx=0).stop 2023-11-17T06:33:30.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 -- 172.21.15.69:0/2108755953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec06cc90 msgr2=0x7efeec15e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:30.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec06cc90 0x7efeec15e0d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c530 tx=0x7efedc00c840 comp rx=0 tx=0).stop 2023-11-17T06:33:30.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 -- 172.21.15.69:0/2108755953 shutdown_connections 2023-11-17T06:33:30.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efecc066510 0x7efecc0689d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efeec15d550 0x7efeec0b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efeec0b6580 0x7efeec153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 --2- 172.21.15.69:0/2108755953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efeec06cc90 0x7efeec15e0d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 -- 172.21.15.69:0/2108755953 >> 172.21.15.69:0/2108755953 conn(0x7efeec0b4cb0 msgr2=0x7efeec0b6a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:30.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 -- 172.21.15.69:0/2108755953 shutdown_connections 2023-11-17T06:33:30.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.519+0000 7efef154b700 1 -- 172.21.15.69:0/2108755953 wait complete. 2023-11-17T06:33:30.528 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-17T06:33:30.539 INFO:tasks.ceph.mds.c.smithi069.stderr: -3255> 2023-11-17T06:33:17.164+0000 7f90d159e700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:33:30.548 DEBUG:teuthology.orchestra.run.smithi069:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents 2023-11-17T06:33:30.596 INFO:tasks.ceph.mds.c.smithi069.stdout:starting mds.c at 2023-11-17T06:33:30.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a60491840 1 -- start start 2023-11-17T06:33:30.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a60491840 1 Processor -- start 2023-11-17T06:33:30.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a60491840 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff57e5400 0x558ff5858b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a60491840 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff57e5800 0x558ff5859080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a60491840 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff57e5c00 0x558ff5859600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a60491840 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff581b180 con 0x558ff57e5400 2023-11-17T06:33:30.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a60491840 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff581a140 con 0x558ff57e5800 2023-11-17T06:33:30.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a60491840 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ff581aa00 con 0x558ff57e5c00 2023-11-17T06:33:30.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5ec4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff57e5400 0x558ff5858b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5ec4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff57e5400 0x558ff5858b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34786/0 (socket says 172.21.15.69:34786) 2023-11-17T06:33:30.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/1125892787 learned_addr learned my addr 172.21.15.69:0/1125892787 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:30.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/1125892787 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff57e5c00 msgr2=0x558ff5859600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/1125892787 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff57e5c00 0x558ff5859600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/1125892787 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff57e5c00 0x558ff5859600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5e44c700 1 --2- 172.21.15.69:0/1125892787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff57e5800 0x558ff5859080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/1125892787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff57e5800 msgr2=0x558ff5859080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/1125892787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff57e5800 0x558ff5859080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/1125892787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ff5806b60 con 0x558ff57e5400 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/1125892787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff57e5400 0x558ff5858b00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x558ff58b32f0 tx=0x558ff58b60c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0d788620921938 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.595+0000 7f6a5c448700 1 -- 172.21.15.69:0/1125892787 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ff5819080 con 0x558ff57e5400 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a5c448700 1 -- 172.21.15.69:0/1125892787 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ff5830900 con 0x558ff57e5400 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a60491840 1 -- 172.21.15.69:0/1125892787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ff58071e0 con 0x558ff57e5400 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a60491840 1 -- 172.21.15.69:0/1125892787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558ff5806b60 con 0x558ff57e5400 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a60491840 4 waiting for MDS map... 2023-11-17T06:33:30.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a5c448700 1 -- 172.21.15.69:0/1125892787 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ff5819600 con 0x558ff57e5400 2023-11-17T06:33:30.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a5c448700 1 -- 172.21.15.69:0/1125892787 <== mon.0 v2:172.21.15.69:3300/0 4 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x558ff581ec40 con 0x558ff57e5400 2023-11-17T06:33:30.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a5c448700 1 -- 172.21.15.69:0/1125892787 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 2723+0+0 (secure 0 0 0) 0x558ff5824f00 con 0x558ff57e5400 2023-11-17T06:33:30.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a60491840 4 Got MDS map 22 2023-11-17T06:33:30.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a60491840 4 datascan.main: Using metadata pool output 2023-11-17T06:33:30.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a60491840 4 datascan.main: connecting to RADOS... 2023-11-17T06:33:30.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a60491840 1 Processor -- start 2023-11-17T06:33:30.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.599+0000 7f6a60491840 1 -- start start 2023-11-17T06:33:30.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28400 0x558ff5859b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff5b28800 0x558ff585a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff5b28c00 0x558ff585a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff581ab40 con 0x558ff5b28400 2023-11-17T06:33:30.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff583f180 con 0x558ff5b28800 2023-11-17T06:33:30.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ff583edc0 con 0x558ff5b28c00 2023-11-17T06:33:30.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5f44e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28400 0x558ff5859b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5f44e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28400 0x558ff5859b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34806/0 (socket says 172.21.15.69:34806) 2023-11-17T06:33:30.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5f44e700 1 -- 172.21.15.69:0/1646132920 learned_addr learned my addr 172.21.15.69:0/1646132920 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:30.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/1646132920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff5b28800 0x558ff585a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5e44c700 1 --2- 172.21.15.69:0/1646132920 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff5b28c00 0x558ff585a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5f44e700 1 -- 172.21.15.69:0/1646132920 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff5b28c00 msgr2=0x558ff585a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/1646132920 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff5b28c00 0x558ff585a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5f44e700 1 -- 172.21.15.69:0/1646132920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff5b28800 msgr2=0x558ff585a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/1646132920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff5b28800 0x558ff585a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5f44e700 1 -- 172.21.15.69:0/1646132920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ff5806340 con 0x558ff5b28400 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5e44c700 1 --2- 172.21.15.69:0/1646132920 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff5b28c00 0x558ff585a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/1646132920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28400 0x558ff5859b80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x558ff5ad4660 tx=0x558ff5ae0c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0366e02ca10c2b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5a444700 1 -- 172.21.15.69:0/1646132920 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ff5819080 con 0x558ff5b28400 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5a444700 1 -- 172.21.15.69:0/1646132920 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ff666a300 con 0x558ff5b28400 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a5a444700 1 -- 172.21.15.69:0/1646132920 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ff5819600 con 0x558ff5b28400 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 -- 172.21.15.69:0/1646132920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28400 msgr2=0x558ff5859b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 --2- 172.21.15.69:0/1646132920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28400 0x558ff5859b80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x558ff5ad4660 tx=0x558ff5ae0c00 comp rx=0 tx=0).stop 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 -- 172.21.15.69:0/1646132920 shutdown_connections 2023-11-17T06:33:30.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 --2- 172.21.15.69:0/1646132920 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff5b28c00 0x558ff585a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 --2- 172.21.15.69:0/1646132920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff5b28800 0x558ff585a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 --2- 172.21.15.69:0/1646132920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28400 0x558ff5859b80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 -- 172.21.15.69:0/1646132920 >> 172.21.15.69:0/1646132920 conn(0x558ff5b28000 msgr2=0x558ff58d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:30.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 -- 172.21.15.69:0/1646132920 shutdown_connections 2023-11-17T06:33:30.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 -- 172.21.15.69:0/1646132920 wait complete. 2023-11-17T06:33:30.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 Processor -- start 2023-11-17T06:33:30.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.603+0000 7f6a60491840 1 -- start start 2023-11-17T06:33:30.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a60491840 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff5b28400 0x558ff5859b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a60491840 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28800 0x558ff585a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a60491840 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff5b28c00 0x558ff585a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a60491840 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff583ec80 con 0x558ff5b28800 2023-11-17T06:33:30.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a60491840 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ff581aa00 con 0x558ff5b28c00 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a60491840 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ff581a140 con 0x558ff5b28400 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5ec4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28800 0x558ff585a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5ec4d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28800 0x558ff585a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34808/0 (socket says 172.21.15.69:34808) 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 learned_addr learned my addr 172.21.15.69:0/2417282529 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5e44c700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff5b28c00 0x558ff585a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff5b28400 0x558ff5859b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff5b28400 msgr2=0x558ff5859b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff5b28400 0x558ff5859b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff5b28c00 msgr2=0x558ff585a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff5b28c00 0x558ff585a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ff5806000 con 0x558ff5b28800 2023-11-17T06:33:30.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28800 0x558ff585a100 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x558ff58b38f0 tx=0x558ff58b6120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a58c41700 1 -- 172.21.15.69:0/2417282529 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ff58191e0 con 0x558ff5b28800 2023-11-17T06:33:30.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a58c41700 1 -- 172.21.15.69:0/2417282529 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ff666b500 con 0x558ff5b28800 2023-11-17T06:33:30.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a58c41700 1 -- 172.21.15.69:0/2417282529 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ff5818f20 con 0x558ff5b28800 2023-11-17T06:33:30.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558ff5806ea0 con 0x558ff5b28800 2023-11-17T06:33:30.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ff5807520 con 0x558ff5b28800 2023-11-17T06:33:30.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.607+0000 7f6a60491840 4 datascan.init: resolving metadata pool 4 2023-11-17T06:33:30.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a58c41700 1 -- 172.21.15.69:0/2417282529 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x558ff5832840 con 0x558ff5b28800 2023-11-17T06:33:30.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a58c41700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x558ff5b29400 0x558ff585b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a58c41700 1 -- 172.21.15.69:0/2417282529 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x558ff581ea80 con 0x558ff5b28800 2023-11-17T06:33:30.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a60491840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-11-17T06:33:30.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a60491840 4 datascan.main: data pool 'cephfs_data' has ID 5 2023-11-17T06:33:30.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a60491840 4 datascan.main: opening data pool 'cephfs_data' 2023-11-17T06:33:30.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x558ff5b29800 0x558ff585ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:1 5.0 5:00000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5b29800 2023-11-17T06:33:30.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x558ff5b29400 0x558ff585b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a5e44c700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x558ff5b29800 0x558ff585ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x558ff5b29400 0x558ff585b700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x558ff5ad4660 tx=0x558ff58a7ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.611+0000 7f6a5e44c700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x558ff5b29800 0x558ff585ac00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.615+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 1 ==== osd_op_reply(1 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.615+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:2 5.0 5:0181e5f0:::10000000061.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5b29800 2023-11-17T06:33:30.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.615+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 2 ==== osd_op_reply(2 10000000061.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.615+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627873.0 2023-11-17T06:33:30.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.615+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:3 5.0 5:0181e5f0:::10000000061.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5b29800 2023-11-17T06:33:30.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.619+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 3 ==== osd_op_reply(3 10000000061.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.619+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:4 5.0 5:03de5254::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5b29800 2023-11-17T06:33:30.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.619+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 4 ==== osd_op_reply(4 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.619+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:5 5.0 5:03de5254:::10000000054.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5b29800 2023-11-17T06:33:30.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.619+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 5 ==== osd_op_reply(5 10000000054.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.619+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627860.0 2023-11-17T06:33:30.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.619+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:6 5.0 5:03de5254:::10000000054.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5b29800 2023-11-17T06:33:30.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.623+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 6 ==== osd_op_reply(6 10000000054.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.623+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x558ff5b29c00 0x558ff585b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.623+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:7 5.20 5:04000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5b29c00 2023-11-17T06:33:30.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.623+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x558ff5b29c00 0x558ff585b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.623+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x558ff5b29c00 0x558ff585b180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.631+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 1 ==== osd_op_reply(7 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.631+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:8 5.20 5:0699973a:::10000000064.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5b29c00 2023-11-17T06:33:30.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.631+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 2 ==== osd_op_reply(8 10000000064.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.631+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627876.0 2023-11-17T06:33:30.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.631+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:9 5.20 5:0699973a:::10000000064.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5b29c00 2023-11-17T06:33:30.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.631+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 3 ==== osd_op_reply(9 10000000064.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.631+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:10 5.20 5:072a8150::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5b29c00 2023-11-17T06:33:30.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.635+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 4 ==== osd_op_reply(10 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.635+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:11 5.20 5:072a8150:::1000000001a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5b29c00 2023-11-17T06:33:30.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.635+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 5 ==== osd_op_reply(11 1000000001a.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.635+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627802.0 2023-11-17T06:33:30.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.635+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:12 5.20 5:072a8150:::1000000001a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5b29c00 2023-11-17T06:33:30.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.635+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 6 ==== osd_op_reply(12 1000000001a.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.635+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x558ff5c3e000 0x558ff5c40000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.635+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:13 5.10 5:08000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3e000 2023-11-17T06:33:30.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.635+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x558ff5c3e000 0x558ff5c40000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.639+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x558ff5c3e000 0x558ff5c40000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.639+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 1 ==== osd_op_reply(13 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.639+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:14 5.10 5:0b7da9c3:::10000000014.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5c3e000 2023-11-17T06:33:30.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.639+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 2 ==== osd_op_reply(14 10000000014.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.639+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627796.0 2023-11-17T06:33:30.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.639+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:15 5.10 5:0b7da9c3:::10000000014.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5c3e000 2023-11-17T06:33:30.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.643+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 3 ==== osd_op_reply(15 10000000014.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.643+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x558ff5c3e400 0x558ff5c40580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.643+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:16 5.30 5:0c000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3e400 2023-11-17T06:33:30.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.643+0000 7f6a5e44c700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x558ff5c3e400 0x558ff5c40580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.643+0000 7f6a5e44c700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x558ff5c3e400 0x558ff5c40580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.647+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 1 ==== osd_op_reply(16 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.647+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:17 5.30 5:0cbf7f79:::1000000005c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3e400 2023-11-17T06:33:30.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.647+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 2 ==== osd_op_reply(17 1000000005c.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.647+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627868.0 2023-11-17T06:33:30.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.647+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:18 5.30 5:0cbf7f79:::1000000005c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5c3e400 2023-11-17T06:33:30.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.651+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 3 ==== osd_op_reply(18 1000000005c.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.651+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:19 5.30 5:0d373645::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5c3e400 2023-11-17T06:33:30.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.651+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 4 ==== osd_op_reply(19 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.651+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:20 5.30 5:0d373645:::10000000062.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5c3e400 2023-11-17T06:33:30.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.651+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 5 ==== osd_op_reply(20 10000000062.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.651+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627874.0 2023-11-17T06:33:30.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.651+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:21 5.30 5:0d373645:::10000000062.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5c3e400 2023-11-17T06:33:30.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.655+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 6 ==== osd_op_reply(21 10000000062.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.655+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x558ff5c3e800 0x558ff5c40b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.655+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:22 5.8 5:10000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5c3e800 2023-11-17T06:33:30.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.655+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x558ff5c3e800 0x558ff5c40b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.655+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x558ff5c3e800 0x558ff5c40b00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.659+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 1 ==== osd_op_reply(22 [pgnls start_epoch 41 out=101b] v39'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.659+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:23 5.8 5:1044c7a4:::10000000047.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3e800 2023-11-17T06:33:30.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.663+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 2 ==== osd_op_reply(23 10000000047.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.663+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627847.0 2023-11-17T06:33:30.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.663+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:24 5.8 5:1044c7a4:::10000000047.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3e800 2023-11-17T06:33:30.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.663+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 3 ==== osd_op_reply(24 10000000047.00000000 [call] v41'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.663+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:25 5.8 5:12420646::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3e800 2023-11-17T06:33:30.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.663+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 4 ==== osd_op_reply(25 [pgnls start_epoch 41 out=101b] v41'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.663+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:26 5.8 5:12420646:::1000000003c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5c3e800 2023-11-17T06:33:30.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.667+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 5 ==== osd_op_reply(26 1000000003c.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.667+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627836.0 2023-11-17T06:33:30.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.667+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:27 5.8 5:12420646:::1000000003c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5c3e800 2023-11-17T06:33:30.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.667+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 6 ==== osd_op_reply(27 1000000003c.00000000 [call] v41'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.667+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:28 5.8 5:12420902::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5c3e800 2023-11-17T06:33:30.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.667+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 7 ==== osd_op_reply(28 [pgnls start_epoch 41 out=81b] v41'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.667+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:29 5.8 5:12420902:::1000000001b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5c3e800 2023-11-17T06:33:30.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.671+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 8 ==== osd_op_reply(29 1000000001b.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.671+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627803.0 2023-11-17T06:33:30.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.671+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:30 5.8 5:12420902:::1000000001b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3e800 2023-11-17T06:33:30.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.671+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 9 ==== osd_op_reply(30 1000000001b.00000000 [call] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.671+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:31 5.28 5:14000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3e000 2023-11-17T06:33:30.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.675+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 4 ==== osd_op_reply(31 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.675+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:32 5.28 5:166e0f51:::10000000056.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5c3e000 2023-11-17T06:33:30.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.675+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 5 ==== osd_op_reply(32 10000000056.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.675+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627862.0 2023-11-17T06:33:30.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.675+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:33 5.28 5:166e0f51:::10000000056.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3e000 2023-11-17T06:33:30.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.675+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 6 ==== osd_op_reply(33 10000000056.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.675+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x558ff5c3ec00 0x558ff5c41080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.675+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:34 5.18 5:18000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5c3ec00 2023-11-17T06:33:30.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.679+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x558ff5c3ec00 0x558ff5c41080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.679+0000 7f6a5ec4d700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x558ff5c3ec00 0x558ff5c41080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.679+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 1 ==== osd_op_reply(34 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.679+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:35 5.18 5:19311010:::10000000029.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5c3ec00 2023-11-17T06:33:30.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.679+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 2 ==== osd_op_reply(35 10000000029.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.679+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627817.0 2023-11-17T06:33:30.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.679+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:36 5.18 5:19311010:::10000000029.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5c3ec00 2023-11-17T06:33:30.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.683+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 3 ==== osd_op_reply(36 10000000029.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.683+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:37 5.18 5:1ae6cdf3::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5c3ec00 2023-11-17T06:33:30.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.683+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 4 ==== osd_op_reply(37 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.683+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:38 5.18 5:1ae6cdf3:::1000000005a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3ec00 2023-11-17T06:33:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.683+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 5 ==== osd_op_reply(38 1000000005a.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.683+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627866.0 2023-11-17T06:33:30.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.683+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:39 5.18 5:1ae6cdf3:::1000000005a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3ec00 2023-11-17T06:33:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.687+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 6 ==== osd_op_reply(39 1000000005a.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.687+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:40 5.38 5:1c000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5c3e000 2023-11-17T06:33:30.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.687+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 7 ==== osd_op_reply(40 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.687+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:41 5.38 5:1e1620c8:::10000000035.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5c3e000 2023-11-17T06:33:30.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.687+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 8 ==== osd_op_reply(41 10000000035.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.687+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627829.0 2023-11-17T06:33:30.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.687+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:42 5.38 5:1e1620c8:::10000000035.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5c3e000 2023-11-17T06:33:30.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.691+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 9 ==== osd_op_reply(42 10000000035.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.691+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:43 5.38 5:1e20cbdb::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5c3e000 2023-11-17T06:33:30.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.695+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 10 ==== osd_op_reply(43 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.695+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:44 5.38 5:1e20cbdb:::10000000016.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5c3e000 2023-11-17T06:33:30.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.695+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 11 ==== osd_op_reply(44 10000000016.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.695+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627798.0 2023-11-17T06:33:30.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.695+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:45 5.38 5:1e20cbdb:::10000000016.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3e000 2023-11-17T06:33:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.695+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 12 ==== osd_op_reply(45 10000000016.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.695+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:46 5.4 5:20000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3e400 2023-11-17T06:33:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.699+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 7 ==== osd_op_reply(46 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.699+0000 7f6a5a444700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:47 5.24 5:24000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5c3e000 2023-11-17T06:33:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.699+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 13 ==== osd_op_reply(47 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.699+0000 7f6a59c43700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:48 5.14 5:28000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5b29800 2023-11-17T06:33:30.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.699+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 7 ==== osd_op_reply(48 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.699+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:49 5.14 5:2a40c2ef:::10000000025.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5b29800 2023-11-17T06:33:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.699+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 8 ==== osd_op_reply(49 10000000025.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.699+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627813.0 2023-11-17T06:33:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.699+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:50 5.14 5:2a40c2ef:::10000000025.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5b29800 2023-11-17T06:33:30.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.703+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 9 ==== osd_op_reply(50 10000000025.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.703+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:51 5.14 5:2b0a3bc5::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5b29800 2023-11-17T06:33:30.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.707+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 10 ==== osd_op_reply(51 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.707+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:52 5.14 5:2b0a3bc5:::10000000058.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5b29800 2023-11-17T06:33:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.707+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 11 ==== osd_op_reply(52 10000000058.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.707+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627864.0 2023-11-17T06:33:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.707+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:53 5.14 5:2b0a3bc5:::10000000058.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5b29800 2023-11-17T06:33:30.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.711+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 12 ==== osd_op_reply(53 10000000058.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.711+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:54 5.34 5:2c000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5c3ec00 2023-11-17T06:33:30.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.711+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 7 ==== osd_op_reply(54 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.711+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:55 5.34 5:2eb4da2b:::10000000009.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5c3ec00 2023-11-17T06:33:30.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.711+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 8 ==== osd_op_reply(55 10000000009.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.711+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627785.0 2023-11-17T06:33:30.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.711+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:56 5.34 5:2eb4da2b:::10000000009.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3ec00 2023-11-17T06:33:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.715+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 9 ==== osd_op_reply(56 10000000009.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.715+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:57 5.c 5:30000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5b29800 2023-11-17T06:33:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.715+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 13 ==== osd_op_reply(57 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.715+0000 7f6a59c43700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:58 5.2c 5:34000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5c3e800 2023-11-17T06:33:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.719+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 10 ==== osd_op_reply(58 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.719+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:59 5.2c 5:34658595:::1000000005f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5c3e800 2023-11-17T06:33:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.719+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 11 ==== osd_op_reply(59 1000000005f.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.719+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627871.0 2023-11-17T06:33:30.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.719+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:60 5.2c 5:34658595:::1000000005f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3e800 2023-11-17T06:33:30.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.723+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 12 ==== osd_op_reply(60 1000000005f.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.723+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:61 5.2c 5:3665eb52::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5c3e800 2023-11-17T06:33:30.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.723+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 13 ==== osd_op_reply(61 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.723+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:62 5.2c 5:3665eb52:::1000000003e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5c3e800 2023-11-17T06:33:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.723+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 14 ==== osd_op_reply(62 1000000003e.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.723+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627838.0 2023-11-17T06:33:30.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.723+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:63 5.2c 5:3665eb52:::1000000003e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3e800 2023-11-17T06:33:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.727+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 15 ==== osd_op_reply(63 1000000003e.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.727+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:64 5.1c 5:38000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5c3e000 2023-11-17T06:33:30.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.727+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 14 ==== osd_op_reply(64 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.727+0000 7f6a5a444700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x558ff5c3f800 0x558ff5c41b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.731+0000 7f6a5a444700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:65 5.3c 5:3c000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5c3f800 2023-11-17T06:33:30.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.731+0000 7f6a5e44c700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x558ff5c3f800 0x558ff5c41b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.731+0000 7f6a5e44c700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x558ff5c3f800 0x558ff5c41b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.731+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 1 ==== osd_op_reply(65 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.731+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:66 5.3c 5:3c3d7520:::1000000003b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3f800 2023-11-17T06:33:30.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.731+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 2 ==== osd_op_reply(66 1000000003b.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.731+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627835.0 2023-11-17T06:33:30.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.731+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:67 5.3c 5:3c3d7520:::1000000003b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5c3f800 2023-11-17T06:33:30.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.735+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 3 ==== osd_op_reply(67 1000000003b.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.735+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:68 5.3c 5:3d4c06c4::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5c3f800 2023-11-17T06:33:30.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.735+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 4 ==== osd_op_reply(68 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.735+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:69 5.3c 5:3d4c06c4:::1000000002a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5c3f800 2023-11-17T06:33:30.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.735+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 5 ==== osd_op_reply(69 1000000002a.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.739+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627818.0 2023-11-17T06:33:30.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.739+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:70 5.3c 5:3d4c06c4:::1000000002a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72700 con 0x558ff5c3f800 2023-11-17T06:33:30.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.739+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 6 ==== osd_op_reply(70 1000000002a.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.739+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:71 5.2 5:40000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72a80 con 0x558ff5c3e400 2023-11-17T06:33:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.743+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 8 ==== osd_op_reply(71 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.743+0000 7f6a59c43700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:72 5.22 5:44000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5c3e400 2023-11-17T06:33:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.743+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 9 ==== osd_op_reply(72 [pgnls start_epoch 41 out=101b] v39'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.743+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:73 5.22 5:44135715:::10000000039.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5c3e400 2023-11-17T06:33:30.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.743+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 10 ==== osd_op_reply(73 10000000039.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.743+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627833.0 2023-11-17T06:33:30.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.743+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:74 5.22 5:44135715:::10000000039.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73180 con 0x558ff5c3e400 2023-11-17T06:33:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.747+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 11 ==== osd_op_reply(74 10000000039.00000000 [call] v41'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.747+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:75 5.22 5:44834937::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73500 con 0x558ff5c3e400 2023-11-17T06:33:30.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.747+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 12 ==== osd_op_reply(75 [pgnls start_epoch 41 out=101b] v41'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.747+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:76 5.22 5:44834937:::10000000013.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73880 con 0x558ff5c3e400 2023-11-17T06:33:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.747+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 13 ==== osd_op_reply(76 10000000013.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.747+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627795.0 2023-11-17T06:33:30.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.747+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:77 5.22 5:44834937:::10000000013.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5c3e400 2023-11-17T06:33:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.751+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 14 ==== osd_op_reply(77 10000000013.00000000 [call] v41'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.751+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:78 5.22 5:4503a7ea::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5c3e400 2023-11-17T06:33:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.751+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 15 ==== osd_op_reply(78 [pgnls start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.751+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:79 5.22 5:4503a7ea:::10000000020.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72700 con 0x558ff5c3e400 2023-11-17T06:33:30.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.751+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 16 ==== osd_op_reply(79 10000000020.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.751+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627808.0 2023-11-17T06:33:30.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.751+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:80 5.22 5:4503a7ea:::10000000020.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72a80 con 0x558ff5c3e400 2023-11-17T06:33:30.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.755+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 17 ==== osd_op_reply(80 10000000020.00000000 [call] v41'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.755+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:81 5.22 5:45d72e17::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5c3e400 2023-11-17T06:33:30.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.755+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 18 ==== osd_op_reply(81 [pgnls start_epoch 41 out=101b] v41'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.755+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:82 5.22 5:45d72e17:::1000000000a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3e400 2023-11-17T06:33:30.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.755+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 19 ==== osd_op_reply(82 1000000000a.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.755+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627786.0 2023-11-17T06:33:30.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.755+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:83 5.22 5:45d72e17:::1000000000a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5c3e400 2023-11-17T06:33:30.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.759+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 20 ==== osd_op_reply(83 1000000000a.00000000 [call] v41'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.759+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:84 5.22 5:46cca9ab::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5c3e400 2023-11-17T06:33:30.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.759+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 21 ==== osd_op_reply(84 [pgnls start_epoch 41 out=81b] v41'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.759+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:85 5.22 5:46cca9ab:::1000000000c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5c3e400 2023-11-17T06:33:30.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.759+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 22 ==== osd_op_reply(85 1000000000c.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.759+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627788.0 2023-11-17T06:33:30.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.759+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:86 5.22 5:46cca9ab:::1000000000c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73180 con 0x558ff5c3e400 2023-11-17T06:33:30.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.763+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 23 ==== osd_op_reply(86 1000000000c.00000000 [call] v41'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.763+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:87 5.12 5:48000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73500 con 0x558ff5c3e800 2023-11-17T06:33:30.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.763+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 16 ==== osd_op_reply(87 [pgnls start_epoch 41 out=101b] v39'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.763+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:88 5.12 5:4899516f:::10000000048.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73880 con 0x558ff5c3e800 2023-11-17T06:33:30.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.767+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 17 ==== osd_op_reply(88 10000000048.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.767+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627848.0 2023-11-17T06:33:30.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.767+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:89 5.12 5:4899516f:::10000000048.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5c3e800 2023-11-17T06:33:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.767+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 18 ==== osd_op_reply(89 10000000048.00000000 [call] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.767+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:90 5.12 5:49e35fbc::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5c3e800 2023-11-17T06:33:30.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.771+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 19 ==== osd_op_reply(90 [pgnls start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.771+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:91 5.12 5:49e35fbc:::1000000000f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72700 con 0x558ff5c3e800 2023-11-17T06:33:30.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.771+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 20 ==== osd_op_reply(91 1000000000f.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.771+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627791.0 2023-11-17T06:33:30.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.771+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:92 5.12 5:49e35fbc:::1000000000f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5c3e800 2023-11-17T06:33:30.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.775+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 21 ==== osd_op_reply(92 1000000000f.00000000 [call] v41'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.775+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:93 5.12 5:49ffa098::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3e800 2023-11-17T06:33:30.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.775+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 22 ==== osd_op_reply(93 [pgnls start_epoch 41 out=101b] v41'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.775+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:94 5.12 5:49ffa098:::1000000002e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5c3e800 2023-11-17T06:33:30.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.775+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 23 ==== osd_op_reply(94 1000000002e.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.775+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627822.0 2023-11-17T06:33:30.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.775+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:95 5.12 5:49ffa098:::1000000002e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73500 con 0x558ff5c3e800 2023-11-17T06:33:30.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.779+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 24 ==== osd_op_reply(95 1000000002e.00000000 [call] v41'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.779+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:96 5.12 5:4bec3886::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73880 con 0x558ff5c3e800 2023-11-17T06:33:30.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.779+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 25 ==== osd_op_reply(96 [pgnls start_epoch 41 out=81b] v41'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.779+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:97 5.12 5:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5c3e800 2023-11-17T06:33:30.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.779+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 26 ==== osd_op_reply(97 10000000002.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.779+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627778.0 2023-11-17T06:33:30.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.779+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:98 5.12 5:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5c3e800 2023-11-17T06:33:30.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.783+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 27 ==== osd_op_reply(98 10000000002.00000000 [call] v41'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.783+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:99 5.32 5:4c000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72700 con 0x558ff5c3f800 2023-11-17T06:33:30.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.783+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 7 ==== osd_op_reply(99 [pgnls start_epoch 41 out=101b] v39'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.783+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:100 5.32 5:4d757255:::10000000055.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c80000 con 0x558ff5c3f800 2023-11-17T06:33:30.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.783+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 8 ==== osd_op_reply(100 10000000055.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.783+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627861.0 2023-11-17T06:33:30.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.783+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:101 5.32 5:4d757255:::10000000055.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c80380 con 0x558ff5c3f800 2023-11-17T06:33:30.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.787+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 9 ==== osd_op_reply(101 10000000055.00000000 [call] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.787+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:102 5.32 5:4def72d4::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c80700 con 0x558ff5c3f800 2023-11-17T06:33:30.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.787+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 10 ==== osd_op_reply(102 [pgnls start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.791+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:103 5.32 5:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c80a80 con 0x558ff5c3f800 2023-11-17T06:33:30.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.791+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 11 ==== osd_op_reply(103 10000000003.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.791+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627779.0 2023-11-17T06:33:30.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.791+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:104 5.32 5:4def72d4:::10000000003.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c80e00 con 0x558ff5c3f800 2023-11-17T06:33:30.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.795+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 12 ==== osd_op_reply(104 10000000003.00000000 [call] v41'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.795+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:105 5.32 5:4ecb6bb7::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c81180 con 0x558ff5c3f800 2023-11-17T06:33:30.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.795+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 13 ==== osd_op_reply(105 [pgnls start_epoch 41 out=101b] v41'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.795+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:106 5.32 5:4ecb6bb7:::1000000003f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c81500 con 0x558ff5c3f800 2023-11-17T06:33:30.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.795+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 14 ==== osd_op_reply(106 1000000003f.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.795+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627839.0 2023-11-17T06:33:30.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.795+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:107 5.32 5:4ecb6bb7:::1000000003f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c81880 con 0x558ff5c3f800 2023-11-17T06:33:30.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.799+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 15 ==== osd_op_reply(107 1000000003f.00000000 [call] v41'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.799+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:108 5.32 5:4f7da3cc::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c81c00 con 0x558ff5c3f800 2023-11-17T06:33:30.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.799+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 16 ==== osd_op_reply(108 [pgnls start_epoch 41 out=81b] v41'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.799+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:109 5.32 5:4f7da3cc:::1000000001e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c80000 con 0x558ff5c3f800 2023-11-17T06:33:30.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.799+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 17 ==== osd_op_reply(109 1000000001e.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.799+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627806.0 2023-11-17T06:33:30.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.799+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:110 5.32 5:4f7da3cc:::1000000001e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72a80 con 0x558ff5c3f800 2023-11-17T06:33:30.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.803+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 18 ==== osd_op_reply(110 1000000001e.00000000 [call] v41'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.803+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:111 5.a 5:50000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5c3e800 2023-11-17T06:33:30.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.803+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 28 ==== osd_op_reply(111 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.803+0000 7f6a59c43700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:112 5.2a 5:54000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72a80 con 0x558ff5c3e000 2023-11-17T06:33:30.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.803+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 15 ==== osd_op_reply(112 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.803+0000 7f6a5a444700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:113 5.1a 5:58000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72380 con 0x558ff5c3ec00 2023-11-17T06:33:30.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.807+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 10 ==== osd_op_reply(113 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.807+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:114 5.1a 5:5b3b19a5:::10000000018.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73180 con 0x558ff5c3ec00 2023-11-17T06:33:30.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.807+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 11 ==== osd_op_reply(114 10000000018.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.807+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627800.0 2023-11-17T06:33:30.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.807+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:115 5.1a 5:5b3b19a5:::10000000018.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72700 con 0x558ff5c3ec00 2023-11-17T06:33:30.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.811+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 12 ==== osd_op_reply(115 10000000018.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.811+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:116 5.1a 5:5bd35317::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3ec00 2023-11-17T06:33:30.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.811+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 13 ==== osd_op_reply(116 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.811+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:117 5.1a 5:5bd35317:::10000000044.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5c3ec00 2023-11-17T06:33:30.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.811+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 14 ==== osd_op_reply(117 10000000044.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.811+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627844.0 2023-11-17T06:33:30.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.811+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:118 5.1a 5:5bd35317:::10000000044.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5c3ec00 2023-11-17T06:33:30.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.815+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 15 ==== osd_op_reply(118 10000000044.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.815+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x558ff5c3f000 0x558ff5c41600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:30.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.815+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:119 5.3a 5:5c000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5c3f000 2023-11-17T06:33:30.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.815+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x558ff5c3f000 0x558ff5c41600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:30.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.815+0000 7f6a5f44e700 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x558ff5c3f000 0x558ff5c41600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:30.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.819+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 1 ==== osd_op_reply(119 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.819+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:120 5.3a 5:5f13809d:::1000000001f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73500 con 0x558ff5c3f000 2023-11-17T06:33:30.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.819+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 2 ==== osd_op_reply(120 1000000001f.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.819+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627807.0 2023-11-17T06:33:30.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.819+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:121 5.3a 5:5f13809d:::1000000001f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73880 con 0x558ff5c3f000 2023-11-17T06:33:30.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.819+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 3 ==== osd_op_reply(121 1000000001f.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.819+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:122 5.6 5:60000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5c3f000 2023-11-17T06:33:30.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.823+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 4 ==== osd_op_reply(122 [pgnls start_epoch 41 out=101b] v39'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.823+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:123 5.6 5:60a13eb4:::10000000037.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5c3f000 2023-11-17T06:33:30.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.823+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 5 ==== osd_op_reply(123 10000000037.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.823+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627831.0 2023-11-17T06:33:30.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.823+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:124 5.6 5:60a13eb4:::10000000037.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5c3f000 2023-11-17T06:33:30.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.827+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 6 ==== osd_op_reply(124 10000000037.00000000 [call] v41'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.827+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:125 5.6 5:61404748::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72a80 con 0x558ff5c3f000 2023-11-17T06:33:30.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.827+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 7 ==== osd_op_reply(125 [pgnls start_epoch 41 out=101b] v41'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.827+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:126 5.6 5:61404748:::10000000042.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72380 con 0x558ff5c3f000 2023-11-17T06:33:30.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.827+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 8 ==== osd_op_reply(126 10000000042.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.827+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627842.0 2023-11-17T06:33:30.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.827+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:127 5.6 5:61404748:::10000000042.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3f000 2023-11-17T06:33:30.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.831+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 9 ==== osd_op_reply(127 10000000042.00000000 [call] v41'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.831+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:128 5.6 5:614fee2a::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5c3f000 2023-11-17T06:33:30.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.831+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 10 ==== osd_op_reply(128 [pgnls start_epoch 41 out=81b] v41'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.831+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:129 5.6 5:614fee2a:::1000000003d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5c3f000 2023-11-17T06:33:30.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.831+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 11 ==== osd_op_reply(129 1000000003d.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.831+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627837.0 2023-11-17T06:33:30.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.831+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:130 5.6 5:614fee2a:::1000000003d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5c3f000 2023-11-17T06:33:30.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.839+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 12 ==== osd_op_reply(130 1000000003d.00000000 [call] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.839+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:131 5.26 5:64000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3f800 2023-11-17T06:33:30.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.839+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 19 ==== osd_op_reply(131 [pgnls start_epoch 41 out=101b] v39'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.839+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:132 5.26 5:645408ac:::1000000002b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5c3f800 2023-11-17T06:33:30.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.839+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 20 ==== osd_op_reply(132 1000000002b.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.839+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627819.0 2023-11-17T06:33:30.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.839+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:133 5.26 5:645408ac:::1000000002b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5c3f800 2023-11-17T06:33:30.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.843+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 21 ==== osd_op_reply(133 1000000002b.00000000 [call] v41'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.843+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:134 5.26 5:65f9ba37::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5c3f800 2023-11-17T06:33:30.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.843+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 22 ==== osd_op_reply(134 [pgnls start_epoch 41 out=101b] v41'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.843+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:135 5.26 5:65f9ba37:::10000000038.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3f800 2023-11-17T06:33:30.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.843+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 23 ==== osd_op_reply(135 10000000038.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.843+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627832.0 2023-11-17T06:33:30.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.847+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:136 5.26 5:65f9ba37:::10000000038.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5c3f800 2023-11-17T06:33:30.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.847+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 24 ==== osd_op_reply(136 10000000038.00000000 [call] v41'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.847+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:137 5.26 5:660982fc::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73500 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.851+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 25 ==== osd_op_reply(137 [pgnls start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.851+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:138 5.26 5:660982fc:::1000000002d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73880 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.851+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 26 ==== osd_op_reply(138 1000000002d.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.851+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627821.0 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.851+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:139 5.26 5:660982fc:::1000000002d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.851+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 27 ==== osd_op_reply(139 1000000002d.00000000 [call] v41'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.855+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:140 5.26 5:66f1e28f::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.855+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 28 ==== osd_op_reply(140 [pgnls start_epoch 41 out=101b] v41'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.855+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:141 5.26 5:66f1e28f:::10000000063.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.855+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 29 ==== osd_op_reply(141 10000000063.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.855+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627875.0 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.855+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:142 5.26 5:66f1e28f:::10000000063.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72a80 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.859+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 30 ==== osd_op_reply(142 10000000063.00000000 [call] v41'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.859+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:143 5.26 5:678705fb::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72380 con 0x558ff5c3f800 2023-11-17T06:33:30.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.859+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 31 ==== osd_op_reply(143 [pgnls start_epoch 41 out=81b] v41'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.859+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:144 5.26 5:678705fb:::10000000046.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73500 con 0x558ff5c3f800 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.859+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 32 ==== osd_op_reply(144 10000000046.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.859+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627846.0 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.859+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:145 5.26 5:678705fb:::10000000046.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73880 con 0x558ff5c3f800 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.863+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 33 ==== osd_op_reply(145 10000000046.00000000 [call] v41'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.863+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:146 5.16 5:68000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5b29c00 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.863+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 7 ==== osd_op_reply(146 [pgnls start_epoch 41 out=101b] v39'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.863+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:147 5.16 5:69de5632:::10000000050.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5b29c00 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.863+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 8 ==== osd_op_reply(147 10000000050.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.863+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627856.0 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.863+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:148 5.16 5:69de5632:::10000000050.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5b29c00 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.867+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 9 ==== osd_op_reply(148 10000000050.00000000 [call] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.867+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:149 5.16 5:6a23747e::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5b29c00 2023-11-17T06:33:30.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.867+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 10 ==== osd_op_reply(149 [pgnls start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.867+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:150 5.16 5:6a23747e:::10000000053.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5b29c00 2023-11-17T06:33:30.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.871+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 11 ==== osd_op_reply(150 10000000053.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.871+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627859.0 2023-11-17T06:33:30.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.871+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:151 5.16 5:6a23747e:::10000000053.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5b29c00 2023-11-17T06:33:30.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.871+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 12 ==== osd_op_reply(151 10000000053.00000000 [call] v41'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.871+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:152 5.16 5:6a415a36::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5b29c00 2023-11-17T06:33:30.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.875+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 13 ==== osd_op_reply(152 [pgnls start_epoch 41 out=101b] v41'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.875+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:153 5.16 5:6a415a36:::10000000043.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5b29c00 2023-11-17T06:33:30.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.875+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 14 ==== osd_op_reply(153 10000000043.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.875+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627843.0 2023-11-17T06:33:30.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.875+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:154 5.16 5:6a415a36:::10000000043.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5b29c00 2023-11-17T06:33:30.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.879+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 15 ==== osd_op_reply(154 10000000043.00000000 [call] v41'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.879+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:155 5.16 5:6a54d456::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5b29c00 2023-11-17T06:33:30.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.879+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 16 ==== osd_op_reply(155 [pgnls start_epoch 41 out=81b] v41'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.879+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:156 5.16 5:6a54d456:::1000000001c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5b29c00 2023-11-17T06:33:30.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.879+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 17 ==== osd_op_reply(156 1000000001c.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.879+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627804.0 2023-11-17T06:33:30.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.879+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:157 5.16 5:6a54d456:::1000000001c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5b29c00 2023-11-17T06:33:30.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.883+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 18 ==== osd_op_reply(157 1000000001c.00000000 [call] v41'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.883+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:158 5.36 5:6c000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5b29c00 2023-11-17T06:33:30.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.883+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 19 ==== osd_op_reply(158 [pgnls start_epoch 41 out=101b] v39'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.883+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:159 5.36 5:6c82bb73:::1000000004d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5b29c00 2023-11-17T06:33:30.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.883+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 20 ==== osd_op_reply(159 1000000004d.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.883+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627853.0 2023-11-17T06:33:30.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.883+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:160 5.36 5:6c82bb73:::1000000004d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5b29c00 2023-11-17T06:33:30.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.887+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 21 ==== osd_op_reply(160 1000000004d.00000000 [call] v41'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.887+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:161 5.36 5:6dc1a442::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5b29c00 2023-11-17T06:33:30.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.887+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 22 ==== osd_op_reply(161 [pgnls start_epoch 41 out=101b] v41'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.887+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:162 5.36 5:6dc1a442:::10000000015.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5b29c00 2023-11-17T06:33:30.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.887+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 23 ==== osd_op_reply(162 10000000015.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.887+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627797.0 2023-11-17T06:33:30.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.887+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:163 5.36 5:6dc1a442:::10000000015.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5b29c00 2023-11-17T06:33:30.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.891+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 24 ==== osd_op_reply(163 10000000015.00000000 [call] v41'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.891+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:164 5.36 5:6f6f8b6e::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5b29c00 2023-11-17T06:33:30.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.891+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 25 ==== osd_op_reply(164 [pgnls start_epoch 41 out=81b] v41'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.891+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:165 5.36 5:6f6f8b6e:::10000000045.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5b29c00 2023-11-17T06:33:30.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.891+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 26 ==== osd_op_reply(165 10000000045.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.891+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627845.0 2023-11-17T06:33:30.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.891+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:166 5.36 5:6f6f8b6e:::10000000045.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5b29c00 2023-11-17T06:33:30.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.895+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 27 ==== osd_op_reply(166 10000000045.00000000 [call] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.895+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:167 5.e 5:70000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5b29c00 2023-11-17T06:33:30.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.895+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 28 ==== osd_op_reply(167 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.895+0000 7f6a59c43700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:168 5.2e 5:74000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9a000 con 0x558ff5c3f000 2023-11-17T06:33:30.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.899+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 13 ==== osd_op_reply(168 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.899+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:169 5.2e 5:74dc0bdf:::10000000057.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5c3f000 2023-11-17T06:33:30.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.899+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 14 ==== osd_op_reply(169 10000000057.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.899+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627863.0 2023-11-17T06:33:30.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.899+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:170 5.2e 5:74dc0bdf:::10000000057.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5c3f000 2023-11-17T06:33:30.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.903+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 15 ==== osd_op_reply(170 10000000057.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.903+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:171 5.1e 5:78000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3e800 2023-11-17T06:33:30.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.903+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 29 ==== osd_op_reply(171 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.903+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:172 5.1e 5:78cea7f0:::10000000017.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5c3e800 2023-11-17T06:33:30.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.903+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 30 ==== osd_op_reply(172 10000000017.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.903+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627799.0 2023-11-17T06:33:30.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.903+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:173 5.1e 5:78cea7f0:::10000000017.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3e800 2023-11-17T06:33:30.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.907+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 31 ==== osd_op_reply(173 10000000017.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.907+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:174 5.3e 5:7c000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5b29800 2023-11-17T06:33:30.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.907+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 14 ==== osd_op_reply(174 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.907+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:175 5.3e 5:7e2d0da6:::10000000033.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5b29800 2023-11-17T06:33:30.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.907+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 15 ==== osd_op_reply(175 10000000033.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.907+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627827.0 2023-11-17T06:33:30.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.907+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:176 5.3e 5:7e2d0da6:::10000000033.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5b29800 2023-11-17T06:33:30.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.911+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 16 ==== osd_op_reply(176 10000000033.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.911+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:177 5.1 5:80000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9ae00 con 0x558ff5b29c00 2023-11-17T06:33:30.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.911+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 29 ==== osd_op_reply(177 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.911+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:178 5.1 5:81df0dbf:::10000000034.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b180 con 0x558ff5b29c00 2023-11-17T06:33:30.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.915+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 30 ==== osd_op_reply(178 10000000034.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.915+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627828.0 2023-11-17T06:33:30.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.915+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:179 5.1 5:81df0dbf:::10000000034.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b500 con 0x558ff5b29c00 2023-11-17T06:33:30.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.915+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 31 ==== osd_op_reply(179 10000000034.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.915+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:180 5.21 5:84000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b880 con 0x558ff5c3e000 2023-11-17T06:33:30.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.919+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 16 ==== osd_op_reply(180 [pgnls start_epoch 41 out=101b] v39'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.919+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:181 5.21 5:844eae9e:::1000000004c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9bc00 con 0x558ff5c3e000 2023-11-17T06:33:30.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.919+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 17 ==== osd_op_reply(181 1000000004c.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.919+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627852.0 2023-11-17T06:33:30.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.919+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:182 5.21 5:844eae9e:::1000000004c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9a000 con 0x558ff5c3e000 2023-11-17T06:33:30.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.923+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 18 ==== osd_op_reply(182 1000000004c.00000000 [call] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.923+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:183 5.21 5:8660ae9f::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9ae00 con 0x558ff5c3e000 2023-11-17T06:33:30.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.923+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 19 ==== osd_op_reply(183 [pgnls start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.923+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:184 5.21 5:8660ae9f:::1000000004f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b180 con 0x558ff5c3e000 2023-11-17T06:33:30.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.923+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 20 ==== osd_op_reply(184 1000000004f.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.923+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627855.0 2023-11-17T06:33:30.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.923+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:185 5.21 5:8660ae9f:::1000000004f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b500 con 0x558ff5c3e000 2023-11-17T06:33:30.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.927+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 21 ==== osd_op_reply(185 1000000004f.00000000 [call] v41'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.927+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:186 5.21 5:86d8200e::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5c3e000 2023-11-17T06:33:30.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.927+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 22 ==== osd_op_reply(186 [pgnls start_epoch 41 out=101b] v41'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.927+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:187 5.21 5:86d8200e:::10000000019.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5c3e000 2023-11-17T06:33:30.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.927+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 23 ==== osd_op_reply(187 10000000019.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.927+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627801.0 2023-11-17T06:33:30.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.927+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:188 5.21 5:86d8200e:::10000000019.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3e000 2023-11-17T06:33:30.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.931+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 24 ==== osd_op_reply(188 10000000019.00000000 [call] v41'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.931+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:189 5.21 5:870ac4b3::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5c3e000 2023-11-17T06:33:30.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.931+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 25 ==== osd_op_reply(189 [pgnls start_epoch 41 out=81b] v41'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.931+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:190 5.21 5:870ac4b3:::1000000005e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3e000 2023-11-17T06:33:30.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.931+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 26 ==== osd_op_reply(190 1000000005e.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.931+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627870.0 2023-11-17T06:33:30.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.931+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:191 5.21 5:870ac4b3:::1000000005e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5c3e000 2023-11-17T06:33:30.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.935+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 27 ==== osd_op_reply(191 1000000005e.00000000 [call] v41'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.935+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:192 5.11 5:88000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5b29c00 2023-11-17T06:33:30.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.935+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 32 ==== osd_op_reply(192 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.935+0000 7f6a5a444700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:193 5.31 5:8c000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5c3e400 2023-11-17T06:33:30.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.935+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 24 ==== osd_op_reply(193 [pgnls start_epoch 41 out=101b] v39'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.935+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:194 5.31 5:8e5cc622:::1000000004b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5c3e400 2023-11-17T06:33:30.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.935+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 25 ==== osd_op_reply(194 1000000004b.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.935+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627851.0 2023-11-17T06:33:30.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.935+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:195 5.31 5:8e5cc622:::1000000004b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9ae00 con 0x558ff5c3e400 2023-11-17T06:33:30.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.939+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 26 ==== osd_op_reply(195 1000000004b.00000000 [call] v41'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.939+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:196 5.31 5:8ea80fc8::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b180 con 0x558ff5c3e400 2023-11-17T06:33:30.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.939+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 27 ==== osd_op_reply(196 [pgnls start_epoch 41 out=101b] v41'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.939+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:197 5.31 5:8ea80fc8:::10000000032.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b500 con 0x558ff5c3e400 2023-11-17T06:33:30.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.943+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 28 ==== osd_op_reply(197 10000000032.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.943+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627826.0 2023-11-17T06:33:30.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.943+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:198 5.31 5:8ea80fc8:::10000000032.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b880 con 0x558ff5c3e400 2023-11-17T06:33:30.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.943+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 29 ==== osd_op_reply(198 10000000032.00000000 [call] v41'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.943+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:199 5.31 5:8ff022d2::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9bc00 con 0x558ff5c3e400 2023-11-17T06:33:30.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.943+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 30 ==== osd_op_reply(199 [pgnls start_epoch 41 out=81b] v41'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.943+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:200 5.31 5:8ff022d2:::10000000059.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9a000 con 0x558ff5c3e400 2023-11-17T06:33:30.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.947+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 31 ==== osd_op_reply(200 10000000059.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.947+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627865.0 2023-11-17T06:33:30.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.947+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:201 5.31 5:8ff022d2:::10000000059.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5c3e400 2023-11-17T06:33:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.951+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 32 ==== osd_op_reply(201 10000000059.00000000 [call] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:30.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.951+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:202 5.9 5:90000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5c3ec00 2023-11-17T06:33:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.951+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 16 ==== osd_op_reply(202 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.951+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:203 5.9 5:9258b67d:::10000000005.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5c3ec00 2023-11-17T06:33:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.951+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 17 ==== osd_op_reply(203 10000000005.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.951+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627781.0 2023-11-17T06:33:30.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.951+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:204 5.9 5:9258b67d:::10000000005.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5c3ec00 2023-11-17T06:33:30.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.955+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 18 ==== osd_op_reply(204 10000000005.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:30.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.955+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:205 5.29 5:94000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3e800 2023-11-17T06:33:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.955+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 32 ==== osd_op_reply(205 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.955+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:206 5.29 5:954bc910:::1000000004e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3e800 2023-11-17T06:33:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.955+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 33 ==== osd_op_reply(206 1000000004e.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.955+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627854.0 2023-11-17T06:33:30.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.955+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:207 5.29 5:954bc910:::1000000004e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5c3e800 2023-11-17T06:33:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.959+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 34 ==== osd_op_reply(207 1000000004e.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.959+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:208 5.29 5:9752f43f::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5c3e800 2023-11-17T06:33:30.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.959+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 35 ==== osd_op_reply(208 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.959+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:209 5.29 5:9752f43f:::1000000000b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9ae00 con 0x558ff5c3e800 2023-11-17T06:33:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.963+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 36 ==== osd_op_reply(209 1000000000b.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.963+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627787.0 2023-11-17T06:33:30.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.963+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:210 5.29 5:9752f43f:::1000000000b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b180 con 0x558ff5c3e800 2023-11-17T06:33:30.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.963+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 37 ==== osd_op_reply(210 1000000000b.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:30.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.963+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:211 5.19 5:98000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b500 con 0x558ff5c3f800 2023-11-17T06:33:30.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.967+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 34 ==== osd_op_reply(211 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.967+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:212 5.19 5:9ae7aaf4:::10000000051.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72a80 con 0x558ff5c3f800 2023-11-17T06:33:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.967+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 35 ==== osd_op_reply(212 10000000051.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.967+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627857.0 2023-11-17T06:33:30.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.967+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:213 5.19 5:9ae7aaf4:::10000000051.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72380 con 0x558ff5c3f800 2023-11-17T06:33:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.971+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 36 ==== osd_op_reply(213 10000000051.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:30.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.971+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:214 5.39 5:9c000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73500 con 0x558ff5c3e000 2023-11-17T06:33:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.971+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 28 ==== osd_op_reply(214 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.971+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:215 5.39 5:9fc48627:::1000000005b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73880 con 0x558ff5c3e000 2023-11-17T06:33:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.971+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 29 ==== osd_op_reply(215 1000000005b.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.971+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627867.0 2023-11-17T06:33:30.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.971+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:216 5.39 5:9fc48627:::1000000005b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5c3e000 2023-11-17T06:33:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.975+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 30 ==== osd_op_reply(216 1000000005b.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:30.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.975+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:217 5.5 5:a0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5c3f000 2023-11-17T06:33:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.975+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 16 ==== osd_op_reply(217 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.975+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:218 5.5 5:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5c3f000 2023-11-17T06:33:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.979+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 17 ==== osd_op_reply(218 10000000004.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.979+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627780.0 2023-11-17T06:33:30.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.979+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:219 5.5 5:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5c3f000 2023-11-17T06:33:30.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.979+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 18 ==== osd_op_reply(219 10000000004.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:30.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.983+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:220 5.25 5:a4000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5b29800 2023-11-17T06:33:30.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.983+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 17 ==== osd_op_reply(220 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.983+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:221 5.25 5:a5feb6f3:::10000000006.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cba000 con 0x558ff5b29800 2023-11-17T06:33:30.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.983+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 18 ==== osd_op_reply(221 10000000006.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.983+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627782.0 2023-11-17T06:33:30.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.983+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:222 5.25 5:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cba380 con 0x558ff5b29800 2023-11-17T06:33:30.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.987+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 19 ==== osd_op_reply(222 10000000006.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.987+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:223 5.25 5:a622384a::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cba700 con 0x558ff5b29800 2023-11-17T06:33:30.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.987+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 20 ==== osd_op_reply(223 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.987+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:224 5.25 5:a622384a:::1000000002c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbaa80 con 0x558ff5b29800 2023-11-17T06:33:30.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.987+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 21 ==== osd_op_reply(224 1000000002c.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.987+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627820.0 2023-11-17T06:33:30.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.987+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:225 5.25 5:a622384a:::1000000002c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbae00 con 0x558ff5b29800 2023-11-17T06:33:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.991+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 22 ==== osd_op_reply(225 1000000002c.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.991+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:226 5.15 5:a8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbb180 con 0x558ff5b29c00 2023-11-17T06:33:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.991+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 33 ==== osd_op_reply(226 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.991+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:227 5.15 5:ab5910e2:::10000000011.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbb500 con 0x558ff5b29c00 2023-11-17T06:33:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.995+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 34 ==== osd_op_reply(227 10000000011.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.995+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627793.0 2023-11-17T06:33:30.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.995+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:228 5.15 5:ab5910e2:::10000000011.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbb880 con 0x558ff5b29c00 2023-11-17T06:33:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.995+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 35 ==== osd_op_reply(228 10000000011.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.995+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:229 5.35 5:ac000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbbc00 con 0x558ff5b29c00 2023-11-17T06:33:31.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.999+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 36 ==== osd_op_reply(229 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.999+0000 7f6a59c43700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:230 5.d 5:b0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9a380 con 0x558ff5c3f000 2023-11-17T06:33:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.999+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 19 ==== osd_op_reply(230 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:31.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.999+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:231 5.d 5:b0d15537:::10000000027.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbb180 con 0x558ff5c3f000 2023-11-17T06:33:31.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.999+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 20 ==== osd_op_reply(231 10000000027.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:31.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.999+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627815.0 2023-11-17T06:33:31.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:30.999+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:232 5.d 5:b0d15537:::10000000027.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbb500 con 0x558ff5c3f000 2023-11-17T06:33:31.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.003+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 21 ==== osd_op_reply(232 10000000027.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:31.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.003+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:233 5.d 5:b185e6e8::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbb880 con 0x558ff5c3f000 2023-11-17T06:33:31.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.003+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 22 ==== osd_op_reply(233 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:31.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.003+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:234 5.d 5:b185e6e8:::10000000012.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cba000 con 0x558ff5c3f000 2023-11-17T06:33:31.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.003+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 23 ==== osd_op_reply(234 10000000012.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:31.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.003+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627794.0 2023-11-17T06:33:31.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.003+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:235 5.d 5:b185e6e8:::10000000012.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cba380 con 0x558ff5c3f000 2023-11-17T06:33:31.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.007+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 24 ==== osd_op_reply(235 10000000012.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:31.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.007+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:236 5.2d 5:b4000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cba700 con 0x558ff5c3f000 2023-11-17T06:33:31.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.007+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 25 ==== osd_op_reply(236 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:31.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.007+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:237 5.2d 5:b5236558:::1000000005d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbaa80 con 0x558ff5c3f000 2023-11-17T06:33:31.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.007+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 26 ==== osd_op_reply(237 1000000005d.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:31.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.007+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627869.0 2023-11-17T06:33:31.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.007+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:238 5.2d 5:b5236558:::1000000005d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbae00 con 0x558ff5c3f000 2023-11-17T06:33:31.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.011+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.7 v2:172.21.15.93:6810/4059179485 27 ==== osd_op_reply(238 1000000005d.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3f000 2023-11-17T06:33:31.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.011+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:239 5.1d 5:b8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5b29800 2023-11-17T06:33:31.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.011+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 23 ==== osd_op_reply(239 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.011+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:240 5.1d 5:ba3960b0:::10000000028.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5b29800 2023-11-17T06:33:31.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.015+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 24 ==== osd_op_reply(240 10000000028.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.015+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627816.0 2023-11-17T06:33:31.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.015+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:241 5.1d 5:ba3960b0:::10000000028.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5b29800 2023-11-17T06:33:31.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.015+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 25 ==== osd_op_reply(241 10000000028.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.015+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:242 5.1d 5:bbf5850a::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5b29800 2023-11-17T06:33:31.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.019+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 26 ==== osd_op_reply(242 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.019+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:243 5.1d 5:bbf5850a:::10000000007.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5b29800 2023-11-17T06:33:31.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.019+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 27 ==== osd_op_reply(243 10000000007.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.019+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627783.0 2023-11-17T06:33:31.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.019+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:244 5.1d 5:bbf5850a:::10000000007.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5b29800 2023-11-17T06:33:31.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.019+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 28 ==== osd_op_reply(244 10000000007.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.019+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:245 5.3d 5:bc000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5c3ec00 2023-11-17T06:33:31.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.023+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 19 ==== osd_op_reply(245 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:31.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.023+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:246 5.3d 5:be1922a8:::10000000026.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5c3ec00 2023-11-17T06:33:31.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.023+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 20 ==== osd_op_reply(246 10000000026.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:31.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.023+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627814.0 2023-11-17T06:33:31.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.023+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:247 5.3d 5:be1922a8:::10000000026.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72a80 con 0x558ff5c3ec00 2023-11-17T06:33:31.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.027+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 21 ==== osd_op_reply(247 10000000026.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:31.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.027+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:248 5.3 5:c0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72380 con 0x558ff5c3f800 2023-11-17T06:33:31.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.027+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 37 ==== osd_op_reply(248 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.027+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:249 5.3 5:c001b242:::10000000060.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9ae00 con 0x558ff5c3f800 2023-11-17T06:33:31.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.027+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 38 ==== osd_op_reply(249 10000000060.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.027+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627872.0 2023-11-17T06:33:31.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.027+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:250 5.3 5:c001b242:::10000000060.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b180 con 0x558ff5c3f800 2023-11-17T06:33:31.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.031+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 39 ==== osd_op_reply(250 10000000060.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.031+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:251 5.3 5:c1adcc3d::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b880 con 0x558ff5c3f800 2023-11-17T06:33:31.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.031+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 40 ==== osd_op_reply(251 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.031+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:252 5.3 5:c1adcc3d:::10000000030.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9bc00 con 0x558ff5c3f800 2023-11-17T06:33:31.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.031+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 41 ==== osd_op_reply(252 10000000030.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.031+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627824.0 2023-11-17T06:33:31.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.031+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:253 5.3 5:c1adcc3d:::10000000030.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9a000 con 0x558ff5c3f800 2023-11-17T06:33:31.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.035+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 42 ==== osd_op_reply(253 10000000030.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.035+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:254 5.23 5:c4000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b500 con 0x558ff5c3e400 2023-11-17T06:33:31.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.035+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 33 ==== osd_op_reply(254 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.035+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:255 5.23 5:c550f404:::1000000002f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5c3e400 2023-11-17T06:33:31.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.035+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 34 ==== osd_op_reply(255 1000000002f.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.035+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627823.0 2023-11-17T06:33:31.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.035+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:256 5.23 5:c550f404:::1000000002f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5c3e400 2023-11-17T06:33:31.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.039+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 35 ==== osd_op_reply(256 1000000002f.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.039+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:257 5.23 5:c6a0a389::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5c3e400 2023-11-17T06:33:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.039+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 36 ==== osd_op_reply(257 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.043+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:258 5.23 5:c6a0a389:::10000000040.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9ae00 con 0x558ff5c3e400 2023-11-17T06:33:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.043+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 37 ==== osd_op_reply(258 10000000040.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.043+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627840.0 2023-11-17T06:33:31.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.043+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:259 5.23 5:c6a0a389:::10000000040.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b180 con 0x558ff5c3e400 2023-11-17T06:33:31.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.043+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 38 ==== osd_op_reply(259 10000000040.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.043+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:260 5.13 5:c8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b880 con 0x558ff5c3f800 2023-11-17T06:33:31.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.047+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 43 ==== osd_op_reply(260 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.047+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:261 5.13 5:cabe77c1:::10000000008.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9bc00 con 0x558ff5c3f800 2023-11-17T06:33:31.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.047+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 44 ==== osd_op_reply(261 10000000008.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.047+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627784.0 2023-11-17T06:33:31.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.047+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:262 5.13 5:cabe77c1:::10000000008.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9a000 con 0x558ff5c3f800 2023-11-17T06:33:31.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.051+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 45 ==== osd_op_reply(262 10000000008.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.051+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:263 5.33 5:cc000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b500 con 0x558ff5c3e800 2023-11-17T06:33:31.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.051+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 38 ==== osd_op_reply(263 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:31.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.051+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:264 5.33 5:cf746ac5:::1000000001d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72380 con 0x558ff5c3e800 2023-11-17T06:33:31.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.051+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 39 ==== osd_op_reply(264 1000000001d.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:31.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.051+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627805.0 2023-11-17T06:33:31.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.051+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:265 5.33 5:cf746ac5:::1000000001d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3e800 2023-11-17T06:33:31.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.055+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.6 v2:172.21.15.93:6826/2665225471 40 ==== osd_op_reply(265 1000000001d.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5c3e800 2023-11-17T06:33:31.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.055+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:266 5.b 5:d0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5b29800 2023-11-17T06:33:31.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.055+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 29 ==== osd_op_reply(266 [pgnls start_epoch 41 out=101b] v39'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.059+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:267 5.b 5:d2626379:::10000000022.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5b29800 2023-11-17T06:33:31.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.059+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 30 ==== osd_op_reply(267 10000000022.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.059+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627810.0 2023-11-17T06:33:31.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.059+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:268 5.b 5:d2626379:::10000000022.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5b29800 2023-11-17T06:33:31.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.059+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 31 ==== osd_op_reply(268 10000000022.00000000 [call] v41'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.059+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:269 5.b 5:d30f9a54::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5b29800 2023-11-17T06:33:31.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.063+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 32 ==== osd_op_reply(269 [pgnls start_epoch 41 out=101b] v41'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.063+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:270 5.b 5:d30f9a54:::10000000052.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5b29800 2023-11-17T06:33:31.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.063+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 33 ==== osd_op_reply(270 10000000052.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.063+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627858.0 2023-11-17T06:33:31.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.063+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:271 5.b 5:d30f9a54:::10000000052.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbe000 con 0x558ff5b29800 2023-11-17T06:33:31.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.067+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 34 ==== osd_op_reply(271 10000000052.00000000 [call] v41'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.067+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:272 5.b 5:d3d0d483::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbe380 con 0x558ff5b29800 2023-11-17T06:33:31.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.067+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 35 ==== osd_op_reply(272 [pgnls start_epoch 41 out=81b] v41'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.067+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:273 5.b 5:d3d0d483:::10000000021.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbe700 con 0x558ff5b29800 2023-11-17T06:33:31.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.067+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 36 ==== osd_op_reply(273 10000000021.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.067+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627809.0 2023-11-17T06:33:31.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.067+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:274 5.b 5:d3d0d483:::10000000021.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbea80 con 0x558ff5b29800 2023-11-17T06:33:31.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.071+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 37 ==== osd_op_reply(274 10000000021.00000000 [call] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.071+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:275 5.2b 5:d4000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbee00 con 0x558ff5c3e400 2023-11-17T06:33:31.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.071+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 39 ==== osd_op_reply(275 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.071+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:276 5.2b 5:d4b9b687:::10000000041.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbf180 con 0x558ff5c3e400 2023-11-17T06:33:31.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.071+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 40 ==== osd_op_reply(276 10000000041.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.071+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627841.0 2023-11-17T06:33:31.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.071+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:277 5.2b 5:d4b9b687:::10000000041.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbf500 con 0x558ff5c3e400 2023-11-17T06:33:31.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.075+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 41 ==== osd_op_reply(277 10000000041.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.075+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:278 5.2b 5:d747f723::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbf880 con 0x558ff5c3e400 2023-11-17T06:33:31.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.075+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 42 ==== osd_op_reply(278 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.075+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:279 5.2b 5:d747f723:::10000000036.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbfc00 con 0x558ff5c3e400 2023-11-17T06:33:31.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.079+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 43 ==== osd_op_reply(279 10000000036.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.079+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627830.0 2023-11-17T06:33:31.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.079+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:280 5.2b 5:d747f723:::10000000036.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbe000 con 0x558ff5c3e400 2023-11-17T06:33:31.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.079+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.0 v2:172.21.15.69:6800/3449021474 44 ==== osd_op_reply(280 10000000036.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3e400 2023-11-17T06:33:31.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.079+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:281 5.1b 5:d8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbe380 con 0x558ff5c3e000 2023-11-17T06:33:31.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.083+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 31 ==== osd_op_reply(281 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:31.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.083+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:282 5.1b 5:d88bb762:::10000000031.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbe700 con 0x558ff5c3e000 2023-11-17T06:33:31.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.083+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 32 ==== osd_op_reply(282 10000000031.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:31.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.083+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627825.0 2023-11-17T06:33:31.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.083+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:283 5.1b 5:d88bb762:::10000000031.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34e00 con 0x558ff5c3e000 2023-11-17T06:33:31.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.087+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 33 ==== osd_op_reply(283 10000000031.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:31.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.087+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:284 5.3b 5:dc000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34700 con 0x558ff5b29800 2023-11-17T06:33:31.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.087+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 38 ==== osd_op_reply(284 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.087+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:285 5.3b 5:dde6a3df:::10000000010.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35880 con 0x558ff5b29800 2023-11-17T06:33:31.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.087+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 39 ==== osd_op_reply(285 10000000010.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.087+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627792.0 2023-11-17T06:33:31.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.087+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:286 5.3b 5:dde6a3df:::10000000010.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35c00 con 0x558ff5b29800 2023-11-17T06:33:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.091+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.5 v2:172.21.15.93:6802/753754499 40 ==== osd_op_reply(286 10000000010.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5b29800 2023-11-17T06:33:31.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.091+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:287 5.7 5:e0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5b29c00 2023-11-17T06:33:31.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.091+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 37 ==== osd_op_reply(287 [pgnls start_epoch 41 out=101b] v39'5 uv5 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.091+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:288 5.7 5:e2d50132:::10000000049.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9ae00 con 0x558ff5b29c00 2023-11-17T06:33:31.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.091+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 38 ==== osd_op_reply(288 10000000049.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.091+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627849.0 2023-11-17T06:33:31.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.091+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:289 5.7 5:e2d50132:::10000000049.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b180 con 0x558ff5b29c00 2023-11-17T06:33:31.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.095+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 39 ==== osd_op_reply(289 10000000049.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.095+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:290 5.7 5:e2e07930::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b880 con 0x558ff5b29c00 2023-11-17T06:33:31.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.095+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 40 ==== osd_op_reply(290 [pgnls start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.095+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:291 5.7 5:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9bc00 con 0x558ff5b29c00 2023-11-17T06:33:31.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.099+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 41 ==== osd_op_reply(291 10000000001.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.099+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627777.0 2023-11-17T06:33:31.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.099+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:292 5.7 5:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9a000 con 0x558ff5b29c00 2023-11-17T06:33:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.099+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 42 ==== osd_op_reply(292 10000000001.00000000 [call] v41'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.099+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:293 5.27 5:e4000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582b880 con 0x558ff5c3f800 2023-11-17T06:33:31.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.103+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 46 ==== osd_op_reply(293 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.103+0000 7f6a59c43700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:294 5.17 5:e8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9a700 con 0x558ff5c3f800 2023-11-17T06:33:31.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.103+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 47 ==== osd_op_reply(294 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.103+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:295 5.17 5:e9ecae36:::1000000000d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff582bc00 con 0x558ff5c3f800 2023-11-17T06:33:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.103+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 48 ==== osd_op_reply(295 1000000000d.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.103+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627789.0 2023-11-17T06:33:31.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.103+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:296 5.17 5:e9ecae36:::1000000000d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5cbe380 con 0x558ff5c3f800 2023-11-17T06:33:31.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.107+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 49 ==== osd_op_reply(296 1000000000d.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.107+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:297 5.17 5:eb6757d1::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72380 con 0x558ff5c3f800 2023-11-17T06:33:31.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.107+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 50 ==== osd_op_reply(297 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.107+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:298 5.17 5:eb6757d1:::10000000023.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73500 con 0x558ff5c3f800 2023-11-17T06:33:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.111+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 51 ==== osd_op_reply(298 10000000023.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.111+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627811.0 2023-11-17T06:33:31.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.111+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:299 5.17 5:eb6757d1:::10000000023.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73880 con 0x558ff5c3f800 2023-11-17T06:33:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.111+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 <== osd.4 v2:172.21.15.93:6812/1712617818 52 ==== osd_op_reply(299 10000000023.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcb40 con 0x558ff5c3f800 2023-11-17T06:33:31.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.111+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:300 5.37 5:ec000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73c00 con 0x558ff5c3ec00 2023-11-17T06:33:31.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.115+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 22 ==== osd_op_reply(300 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:31.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.115+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:301 5.37 5:eefe613f:::1000000000e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72000 con 0x558ff5c3ec00 2023-11-17T06:33:31.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.115+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 23 ==== osd_op_reply(301 1000000000e.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:31.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.115+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627790.0 2023-11-17T06:33:31.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.115+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:302 5.37 5:eefe613f:::1000000000e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72e00 con 0x558ff5c3ec00 2023-11-17T06:33:31.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.119+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 24 ==== osd_op_reply(302 1000000000e.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.119+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:303 5.f 5:f0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72a80 con 0x558ff5c3ec00 2023-11-17T06:33:31.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.119+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 25 ==== osd_op_reply(303 [pgnls start_epoch 41 out=81b] v39'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.119+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:304 5.f 5:f1a9c549:::1000000003a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34380 con 0x558ff5c3ec00 2023-11-17T06:33:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.119+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 26 ==== osd_op_reply(304 1000000003a.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.119+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627834.0 2023-11-17T06:33:31.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.119+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:305 5.f 5:f1a9c549:::1000000003a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35500 con 0x558ff5c3ec00 2023-11-17T06:33:31.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.123+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.1 v2:172.21.15.69:6809/346628569 27 ==== osd_op_reply(305 1000000003a.00000000 [call] v41'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3ec00 2023-11-17T06:33:31.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.123+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:306 5.2f 5:f4000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34000 con 0x558ff5b29c00 2023-11-17T06:33:31.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.123+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 43 ==== osd_op_reply(306 [pgnls start_epoch 41 out=101b] v39'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.123+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:307 5.2f 5:f6ddf183:::10000000024.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c35180 con 0x558ff5b29c00 2023-11-17T06:33:31.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.123+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 44 ==== osd_op_reply(307 10000000024.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.123+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627812.0 2023-11-17T06:33:31.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.123+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:308 5.2f 5:f6ddf183:::10000000024.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c34a80 con 0x558ff5b29c00 2023-11-17T06:33:31.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.127+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 45 ==== osd_op_reply(308 10000000024.00000000 [call] v41'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.127+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:309 5.2f 5:f7911ae7::::head [pgnls start_epoch 41 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9a380 con 0x558ff5b29c00 2023-11-17T06:33:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.127+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 46 ==== osd_op_reply(309 [pgnls start_epoch 41 out=81b] v41'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.127+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:310 5.2f 5:f7911ae7:::1000000004a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c9b500 con 0x558ff5b29c00 2023-11-17T06:33:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.127+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 47 ==== osd_op_reply(310 1000000004a.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.127+0000 7f6a60491840 10 datascan.operator(): handling object 1099511627850.0 2023-11-17T06:33:31.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.127+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:311 5.2f 5:f7911ae7:::1000000004a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c72380 con 0x558ff5b29c00 2023-11-17T06:33:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a5f44e700 1 -- 172.21.15.69:0/2417282529 <== osd.3 v2:172.21.15.69:6824/183679214 48 ==== osd_op_reply(311 1000000004a.00000000 [call] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ff65bcd80 con 0x558ff5b29c00 2023-11-17T06:33:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:312 5.1f 5:f8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73500 con 0x558ff5c3e000 2023-11-17T06:33:31.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 34 ==== osd_op_reply(312 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:31.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a5a444700 1 -- 172.21.15.69:0/2417282529 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:313 5.3f 5:fc000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x558ff5c73180 con 0x558ff5c3e000 2023-11-17T06:33:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a5ec4d700 1 -- 172.21.15.69:0/2417282529 <== osd.2 v2:172.21.15.69:6808/576340262 35 ==== osd_op_reply(313 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ff65bcfc0 con 0x558ff5c3e000 2023-11-17T06:33:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x558ff5c3e400 msgr2=0x558ff5c40580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x558ff5c3e400 0x558ff5c40580 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x558ff5c3ec00 msgr2=0x558ff5c41080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x558ff5c3ec00 0x558ff5c41080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x558ff5c3e000 msgr2=0x558ff5c40000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x558ff5c3e000 0x558ff5c40000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x558ff5b29c00 msgr2=0x558ff585b180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x558ff5b29c00 0x558ff585b180 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x558ff5c3f800 msgr2=0x558ff5c41b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x558ff5c3f800 0x558ff5c41b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x558ff5b29800 msgr2=0x558ff585ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.131+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x558ff5b29800 0x558ff585ac00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x558ff5c3e800 msgr2=0x558ff5c40b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x558ff5c3e800 0x558ff5c40b00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x558ff5c3f000 msgr2=0x558ff5c41600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x558ff5c3f000 0x558ff5c41600 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 reap_dead start 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 reap_dead start 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 reap_dead start 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a5e44c700 1 -- 172.21.15.69:0/2417282529 reap_dead start 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x558ff5b29400 msgr2=0x558ff585b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x558ff5b29400 0x558ff585b700 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x558ff5ad4660 tx=0x558ff58a7ec0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28800 msgr2=0x558ff585a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28800 0x558ff585a100 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x558ff58b38f0 tx=0x558ff58b6120 comp rx=0 tx=0).stop 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 shutdown_connections 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x558ff5b29400 0x558ff585b700 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 --2- 172.21.15.69:0/2417282529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff5b28800 0x558ff585a100 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 >> 172.21.15.69:0/2417282529 conn(0x558ff5b28000 msgr2=0x558ff58d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 shutdown_connections 2023-11-17T06:33:31.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/2417282529 wait complete. 2023-11-17T06:33:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/1125892787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff57e5400 msgr2=0x558ff5858b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 --2- 172.21.15.69:0/1125892787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff57e5400 0x558ff5858b00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x558ff58b32f0 tx=0x558ff58b60c0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/1125892787 shutdown_connections 2023-11-17T06:33:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 --2- 172.21.15.69:0/1125892787 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x558ff57e5c00 0x558ff5859600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 --2- 172.21.15.69:0/1125892787 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558ff57e5800 0x558ff5859080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 --2- 172.21.15.69:0/1125892787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ff57e5400 0x558ff5858b00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/1125892787 >> 172.21.15.69:0/1125892787 conn(0x558ff57e4c00 msgr2=0x558ff58d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/1125892787 shutdown_connections 2023-11-17T06:33:31.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.135+0000 7f6a60491840 1 -- 172.21.15.69:0/1125892787 wait complete. 2023-11-17T06:33:31.148 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents'] in time 0:00:00.599742, result: 2023-11-17T06:33:31.148 DEBUG:teuthology.orchestra.run.smithi069:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes 2023-11-17T06:33:31.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.251+0000 7fa48d92e840 1 -- start start 2023-11-17T06:33:31.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.251+0000 7fa48d92e840 1 Processor -- start 2023-11-17T06:33:31.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48d92e840 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90b7d9000 0x55e90b84c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48d92e840 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90b7d9400 0x55e90b84cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48d92e840 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90b7d9800 0x55e90b84d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48d92e840 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b80e140 con 0x55e90b7d9400 2023-11-17T06:33:31.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48d92e840 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b80f180 con 0x55e90b7d9000 2023-11-17T06:33:31.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48d92e840 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e90b80e000 con 0x55e90b7d9800 2023-11-17T06:33:31.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48b8e9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90b7d9400 0x55e90b84cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48b8e9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90b7d9400 0x55e90b84cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34822/0 (socket says 172.21.15.69:34822) 2023-11-17T06:33:31.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48b8e9700 1 -- 172.21.15.69:0/1053898936 learned_addr learned my addr 172.21.15.69:0/1053898936 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:31.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/1053898936 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90b7d9800 0x55e90b84d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48c0ea700 1 --2- 172.21.15.69:0/1053898936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90b7d9000 0x55e90b84c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48b8e9700 1 -- 172.21.15.69:0/1053898936 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90b7d9800 msgr2=0x55e90b84d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:31.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48b8e9700 1 --2- 172.21.15.69:0/1053898936 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90b7d9800 0x55e90b84d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48b8e9700 1 -- 172.21.15.69:0/1053898936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90b7d9000 msgr2=0x55e90b84c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:31.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48b8e9700 1 --2- 172.21.15.69:0/1053898936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90b7d9000 0x55e90b84c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48b8e9700 1 -- 172.21.15.69:0/1053898936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e90b7fab60 con 0x55e90b7d9400 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48b8e9700 1 --2- 172.21.15.69:0/1053898936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90b7d9400 0x55e90b84cb00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x55e90b8935f0 tx=0x55e90c5c4480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9dbfbc88b8ab15 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa4898e5700 1 -- 172.21.15.69:0/1053898936 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e90b80d600 con 0x55e90b7d9400 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa4898e5700 1 -- 172.21.15.69:0/1053898936 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e90b824480 con 0x55e90b7d9400 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa4898e5700 1 -- 172.21.15.69:0/1053898936 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e90b80d1e0 con 0x55e90b7d9400 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48d92e840 1 -- 172.21.15.69:0/1053898936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e90b7fa340 con 0x55e90b7d9400 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48d92e840 1 -- 172.21.15.69:0/1053898936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e90b7fa000 con 0x55e90b7d9400 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48d92e840 4 waiting for MDS map... 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa4898e5700 1 -- 172.21.15.69:0/1053898936 <== mon.0 v2:172.21.15.69:3300/0 4 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x55e90b812c40 con 0x55e90b7d9400 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa4898e5700 1 -- 172.21.15.69:0/1053898936 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 22) v1 ==== 2723+0+0 (secure 0 0 0) 0x55e90bac4300 con 0x55e90b7d9400 2023-11-17T06:33:31.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.255+0000 7fa48d92e840 4 Got MDS map 22 2023-11-17T06:33:31.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.259+0000 7fa48d92e840 4 datascan.main: Using metadata pool output 2023-11-17T06:33:31.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.259+0000 7fa48d92e840 4 datascan.main: connecting to RADOS... 2023-11-17T06:33:31.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.259+0000 7fa48d92e840 1 Processor -- start 2023-11-17T06:33:31.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.259+0000 7fa48d92e840 1 -- start start 2023-11-17T06:33:31.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.259+0000 7fa48d92e840 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28400 0x55e90b84d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.259+0000 7fa48d92e840 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90bb28800 0x55e90b84db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.259+0000 7fa48d92e840 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90bb28c00 0x55e90b84e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.259+0000 7fa48d92e840 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b80ea00 con 0x55e90bb28c00 2023-11-17T06:33:31.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.259+0000 7fa48d92e840 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b833180 con 0x55e90bb28800 2023-11-17T06:33:31.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.259+0000 7fa48d92e840 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e90b832dc0 con 0x55e90bb28400 2023-11-17T06:33:31.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48b8e9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90bb28c00 0x55e90b84e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48c8eb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28400 0x55e90b84d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48c0ea700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90bb28800 0x55e90b84db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48c8eb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28400 0x55e90b84d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:49618/0 (socket says 172.21.15.69:49618) 2023-11-17T06:33:31.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48c8eb700 1 -- 172.21.15.69:0/1258580176 learned_addr learned my addr 172.21.15.69:0/1258580176 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:31.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48c8eb700 1 -- 172.21.15.69:0/1258580176 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90bb28800 msgr2=0x55e90b84db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:31.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/1258580176 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90bb28800 0x55e90b84db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48c8eb700 1 -- 172.21.15.69:0/1258580176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90bb28c00 msgr2=0x55e90b84e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:31.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/1258580176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90bb28c00 0x55e90b84e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48c8eb700 1 -- 172.21.15.69:0/1258580176 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e90b7faea0 con 0x55e90bb28400 2023-11-17T06:33:31.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/1258580176 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28400 0x55e90b84d600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55e90bad6a80 tx=0x55e90c5c4060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49d2eac3451af7b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa4878e1700 1 -- 172.21.15.69:0/1258580176 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e90b80d080 con 0x55e90bb28400 2023-11-17T06:33:31.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa4878e1700 1 -- 172.21.15.69:0/1258580176 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e90c5c6900 con 0x55e90bb28400 2023-11-17T06:33:31.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa4878e1700 1 -- 172.21.15.69:0/1258580176 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e90b80d600 con 0x55e90bb28400 2023-11-17T06:33:31.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48d92e840 1 -- 172.21.15.69:0/1258580176 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28400 msgr2=0x55e90b84d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48d92e840 1 --2- 172.21.15.69:0/1258580176 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28400 0x55e90b84d600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55e90bad6a80 tx=0x55e90c5c4060 comp rx=0 tx=0).stop 2023-11-17T06:33:31.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48d92e840 1 -- 172.21.15.69:0/1258580176 shutdown_connections 2023-11-17T06:33:31.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48d92e840 1 --2- 172.21.15.69:0/1258580176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90bb28c00 0x55e90b84e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48d92e840 1 --2- 172.21.15.69:0/1258580176 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90bb28800 0x55e90b84db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48d92e840 1 --2- 172.21.15.69:0/1258580176 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28400 0x55e90b84d600 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48d92e840 1 -- 172.21.15.69:0/1258580176 >> 172.21.15.69:0/1258580176 conn(0x55e90bb28000 msgr2=0x55e90b8a3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:31.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48d92e840 1 -- 172.21.15.69:0/1258580176 shutdown_connections 2023-11-17T06:33:31.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.263+0000 7fa48d92e840 1 -- 172.21.15.69:0/1258580176 wait complete. 2023-11-17T06:33:31.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48d92e840 1 Processor -- start 2023-11-17T06:33:31.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48d92e840 1 -- start start 2023-11-17T06:33:31.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48d92e840 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90bb28400 0x55e90b84f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48d92e840 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90bb28800 0x55e90b84ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48d92e840 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28c00 0x55e90b84e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48d92e840 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b832c80 con 0x55e90bb28400 2023-11-17T06:33:31.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48d92e840 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e90b80f180 con 0x55e90bb28800 2023-11-17T06:33:31.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48d92e840 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e90b80eb40 con 0x55e90bb28c00 2023-11-17T06:33:31.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48b8e9700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28c00 0x55e90b84e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48c8eb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90bb28400 0x55e90b84f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48b8e9700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28c00 0x55e90b84e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:49626/0 (socket says 172.21.15.69:49626) 2023-11-17T06:33:31.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 learned_addr learned my addr 172.21.15.69:0/2277796807 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:31.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48c0ea700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90bb28800 0x55e90b84ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90bb28800 msgr2=0x55e90b84ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48b8e9700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90bb28800 0x55e90b84ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90bb28400 msgr2=0x55e90b84f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:31.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48b8e9700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90bb28400 0x55e90b84f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:31.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e90b7fb1e0 con 0x55e90bb28c00 2023-11-17T06:33:31.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48b8e9700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28c00 0x55e90b84e680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55e90b893bf0 tx=0x55e90c5c4120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa4860de700 1 -- 172.21.15.69:0/2277796807 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e90b80cf20 con 0x55e90bb28c00 2023-11-17T06:33:31.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa4860de700 1 -- 172.21.15.69:0/2277796807 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e90c5c6d80 con 0x55e90bb28c00 2023-11-17T06:33:31.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa4860de700 1 -- 172.21.15.69:0/2277796807 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e90b80d080 con 0x55e90bb28c00 2023-11-17T06:33:31.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.267+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e90b7faea0 con 0x55e90bb28c00 2023-11-17T06:33:31.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.271+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e90b7fab60 con 0x55e90bb28c00 2023-11-17T06:33:31.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.271+0000 7fa48d92e840 4 datascan.init: resolving metadata pool 4 2023-11-17T06:33:31.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.271+0000 7fa4860de700 1 -- 172.21.15.69:0/2277796807 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x55e90b826840 con 0x55e90bb28c00 2023-11-17T06:33:31.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.271+0000 7fa4860de700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55e90bb29800 0x55e90b84f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.271+0000 7fa4860de700 1 -- 172.21.15.69:0/2277796807 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x55e90b812a80 con 0x55e90bb28c00 2023-11-17T06:33:31.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48d92e840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-11-17T06:33:31.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48d92e840 4 datascan.main: data pool 'cephfs_data' has ID 5 2023-11-17T06:33:31.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48d92e840 4 datascan.main: opening data pool 'cephfs_data' 2023-11-17T06:33:31.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x55e90bb29c00 0x55e90b84e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:1 4.14 4:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bb29c00 2023-11-17T06:33:31.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55e90bb29800 0x55e90b84f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48c0ea700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x55e90bb29c00 0x55e90b84e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55e90bb29800 0x55e90b84f700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55e90bad6a80 tx=0x55e90c5c4300 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48c0ea700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x55e90bb29c00 0x55e90b84e100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55e90bc2a000 0x55e90b84db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:2 4.1f 4:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a000 2023-11-17T06:33:31.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55e90bc2a000 0x55e90b84db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.275+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55e90bc2a000 0x55e90b84db80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.279+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.279+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x55e90bc2a400 0x55e90b84d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.279+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:3 5.0 5:00000000::::head [pgnls-filter start_epoch 41 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc30000 con 0x55e90bc2a400 2023-11-17T06:33:31.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.279+0000 7fa48c0ea700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x55e90bc2a400 0x55e90b84d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.279+0000 7fa48c0ea700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x55e90bc2a400 0x55e90b84d600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.279+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.279+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:4 5.0 5:00000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc30380 con 0x55e90bc2a400 2023-11-17T06:33:31.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000061.00000000 2023-11-17T06:33:31.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000061.0 2023-11-17T06:33:31.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:5 5.0 5:0181e5f0:::10000000061.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc30700 con 0x55e90bc2a400 2023-11-17T06:33:31.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 3 ==== osd_op_reply(5 10000000061.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000061 2023-11-17T06:33:31.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/96 2023-11-17T06:33:31.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=96 2023-11-17T06:33:31.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x55e90bc2ac00 0x55e90bc3a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:6 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2ac00 2023-11-17T06:33:31.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.283+0000 7fa48b8e9700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x55e90bc2ac00 0x55e90bc3a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48b8e9700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x55e90bc2ac00 0x55e90bc3a000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 1 ==== osd_op_reply(6 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:7 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a000 2023-11-17T06:33:31.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 2 ==== osd_op_reply(7 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:8 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a000 2023-11-17T06:33:31.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 3 ==== osd_op_reply(8 10000000000.01000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-11-17T06:33:31.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.287+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:9 4.5 4:a40620de:::10000000000.01000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2a000 2023-11-17T06:33:31.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.291+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 4 ==== osd_op_reply(9 10000000000.01000000 [create,omap-set-header] v41'5 uv5 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.291+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-11-17T06:33:31.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.291+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:10 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.291+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 5 ==== osd_op_reply(10 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.291+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=96 frag=0*, r=0 2023-11-17T06:33:31.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.291+0000 7fa48d92e840 20 datascan.read_dentry: 96_head not found in result 2023-11-17T06:33:31.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.291+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000061 at 0x0x10000000000/96 with size=2 bytes 2023-11-17T06:33:31.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.291+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:11 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a000 2023-11-17T06:33:31.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 6 ==== osd_op_reply(11 10000000000.01000000 [omap-set-vals] v41'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/96 pointing to 0x0x10000000061 2023-11-17T06:33:31.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2023-11-17T06:33:31.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2023-11-17T06:33:31.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:12 4.1f 4:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2a000 2023-11-17T06:33:31.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 7 ==== osd_op_reply(12 1.00000000 [getxattr (30) out=30b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+30 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 4 datascan.get_frag_of: No backtrace on '1.00000000': cannot determine fragtree 2023-11-17T06:33:31.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2023-11-17T06:33:31.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:13 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 8 ==== osd_op_reply(13 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 6 2023-11-17T06:33:31.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x1 * 2023-11-17T06:33:31.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:14 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a000 2023-11-17T06:33:31.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 9 ==== osd_op_reply(14 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 20 datascan.inject_with_backtrace: Dentry 0x0x1/subdir already exists and points to me 2023-11-17T06:33:31.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:15 5.0 5:03de5254::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a400 2023-11-17T06:33:31.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 4 ==== osd_op_reply(15 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000054.00000000 2023-11-17T06:33:31.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000054.0 2023-11-17T06:33:31.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.295+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:16 5.0 5:03de5254:::10000000054.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a400 2023-11-17T06:33:31.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 5 ==== osd_op_reply(16 10000000054.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000054 2023-11-17T06:33:31.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/83 2023-11-17T06:33:31.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=83 2023-11-17T06:33:31.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:17 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2ac00 2023-11-17T06:33:31.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 2 ==== osd_op_reply(17 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:18 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 10 ==== osd_op_reply(18 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:19 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a000 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 11 ==== osd_op_reply(19 10000000000.01000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 6 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:20 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2a000 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 12 ==== osd_op_reply(20 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=83 frag=0*, r=0 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 20 datascan.read_dentry: 83_head not found in result 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000054 at 0x0x10000000000/83 with size=2 bytes 2023-11-17T06:33:31.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.299+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:21 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a000 2023-11-17T06:33:31.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.303+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 13 ==== osd_op_reply(21 10000000000.01000000 [omap-set-vals] v41'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.303+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/83 pointing to 0x0x10000000054 2023-11-17T06:33:31.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.303+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:22 5.20 5:04000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.303+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 14 ==== osd_op_reply(22 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.303+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000064.00000000 2023-11-17T06:33:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.303+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000064.0 2023-11-17T06:33:31.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.303+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:23 5.20 5:0699973a:::10000000064.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 15 ==== osd_op_reply(23 10000000064.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000064 2023-11-17T06:33:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/99 2023-11-17T06:33:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=99 2023-11-17T06:33:31.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:24 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2ac00 2023-11-17T06:33:31.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 3 ==== osd_op_reply(24 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:25 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a000 2023-11-17T06:33:31.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 16 ==== osd_op_reply(25 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x55e90bc2a800 0x55e90bc3a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:26 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a800 2023-11-17T06:33:31.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x55e90bc2a800 0x55e90bc3a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x55e90bc2a800 0x55e90bc3a580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 1 ==== osd_op_reply(26 10000000000.01800000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-11-17T06:33:31.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.307+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:27 4.1b 4:dcc776e0:::10000000000.01800000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a800 2023-11-17T06:33:31.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.311+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 2 ==== osd_op_reply(27 10000000000.01800000 [create,omap-set-header] v41'6 uv6 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.311+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-11-17T06:33:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.311+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:28 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2a800 2023-11-17T06:33:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.311+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 3 ==== osd_op_reply(28 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.311+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=99 frag=1*, r=0 2023-11-17T06:33:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.311+0000 7fa48d92e840 20 datascan.read_dentry: 99_head not found in result 2023-11-17T06:33:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.311+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000064 at 0x0x10000000000/99 with size=2 bytes 2023-11-17T06:33:31.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.311+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:29 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2a800 2023-11-17T06:33:31.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 4 ==== osd_op_reply(29 10000000000.01800000 [omap-set-vals] v41'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/99 pointing to 0x0x10000000064 2023-11-17T06:33:31.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2023-11-17T06:33:31.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2023-11-17T06:33:31.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:30 4.1f 4:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a000 2023-11-17T06:33:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 17 ==== osd_op_reply(30 1.00000000 [getxattr (30) out=30b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+30 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48d92e840 4 datascan.get_frag_of: No backtrace on '1.00000000': cannot determine fragtree 2023-11-17T06:33:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48d92e840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2023-11-17T06:33:31.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:31 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 18 ==== osd_op_reply(31 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 6 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x1 * 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.315+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:32 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a000 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 19 ==== osd_op_reply(32 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 20 datascan.inject_with_backtrace: Dentry 0x0x1/subdir already exists and points to me 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:33 5.20 5:072a8150::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 20 ==== osd_op_reply(33 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000001a.00000000 2023-11-17T06:33:31.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000001a.0 2023-11-17T06:33:31.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:34 5.20 5:072a8150:::1000000001a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a000 2023-11-17T06:33:31.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 21 ==== osd_op_reply(34 1000000001a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001a 2023-11-17T06:33:31.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/25 2023-11-17T06:33:31.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=25 2023-11-17T06:33:31.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:35 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc2ac00 2023-11-17T06:33:31.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 4 ==== osd_op_reply(35 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:36 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bc2a000 2023-11-17T06:33:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 22 ==== osd_op_reply(36 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:37 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bc2a800 2023-11-17T06:33:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 5 ==== osd_op_reply(37 10000000000.01800000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 7 2023-11-17T06:33:31.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.319+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:38 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a800 2023-11-17T06:33:31.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 6 ==== osd_op_reply(38 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=25 frag=1*, r=0 2023-11-17T06:33:31.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48d92e840 20 datascan.read_dentry: 25_head not found in result 2023-11-17T06:33:31.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001a at 0x0x10000000000/25 with size=2 bytes 2023-11-17T06:33:31.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:39 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a800 2023-11-17T06:33:31.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 7 ==== osd_op_reply(39 10000000000.01800000 [omap-set-vals] v41'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/25 pointing to 0x0x1000000001a 2023-11-17T06:33:31.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:40 5.10 5:08000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a800 2023-11-17T06:33:31.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 8 ==== osd_op_reply(40 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000014.00000000 2023-11-17T06:33:31.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000014.0 2023-11-17T06:33:31.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.323+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:41 5.10 5:0b7da9c3:::10000000014.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bc2a800 2023-11-17T06:33:31.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 9 ==== osd_op_reply(41 10000000014.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000014 2023-11-17T06:33:31.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/19 2023-11-17T06:33:31.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=19 2023-11-17T06:33:31.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:42 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59c00 con 0x55e90bc2ac00 2023-11-17T06:33:31.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 5 ==== osd_op_reply(42 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:43 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bc2a000 2023-11-17T06:33:31.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 23 ==== osd_op_reply(43 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:44 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bc2a000 2023-11-17T06:33:31.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 24 ==== osd_op_reply(44 10000000000.01000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 7 2023-11-17T06:33:31.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:45 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a000 2023-11-17T06:33:31.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 25 ==== osd_op_reply(45 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=19 frag=0*, r=0 2023-11-17T06:33:31.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 20 datascan.read_dentry: 19_head not found in result 2023-11-17T06:33:31.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000014 at 0x0x10000000000/19 with size=2 bytes 2023-11-17T06:33:31.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.327+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:46 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2a000 2023-11-17T06:33:31.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.331+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 26 ==== osd_op_reply(46 10000000000.01000000 [omap-set-vals] v41'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.331+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/19 pointing to 0x0x10000000014 2023-11-17T06:33:31.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.331+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x55e90bc2bc00 0x55e90bc3ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.331+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:47 5.30 5:0c000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2bc00 2023-11-17T06:33:31.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.331+0000 7fa48c0ea700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x55e90bc2bc00 0x55e90bc3ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.331+0000 7fa48c0ea700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x55e90bc2bc00 0x55e90bc3ab00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 1 ==== osd_op_reply(47 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000005c.00000000 2023-11-17T06:33:31.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000005c.0 2023-11-17T06:33:31.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:48 5.30 5:0cbf7f79:::1000000005c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2bc00 2023-11-17T06:33:31.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 2 ==== osd_op_reply(48 1000000005c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005c 2023-11-17T06:33:31.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/91 2023-11-17T06:33:31.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=91 2023-11-17T06:33:31.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:49 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2ac00 2023-11-17T06:33:31.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 6 ==== osd_op_reply(49 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:50 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2a000 2023-11-17T06:33:31.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 27 ==== osd_op_reply(50 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:51 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a800 2023-11-17T06:33:31.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 10 ==== osd_op_reply(51 10000000000.01800000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 8 2023-11-17T06:33:31.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.335+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:52 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2a800 2023-11-17T06:33:31.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 11 ==== osd_op_reply(52 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=91 frag=1*, r=0 2023-11-17T06:33:31.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48d92e840 20 datascan.read_dentry: 91_head not found in result 2023-11-17T06:33:31.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005c at 0x0x10000000000/91 with size=2 bytes 2023-11-17T06:33:31.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:53 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2a800 2023-11-17T06:33:31.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 12 ==== osd_op_reply(53 10000000000.01800000 [omap-set-vals] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/91 pointing to 0x0x1000000005c 2023-11-17T06:33:31.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:54 5.30 5:0d373645::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2bc00 2023-11-17T06:33:31.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 3 ==== osd_op_reply(54 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000062.00000000 2023-11-17T06:33:31.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000062.0 2023-11-17T06:33:31.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.339+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:55 5.30 5:0d373645:::10000000062.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2bc00 2023-11-17T06:33:31.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 4 ==== osd_op_reply(55 10000000062.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000062 2023-11-17T06:33:31.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/97 2023-11-17T06:33:31.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=97 2023-11-17T06:33:31.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:56 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2ac00 2023-11-17T06:33:31.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 7 ==== osd_op_reply(56 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:57 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a000 2023-11-17T06:33:31.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 28 ==== osd_op_reply(57 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:58 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a000 2023-11-17T06:33:31.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 29 ==== osd_op_reply(58 10000000000.01000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 8 2023-11-17T06:33:31.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:59 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59880 con 0x55e90bc2a000 2023-11-17T06:33:31.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 30 ==== osd_op_reply(59 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=97 frag=0*, r=0 2023-11-17T06:33:31.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 20 datascan.read_dentry: 97_head not found in result 2023-11-17T06:33:31.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000062 at 0x0x10000000000/97 with size=2 bytes 2023-11-17T06:33:31.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.343+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:60 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bc2a000 2023-11-17T06:33:31.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.347+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 31 ==== osd_op_reply(60 10000000000.01000000 [omap-set-vals] v41'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.347+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/97 pointing to 0x0x10000000062 2023-11-17T06:33:31.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.347+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:61 5.8 5:10000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bb29c00 2023-11-17T06:33:31.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.347+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 2 ==== osd_op_reply(61 [pgnls-filter start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.347+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000047.00000000 2023-11-17T06:33:31.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.347+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000047.0 2023-11-17T06:33:31.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.347+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:62 5.8 5:1044c7a4:::10000000047.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bb29c00 2023-11-17T06:33:31.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 3 ==== osd_op_reply(62 10000000047.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000047 2023-11-17T06:33:31.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/70 2023-11-17T06:33:31.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=70 2023-11-17T06:33:31.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:63 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2ac00 2023-11-17T06:33:31.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 8 ==== osd_op_reply(63 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:64 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a000 2023-11-17T06:33:31.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 32 ==== osd_op_reply(64 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:65 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a000 2023-11-17T06:33:31.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 33 ==== osd_op_reply(65 10000000000.01000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 9 2023-11-17T06:33:31.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:66 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a000 2023-11-17T06:33:31.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 34 ==== osd_op_reply(66 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=70 frag=0*, r=0 2023-11-17T06:33:31.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 20 datascan.read_dentry: 70_head not found in result 2023-11-17T06:33:31.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000047 at 0x0x10000000000/70 with size=2 bytes 2023-11-17T06:33:31.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.351+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:67 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 35 ==== osd_op_reply(67 10000000000.01000000 [omap-set-vals] v41'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/70 pointing to 0x0x10000000047 2023-11-17T06:33:31.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:68 5.8 5:12420646::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bb29c00 2023-11-17T06:33:31.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 4 ==== osd_op_reply(68 [pgnls-filter start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000003c.00000000 2023-11-17T06:33:31.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000003c.0 2023-11-17T06:33:31.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:69 5.8 5:12420646:::1000000003c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bb29c00 2023-11-17T06:33:31.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 5 ==== osd_op_reply(69 1000000003c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003c 2023-11-17T06:33:31.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/59 2023-11-17T06:33:31.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=59 2023-11-17T06:33:31.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.355+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:70 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2ac00 2023-11-17T06:33:31.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 9 ==== osd_op_reply(70 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:71 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a000 2023-11-17T06:33:31.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 36 ==== osd_op_reply(71 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:72 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a000 2023-11-17T06:33:31.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 37 ==== osd_op_reply(72 10000000000.01000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 10 2023-11-17T06:33:31.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:73 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a000 2023-11-17T06:33:31.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 38 ==== osd_op_reply(73 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=59 frag=0*, r=0 2023-11-17T06:33:31.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 20 datascan.read_dentry: 59_head not found in result 2023-11-17T06:33:31.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003c at 0x0x10000000000/59 with size=2 bytes 2023-11-17T06:33:31.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.359+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:74 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2a000 2023-11-17T06:33:31.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 39 ==== osd_op_reply(74 10000000000.01000000 [omap-set-vals] v41'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/59 pointing to 0x0x1000000003c 2023-11-17T06:33:31.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:75 5.8 5:12420902::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bb29c00 2023-11-17T06:33:31.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 6 ==== osd_op_reply(75 [pgnls-filter start_epoch 41 out=81b] v41'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000001b.00000000 2023-11-17T06:33:31.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000001b.0 2023-11-17T06:33:31.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:76 5.8 5:12420902:::1000000001b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bb29c00 2023-11-17T06:33:31.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 7 ==== osd_op_reply(76 1000000001b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001b 2023-11-17T06:33:31.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/26 2023-11-17T06:33:31.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=26 2023-11-17T06:33:31.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.363+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:77 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2ac00 2023-11-17T06:33:31.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 10 ==== osd_op_reply(77 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:78 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 40 ==== osd_op_reply(78 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:79 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a800 2023-11-17T06:33:31.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 13 ==== osd_op_reply(79 10000000000.01800000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 9 2023-11-17T06:33:31.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:80 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a800 2023-11-17T06:33:31.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 14 ==== osd_op_reply(80 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=26 frag=1*, r=0 2023-11-17T06:33:31.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 20 datascan.read_dentry: 26_head not found in result 2023-11-17T06:33:31.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001b at 0x0x10000000000/26 with size=2 bytes 2023-11-17T06:33:31.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.367+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:81 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59880 con 0x55e90bc2a800 2023-11-17T06:33:31.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 15 ==== osd_op_reply(81 10000000000.01800000 [omap-set-vals] v41'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/26 pointing to 0x0x1000000001b 2023-11-17T06:33:31.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:82 5.28 5:14000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bc2a800 2023-11-17T06:33:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 16 ==== osd_op_reply(82 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000056.00000000 2023-11-17T06:33:31.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000056.0 2023-11-17T06:33:31.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:83 5.28 5:166e0f51:::10000000056.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a800 2023-11-17T06:33:31.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 17 ==== osd_op_reply(83 10000000056.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000056 2023-11-17T06:33:31.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/85 2023-11-17T06:33:31.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=85 2023-11-17T06:33:31.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.371+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:84 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2ac00 2023-11-17T06:33:31.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 11 ==== osd_op_reply(84 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:85 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bc2a000 2023-11-17T06:33:31.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 41 ==== osd_op_reply(85 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:86 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bc2a000 2023-11-17T06:33:31.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 42 ==== osd_op_reply(86 10000000000.01000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 11 2023-11-17T06:33:31.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:87 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59c00 con 0x55e90bc2a000 2023-11-17T06:33:31.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 43 ==== osd_op_reply(87 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=85 frag=0*, r=0 2023-11-17T06:33:31.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 20 datascan.read_dentry: 85_head not found in result 2023-11-17T06:33:31.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000056 at 0x0x10000000000/85 with size=2 bytes 2023-11-17T06:33:31.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.375+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:88 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc2a000 2023-11-17T06:33:31.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.379+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 44 ==== osd_op_reply(88 10000000000.01000000 [omap-set-vals] v41'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.379+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/85 pointing to 0x0x10000000056 2023-11-17T06:33:31.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.379+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x55e90bc65000 0x55e90bc3b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.379+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:89 5.18 5:18000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc65000 2023-11-17T06:33:31.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.379+0000 7fa48b8e9700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x55e90bc65000 0x55e90bc3b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.379+0000 7fa48b8e9700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x55e90bc65000 0x55e90bc3b080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.379+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 1 ==== osd_op_reply(89 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.379+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000029.00000000 2023-11-17T06:33:31.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000029.0 2023-11-17T06:33:31.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:90 5.18 5:19311010:::10000000029.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc65000 2023-11-17T06:33:31.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 2 ==== osd_op_reply(90 10000000029.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000029 2023-11-17T06:33:31.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/40 2023-11-17T06:33:31.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=40 2023-11-17T06:33:31.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:91 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bc2ac00 2023-11-17T06:33:31.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 12 ==== osd_op_reply(91 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:92 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bc2a000 2023-11-17T06:33:31.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 45 ==== osd_op_reply(92 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:93 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a800 2023-11-17T06:33:31.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 18 ==== osd_op_reply(93 10000000000.01800000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 10 2023-11-17T06:33:31.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:94 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2a800 2023-11-17T06:33:31.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 19 ==== osd_op_reply(94 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=40 frag=1*, r=0 2023-11-17T06:33:31.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 20 datascan.read_dentry: 40_head not found in result 2023-11-17T06:33:31.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000029 at 0x0x10000000000/40 with size=2 bytes 2023-11-17T06:33:31.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.383+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:95 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a800 2023-11-17T06:33:31.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.387+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 20 ==== osd_op_reply(95 10000000000.01800000 [omap-set-vals] v41'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.387+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/40 pointing to 0x0x10000000029 2023-11-17T06:33:31.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.387+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:96 5.18 5:1ae6cdf3::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc65000 2023-11-17T06:33:31.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.387+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 3 ==== osd_op_reply(96 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.387+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000005a.00000000 2023-11-17T06:33:31.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.387+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000005a.0 2023-11-17T06:33:31.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.387+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:97 5.18 5:1ae6cdf3:::1000000005a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc65000 2023-11-17T06:33:31.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 4 ==== osd_op_reply(97 1000000005a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005a 2023-11-17T06:33:31.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/89 2023-11-17T06:33:31.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=89 2023-11-17T06:33:31.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:98 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2ac00 2023-11-17T06:33:31.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 13 ==== osd_op_reply(98 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:99 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59880 con 0x55e90bc2a000 2023-11-17T06:33:31.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 46 ==== osd_op_reply(99 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:100 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a800 2023-11-17T06:33:31.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 21 ==== osd_op_reply(100 10000000000.01800000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 11 2023-11-17T06:33:31.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:101 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bc2a800 2023-11-17T06:33:31.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 22 ==== osd_op_reply(101 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=89 frag=1*, r=0 2023-11-17T06:33:31.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 20 datascan.read_dentry: 89_head not found in result 2023-11-17T06:33:31.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005a at 0x0x10000000000/89 with size=2 bytes 2023-11-17T06:33:31.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.391+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:102 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a800 2023-11-17T06:33:31.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.395+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 23 ==== osd_op_reply(102 10000000000.01800000 [omap-set-vals] v41'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.395+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/89 pointing to 0x0x1000000005a 2023-11-17T06:33:31.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.395+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:103 5.38 5:1c000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a800 2023-11-17T06:33:31.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.395+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 24 ==== osd_op_reply(103 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.395+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000035.00000000 2023-11-17T06:33:31.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.395+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000035.0 2023-11-17T06:33:31.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.395+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:104 5.38 5:1e1620c8:::10000000035.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2a800 2023-11-17T06:33:31.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 25 ==== osd_op_reply(104 10000000035.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000035 2023-11-17T06:33:31.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/52 2023-11-17T06:33:31.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=52 2023-11-17T06:33:31.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:105 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bc2ac00 2023-11-17T06:33:31.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 14 ==== osd_op_reply(105 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:106 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a000 2023-11-17T06:33:31.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 47 ==== osd_op_reply(106 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:107 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a000 2023-11-17T06:33:31.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 48 ==== osd_op_reply(107 10000000000.01000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 12 2023-11-17T06:33:31.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.399+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:108 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc2a000 2023-11-17T06:33:31.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 49 ==== osd_op_reply(108 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=52 frag=0*, r=0 2023-11-17T06:33:31.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48d92e840 20 datascan.read_dentry: 52_head not found in result 2023-11-17T06:33:31.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000035 at 0x0x10000000000/52 with size=2 bytes 2023-11-17T06:33:31.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:109 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2a000 2023-11-17T06:33:31.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 50 ==== osd_op_reply(109 10000000000.01000000 [omap-set-vals] v41'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/52 pointing to 0x0x10000000035 2023-11-17T06:33:31.409 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:110 5.38 5:1e20cbdb::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2a800 2023-11-17T06:33:31.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 26 ==== osd_op_reply(110 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000016.00000000 2023-11-17T06:33:31.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000016.0 2023-11-17T06:33:31.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.403+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:111 5.38 5:1e20cbdb:::10000000016.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7dc00 con 0x55e90bc2a800 2023-11-17T06:33:31.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 27 ==== osd_op_reply(111 10000000016.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000016 2023-11-17T06:33:31.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/21 2023-11-17T06:33:31.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=21 2023-11-17T06:33:31.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:112 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2ac00 2023-11-17T06:33:31.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 15 ==== osd_op_reply(112 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:113 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a000 2023-11-17T06:33:31.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 51 ==== osd_op_reply(113 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:114 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a000 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 52 ==== osd_op_reply(114 10000000000.01000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 13 2023-11-17T06:33:31.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:115 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a000 2023-11-17T06:33:31.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 53 ==== osd_op_reply(115 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=21 frag=0*, r=0 2023-11-17T06:33:31.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 20 datascan.read_dentry: 21_head not found in result 2023-11-17T06:33:31.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000016 at 0x0x10000000000/21 with size=2 bytes 2023-11-17T06:33:31.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.407+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:116 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.411+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 54 ==== osd_op_reply(116 10000000000.01000000 [omap-set-vals] v41'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.411+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/21 pointing to 0x0x10000000016 2023-11-17T06:33:31.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.411+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:117 5.4 5:20000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2bc00 2023-11-17T06:33:31.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.411+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 5 ==== osd_op_reply(117 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.411+0000 7fa4870e0700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:118 5.24 5:24000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc2a800 2023-11-17T06:33:31.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.411+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 28 ==== osd_op_reply(118 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.411+0000 7fa4878e1700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:119 5.14 5:28000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bc2a400 2023-11-17T06:33:31.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 6 ==== osd_op_reply(119 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000025.00000000 2023-11-17T06:33:31.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000025.0 2023-11-17T06:33:31.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:120 5.14 5:2a40c2ef:::10000000025.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a400 2023-11-17T06:33:31.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 7 ==== osd_op_reply(120 10000000025.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000025 2023-11-17T06:33:31.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/36 2023-11-17T06:33:31.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=36 2023-11-17T06:33:31.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:121 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2ac00 2023-11-17T06:33:31.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 16 ==== osd_op_reply(121 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:122 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a000 2023-11-17T06:33:31.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 55 ==== osd_op_reply(122 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:123 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a000 2023-11-17T06:33:31.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 56 ==== osd_op_reply(123 10000000000.01000000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 14 2023-11-17T06:33:31.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.415+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:124 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc2a000 2023-11-17T06:33:31.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.419+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 57 ==== osd_op_reply(124 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.419+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=36 frag=0*, r=0 2023-11-17T06:33:31.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.419+0000 7fa48d92e840 20 datascan.read_dentry: 36_head not found in result 2023-11-17T06:33:31.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.419+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000025 at 0x0x10000000000/36 with size=2 bytes 2023-11-17T06:33:31.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.419+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:125 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bc2a000 2023-11-17T06:33:31.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.419+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 58 ==== osd_op_reply(125 10000000000.01000000 [omap-set-vals] v41'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.419+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/36 pointing to 0x0x10000000025 2023-11-17T06:33:31.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.419+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:126 5.14 5:2b0a3bc5::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a400 2023-11-17T06:33:31.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 8 ==== osd_op_reply(126 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000058.00000000 2023-11-17T06:33:31.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000058.0 2023-11-17T06:33:31.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:127 5.14 5:2b0a3bc5:::10000000058.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a400 2023-11-17T06:33:31.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 9 ==== osd_op_reply(127 10000000058.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000058 2023-11-17T06:33:31.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/87 2023-11-17T06:33:31.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=87 2023-11-17T06:33:31.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:128 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bc2ac00 2023-11-17T06:33:31.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 17 ==== osd_op_reply(128 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:129 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59880 con 0x55e90bc2a000 2023-11-17T06:33:31.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 59 ==== osd_op_reply(129 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.423+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:130 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59c00 con 0x55e90bc2a000 2023-11-17T06:33:31.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 60 ==== osd_op_reply(130 10000000000.01000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 15 2023-11-17T06:33:31.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:131 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a000 2023-11-17T06:33:31.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 61 ==== osd_op_reply(131 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=87 frag=0*, r=0 2023-11-17T06:33:31.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48d92e840 20 datascan.read_dentry: 87_head not found in result 2023-11-17T06:33:31.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000058 at 0x0x10000000000/87 with size=2 bytes 2023-11-17T06:33:31.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:132 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a000 2023-11-17T06:33:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 62 ==== osd_op_reply(132 10000000000.01000000 [omap-set-vals] v41'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/87 pointing to 0x0x10000000058 2023-11-17T06:33:31.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.427+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:133 5.34 5:2c000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc65000 2023-11-17T06:33:31.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 5 ==== osd_op_reply(133 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000009.00000000 2023-11-17T06:33:31.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000009.0 2023-11-17T06:33:31.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:134 5.34 5:2eb4da2b:::10000000009.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc65000 2023-11-17T06:33:31.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 6 ==== osd_op_reply(134 10000000009.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000009 2023-11-17T06:33:31.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/8 2023-11-17T06:33:31.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=8 2023-11-17T06:33:31.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:135 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2ac00 2023-11-17T06:33:31.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 18 ==== osd_op_reply(135 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:136 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a000 2023-11-17T06:33:31.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 63 ==== osd_op_reply(136 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:137 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a000 2023-11-17T06:33:31.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 64 ==== osd_op_reply(137 10000000000.01000000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 16 2023-11-17T06:33:31.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.431+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:138 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc2a000 2023-11-17T06:33:31.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.435+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 65 ==== osd_op_reply(138 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.435+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=8 frag=0*, r=0 2023-11-17T06:33:31.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.435+0000 7fa48d92e840 20 datascan.read_dentry: 8_head not found in result 2023-11-17T06:33:31.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.435+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000009 at 0x0x10000000000/8 with size=1 bytes 2023-11-17T06:33:31.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.435+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:139 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2a000 2023-11-17T06:33:31.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.435+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 66 ==== osd_op_reply(139 10000000000.01000000 [omap-set-vals] v41'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.435+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/8 pointing to 0x0x10000000009 2023-11-17T06:33:31.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.435+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:140 5.c 5:30000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2a400 2023-11-17T06:33:31.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 10 ==== osd_op_reply(140 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa4878e1700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:141 5.2c 5:34000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88000 con 0x55e90bb29c00 2023-11-17T06:33:31.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 8 ==== osd_op_reply(141 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000005f.00000000 2023-11-17T06:33:31.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000005f.0 2023-11-17T06:33:31.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:142 5.2c 5:34658595:::1000000005f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bb29c00 2023-11-17T06:33:31.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 9 ==== osd_op_reply(142 1000000005f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005f 2023-11-17T06:33:31.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/94 2023-11-17T06:33:31.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=94 2023-11-17T06:33:31.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.439+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:143 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88000 con 0x55e90bc2ac00 2023-11-17T06:33:31.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 19 ==== osd_op_reply(143 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:144 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88700 con 0x55e90bc2a000 2023-11-17T06:33:31.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 67 ==== osd_op_reply(144 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:145 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88a80 con 0x55e90bc2a800 2023-11-17T06:33:31.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 29 ==== osd_op_reply(145 10000000000.01800000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 12 2023-11-17T06:33:31.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:146 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88e00 con 0x55e90bc2a800 2023-11-17T06:33:31.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 30 ==== osd_op_reply(146 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=94 frag=1*, r=0 2023-11-17T06:33:31.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 20 datascan.read_dentry: 94_head not found in result 2023-11-17T06:33:31.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005f at 0x0x10000000000/94 with size=2 bytes 2023-11-17T06:33:31.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.443+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:147 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bc2a800 2023-11-17T06:33:31.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.447+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 31 ==== osd_op_reply(147 10000000000.01800000 [omap-set-vals] v41'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.447+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/94 pointing to 0x0x1000000005f 2023-11-17T06:33:31.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.447+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:148 5.2c 5:3665eb52::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89500 con 0x55e90bb29c00 2023-11-17T06:33:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 10 ==== osd_op_reply(148 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000003e.00000000 2023-11-17T06:33:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000003e.0 2023-11-17T06:33:31.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:149 5.2c 5:3665eb52:::1000000003e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89880 con 0x55e90bb29c00 2023-11-17T06:33:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 11 ==== osd_op_reply(149 1000000003e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003e 2023-11-17T06:33:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/61 2023-11-17T06:33:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=61 2023-11-17T06:33:31.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:150 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2ac00 2023-11-17T06:33:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 20 ==== osd_op_reply(150 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:151 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a000 2023-11-17T06:33:31.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 68 ==== osd_op_reply(151 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.451+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:152 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a000 2023-11-17T06:33:31.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.455+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 69 ==== osd_op_reply(152 10000000000.01000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.455+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 17 2023-11-17T06:33:31.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.455+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.455+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:153 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a000 2023-11-17T06:33:31.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.455+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 70 ==== osd_op_reply(153 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.455+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=61 frag=0*, r=0 2023-11-17T06:33:31.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.455+0000 7fa48d92e840 20 datascan.read_dentry: 61_head not found in result 2023-11-17T06:33:31.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.455+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003e at 0x0x10000000000/61 with size=2 bytes 2023-11-17T06:33:31.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.455+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:154 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bc2a000 2023-11-17T06:33:31.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.459+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 71 ==== osd_op_reply(154 10000000000.01000000 [omap-set-vals] v41'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.459+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/61 pointing to 0x0x1000000003e 2023-11-17T06:33:31.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.459+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:155 5.1c 5:38000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a800 2023-11-17T06:33:31.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.459+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 32 ==== osd_op_reply(155 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.459+0000 7fa4870e0700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x55e90bb29400 0x55e90bc3c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:31.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.459+0000 7fa4870e0700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:156 5.3c 5:3c000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bb29400 2023-11-17T06:33:31.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.459+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x55e90bb29400 0x55e90bc3c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:31.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.459+0000 7fa48c8eb700 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x55e90bb29400 0x55e90bc3c680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:31.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 1 ==== osd_op_reply(156 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000003b.00000000 2023-11-17T06:33:31.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000003b.0 2023-11-17T06:33:31.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:157 5.3c 5:3c3d7520:::1000000003b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bb29400 2023-11-17T06:33:31.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 2 ==== osd_op_reply(157 1000000003b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003b 2023-11-17T06:33:31.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/58 2023-11-17T06:33:31.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=58 2023-11-17T06:33:31.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:158 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2ac00 2023-11-17T06:33:31.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 21 ==== osd_op_reply(158 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:159 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88000 con 0x55e90bc2a000 2023-11-17T06:33:31.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 72 ==== osd_op_reply(159 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.463+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:160 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88700 con 0x55e90bc2a800 2023-11-17T06:33:31.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 33 ==== osd_op_reply(160 10000000000.01800000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 13 2023-11-17T06:33:31.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:161 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88a80 con 0x55e90bc2a800 2023-11-17T06:33:31.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 34 ==== osd_op_reply(161 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=58 frag=1*, r=0 2023-11-17T06:33:31.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48d92e840 20 datascan.read_dentry: 58_head not found in result 2023-11-17T06:33:31.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003b at 0x0x10000000000/58 with size=2 bytes 2023-11-17T06:33:31.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.467+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:162 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88e00 con 0x55e90bc2a800 2023-11-17T06:33:31.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 35 ==== osd_op_reply(162 10000000000.01800000 [omap-set-vals] v41'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/58 pointing to 0x0x1000000003b 2023-11-17T06:33:31.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:163 5.3c 5:3d4c06c4::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bb29400 2023-11-17T06:33:31.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 3 ==== osd_op_reply(163 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000002a.00000000 2023-11-17T06:33:31.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000002a.0 2023-11-17T06:33:31.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:164 5.3c 5:3d4c06c4:::1000000002a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bb29400 2023-11-17T06:33:31.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 4 ==== osd_op_reply(164 1000000002a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002a 2023-11-17T06:33:31.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/41 2023-11-17T06:33:31.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=41 2023-11-17T06:33:31.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:165 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2ac00 2023-11-17T06:33:31.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.471+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 22 ==== osd_op_reply(165 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:166 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a000 2023-11-17T06:33:31.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 73 ==== osd_op_reply(166 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:167 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a800 2023-11-17T06:33:31.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 36 ==== osd_op_reply(167 10000000000.01800000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 14 2023-11-17T06:33:31.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:168 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc2a800 2023-11-17T06:33:31.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 37 ==== osd_op_reply(168 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=41 frag=1*, r=0 2023-11-17T06:33:31.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 20 datascan.read_dentry: 41_head not found in result 2023-11-17T06:33:31.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002a at 0x0x10000000000/41 with size=2 bytes 2023-11-17T06:33:31.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.475+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:169 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2a800 2023-11-17T06:33:31.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.479+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 38 ==== osd_op_reply(169 10000000000.01800000 [omap-set-vals] v41'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.479+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/41 pointing to 0x0x1000000002a 2023-11-17T06:33:31.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.479+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:170 5.2 5:40000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2bc00 2023-11-17T06:33:31.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.479+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 6 ==== osd_op_reply(170 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.479+0000 7fa4878e1700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:171 5.22 5:44000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88380 con 0x55e90bc2bc00 2023-11-17T06:33:31.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.479+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 7 ==== osd_op_reply(171 [pgnls-filter start_epoch 41 out=101b] v41'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.479+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000039.00000000 2023-11-17T06:33:31.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.479+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000039.0 2023-11-17T06:33:31.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.479+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:172 5.22 5:44135715:::10000000039.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2bc00 2023-11-17T06:33:31.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 8 ==== osd_op_reply(172 10000000039.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000039 2023-11-17T06:33:31.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/56 2023-11-17T06:33:31.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=56 2023-11-17T06:33:31.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:173 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2ac00 2023-11-17T06:33:31.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 23 ==== osd_op_reply(173 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:174 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a000 2023-11-17T06:33:31.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 74 ==== osd_op_reply(174 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:175 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a800 2023-11-17T06:33:31.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 39 ==== osd_op_reply(175 10000000000.01800000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 15 2023-11-17T06:33:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:176 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a800 2023-11-17T06:33:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 40 ==== osd_op_reply(176 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=56 frag=1*, r=0 2023-11-17T06:33:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 20 datascan.read_dentry: 56_head not found in result 2023-11-17T06:33:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000039 at 0x0x10000000000/56 with size=2 bytes 2023-11-17T06:33:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.483+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:177 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bc2a800 2023-11-17T06:33:31.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.487+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 41 ==== osd_op_reply(177 10000000000.01800000 [omap-set-vals] v41'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.487+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/56 pointing to 0x0x10000000039 2023-11-17T06:33:31.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.487+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:178 5.22 5:44834937::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59880 con 0x55e90bc2bc00 2023-11-17T06:33:31.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.487+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 9 ==== osd_op_reply(178 [pgnls-filter start_epoch 41 out=101b] v41'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.487+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000013.00000000 2023-11-17T06:33:31.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.487+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000013.0 2023-11-17T06:33:31.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:179 5.22 5:44834937:::10000000013.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59c00 con 0x55e90bc2bc00 2023-11-17T06:33:31.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 10 ==== osd_op_reply(179 10000000013.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000013 2023-11-17T06:33:31.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/18 2023-11-17T06:33:31.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=18 2023-11-17T06:33:31.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:180 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2ac00 2023-11-17T06:33:31.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 24 ==== osd_op_reply(180 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:181 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a000 2023-11-17T06:33:31.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 75 ==== osd_op_reply(181 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:182 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88000 con 0x55e90bc2a800 2023-11-17T06:33:31.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 42 ==== osd_op_reply(182 10000000000.01800000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 16 2023-11-17T06:33:31.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.491+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:183 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88700 con 0x55e90bc2a800 2023-11-17T06:33:31.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.495+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 43 ==== osd_op_reply(183 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.495+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=18 frag=1*, r=0 2023-11-17T06:33:31.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.495+0000 7fa48d92e840 20 datascan.read_dentry: 18_head not found in result 2023-11-17T06:33:31.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.495+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000013 at 0x0x10000000000/18 with size=2 bytes 2023-11-17T06:33:31.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.495+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:184 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88a80 con 0x55e90bc2a800 2023-11-17T06:33:31.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.495+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 44 ==== osd_op_reply(184 10000000000.01800000 [omap-set-vals] v41'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.495+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/18 pointing to 0x0x10000000013 2023-11-17T06:33:31.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.495+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:185 5.22 5:4503a7ea::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88e00 con 0x55e90bc2bc00 2023-11-17T06:33:31.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 11 ==== osd_op_reply(185 [pgnls-filter start_epoch 41 out=101b] v41'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000020.00000000 2023-11-17T06:33:31.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000020.0 2023-11-17T06:33:31.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:186 5.22 5:4503a7ea:::10000000020.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bc2bc00 2023-11-17T06:33:31.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 12 ==== osd_op_reply(186 10000000020.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000020 2023-11-17T06:33:31.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/31 2023-11-17T06:33:31.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=31 2023-11-17T06:33:31.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:187 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2ac00 2023-11-17T06:33:31.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 25 ==== osd_op_reply(187 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:188 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2a000 2023-11-17T06:33:31.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 76 ==== osd_op_reply(188 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.499+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:189 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a000 2023-11-17T06:33:31.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 77 ==== osd_op_reply(189 10000000000.01000000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 18 2023-11-17T06:33:31.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:190 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a000 2023-11-17T06:33:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 78 ==== osd_op_reply(190 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=31 frag=0*, r=0 2023-11-17T06:33:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48d92e840 20 datascan.read_dentry: 31_head not found in result 2023-11-17T06:33:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000020 at 0x0x10000000000/31 with size=2 bytes 2023-11-17T06:33:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:191 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a000 2023-11-17T06:33:31.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 79 ==== osd_op_reply(191 10000000000.01000000 [omap-set-vals] v41'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/31 pointing to 0x0x10000000020 2023-11-17T06:33:31.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.503+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:192 5.22 5:45d72e17::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bc2bc00 2023-11-17T06:33:31.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 13 ==== osd_op_reply(192 [pgnls-filter start_epoch 41 out=101b] v41'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000000a.00000000 2023-11-17T06:33:31.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000000a.0 2023-11-17T06:33:31.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:193 5.22 5:45d72e17:::1000000000a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bc2bc00 2023-11-17T06:33:31.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 14 ==== osd_op_reply(193 1000000000a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000a 2023-11-17T06:33:31.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/9 2023-11-17T06:33:31.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=9 2023-11-17T06:33:31.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:194 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bc2ac00 2023-11-17T06:33:31.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 26 ==== osd_op_reply(194 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:195 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2a000 2023-11-17T06:33:31.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 80 ==== osd_op_reply(195 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:196 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59880 con 0x55e90bc2a000 2023-11-17T06:33:31.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 81 ==== osd_op_reply(196 10000000000.01000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-11-17T06:33:31.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.507+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:197 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 82 ==== osd_op_reply(197 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=9 frag=0*, r=0 2023-11-17T06:33:31.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48d92e840 20 datascan.read_dentry: 9_head not found in result 2023-11-17T06:33:31.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000a at 0x0x10000000000/9 with size=1 bytes 2023-11-17T06:33:31.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:198 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 83 ==== osd_op_reply(198 10000000000.01000000 [omap-set-vals] v41'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/9 pointing to 0x0x1000000000a 2023-11-17T06:33:31.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:199 5.22 5:46cca9ab::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2bc00 2023-11-17T06:33:31.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 15 ==== osd_op_reply(199 [pgnls-filter start_epoch 41 out=81b] v41'15 uv15 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000000c.00000000 2023-11-17T06:33:31.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000000c.0 2023-11-17T06:33:31.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.511+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:200 5.22 5:46cca9ab:::1000000000c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89500 con 0x55e90bc2bc00 2023-11-17T06:33:31.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 16 ==== osd_op_reply(200 1000000000c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000c 2023-11-17T06:33:31.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/11 2023-11-17T06:33:31.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=11 2023-11-17T06:33:31.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:201 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89880 con 0x55e90bc2ac00 2023-11-17T06:33:31.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 27 ==== osd_op_reply(201 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:202 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88380 con 0x55e90bc2a000 2023-11-17T06:33:31.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 84 ==== osd_op_reply(202 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:203 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bc2a000 2023-11-17T06:33:31.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 85 ==== osd_op_reply(203 10000000000.01000000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 20 2023-11-17T06:33:31.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:204 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a000 2023-11-17T06:33:31.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 86 ==== osd_op_reply(204 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=11 frag=0*, r=0 2023-11-17T06:33:31.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 20 datascan.read_dentry: 11_head not found in result 2023-11-17T06:33:31.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000c at 0x0x10000000000/11 with size=2 bytes 2023-11-17T06:33:31.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.515+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:205 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a000 2023-11-17T06:33:31.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.519+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 87 ==== osd_op_reply(205 10000000000.01000000 [omap-set-vals] v41'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.519+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/11 pointing to 0x0x1000000000c 2023-11-17T06:33:31.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.519+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:206 5.12 5:48000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bb29c00 2023-11-17T06:33:31.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.519+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 12 ==== osd_op_reply(206 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.519+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000048.00000000 2023-11-17T06:33:31.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.519+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000048.0 2023-11-17T06:33:31.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.519+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:207 5.12 5:4899516f:::10000000048.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59880 con 0x55e90bb29c00 2023-11-17T06:33:31.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 13 ==== osd_op_reply(207 10000000048.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000048 2023-11-17T06:33:31.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/71 2023-11-17T06:33:31.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=71 2023-11-17T06:33:31.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:208 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc2ac00 2023-11-17T06:33:31.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 28 ==== osd_op_reply(208 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:209 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2a000 2023-11-17T06:33:31.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 88 ==== osd_op_reply(209 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:210 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a800 2023-11-17T06:33:31.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 45 ==== osd_op_reply(210 10000000000.01800000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 17 2023-11-17T06:33:31.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:211 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2a800 2023-11-17T06:33:31.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 46 ==== osd_op_reply(211 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=71 frag=1*, r=0 2023-11-17T06:33:31.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 20 datascan.read_dentry: 71_head not found in result 2023-11-17T06:33:31.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000048 at 0x0x10000000000/71 with size=2 bytes 2023-11-17T06:33:31.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.523+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:212 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a800 2023-11-17T06:33:31.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.527+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 47 ==== osd_op_reply(212 10000000000.01800000 [omap-set-vals] v41'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.527+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/71 pointing to 0x0x10000000048 2023-11-17T06:33:31.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.527+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:213 5.12 5:49e35fbc::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bb29c00 2023-11-17T06:33:31.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.527+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 14 ==== osd_op_reply(213 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.527+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000000f.00000000 2023-11-17T06:33:31.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.527+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000000f.0 2023-11-17T06:33:31.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.527+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:214 5.12 5:49e35fbc:::1000000000f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88000 con 0x55e90bb29c00 2023-11-17T06:33:31.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 15 ==== osd_op_reply(214 1000000000f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000f 2023-11-17T06:33:31.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/14 2023-11-17T06:33:31.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=14 2023-11-17T06:33:31.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:215 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88a80 con 0x55e90bc2ac00 2023-11-17T06:33:31.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 29 ==== osd_op_reply(215 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:216 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a000 2023-11-17T06:33:31.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 89 ==== osd_op_reply(216 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:217 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a800 2023-11-17T06:33:31.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 48 ==== osd_op_reply(217 10000000000.01800000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 18 2023-11-17T06:33:31.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:218 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7dc00 con 0x55e90bc2a800 2023-11-17T06:33:31.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 49 ==== osd_op_reply(218 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=14 frag=1*, r=0 2023-11-17T06:33:31.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 20 datascan.read_dentry: 14_head not found in result 2023-11-17T06:33:31.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000f at 0x0x10000000000/14 with size=2 bytes 2023-11-17T06:33:31.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.531+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:219 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a800 2023-11-17T06:33:31.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 50 ==== osd_op_reply(219 10000000000.01800000 [omap-set-vals] v41'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/14 pointing to 0x0x1000000000f 2023-11-17T06:33:31.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:220 5.12 5:49ffa098::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59c00 con 0x55e90bb29c00 2023-11-17T06:33:31.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 16 ==== osd_op_reply(220 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000002e.00000000 2023-11-17T06:33:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000002e.0 2023-11-17T06:33:31.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:221 5.12 5:49ffa098:::1000000002e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bb29c00 2023-11-17T06:33:31.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 17 ==== osd_op_reply(221 1000000002e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002e 2023-11-17T06:33:31.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/45 2023-11-17T06:33:31.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=45 2023-11-17T06:33:31.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:222 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2ac00 2023-11-17T06:33:31.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 30 ==== osd_op_reply(222 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:223 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88e00 con 0x55e90bc2a000 2023-11-17T06:33:31.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 90 ==== osd_op_reply(223 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.535+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:224 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bc2a800 2023-11-17T06:33:31.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 51 ==== osd_op_reply(224 10000000000.01800000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-11-17T06:33:31.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:225 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89c00 con 0x55e90bc2a800 2023-11-17T06:33:31.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 52 ==== osd_op_reply(225 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=45 frag=1*, r=0 2023-11-17T06:33:31.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48d92e840 20 datascan.read_dentry: 45_head not found in result 2023-11-17T06:33:31.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002e at 0x0x10000000000/45 with size=2 bytes 2023-11-17T06:33:31.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:226 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89500 con 0x55e90bc2a800 2023-11-17T06:33:31.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 53 ==== osd_op_reply(226 10000000000.01800000 [omap-set-vals] v41'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/45 pointing to 0x0x1000000002e 2023-11-17T06:33:31.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.539+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:227 5.12 5:4bec3886::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bb29c00 2023-11-17T06:33:31.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 18 ==== osd_op_reply(227 [pgnls-filter start_epoch 41 out=81b] v41'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000002.00000000 2023-11-17T06:33:31.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000002.0 2023-11-17T06:33:31.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:228 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bb29c00 2023-11-17T06:33:31.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 19 ==== osd_op_reply(228 10000000002.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000002 2023-11-17T06:33:31.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/1 2023-11-17T06:33:31.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=1 2023-11-17T06:33:31.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:229 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2ac00 2023-11-17T06:33:31.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 31 ==== osd_op_reply(229 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:230 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a000 2023-11-17T06:33:31.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 91 ==== osd_op_reply(230 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:231 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a000 2023-11-17T06:33:31.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 92 ==== osd_op_reply(231 10000000000.01000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 21 2023-11-17T06:33:31.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.543+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:232 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88380 con 0x55e90bc2a000 2023-11-17T06:33:31.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.547+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 93 ==== osd_op_reply(232 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.547+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=1 frag=0*, r=0 2023-11-17T06:33:31.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.547+0000 7fa48d92e840 20 datascan.read_dentry: 1_head not found in result 2023-11-17T06:33:31.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.547+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000002 at 0x0x10000000000/1 with size=1 bytes 2023-11-17T06:33:31.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.547+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:233 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88e00 con 0x55e90bc2a000 2023-11-17T06:33:31.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.547+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 94 ==== osd_op_reply(233 10000000000.01000000 [omap-set-vals] v41'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.547+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/1 pointing to 0x0x10000000002 2023-11-17T06:33:31.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.547+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:234 5.32 5:4c000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bb29400 2023-11-17T06:33:31.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 5 ==== osd_op_reply(234 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000055.00000000 2023-11-17T06:33:31.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000055.0 2023-11-17T06:33:31.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:235 5.32 5:4d757255:::10000000055.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89c00 con 0x55e90bb29400 2023-11-17T06:33:31.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 6 ==== osd_op_reply(235 10000000055.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000055 2023-11-17T06:33:31.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/84 2023-11-17T06:33:31.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=84 2023-11-17T06:33:31.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:236 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89880 con 0x55e90bc2ac00 2023-11-17T06:33:31.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 32 ==== osd_op_reply(236 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:237 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88a80 con 0x55e90bc2a000 2023-11-17T06:33:31.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 95 ==== osd_op_reply(237 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:238 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 96 ==== osd_op_reply(238 10000000000.01000000 [omap-get-header out=274b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 22 2023-11-17T06:33:31.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.551+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:239 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.555+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 97 ==== osd_op_reply(239 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.555+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=84 frag=0*, r=0 2023-11-17T06:33:31.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.555+0000 7fa48d92e840 20 datascan.read_dentry: 84_head not found in result 2023-11-17T06:33:31.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.555+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000055 at 0x0x10000000000/84 with size=2 bytes 2023-11-17T06:33:31.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.555+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:240 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a000 2023-11-17T06:33:31.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.555+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 98 ==== osd_op_reply(240 10000000000.01000000 [omap-set-vals] v41'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.555+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/84 pointing to 0x0x10000000055 2023-11-17T06:33:31.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.555+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:241 5.32 5:4def72d4::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bb29400 2023-11-17T06:33:31.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 7 ==== osd_op_reply(241 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000003.00000000 2023-11-17T06:33:31.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000003.0 2023-11-17T06:33:31.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:242 5.32 5:4def72d4:::10000000003.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bb29400 2023-11-17T06:33:31.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 8 ==== osd_op_reply(242 10000000003.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000003 2023-11-17T06:33:31.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/2 2023-11-17T06:33:31.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=2 2023-11-17T06:33:31.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:243 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2ac00 2023-11-17T06:33:31.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 33 ==== osd_op_reply(243 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:244 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a000 2023-11-17T06:33:31.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 99 ==== osd_op_reply(244 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:245 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2a000 2023-11-17T06:33:31.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 100 ==== osd_op_reply(245 10000000000.01000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 23 2023-11-17T06:33:31.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.559+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:246 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2a000 2023-11-17T06:33:31.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.563+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 101 ==== osd_op_reply(246 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.563+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=2 frag=0*, r=0 2023-11-17T06:33:31.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.563+0000 7fa48d92e840 20 datascan.read_dentry: 2_head not found in result 2023-11-17T06:33:31.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.563+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000003 at 0x0x10000000000/2 with size=1 bytes 2023-11-17T06:33:31.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.563+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:247 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bc2a000 2023-11-17T06:33:31.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.563+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 102 ==== osd_op_reply(247 10000000000.01000000 [omap-set-vals] v41'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.563+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/2 pointing to 0x0x10000000003 2023-11-17T06:33:31.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.563+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:248 5.32 5:4ecb6bb7::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bb29400 2023-11-17T06:33:31.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 9 ==== osd_op_reply(248 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000003f.00000000 2023-11-17T06:33:31.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000003f.0 2023-11-17T06:33:31.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:249 5.32 5:4ecb6bb7:::1000000003f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bb29400 2023-11-17T06:33:31.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 10 ==== osd_op_reply(249 1000000003f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003f 2023-11-17T06:33:31.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/62 2023-11-17T06:33:31.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=62 2023-11-17T06:33:31.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:250 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2ac00 2023-11-17T06:33:31.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 34 ==== osd_op_reply(250 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:251 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2a000 2023-11-17T06:33:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 103 ==== osd_op_reply(251 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:252 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7dc00 con 0x55e90bc2a800 2023-11-17T06:33:31.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 54 ==== osd_op_reply(252 10000000000.01800000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 20 2023-11-17T06:33:31.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:253 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2a800 2023-11-17T06:33:31.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 55 ==== osd_op_reply(253 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=62 frag=1*, r=0 2023-11-17T06:33:31.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 20 datascan.read_dentry: 62_head not found in result 2023-11-17T06:33:31.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003f at 0x0x10000000000/62 with size=2 bytes 2023-11-17T06:33:31.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.567+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:254 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2a800 2023-11-17T06:33:31.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.571+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 56 ==== osd_op_reply(254 10000000000.01800000 [omap-set-vals] v41'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.571+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/62 pointing to 0x0x1000000003f 2023-11-17T06:33:31.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.571+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:255 5.32 5:4f7da3cc::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bb29400 2023-11-17T06:33:31.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 11 ==== osd_op_reply(255 [pgnls-filter start_epoch 41 out=81b] v41'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000001e.00000000 2023-11-17T06:33:31.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000001e.0 2023-11-17T06:33:31.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:256 5.32 5:4f7da3cc:::1000000001e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bb29400 2023-11-17T06:33:31.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 12 ==== osd_op_reply(256 1000000001e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001e 2023-11-17T06:33:31.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/29 2023-11-17T06:33:31.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=29 2023-11-17T06:33:31.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:257 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2ac00 2023-11-17T06:33:31.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 35 ==== osd_op_reply(257 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:258 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 104 ==== osd_op_reply(258 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:259 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a800 2023-11-17T06:33:31.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 57 ==== osd_op_reply(259 10000000000.01800000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 21 2023-11-17T06:33:31.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.575+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:260 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a800 2023-11-17T06:33:31.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.579+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 58 ==== osd_op_reply(260 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.579+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=29 frag=1*, r=0 2023-11-17T06:33:31.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.579+0000 7fa48d92e840 20 datascan.read_dentry: 29_head not found in result 2023-11-17T06:33:31.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.579+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001e at 0x0x10000000000/29 with size=2 bytes 2023-11-17T06:33:31.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.579+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:261 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2a800 2023-11-17T06:33:31.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.579+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 59 ==== osd_op_reply(261 10000000000.01800000 [omap-set-vals] v41'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.579+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/29 pointing to 0x0x1000000001e 2023-11-17T06:33:31.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.579+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:262 5.a 5:50000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bb29c00 2023-11-17T06:33:31.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 20 ==== osd_op_reply(262 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa4878e1700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:263 5.2a 5:54000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2a800 2023-11-17T06:33:31.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 60 ==== osd_op_reply(263 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa4870e0700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:264 5.1a 5:58000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc65000 2023-11-17T06:33:31.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 7 ==== osd_op_reply(264 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000018.00000000 2023-11-17T06:33:31.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000018.0 2023-11-17T06:33:31.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:265 5.1a 5:5b3b19a5:::10000000018.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88380 con 0x55e90bc65000 2023-11-17T06:33:31.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 8 ==== osd_op_reply(265 10000000018.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000018 2023-11-17T06:33:31.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/23 2023-11-17T06:33:31.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=23 2023-11-17T06:33:31.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:266 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bc2ac00 2023-11-17T06:33:31.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 36 ==== osd_op_reply(266 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.583+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:267 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89500 con 0x55e90bc2a000 2023-11-17T06:33:31.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 105 ==== osd_op_reply(267 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:268 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89c00 con 0x55e90bc2a800 2023-11-17T06:33:31.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 61 ==== osd_op_reply(268 10000000000.01800000 [omap-get-header out=274b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 22 2023-11-17T06:33:31.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:269 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88a80 con 0x55e90bc2a800 2023-11-17T06:33:31.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 62 ==== osd_op_reply(269 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=23 frag=1*, r=0 2023-11-17T06:33:31.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 20 datascan.read_dentry: 23_head not found in result 2023-11-17T06:33:31.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000018 at 0x0x10000000000/23 with size=2 bytes 2023-11-17T06:33:31.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.587+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:270 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a800 2023-11-17T06:33:31.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 63 ==== osd_op_reply(270 10000000000.01800000 [omap-set-vals] v41'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/23 pointing to 0x0x10000000018 2023-11-17T06:33:31.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:271 5.1a 5:5bd35317::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc65000 2023-11-17T06:33:31.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 9 ==== osd_op_reply(271 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000044.00000000 2023-11-17T06:33:31.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000044.0 2023-11-17T06:33:31.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:272 5.1a 5:5bd35317:::10000000044.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6a80 con 0x55e90bc65000 2023-11-17T06:33:31.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 10 ==== osd_op_reply(272 10000000044.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000044 2023-11-17T06:33:31.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/67 2023-11-17T06:33:31.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=67 2023-11-17T06:33:31.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:273 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7180 con 0x55e90bc2ac00 2023-11-17T06:33:31.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 37 ==== osd_op_reply(273 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.591+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:274 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bc2a000 2023-11-17T06:33:31.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 106 ==== osd_op_reply(274 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:275 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7880 con 0x55e90bc2a800 2023-11-17T06:33:31.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 64 ==== osd_op_reply(275 10000000000.01800000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 23 2023-11-17T06:33:31.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:276 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2a800 2023-11-17T06:33:31.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 65 ==== osd_op_reply(276 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=67 frag=1*, r=0 2023-11-17T06:33:31.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 20 datascan.read_dentry: 67_head not found in result 2023-11-17T06:33:31.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000044 at 0x0x10000000000/67 with size=2 bytes 2023-11-17T06:33:31.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.595+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:277 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2a800 2023-11-17T06:33:31.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 66 ==== osd_op_reply(277 10000000000.01800000 [omap-set-vals] v41'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/67 pointing to 0x0x10000000044 2023-11-17T06:33:31.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:278 5.3a 5:5c000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bc2ac00 2023-11-17T06:33:31.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 38 ==== osd_op_reply(278 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000001f.00000000 2023-11-17T06:33:31.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000001f.0 2023-11-17T06:33:31.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:279 5.3a 5:5f13809d:::1000000001f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7880 con 0x55e90bc2ac00 2023-11-17T06:33:31.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 39 ==== osd_op_reply(279 1000000001f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001f 2023-11-17T06:33:31.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/30 2023-11-17T06:33:31.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=30 2023-11-17T06:33:31.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.599+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:280 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2ac00 2023-11-17T06:33:31.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 40 ==== osd_op_reply(280 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:281 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a000 2023-11-17T06:33:31.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 107 ==== osd_op_reply(281 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:282 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc2a800 2023-11-17T06:33:31.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 67 ==== osd_op_reply(282 10000000000.01800000 [omap-get-header out=274b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 24 2023-11-17T06:33:31.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:283 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a800 2023-11-17T06:33:31.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 68 ==== osd_op_reply(283 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=30 frag=1*, r=0 2023-11-17T06:33:31.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 20 datascan.read_dentry: 30_head not found in result 2023-11-17T06:33:31.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001f at 0x0x10000000000/30 with size=2 bytes 2023-11-17T06:33:31.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.603+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:284 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89500 con 0x55e90bc2a800 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 69 ==== osd_op_reply(284 10000000000.01800000 [omap-set-vals] v41'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/30 pointing to 0x0x1000000001f 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:285 5.6 5:60000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89c00 con 0x55e90bc2ac00 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 41 ==== osd_op_reply(285 [pgnls-filter start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000037.00000000 2023-11-17T06:33:31.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000037.0 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:286 5.6 5:60a13eb4:::10000000037.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88a80 con 0x55e90bc2ac00 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 42 ==== osd_op_reply(286 10000000037.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000037 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/54 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=54 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.607+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:287 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88e00 con 0x55e90bc2ac00 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 43 ==== osd_op_reply(287 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:288 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88380 con 0x55e90bc2a000 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 108 ==== osd_op_reply(288 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:289 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bc2a800 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 70 ==== osd_op_reply(289 10000000000.01800000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 25 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:290 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a800 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 71 ==== osd_op_reply(290 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=54 frag=1*, r=0 2023-11-17T06:33:31.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 20 datascan.read_dentry: 54_head not found in result 2023-11-17T06:33:31.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000037 at 0x0x10000000000/54 with size=2 bytes 2023-11-17T06:33:31.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.611+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:291 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a800 2023-11-17T06:33:31.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 72 ==== osd_op_reply(291 10000000000.01800000 [omap-set-vals] v41'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/54 pointing to 0x0x10000000037 2023-11-17T06:33:31.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:292 5.6 5:61404748::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2ac00 2023-11-17T06:33:31.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 44 ==== osd_op_reply(292 [pgnls-filter start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000042.00000000 2023-11-17T06:33:31.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000042.0 2023-11-17T06:33:31.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:293 5.6 5:61404748:::10000000042.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2ac00 2023-11-17T06:33:31.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 45 ==== osd_op_reply(293 10000000042.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000042 2023-11-17T06:33:31.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/65 2023-11-17T06:33:31.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=65 2023-11-17T06:33:31.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.615+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:294 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2ac00 2023-11-17T06:33:31.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 46 ==== osd_op_reply(294 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:295 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a000 2023-11-17T06:33:31.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 109 ==== osd_op_reply(295 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:296 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a000 2023-11-17T06:33:31.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 110 ==== osd_op_reply(296 10000000000.01000000 [omap-get-header out=274b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 24 2023-11-17T06:33:31.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.628 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:297 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 111 ==== osd_op_reply(297 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=65 frag=0*, r=0 2023-11-17T06:33:31.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 20 datascan.read_dentry: 65_head not found in result 2023-11-17T06:33:31.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000042 at 0x0x10000000000/65 with size=2 bytes 2023-11-17T06:33:31.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.619+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:298 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89c00 con 0x55e90bc2a000 2023-11-17T06:33:31.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 112 ==== osd_op_reply(298 10000000000.01000000 [omap-set-vals] v41'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/65 pointing to 0x0x10000000042 2023-11-17T06:33:31.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:299 5.6 5:614fee2a::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89880 con 0x55e90bc2ac00 2023-11-17T06:33:31.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 47 ==== osd_op_reply(299 [pgnls-filter start_epoch 41 out=81b] v41'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000003d.00000000 2023-11-17T06:33:31.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000003d.0 2023-11-17T06:33:31.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:300 5.6 5:614fee2a:::1000000003d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88a80 con 0x55e90bc2ac00 2023-11-17T06:33:31.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 48 ==== osd_op_reply(300 1000000003d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003d 2023-11-17T06:33:31.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/60 2023-11-17T06:33:31.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=60 2023-11-17T06:33:31.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.623+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:301 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2ac00 2023-11-17T06:33:31.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 49 ==== osd_op_reply(301 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:302 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6a80 con 0x55e90bc2a000 2023-11-17T06:33:31.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 113 ==== osd_op_reply(302 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:303 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7180 con 0x55e90bc2a800 2023-11-17T06:33:31.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 73 ==== osd_op_reply(303 10000000000.01800000 [omap-get-header out=274b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 26 2023-11-17T06:33:31.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:304 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bc2a800 2023-11-17T06:33:31.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 74 ==== osd_op_reply(304 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=60 frag=1*, r=0 2023-11-17T06:33:31.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 20 datascan.read_dentry: 60_head not found in result 2023-11-17T06:33:31.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003d at 0x0x10000000000/60 with size=2 bytes 2023-11-17T06:33:31.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.627+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:305 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2a800 2023-11-17T06:33:31.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.631+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 75 ==== osd_op_reply(305 10000000000.01800000 [omap-set-vals] v41'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.631+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/60 pointing to 0x0x1000000003d 2023-11-17T06:33:31.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.631+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:306 5.26 5:64000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7880 con 0x55e90bb29400 2023-11-17T06:33:31.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.631+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 13 ==== osd_op_reply(306 [pgnls-filter start_epoch 41 out=101b] v41'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.631+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000002b.00000000 2023-11-17T06:33:31.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.631+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000002b.0 2023-11-17T06:33:31.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.631+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:307 5.26 5:645408ac:::1000000002b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bb29400 2023-11-17T06:33:31.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 14 ==== osd_op_reply(307 1000000002b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002b 2023-11-17T06:33:31.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/42 2023-11-17T06:33:31.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=42 2023-11-17T06:33:31.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:308 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bc2ac00 2023-11-17T06:33:31.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 50 ==== osd_op_reply(308 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:309 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a000 2023-11-17T06:33:31.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 114 ==== osd_op_reply(309 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:310 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a000 2023-11-17T06:33:31.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 115 ==== osd_op_reply(310 10000000000.01000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 25 2023-11-17T06:33:31.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:311 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc2a000 2023-11-17T06:33:31.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 116 ==== osd_op_reply(311 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=42 frag=0*, r=0 2023-11-17T06:33:31.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 20 datascan.read_dentry: 42_head not found in result 2023-11-17T06:33:31.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002b at 0x0x10000000000/42 with size=2 bytes 2023-11-17T06:33:31.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.635+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:312 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2a000 2023-11-17T06:33:31.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.639+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 117 ==== osd_op_reply(312 10000000000.01000000 [omap-set-vals] v41'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.639+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/42 pointing to 0x0x1000000002b 2023-11-17T06:33:31.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.639+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:313 5.26 5:65f9ba37::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bb29400 2023-11-17T06:33:31.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.639+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 15 ==== osd_op_reply(313 [pgnls-filter start_epoch 41 out=101b] v41'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.639+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000038.00000000 2023-11-17T06:33:31.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.639+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000038.0 2023-11-17T06:33:31.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.639+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:314 5.26 5:65f9ba37:::10000000038.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7dc00 con 0x55e90bb29400 2023-11-17T06:33:31.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 16 ==== osd_op_reply(314 10000000038.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000038 2023-11-17T06:33:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/55 2023-11-17T06:33:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=55 2023-11-17T06:33:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:315 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2ac00 2023-11-17T06:33:31.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 51 ==== osd_op_reply(315 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:316 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a000 2023-11-17T06:33:31.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 118 ==== osd_op_reply(316 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:317 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a000 2023-11-17T06:33:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 119 ==== osd_op_reply(317 10000000000.01000000 [omap-get-header out=274b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 26 2023-11-17T06:33:31.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:318 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7880 con 0x55e90bc2a000 2023-11-17T06:33:31.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 120 ==== osd_op_reply(318 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=55 frag=0*, r=0 2023-11-17T06:33:31.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 20 datascan.read_dentry: 55_head not found in result 2023-11-17T06:33:31.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000038 at 0x0x10000000000/55 with size=2 bytes 2023-11-17T06:33:31.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.643+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:319 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2a000 2023-11-17T06:33:31.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.647+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 121 ==== osd_op_reply(319 10000000000.01000000 [omap-set-vals] v41'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.647+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/55 pointing to 0x0x10000000038 2023-11-17T06:33:31.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.647+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:320 5.26 5:660982fc::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bb29400 2023-11-17T06:33:31.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.647+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 17 ==== osd_op_reply(320 [pgnls-filter start_epoch 41 out=101b] v41'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.647+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000002d.00000000 2023-11-17T06:33:31.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.647+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000002d.0 2023-11-17T06:33:31.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.647+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:321 5.26 5:660982fc:::1000000002d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7180 con 0x55e90bb29400 2023-11-17T06:33:31.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 18 ==== osd_op_reply(321 1000000002d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002d 2023-11-17T06:33:31.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/44 2023-11-17T06:33:31.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=44 2023-11-17T06:33:31.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:322 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2ac00 2023-11-17T06:33:31.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 52 ==== osd_op_reply(322 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:323 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2a000 2023-11-17T06:33:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 122 ==== osd_op_reply(323 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:324 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89c00 con 0x55e90bc2a800 2023-11-17T06:33:31.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 76 ==== osd_op_reply(324 10000000000.01800000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 27 2023-11-17T06:33:31.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:325 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bc2a800 2023-11-17T06:33:31.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 77 ==== osd_op_reply(325 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=44 frag=1*, r=0 2023-11-17T06:33:31.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 20 datascan.read_dentry: 44_head not found in result 2023-11-17T06:33:31.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002d at 0x0x10000000000/44 with size=2 bytes 2023-11-17T06:33:31.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.651+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:326 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88380 con 0x55e90bc2a800 2023-11-17T06:33:31.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.655+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 78 ==== osd_op_reply(326 10000000000.01800000 [omap-set-vals] v41'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.655+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/44 pointing to 0x0x1000000002d 2023-11-17T06:33:31.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.655+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:327 5.26 5:66f1e28f::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89500 con 0x55e90bb29400 2023-11-17T06:33:31.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.655+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 19 ==== osd_op_reply(327 [pgnls-filter start_epoch 41 out=101b] v41'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.655+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000063.00000000 2023-11-17T06:33:31.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.655+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000063.0 2023-11-17T06:33:31.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.655+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:328 5.26 5:66f1e28f:::10000000063.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bb29400 2023-11-17T06:33:31.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 20 ==== osd_op_reply(328 10000000063.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000063 2023-11-17T06:33:31.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/98 2023-11-17T06:33:31.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=98 2023-11-17T06:33:31.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:329 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2ac00 2023-11-17T06:33:31.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 53 ==== osd_op_reply(329 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:330 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 123 ==== osd_op_reply(330 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:331 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a800 2023-11-17T06:33:31.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 79 ==== osd_op_reply(331 10000000000.01800000 [omap-get-header out=274b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 28 2023-11-17T06:33:31.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.659+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:332 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a800 2023-11-17T06:33:31.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.663+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 80 ==== osd_op_reply(332 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.663+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=98 frag=1*, r=0 2023-11-17T06:33:31.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.663+0000 7fa48d92e840 20 datascan.read_dentry: 98_head not found in result 2023-11-17T06:33:31.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.663+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000063 at 0x0x10000000000/98 with size=2 bytes 2023-11-17T06:33:31.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.663+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:333 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc2a800 2023-11-17T06:33:31.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.663+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 81 ==== osd_op_reply(333 10000000000.01800000 [omap-set-vals] v41'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a800 2023-11-17T06:33:31.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.663+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/98 pointing to 0x0x10000000063 2023-11-17T06:33:31.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.663+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:334 5.26 5:678705fb::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bb29400 2023-11-17T06:33:31.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 21 ==== osd_op_reply(334 [pgnls-filter start_epoch 41 out=81b] v41'15 uv15 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000046.00000000 2023-11-17T06:33:31.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000046.0 2023-11-17T06:33:31.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:335 5.26 5:678705fb:::10000000046.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bb29400 2023-11-17T06:33:31.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 22 ==== osd_op_reply(335 10000000046.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bb29400 2023-11-17T06:33:31.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000046 2023-11-17T06:33:31.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/69 2023-11-17T06:33:31.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=69 2023-11-17T06:33:31.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:336 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2ac00 2023-11-17T06:33:31.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 54 ==== osd_op_reply(336 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:337 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a000 2023-11-17T06:33:31.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 124 ==== osd_op_reply(337 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:338 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a000 2023-11-17T06:33:31.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.667+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 125 ==== osd_op_reply(338 10000000000.01000000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 27 2023-11-17T06:33:31.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:339 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 126 ==== osd_op_reply(339 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=69 frag=0*, r=0 2023-11-17T06:33:31.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48d92e840 20 datascan.read_dentry: 69_head not found in result 2023-11-17T06:33:31.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000046 at 0x0x10000000000/69 with size=2 bytes 2023-11-17T06:33:31.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:340 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 127 ==== osd_op_reply(340 10000000000.01000000 [omap-set-vals] v41'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/69 pointing to 0x0x10000000046 2023-11-17T06:33:31.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.671+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:341 5.16 5:68000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89c00 con 0x55e90bc2a000 2023-11-17T06:33:31.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 128 ==== osd_op_reply(341 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000050.00000000 2023-11-17T06:33:31.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000050.0 2023-11-17T06:33:31.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:342 5.16 5:69de5632:::10000000050.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bc2a000 2023-11-17T06:33:31.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 129 ==== osd_op_reply(342 10000000050.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2d80 con 0x55e90bc2a000 2023-11-17T06:33:31.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000050 2023-11-17T06:33:31.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/79 2023-11-17T06:33:31.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=79 2023-11-17T06:33:31.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:343 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89500 con 0x55e90bc2ac00 2023-11-17T06:33:31.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 55 ==== osd_op_reply(343 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:344 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7880 con 0x55e90bc2a000 2023-11-17T06:33:31.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 130 ==== osd_op_reply(344 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:345 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2a800 2023-11-17T06:33:31.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 82 ==== osd_op_reply(345 10000000000.01800000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 29 2023-11-17T06:33:31.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:346 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bc2a800 2023-11-17T06:33:31.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 83 ==== osd_op_reply(346 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=79 frag=1*, r=0 2023-11-17T06:33:31.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 20 datascan.read_dentry: 79_head not found in result 2023-11-17T06:33:31.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000050 at 0x0x10000000000/79 with size=2 bytes 2023-11-17T06:33:31.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.675+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:347 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6a80 con 0x55e90bc2a800 2023-11-17T06:33:31.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.679+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 84 ==== osd_op_reply(347 10000000000.01800000 [omap-set-vals] v41'30 uv30 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.679+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/79 pointing to 0x0x10000000050 2023-11-17T06:33:31.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.679+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:348 5.16 5:6a23747e::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7180 con 0x55e90bc2a000 2023-11-17T06:33:31.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.679+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 131 ==== osd_op_reply(348 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000053.00000000 2023-11-17T06:33:31.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000053.0 2023-11-17T06:33:31.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:349 5.16 5:6a23747e:::10000000053.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2a000 2023-11-17T06:33:31.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 132 ==== osd_op_reply(349 10000000053.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000053 2023-11-17T06:33:31.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/82 2023-11-17T06:33:31.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=82 2023-11-17T06:33:31.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:350 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2ac00 2023-11-17T06:33:31.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 56 ==== osd_op_reply(350 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:351 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2a000 2023-11-17T06:33:31.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 133 ==== osd_op_reply(351 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:352 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2a800 2023-11-17T06:33:31.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 85 ==== osd_op_reply(352 10000000000.01800000 [omap-get-header out=274b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 30 2023-11-17T06:33:31.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:353 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7dc00 con 0x55e90bc2a800 2023-11-17T06:33:31.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 86 ==== osd_op_reply(353 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=82 frag=1*, r=0 2023-11-17T06:33:31.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 20 datascan.read_dentry: 82_head not found in result 2023-11-17T06:33:31.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000053 at 0x0x10000000000/82 with size=2 bytes 2023-11-17T06:33:31.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.683+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:354 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a800 2023-11-17T06:33:31.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.687+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 87 ==== osd_op_reply(354 10000000000.01800000 [omap-set-vals] v41'31 uv31 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.687+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/82 pointing to 0x0x10000000053 2023-11-17T06:33:31.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.687+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:355 5.16 5:6a415a36::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a000 2023-11-17T06:33:31.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.687+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 134 ==== osd_op_reply(355 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.687+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000043.00000000 2023-11-17T06:33:31.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.687+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000043.0 2023-11-17T06:33:31.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.687+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:356 5.16 5:6a415a36:::10000000043.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bc2a000 2023-11-17T06:33:31.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 135 ==== osd_op_reply(356 10000000043.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000043 2023-11-17T06:33:31.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/66 2023-11-17T06:33:31.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=66 2023-11-17T06:33:31.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:357 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2ac00 2023-11-17T06:33:31.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 57 ==== osd_op_reply(357 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:358 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89880 con 0x55e90bc2a000 2023-11-17T06:33:31.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 136 ==== osd_op_reply(358 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:359 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88e00 con 0x55e90bc2a000 2023-11-17T06:33:31.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 137 ==== osd_op_reply(359 10000000000.01000000 [omap-get-header out=274b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 28 2023-11-17T06:33:31.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:360 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88a80 con 0x55e90bc2a000 2023-11-17T06:33:31.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 138 ==== osd_op_reply(360 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=66 frag=0*, r=0 2023-11-17T06:33:31.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 20 datascan.read_dentry: 66_head not found in result 2023-11-17T06:33:31.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000043 at 0x0x10000000000/66 with size=2 bytes 2023-11-17T06:33:31.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.691+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:361 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89500 con 0x55e90bc2a000 2023-11-17T06:33:31.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 139 ==== osd_op_reply(361 10000000000.01000000 [omap-set-vals] v41'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/66 pointing to 0x0x10000000043 2023-11-17T06:33:31.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:362 5.16 5:6a54d456::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a000 2023-11-17T06:33:31.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 140 ==== osd_op_reply(362 [pgnls-filter start_epoch 41 out=81b] v41'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000001c.00000000 2023-11-17T06:33:31.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000001c.0 2023-11-17T06:33:31.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:363 5.16 5:6a54d456:::1000000001c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a000 2023-11-17T06:33:31.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 141 ==== osd_op_reply(363 1000000001c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001c 2023-11-17T06:33:31.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/27 2023-11-17T06:33:31.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=27 2023-11-17T06:33:31.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.695+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:364 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2ac00 2023-11-17T06:33:31.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 58 ==== osd_op_reply(364 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:365 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2a000 2023-11-17T06:33:31.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 142 ==== osd_op_reply(365 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:366 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a000 2023-11-17T06:33:31.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 143 ==== osd_op_reply(366 10000000000.01000000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 29 2023-11-17T06:33:31.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:367 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89c00 con 0x55e90bc2a000 2023-11-17T06:33:31.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 144 ==== osd_op_reply(367 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=27 frag=0*, r=0 2023-11-17T06:33:31.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 20 datascan.read_dentry: 27_head not found in result 2023-11-17T06:33:31.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001c at 0x0x10000000000/27 with size=2 bytes 2023-11-17T06:33:31.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.699+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:368 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88380 con 0x55e90bc2a000 2023-11-17T06:33:31.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 145 ==== osd_op_reply(368 10000000000.01000000 [omap-set-vals] v41'30 uv30 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/27 pointing to 0x0x1000000001c 2023-11-17T06:33:31.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:369 5.36 5:6c000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bc2a000 2023-11-17T06:33:31.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 146 ==== osd_op_reply(369 [pgnls-filter start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000004d.00000000 2023-11-17T06:33:31.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000004d.0 2023-11-17T06:33:31.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:370 5.36 5:6c82bb73:::1000000004d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89880 con 0x55e90bc2a000 2023-11-17T06:33:31.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 147 ==== osd_op_reply(370 1000000004d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004d 2023-11-17T06:33:31.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/76 2023-11-17T06:33:31.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=76 2023-11-17T06:33:31.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:371 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc2ac00 2023-11-17T06:33:31.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 59 ==== osd_op_reply(371 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.703+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:372 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2a000 2023-11-17T06:33:31.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 148 ==== osd_op_reply(372 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:373 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2a800 2023-11-17T06:33:31.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 88 ==== osd_op_reply(373 10000000000.01800000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 31 2023-11-17T06:33:31.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:374 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7dc00 con 0x55e90bc2a800 2023-11-17T06:33:31.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 89 ==== osd_op_reply(374 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=76 frag=1*, r=0 2023-11-17T06:33:31.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 20 datascan.read_dentry: 76_head not found in result 2023-11-17T06:33:31.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004d at 0x0x10000000000/76 with size=2 bytes 2023-11-17T06:33:31.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.707+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:375 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a800 2023-11-17T06:33:31.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 90 ==== osd_op_reply(375 10000000000.01800000 [omap-set-vals] v41'32 uv32 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/76 pointing to 0x0x1000000004d 2023-11-17T06:33:31.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:376 5.36 5:6dc1a442::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a000 2023-11-17T06:33:31.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 149 ==== osd_op_reply(376 [pgnls-filter start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000015.00000000 2023-11-17T06:33:31.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000015.0 2023-11-17T06:33:31.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:377 5.36 5:6dc1a442:::10000000015.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2a000 2023-11-17T06:33:31.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 150 ==== osd_op_reply(377 10000000015.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000015 2023-11-17T06:33:31.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/20 2023-11-17T06:33:31.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=20 2023-11-17T06:33:31.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:378 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7880 con 0x55e90bc2ac00 2023-11-17T06:33:31.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 60 ==== osd_op_reply(378 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.732 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.711+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:379 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2a000 2023-11-17T06:33:31.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 151 ==== osd_op_reply(379 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:380 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bc2a000 2023-11-17T06:33:31.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 152 ==== osd_op_reply(380 10000000000.01000000 [omap-get-header out=274b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 30 2023-11-17T06:33:31.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:381 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6a80 con 0x55e90bc2a000 2023-11-17T06:33:31.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 153 ==== osd_op_reply(381 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=20 frag=0*, r=0 2023-11-17T06:33:31.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 20 datascan.read_dentry: 20_head not found in result 2023-11-17T06:33:31.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000015 at 0x0x10000000000/20 with size=2 bytes 2023-11-17T06:33:31.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:382 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7180 con 0x55e90bc2a000 2023-11-17T06:33:31.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 154 ==== osd_op_reply(382 10000000000.01000000 [omap-set-vals] v41'31 uv31 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/20 pointing to 0x0x10000000015 2023-11-17T06:33:31.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.715+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:383 5.36 5:6f6f8b6e::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2a000 2023-11-17T06:33:31.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 155 ==== osd_op_reply(383 [pgnls-filter start_epoch 41 out=81b] v41'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000045.00000000 2023-11-17T06:33:31.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000045.0 2023-11-17T06:33:31.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:384 5.36 5:6f6f8b6e:::10000000045.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a000 2023-11-17T06:33:31.735 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 156 ==== osd_op_reply(384 10000000045.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000045 2023-11-17T06:33:31.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/68 2023-11-17T06:33:31.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=68 2023-11-17T06:33:31.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:385 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2ac00 2023-11-17T06:33:31.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 61 ==== osd_op_reply(385 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:386 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a000 2023-11-17T06:33:31.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 157 ==== osd_op_reply(386 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.737 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:387 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc2a800 2023-11-17T06:33:31.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 91 ==== osd_op_reply(387 10000000000.01800000 [omap-get-header out=274b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 32 2023-11-17T06:33:31.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:388 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a800 2023-11-17T06:33:31.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 92 ==== osd_op_reply(388 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=68 frag=1*, r=0 2023-11-17T06:33:31.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 20 datascan.read_dentry: 68_head not found in result 2023-11-17T06:33:31.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000045 at 0x0x10000000000/68 with size=2 bytes 2023-11-17T06:33:31.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.719+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:389 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a800 2023-11-17T06:33:31.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.723+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 93 ==== osd_op_reply(389 10000000000.01800000 [omap-set-vals] v41'33 uv33 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.723+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/68 pointing to 0x0x10000000045 2023-11-17T06:33:31.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.723+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:390 5.e 5:70000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a000 2023-11-17T06:33:31.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 158 ==== osd_op_reply(390 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa4878e1700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:391 5.2e 5:74000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6380 con 0x55e90bc2ac00 2023-11-17T06:33:31.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 62 ==== osd_op_reply(391 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000057.00000000 2023-11-17T06:33:31.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000057.0 2023-11-17T06:33:31.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:392 5.2e 5:74dc0bdf:::10000000057.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc2ac00 2023-11-17T06:33:31.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 63 ==== osd_op_reply(392 10000000057.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000057 2023-11-17T06:33:31.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/86 2023-11-17T06:33:31.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=86 2023-11-17T06:33:31.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:393 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2ac00 2023-11-17T06:33:31.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 64 ==== osd_op_reply(393 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.727+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:394 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a000 2023-11-17T06:33:31.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 159 ==== osd_op_reply(394 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:395 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 160 ==== osd_op_reply(395 10000000000.01000000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 31 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:396 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2a000 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 161 ==== osd_op_reply(396 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=86 frag=0*, r=0 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 20 datascan.read_dentry: 86_head not found in result 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000057 at 0x0x10000000000/86 with size=2 bytes 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.731+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:397 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2a000 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 162 ==== osd_op_reply(397 10000000000.01000000 [omap-set-vals] v41'32 uv32 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/86 pointing to 0x0x10000000057 2023-11-17T06:33:31.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:398 5.1e 5:78000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7180 con 0x55e90bb29c00 2023-11-17T06:33:31.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 21 ==== osd_op_reply(398 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000017.00000000 2023-11-17T06:33:31.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000017.0 2023-11-17T06:33:31.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:399 5.1e 5:78cea7f0:::10000000017.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6a80 con 0x55e90bb29c00 2023-11-17T06:33:31.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 22 ==== osd_op_reply(399 10000000017.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000017 2023-11-17T06:33:31.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/22 2023-11-17T06:33:31.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=22 2023-11-17T06:33:31.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.735+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:400 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2ac00 2023-11-17T06:33:31.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 65 ==== osd_op_reply(400 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:401 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2a000 2023-11-17T06:33:31.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 163 ==== osd_op_reply(401 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:402 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2a800 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 94 ==== osd_op_reply(402 10000000000.01800000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 33 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:403 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bc2a800 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 95 ==== osd_op_reply(403 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=22 frag=1*, r=0 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 20 datascan.read_dentry: 22_head not found in result 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000017 at 0x0x10000000000/22 with size=2 bytes 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.739+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:404 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a800 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 96 ==== osd_op_reply(404 10000000000.01800000 [omap-set-vals] v41'34 uv34 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/22 pointing to 0x0x10000000017 2023-11-17T06:33:31.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:405 5.3e 5:7c000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a400 2023-11-17T06:33:31.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 11 ==== osd_op_reply(405 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000033.00000000 2023-11-17T06:33:31.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000033.0 2023-11-17T06:33:31.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:406 5.3e 5:7e2d0da6:::10000000033.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7dc00 con 0x55e90bc2a400 2023-11-17T06:33:31.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 12 ==== osd_op_reply(406 10000000033.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000033 2023-11-17T06:33:31.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/50 2023-11-17T06:33:31.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=50 2023-11-17T06:33:31.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.743+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:407 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2ac00 2023-11-17T06:33:31.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 66 ==== osd_op_reply(407 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:408 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89880 con 0x55e90bc2a000 2023-11-17T06:33:31.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 164 ==== osd_op_reply(408 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:409 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88e00 con 0x55e90bc2a000 2023-11-17T06:33:31.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 165 ==== osd_op_reply(409 10000000000.01000000 [omap-get-header out=274b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 32 2023-11-17T06:33:31.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:410 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89180 con 0x55e90bc2a000 2023-11-17T06:33:31.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 166 ==== osd_op_reply(410 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=50 frag=0*, r=0 2023-11-17T06:33:31.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 20 datascan.read_dentry: 50_head not found in result 2023-11-17T06:33:31.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000033 at 0x0x10000000000/50 with size=2 bytes 2023-11-17T06:33:31.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.747+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:411 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88380 con 0x55e90bc2a000 2023-11-17T06:33:31.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 167 ==== osd_op_reply(411 10000000000.01000000 [omap-set-vals] v41'33 uv33 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/50 pointing to 0x0x10000000033 2023-11-17T06:33:31.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:412 5.1 5:80000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89c00 con 0x55e90bc2a000 2023-11-17T06:33:31.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 168 ==== osd_op_reply(412 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000034.00000000 2023-11-17T06:33:31.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000034.0 2023-11-17T06:33:31.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:413 5.1 5:81df0dbf:::10000000034.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc89500 con 0x55e90bc2a000 2023-11-17T06:33:31.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 169 ==== osd_op_reply(413 10000000034.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000034 2023-11-17T06:33:31.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/51 2023-11-17T06:33:31.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=51 2023-11-17T06:33:31.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:414 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7180 con 0x55e90bc2ac00 2023-11-17T06:33:31.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 67 ==== osd_op_reply(414 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.751+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:415 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bc2a000 2023-11-17T06:33:31.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 170 ==== osd_op_reply(415 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:416 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2a800 2023-11-17T06:33:31.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 97 ==== osd_op_reply(416 10000000000.01800000 [omap-get-header out=274b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 34 2023-11-17T06:33:31.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:417 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a800 2023-11-17T06:33:31.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 98 ==== osd_op_reply(417 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=51 frag=1*, r=0 2023-11-17T06:33:31.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 20 datascan.read_dentry: 51_head not found in result 2023-11-17T06:33:31.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000034 at 0x0x10000000000/51 with size=2 bytes 2023-11-17T06:33:31.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.755+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:418 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a800 2023-11-17T06:33:31.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 99 ==== osd_op_reply(418 10000000000.01800000 [omap-set-vals] v41'35 uv35 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/51 pointing to 0x0x10000000034 2023-11-17T06:33:31.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:419 5.21 5:84000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a800 2023-11-17T06:33:31.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 100 ==== osd_op_reply(419 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000004c.00000000 2023-11-17T06:33:31.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000004c.0 2023-11-17T06:33:31.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:420 5.21 5:844eae9e:::1000000004c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59880 con 0x55e90bc2a800 2023-11-17T06:33:31.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 101 ==== osd_op_reply(420 1000000004c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004c 2023-11-17T06:33:31.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/75 2023-11-17T06:33:31.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=75 2023-11-17T06:33:31.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:421 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bc2ac00 2023-11-17T06:33:31.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 68 ==== osd_op_reply(421 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:422 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bc2a000 2023-11-17T06:33:31.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 171 ==== osd_op_reply(422 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.759+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:423 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bc2a000 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 172 ==== osd_op_reply(423 10000000000.01000000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 33 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:424 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88700 con 0x55e90bc2a000 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 173 ==== osd_op_reply(424 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=75 frag=0*, r=0 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48d92e840 20 datascan.read_dentry: 75_head not found in result 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004c at 0x0x10000000000/75 with size=2 bytes 2023-11-17T06:33:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:425 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc88000 con 0x55e90bc2a000 2023-11-17T06:33:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 174 ==== osd_op_reply(425 10000000000.01000000 [omap-set-vals] v41'34 uv34 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/75 pointing to 0x0x1000000004c 2023-11-17T06:33:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.763+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:426 5.21 5:8660ae9f::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a800 2023-11-17T06:33:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 102 ==== osd_op_reply(426 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000004f.00000000 2023-11-17T06:33:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000004f.0 2023-11-17T06:33:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:427 5.21 5:8660ae9f:::1000000004f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a800 2023-11-17T06:33:31.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 103 ==== osd_op_reply(427 1000000004f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004f 2023-11-17T06:33:31.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/78 2023-11-17T06:33:31.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=78 2023-11-17T06:33:31.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:428 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59c00 con 0x55e90bc2ac00 2023-11-17T06:33:31.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 69 ==== osd_op_reply(428 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:429 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59880 con 0x55e90bc2a000 2023-11-17T06:33:31.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 175 ==== osd_op_reply(429 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:430 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bc2a800 2023-11-17T06:33:31.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 104 ==== osd_op_reply(430 10000000000.01800000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 35 2023-11-17T06:33:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:431 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bc2a800 2023-11-17T06:33:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.767+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 105 ==== osd_op_reply(431 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.771+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=78 frag=1*, r=0 2023-11-17T06:33:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.771+0000 7fa48d92e840 20 datascan.read_dentry: 78_head not found in result 2023-11-17T06:33:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.771+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004f at 0x0x10000000000/78 with size=2 bytes 2023-11-17T06:33:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.771+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:432 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a800 2023-11-17T06:33:31.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.771+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 106 ==== osd_op_reply(432 10000000000.01800000 [omap-set-vals] v41'36 uv36 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.771+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/78 pointing to 0x0x1000000004f 2023-11-17T06:33:31.778 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.771+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:433 5.21 5:86d8200e::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a800 2023-11-17T06:33:31.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 107 ==== osd_op_reply(433 [pgnls-filter start_epoch 41 out=101b] v41'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000019.00000000 2023-11-17T06:33:31.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000019.0 2023-11-17T06:33:31.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:434 5.21 5:86d8200e:::10000000019.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2a800 2023-11-17T06:33:31.779 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 108 ==== osd_op_reply(434 10000000019.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000019 2023-11-17T06:33:31.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/24 2023-11-17T06:33:31.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=24 2023-11-17T06:33:31.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:435 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2ac00 2023-11-17T06:33:31.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 70 ==== osd_op_reply(435 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:436 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a000 2023-11-17T06:33:31.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 176 ==== osd_op_reply(436 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:437 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a800 2023-11-17T06:33:31.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 109 ==== osd_op_reply(437 10000000000.01800000 [omap-get-header out=274b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 36 2023-11-17T06:33:31.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:438 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2a800 2023-11-17T06:33:31.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 110 ==== osd_op_reply(438 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=24 frag=1*, r=0 2023-11-17T06:33:31.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 20 datascan.read_dentry: 24_head not found in result 2023-11-17T06:33:31.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000019 at 0x0x10000000000/24 with size=2 bytes 2023-11-17T06:33:31.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.775+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:439 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2a800 2023-11-17T06:33:31.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.779+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 111 ==== osd_op_reply(439 10000000000.01800000 [omap-set-vals] v41'37 uv37 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.779+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/24 pointing to 0x0x10000000019 2023-11-17T06:33:31.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.779+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:440 5.21 5:870ac4b3::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bc2a800 2023-11-17T06:33:31.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.779+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 112 ==== osd_op_reply(440 [pgnls-filter start_epoch 41 out=81b] v41'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.779+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000005e.00000000 2023-11-17T06:33:31.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.779+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000005e.0 2023-11-17T06:33:31.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.779+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:441 5.21 5:870ac4b3:::1000000005e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2a800 2023-11-17T06:33:31.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 113 ==== osd_op_reply(441 1000000005e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005e 2023-11-17T06:33:31.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/93 2023-11-17T06:33:31.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=93 2023-11-17T06:33:31.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:442 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2ac00 2023-11-17T06:33:31.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 71 ==== osd_op_reply(442 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:443 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc2a000 2023-11-17T06:33:31.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 177 ==== osd_op_reply(443 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:444 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bc2a800 2023-11-17T06:33:31.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 114 ==== osd_op_reply(444 10000000000.01800000 [omap-get-header out=274b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 37 2023-11-17T06:33:31.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:445 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59c00 con 0x55e90bc2a800 2023-11-17T06:33:31.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 115 ==== osd_op_reply(445 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=93 frag=1*, r=0 2023-11-17T06:33:31.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 20 datascan.read_dentry: 93_head not found in result 2023-11-17T06:33:31.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005e at 0x0x10000000000/93 with size=2 bytes 2023-11-17T06:33:31.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.783+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:446 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7880 con 0x55e90bc2a800 2023-11-17T06:33:31.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.787+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 116 ==== osd_op_reply(446 10000000000.01800000 [omap-set-vals] v41'38 uv38 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.787+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/93 pointing to 0x0x1000000005e 2023-11-17T06:33:31.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.787+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:447 5.11 5:88000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6380 con 0x55e90bc2a000 2023-11-17T06:33:31.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.787+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 178 ==== osd_op_reply(447 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.787+0000 7fa4870e0700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:448 5.31 5:8c000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6000 con 0x55e90bc2bc00 2023-11-17T06:33:31.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 17 ==== osd_op_reply(448 [pgnls-filter start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000004b.00000000 2023-11-17T06:33:31.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000004b.0 2023-11-17T06:33:31.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:449 5.31 5:8e5cc622:::1000000004b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2bc00 2023-11-17T06:33:31.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 18 ==== osd_op_reply(449 1000000004b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004b 2023-11-17T06:33:31.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/74 2023-11-17T06:33:31.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=74 2023-11-17T06:33:31.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:450 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2ac00 2023-11-17T06:33:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 72 ==== osd_op_reply(450 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:451 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc2a000 2023-11-17T06:33:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 179 ==== osd_op_reply(451 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:452 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2a000 2023-11-17T06:33:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 180 ==== osd_op_reply(452 10000000000.01000000 [omap-get-header out=274b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 34 2023-11-17T06:33:31.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.791+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:453 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a000 2023-11-17T06:33:31.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.795+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 181 ==== osd_op_reply(453 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.795+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=74 frag=0*, r=0 2023-11-17T06:33:31.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.795+0000 7fa48d92e840 20 datascan.read_dentry: 74_head not found in result 2023-11-17T06:33:31.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.795+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004b at 0x0x10000000000/74 with size=2 bytes 2023-11-17T06:33:31.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.795+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:454 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a000 2023-11-17T06:33:31.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.795+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 182 ==== osd_op_reply(454 10000000000.01000000 [omap-set-vals] v41'35 uv35 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.795+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/74 pointing to 0x0x1000000004b 2023-11-17T06:33:31.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.795+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:455 5.31 5:8ea80fc8::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2bc00 2023-11-17T06:33:31.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 19 ==== osd_op_reply(455 [pgnls-filter start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000032.00000000 2023-11-17T06:33:31.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000032.0 2023-11-17T06:33:31.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:456 5.31 5:8ea80fc8:::10000000032.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2bc00 2023-11-17T06:33:31.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 20 ==== osd_op_reply(456 10000000032.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000032 2023-11-17T06:33:31.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/49 2023-11-17T06:33:31.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=49 2023-11-17T06:33:31.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:457 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6e00 con 0x55e90bc2ac00 2023-11-17T06:33:31.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 73 ==== osd_op_reply(457 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:458 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7180 con 0x55e90bc2a000 2023-11-17T06:33:31.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 183 ==== osd_op_reply(458 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:459 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7500 con 0x55e90bc2a800 2023-11-17T06:33:31.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 117 ==== osd_op_reply(459 10000000000.01800000 [omap-get-header out=274b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 38 2023-11-17T06:33:31.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:460 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7880 con 0x55e90bc2a800 2023-11-17T06:33:31.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 118 ==== osd_op_reply(460 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=49 frag=1*, r=0 2023-11-17T06:33:31.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 20 datascan.read_dentry: 49_head not found in result 2023-11-17T06:33:31.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000032 at 0x0x10000000000/49 with size=2 bytes 2023-11-17T06:33:31.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.799+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:461 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7c00 con 0x55e90bc2a800 2023-11-17T06:33:31.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.803+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 119 ==== osd_op_reply(461 10000000000.01800000 [omap-set-vals] v41'39 uv39 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.803+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/49 pointing to 0x0x10000000032 2023-11-17T06:33:31.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.803+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:462 5.31 5:8ff022d2::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7180 con 0x55e90bc2bc00 2023-11-17T06:33:31.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.803+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 21 ==== osd_op_reply(462 [pgnls-filter start_epoch 41 out=81b] v41'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.803+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000059.00000000 2023-11-17T06:33:31.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.803+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000059.0 2023-11-17T06:33:31.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.803+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:463 5.31 5:8ff022d2:::10000000059.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7500 con 0x55e90bc2bc00 2023-11-17T06:33:31.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 22 ==== osd_op_reply(463 10000000059.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000059 2023-11-17T06:33:31.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/88 2023-11-17T06:33:31.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=88 2023-11-17T06:33:31.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:464 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7c00 con 0x55e90bc2ac00 2023-11-17T06:33:31.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 74 ==== osd_op_reply(464 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:465 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a000 2023-11-17T06:33:31.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 184 ==== osd_op_reply(465 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:466 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a000 2023-11-17T06:33:31.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 185 ==== osd_op_reply(466 10000000000.01000000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 35 2023-11-17T06:33:31.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:467 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bc2a000 2023-11-17T06:33:31.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 186 ==== osd_op_reply(467 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=88 frag=0*, r=0 2023-11-17T06:33:31.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 20 datascan.read_dentry: 88_head not found in result 2023-11-17T06:33:31.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000059 at 0x0x10000000000/88 with size=2 bytes 2023-11-17T06:33:31.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.807+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:468 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2a000 2023-11-17T06:33:31.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 187 ==== osd_op_reply(468 10000000000.01000000 [omap-set-vals] v41'36 uv36 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/88 pointing to 0x0x10000000059 2023-11-17T06:33:31.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:469 5.9 5:90000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc65000 2023-11-17T06:33:31.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 11 ==== osd_op_reply(469 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000005.00000000 2023-11-17T06:33:31.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000005.0 2023-11-17T06:33:31.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:470 5.9 5:9258b67d:::10000000005.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc65000 2023-11-17T06:33:31.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 12 ==== osd_op_reply(470 10000000005.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000005 2023-11-17T06:33:31.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/4 2023-11-17T06:33:31.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=4 2023-11-17T06:33:31.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.811+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:471 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2ac00 2023-11-17T06:33:31.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 75 ==== osd_op_reply(471 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:472 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bc2a000 2023-11-17T06:33:31.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 188 ==== osd_op_reply(472 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:473 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7880 con 0x55e90bc2a000 2023-11-17T06:33:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 189 ==== osd_op_reply(473 10000000000.01000000 [omap-get-header out=274b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 36 2023-11-17T06:33:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:474 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6380 con 0x55e90bc2a000 2023-11-17T06:33:31.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 190 ==== osd_op_reply(474 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=4 frag=0*, r=0 2023-11-17T06:33:31.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 20 datascan.read_dentry: 4_head not found in result 2023-11-17T06:33:31.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000005 at 0x0x10000000000/4 with size=1 bytes 2023-11-17T06:33:31.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.815+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:475 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a000 2023-11-17T06:33:31.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 191 ==== osd_op_reply(475 10000000000.01000000 [omap-set-vals] v41'37 uv37 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/4 pointing to 0x0x10000000005 2023-11-17T06:33:31.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:476 5.29 5:94000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bb29c00 2023-11-17T06:33:31.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 23 ==== osd_op_reply(476 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000004e.00000000 2023-11-17T06:33:31.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000004e.0 2023-11-17T06:33:31.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:477 5.29 5:954bc910:::1000000004e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bb29c00 2023-11-17T06:33:31.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 24 ==== osd_op_reply(477 1000000004e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004e 2023-11-17T06:33:31.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/77 2023-11-17T06:33:31.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=77 2023-11-17T06:33:31.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.819+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:478 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2ac00 2023-11-17T06:33:31.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 76 ==== osd_op_reply(478 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:479 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a000 2023-11-17T06:33:31.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 192 ==== osd_op_reply(479 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:480 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a000 2023-11-17T06:33:31.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 193 ==== osd_op_reply(480 10000000000.01000000 [omap-get-header out=274b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 37 2023-11-17T06:33:31.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:481 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2a000 2023-11-17T06:33:31.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 194 ==== osd_op_reply(481 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=77 frag=0*, r=0 2023-11-17T06:33:31.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 20 datascan.read_dentry: 77_head not found in result 2023-11-17T06:33:31.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004e at 0x0x10000000000/77 with size=2 bytes 2023-11-17T06:33:31.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.823+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:482 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 195 ==== osd_op_reply(482 10000000000.01000000 [omap-set-vals] v41'38 uv38 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/77 pointing to 0x0x1000000004e 2023-11-17T06:33:31.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:483 5.29 5:9752f43f::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6000 con 0x55e90bb29c00 2023-11-17T06:33:31.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 25 ==== osd_op_reply(483 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000000b.00000000 2023-11-17T06:33:31.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000000b.0 2023-11-17T06:33:31.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:484 5.29 5:9752f43f:::1000000000b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6a80 con 0x55e90bb29c00 2023-11-17T06:33:31.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 26 ==== osd_op_reply(484 1000000000b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000b 2023-11-17T06:33:31.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/10 2023-11-17T06:33:31.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=10 2023-11-17T06:33:31.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.827+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:485 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7880 con 0x55e90bc2ac00 2023-11-17T06:33:31.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 77 ==== osd_op_reply(485 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:486 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7500 con 0x55e90bc2a000 2023-11-17T06:33:31.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 196 ==== osd_op_reply(486 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:487 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6a80 con 0x55e90bc2a000 2023-11-17T06:33:31.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 197 ==== osd_op_reply(487 10000000000.01000000 [omap-get-header out=274b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 38 2023-11-17T06:33:31.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:488 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7180 con 0x55e90bc2a000 2023-11-17T06:33:31.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 198 ==== osd_op_reply(488 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=10 frag=0*, r=0 2023-11-17T06:33:31.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 20 datascan.read_dentry: 10_head not found in result 2023-11-17T06:33:31.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000b at 0x0x10000000000/10 with size=2 bytes 2023-11-17T06:33:31.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.831+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:489 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2a000 2023-11-17T06:33:31.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 199 ==== osd_op_reply(489 10000000000.01000000 [omap-set-vals] v41'39 uv39 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/10 pointing to 0x0x1000000000b 2023-11-17T06:33:31.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:490 5.19 5:98000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bb29400 2023-11-17T06:33:31.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 23 ==== osd_op_reply(490 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:31.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000051.00000000 2023-11-17T06:33:31.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000051.0 2023-11-17T06:33:31.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:491 5.19 5:9ae7aaf4:::10000000051.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bb29400 2023-11-17T06:33:31.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 24 ==== osd_op_reply(491 10000000051.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:31.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000051 2023-11-17T06:33:31.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/80 2023-11-17T06:33:31.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=80 2023-11-17T06:33:31.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:492 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58000 con 0x55e90bc2ac00 2023-11-17T06:33:31.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 78 ==== osd_op_reply(492 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.835+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:493 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58380 con 0x55e90bc2a000 2023-11-17T06:33:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 200 ==== osd_op_reply(493 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:494 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58700 con 0x55e90bc2a000 2023-11-17T06:33:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 201 ==== osd_op_reply(494 10000000000.01000000 [omap-get-header out=274b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 39 2023-11-17T06:33:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:495 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58a80 con 0x55e90bc2a000 2023-11-17T06:33:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 202 ==== osd_op_reply(495 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=80 frag=0*, r=0 2023-11-17T06:33:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 20 datascan.read_dentry: 80_head not found in result 2023-11-17T06:33:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000051 at 0x0x10000000000/80 with size=2 bytes 2023-11-17T06:33:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.839+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:496 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc58e00 con 0x55e90bc2a000 2023-11-17T06:33:31.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 203 ==== osd_op_reply(496 10000000000.01000000 [omap-set-vals] v41'40 uv40 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/80 pointing to 0x0x10000000051 2023-11-17T06:33:31.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:497 5.39 5:9c000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59180 con 0x55e90bc2a800 2023-11-17T06:33:31.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 120 ==== osd_op_reply(497 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000005b.00000000 2023-11-17T06:33:31.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000005b.0 2023-11-17T06:33:31.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:498 5.39 5:9fc48627:::1000000005b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59500 con 0x55e90bc2a800 2023-11-17T06:33:31.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 121 ==== osd_op_reply(498 1000000005b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005b 2023-11-17T06:33:31.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/90 2023-11-17T06:33:31.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=90 2023-11-17T06:33:31.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:499 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc59c00 con 0x55e90bc2ac00 2023-11-17T06:33:31.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 79 ==== osd_op_reply(499 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:500 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8000 con 0x55e90bc2a000 2023-11-17T06:33:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 204 ==== osd_op_reply(500 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.843+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:501 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8380 con 0x55e90bc2a000 2023-11-17T06:33:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 205 ==== osd_op_reply(501 10000000000.01000000 [omap-get-header out=274b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 40 2023-11-17T06:33:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:502 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8700 con 0x55e90bc2a000 2023-11-17T06:33:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 206 ==== osd_op_reply(502 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=90 frag=0*, r=0 2023-11-17T06:33:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48d92e840 20 datascan.read_dentry: 90_head not found in result 2023-11-17T06:33:31.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005b at 0x0x10000000000/90 with size=2 bytes 2023-11-17T06:33:31.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:503 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8a80 con 0x55e90bc2a000 2023-11-17T06:33:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 207 ==== osd_op_reply(503 10000000000.01000000 [omap-set-vals] v41'41 uv41 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/90 pointing to 0x0x1000000005b 2023-11-17T06:33:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.847+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:504 5.5 5:a0000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8e00 con 0x55e90bc2ac00 2023-11-17T06:33:31.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 80 ==== osd_op_reply(504 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000004.00000000 2023-11-17T06:33:31.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000004.0 2023-11-17T06:33:31.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:505 5.5 5:a367a3e8:::10000000004.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9180 con 0x55e90bc2ac00 2023-11-17T06:33:31.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 81 ==== osd_op_reply(505 10000000004.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000004 2023-11-17T06:33:31.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/3 2023-11-17T06:33:31.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=3 2023-11-17T06:33:31.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:506 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9880 con 0x55e90bc2ac00 2023-11-17T06:33:31.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 82 ==== osd_op_reply(506 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.851+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:507 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9c00 con 0x55e90bc2a000 2023-11-17T06:33:31.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 208 ==== osd_op_reply(507 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:508 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8000 con 0x55e90bc2a000 2023-11-17T06:33:31.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 209 ==== osd_op_reply(508 10000000000.01000000 [omap-get-header out=274b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 41 2023-11-17T06:33:31.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:509 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8380 con 0x55e90bc2a000 2023-11-17T06:33:31.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 210 ==== osd_op_reply(509 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=3 frag=0*, r=0 2023-11-17T06:33:31.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 20 datascan.read_dentry: 3_head not found in result 2023-11-17T06:33:31.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000004 at 0x0x10000000000/3 with size=1 bytes 2023-11-17T06:33:31.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:510 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8700 con 0x55e90bc2a000 2023-11-17T06:33:31.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 211 ==== osd_op_reply(510 10000000000.01000000 [omap-set-vals] v41'42 uv42 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/3 pointing to 0x0x10000000004 2023-11-17T06:33:31.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.855+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:511 5.25 5:a4000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8a80 con 0x55e90bc2a400 2023-11-17T06:33:31.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 13 ==== osd_op_reply(511 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000006.00000000 2023-11-17T06:33:31.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000006.0 2023-11-17T06:33:31.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:512 5.25 5:a5feb6f3:::10000000006.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9c00 con 0x55e90bc2a400 2023-11-17T06:33:31.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 14 ==== osd_op_reply(512 10000000006.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000006 2023-11-17T06:33:31.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/5 2023-11-17T06:33:31.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=5 2023-11-17T06:33:31.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:513 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9500 con 0x55e90bc2ac00 2023-11-17T06:33:31.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 83 ==== osd_op_reply(513 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:514 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7500 con 0x55e90bc2a000 2023-11-17T06:33:31.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 212 ==== osd_op_reply(514 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:515 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6e00 con 0x55e90bc2a800 2023-11-17T06:33:31.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 122 ==== osd_op_reply(515 10000000000.01800000 [omap-get-header out=274b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 39 2023-11-17T06:33:31.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.859+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:516 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7c00 con 0x55e90bc2a800 2023-11-17T06:33:31.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.863+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 123 ==== osd_op_reply(516 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.863+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=5 frag=1*, r=0 2023-11-17T06:33:31.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.863+0000 7fa48d92e840 20 datascan.read_dentry: 5_head not found in result 2023-11-17T06:33:31.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.863+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000006 at 0x0x10000000000/5 with size=1 bytes 2023-11-17T06:33:31.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.863+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:517 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7880 con 0x55e90bc2a800 2023-11-17T06:33:31.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.863+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 124 ==== osd_op_reply(517 10000000000.01800000 [omap-set-vals] v41'40 uv40 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.863+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/5 pointing to 0x0x10000000006 2023-11-17T06:33:31.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.863+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:518 5.25 5:a622384a::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a400 2023-11-17T06:33:31.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 15 ==== osd_op_reply(518 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000002c.00000000 2023-11-17T06:33:31.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000002c.0 2023-11-17T06:33:31.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:519 5.25 5:a622384a:::1000000002c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a400 2023-11-17T06:33:31.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 16 ==== osd_op_reply(519 1000000002c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002c 2023-11-17T06:33:31.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/43 2023-11-17T06:33:31.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=43 2023-11-17T06:33:31.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:520 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc2ac00 2023-11-17T06:33:31.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 84 ==== osd_op_reply(520 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:521 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 213 ==== osd_op_reply(521 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.867+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:522 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a000 2023-11-17T06:33:31.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 214 ==== osd_op_reply(522 10000000000.01000000 [omap-get-header out=274b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 42 2023-11-17T06:33:31.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:523 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a000 2023-11-17T06:33:31.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 215 ==== osd_op_reply(523 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=43 frag=0*, r=0 2023-11-17T06:33:31.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48d92e840 20 datascan.read_dentry: 43_head not found in result 2023-11-17T06:33:31.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002c at 0x0x10000000000/43 with size=2 bytes 2023-11-17T06:33:31.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:524 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bc2a000 2023-11-17T06:33:31.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 216 ==== osd_op_reply(524 10000000000.01000000 [omap-set-vals] v41'43 uv43 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/43 pointing to 0x0x1000000002c 2023-11-17T06:33:31.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.871+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:525 5.15 5:a8000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7880 con 0x55e90bc2a000 2023-11-17T06:33:31.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 217 ==== osd_op_reply(525 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000011.00000000 2023-11-17T06:33:31.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000011.0 2023-11-17T06:33:31.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:526 5.15 5:ab5910e2:::10000000011.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6380 con 0x55e90bc2a000 2023-11-17T06:33:31.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 218 ==== osd_op_reply(526 10000000011.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000011 2023-11-17T06:33:31.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/16 2023-11-17T06:33:31.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=16 2023-11-17T06:33:31.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:527 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7180 con 0x55e90bc2ac00 2023-11-17T06:33:31.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 85 ==== osd_op_reply(527 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:528 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2a000 2023-11-17T06:33:31.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 219 ==== osd_op_reply(528 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:529 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2a800 2023-11-17T06:33:31.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 125 ==== osd_op_reply(529 10000000000.01800000 [omap-get-header out=274b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 40 2023-11-17T06:33:31.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.875+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:530 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2a800 2023-11-17T06:33:31.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.879+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 126 ==== osd_op_reply(530 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.879+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=16 frag=1*, r=0 2023-11-17T06:33:31.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.879+0000 7fa48d92e840 20 datascan.read_dentry: 16_head not found in result 2023-11-17T06:33:31.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.879+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000011 at 0x0x10000000000/16 with size=2 bytes 2023-11-17T06:33:31.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.879+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:531 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a800 2023-11-17T06:33:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 127 ==== osd_op_reply(531 10000000000.01800000 [omap-set-vals] v41'41 uv41 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/16 pointing to 0x0x10000000011 2023-11-17T06:33:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:532 5.35 5:ac000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2a000 2023-11-17T06:33:31.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 220 ==== osd_op_reply(532 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa4878e1700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:533 5.d 5:b0000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6700 con 0x55e90bc2ac00 2023-11-17T06:33:31.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 86 ==== osd_op_reply(533 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000027.00000000 2023-11-17T06:33:31.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000027.0 2023-11-17T06:33:31.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:534 5.d 5:b0d15537:::10000000027.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2ac00 2023-11-17T06:33:31.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 87 ==== osd_op_reply(534 10000000027.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000027 2023-11-17T06:33:31.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/38 2023-11-17T06:33:31.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=38 2023-11-17T06:33:31.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.883+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:535 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bc2ac00 2023-11-17T06:33:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 88 ==== osd_op_reply(535 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:536 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a000 2023-11-17T06:33:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 221 ==== osd_op_reply(536 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:537 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a000 2023-11-17T06:33:31.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 222 ==== osd_op_reply(537 10000000000.01000000 [omap-get-header out=274b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 43 2023-11-17T06:33:31.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:538 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc2a000 2023-11-17T06:33:31.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 223 ==== osd_op_reply(538 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=38 frag=0*, r=0 2023-11-17T06:33:31.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 20 datascan.read_dentry: 38_head not found in result 2023-11-17T06:33:31.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000027 at 0x0x10000000000/38 with size=2 bytes 2023-11-17T06:33:31.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.887+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:539 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2a000 2023-11-17T06:33:31.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 224 ==== osd_op_reply(539 10000000000.01000000 [omap-set-vals] v41'44 uv44 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/38 pointing to 0x0x10000000027 2023-11-17T06:33:31.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:540 5.d 5:b185e6e8::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2ac00 2023-11-17T06:33:31.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 89 ==== osd_op_reply(540 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000012.00000000 2023-11-17T06:33:31.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000012.0 2023-11-17T06:33:31.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:541 5.d 5:b185e6e8:::10000000012.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7dc00 con 0x55e90bc2ac00 2023-11-17T06:33:31.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 90 ==== osd_op_reply(541 10000000012.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000012 2023-11-17T06:33:31.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/17 2023-11-17T06:33:31.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=17 2023-11-17T06:33:31.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.891+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:542 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca380 con 0x55e90bc2ac00 2023-11-17T06:33:31.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 91 ==== osd_op_reply(542 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:543 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca700 con 0x55e90bc2a000 2023-11-17T06:33:31.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 225 ==== osd_op_reply(543 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:544 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5caa80 con 0x55e90bc2a800 2023-11-17T06:33:31.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 128 ==== osd_op_reply(544 10000000000.01800000 [omap-get-header out=274b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 41 2023-11-17T06:33:31.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:545 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cae00 con 0x55e90bc2a800 2023-11-17T06:33:31.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 129 ==== osd_op_reply(545 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=17 frag=1*, r=0 2023-11-17T06:33:31.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 20 datascan.read_dentry: 17_head not found in result 2023-11-17T06:33:31.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000012 at 0x0x10000000000/17 with size=2 bytes 2023-11-17T06:33:31.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.895+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:546 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb180 con 0x55e90bc2a800 2023-11-17T06:33:31.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 130 ==== osd_op_reply(546 10000000000.01800000 [omap-set-vals] v41'42 uv42 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/17 pointing to 0x0x10000000012 2023-11-17T06:33:31.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:547 5.2d 5:b4000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb500 con 0x55e90bc2ac00 2023-11-17T06:33:31.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 92 ==== osd_op_reply(547 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000005d.00000000 2023-11-17T06:33:31.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000005d.0 2023-11-17T06:33:31.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:548 5.2d 5:b5236558:::1000000005d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb880 con 0x55e90bc2ac00 2023-11-17T06:33:31.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 93 ==== osd_op_reply(548 1000000005d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000005d 2023-11-17T06:33:31.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/92 2023-11-17T06:33:31.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=92 2023-11-17T06:33:31.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:549 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0000 con 0x55e90bc2ac00 2023-11-17T06:33:31.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.899+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 94 ==== osd_op_reply(549 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:550 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0380 con 0x55e90bc2a000 2023-11-17T06:33:31.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 226 ==== osd_op_reply(550 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:551 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0700 con 0x55e90bc2a000 2023-11-17T06:33:31.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 227 ==== osd_op_reply(551 10000000000.01000000 [omap-get-header out=274b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 44 2023-11-17T06:33:31.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:552 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0a80 con 0x55e90bc2a000 2023-11-17T06:33:31.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 228 ==== osd_op_reply(552 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=92 frag=0*, r=0 2023-11-17T06:33:31.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 20 datascan.read_dentry: 92_head not found in result 2023-11-17T06:33:31.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000005d at 0x0x10000000000/92 with size=2 bytes 2023-11-17T06:33:31.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.903+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:553 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0e00 con 0x55e90bc2a000 2023-11-17T06:33:31.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 229 ==== osd_op_reply(553 10000000000.01000000 [omap-set-vals] v41'45 uv45 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/92 pointing to 0x0x1000000005d 2023-11-17T06:33:31.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:554 5.1d 5:b8000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1180 con 0x55e90bc2a400 2023-11-17T06:33:31.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 17 ==== osd_op_reply(554 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000028.00000000 2023-11-17T06:33:31.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000028.0 2023-11-17T06:33:31.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:555 5.1d 5:ba3960b0:::10000000028.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1500 con 0x55e90bc2a400 2023-11-17T06:33:31.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 18 ==== osd_op_reply(555 10000000028.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000028 2023-11-17T06:33:31.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/39 2023-11-17T06:33:31.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=39 2023-11-17T06:33:31.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:556 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1c00 con 0x55e90bc2ac00 2023-11-17T06:33:31.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.907+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 95 ==== osd_op_reply(556 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:557 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0000 con 0x55e90bc2a000 2023-11-17T06:33:31.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 230 ==== osd_op_reply(557 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:558 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1c00 con 0x55e90bc2a000 2023-11-17T06:33:31.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 231 ==== osd_op_reply(558 10000000000.01000000 [omap-get-header out=274b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 45 2023-11-17T06:33:31.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:559 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb880 con 0x55e90bc2a000 2023-11-17T06:33:31.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 232 ==== osd_op_reply(559 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=39 frag=0*, r=0 2023-11-17T06:33:31.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 20 datascan.read_dentry: 39_head not found in result 2023-11-17T06:33:31.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000028 at 0x0x10000000000/39 with size=2 bytes 2023-11-17T06:33:31.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.911+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:560 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cbc00 con 0x55e90bc2a000 2023-11-17T06:33:31.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 233 ==== osd_op_reply(560 10000000000.01000000 [omap-set-vals] v41'46 uv46 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/39 pointing to 0x0x10000000028 2023-11-17T06:33:31.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:561 5.1d 5:bbf5850a::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb500 con 0x55e90bc2a400 2023-11-17T06:33:31.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 19 ==== osd_op_reply(561 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000007.00000000 2023-11-17T06:33:31.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000007.0 2023-11-17T06:33:31.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:562 5.1d 5:bbf5850a:::10000000007.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca380 con 0x55e90bc2a400 2023-11-17T06:33:31.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 20 ==== osd_op_reply(562 10000000007.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000007 2023-11-17T06:33:31.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/6 2023-11-17T06:33:31.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=6 2023-11-17T06:33:31.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:563 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7dc00 con 0x55e90bc2ac00 2023-11-17T06:33:31.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 96 ==== osd_op_reply(563 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.915+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:564 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d880 con 0x55e90bc2a000 2023-11-17T06:33:31.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 234 ==== osd_op_reply(564 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:565 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bc2a800 2023-11-17T06:33:31.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 131 ==== osd_op_reply(565 10000000000.01800000 [omap-get-header out=274b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 42 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:566 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2a800 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 132 ==== osd_op_reply(566 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=6 frag=1*, r=0 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 20 datascan.read_dentry: 6_head not found in result 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000007 at 0x0x10000000000/6 with size=1 bytes 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.919+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:567 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2a800 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 133 ==== osd_op_reply(567 10000000000.01800000 [omap-set-vals] v41'43 uv43 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/6 pointing to 0x0x10000000007 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:568 5.3d 5:bc000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6700 con 0x55e90bc65000 2023-11-17T06:33:31.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 13 ==== osd_op_reply(568 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000026.00000000 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000026.0 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:569 5.3d 5:be1922a8:::10000000026.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7180 con 0x55e90bc65000 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 14 ==== osd_op_reply(569 10000000026.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000026 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/37 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=37 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:570 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9500 con 0x55e90bc2ac00 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 97 ==== osd_op_reply(570 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:571 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9880 con 0x55e90bc2a000 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 235 ==== osd_op_reply(571 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.923+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:572 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9180 con 0x55e90bc2a800 2023-11-17T06:33:31.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.927+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 134 ==== osd_op_reply(572 10000000000.01800000 [omap-get-header out=274b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.927+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 43 2023-11-17T06:33:31.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.927+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.927+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:573 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0000 con 0x55e90bc2a800 2023-11-17T06:33:31.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.927+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 135 ==== osd_op_reply(573 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.927+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=37 frag=1*, r=0 2023-11-17T06:33:31.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.927+0000 7fa48d92e840 20 datascan.read_dentry: 37_head not found in result 2023-11-17T06:33:31.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.927+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000026 at 0x0x10000000000/37 with size=2 bytes 2023-11-17T06:33:31.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.927+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:574 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0e00 con 0x55e90bc2a800 2023-11-17T06:33:31.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 136 ==== osd_op_reply(574 10000000000.01800000 [omap-set-vals] v41'44 uv44 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/37 pointing to 0x0x10000000026 2023-11-17T06:33:31.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:575 5.3 5:c0000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0a80 con 0x55e90bb29400 2023-11-17T06:33:31.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 25 ==== osd_op_reply(575 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:31.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000060.00000000 2023-11-17T06:33:31.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000060.0 2023-11-17T06:33:31.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:576 5.3 5:c001b242:::10000000060.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0700 con 0x55e90bb29400 2023-11-17T06:33:31.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 26 ==== osd_op_reply(576 10000000060.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:31.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000060 2023-11-17T06:33:31.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/95 2023-11-17T06:33:31.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=95 2023-11-17T06:33:31.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.931+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:577 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb180 con 0x55e90bc2ac00 2023-11-17T06:33:31.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 98 ==== osd_op_reply(577 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:578 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cae00 con 0x55e90bc2a000 2023-11-17T06:33:31.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 236 ==== osd_op_reply(578 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:579 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5caa80 con 0x55e90bc2a000 2023-11-17T06:33:31.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 237 ==== osd_op_reply(579 10000000000.01000000 [omap-get-header out=274b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 46 2023-11-17T06:33:31.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:580 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca700 con 0x55e90bc2a000 2023-11-17T06:33:31.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 238 ==== osd_op_reply(580 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=95 frag=0*, r=0 2023-11-17T06:33:31.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 20 datascan.read_dentry: 95_head not found in result 2023-11-17T06:33:31.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000060 at 0x0x10000000000/95 with size=2 bytes 2023-11-17T06:33:31.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.935+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:581 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2a000 2023-11-17T06:33:31.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 239 ==== osd_op_reply(581 10000000000.01000000 [omap-set-vals] v41'47 uv47 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/95 pointing to 0x0x10000000060 2023-11-17T06:33:31.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:582 5.3 5:c1adcc3d::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bb29400 2023-11-17T06:33:31.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 27 ==== osd_op_reply(582 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:31.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000030.00000000 2023-11-17T06:33:31.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000030.0 2023-11-17T06:33:31.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:583 5.3 5:c1adcc3d:::10000000030.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bb29400 2023-11-17T06:33:31.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 28 ==== osd_op_reply(583 10000000030.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:31.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000030 2023-11-17T06:33:31.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/47 2023-11-17T06:33:31.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=47 2023-11-17T06:33:31.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:584 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bc2ac00 2023-11-17T06:33:31.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 99 ==== osd_op_reply(584 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.939+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:585 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a000 2023-11-17T06:33:31.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 240 ==== osd_op_reply(585 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:586 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2a800 2023-11-17T06:33:31.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 137 ==== osd_op_reply(586 10000000000.01800000 [omap-get-header out=274b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 44 2023-11-17T06:33:31.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:587 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2a800 2023-11-17T06:33:31.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 138 ==== osd_op_reply(587 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=47 frag=1*, r=0 2023-11-17T06:33:31.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 20 datascan.read_dentry: 47_head not found in result 2023-11-17T06:33:31.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000030 at 0x0x10000000000/47 with size=2 bytes 2023-11-17T06:33:31.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.943+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:588 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2a800 2023-11-17T06:33:31.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 139 ==== osd_op_reply(588 10000000000.01800000 [omap-set-vals] v41'45 uv45 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/47 pointing to 0x0x10000000030 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:589 5.23 5:c4000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6380 con 0x55e90bc2bc00 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 23 ==== osd_op_reply(589 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000002f.00000000 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000002f.0 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:590 5.23 5:c550f404:::1000000002f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6a80 con 0x55e90bc2bc00 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 24 ==== osd_op_reply(590 1000000002f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000002f 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/46 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=46 2023-11-17T06:33:31.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:591 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7500 con 0x55e90bc2ac00 2023-11-17T06:33:31.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 100 ==== osd_op_reply(591 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.947+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:592 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a000 2023-11-17T06:33:31.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 241 ==== osd_op_reply(592 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:593 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2a000 2023-11-17T06:33:31.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 242 ==== osd_op_reply(593 10000000000.01000000 [omap-get-header out=274b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 47 2023-11-17T06:33:31.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:594 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:31.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 243 ==== osd_op_reply(594 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=46 frag=0*, r=0 2023-11-17T06:33:31.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 20 datascan.read_dentry: 46_head not found in result 2023-11-17T06:33:31.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000002f at 0x0x10000000000/46 with size=2 bytes 2023-11-17T06:33:31.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.951+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:595 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7880 con 0x55e90bc2a000 2023-11-17T06:33:31.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 244 ==== osd_op_reply(595 10000000000.01000000 [omap-set-vals] v41'48 uv48 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/46 pointing to 0x0x1000000002f 2023-11-17T06:33:31.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:596 5.23 5:c6a0a389::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7c00 con 0x55e90bc2bc00 2023-11-17T06:33:31.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 25 ==== osd_op_reply(596 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000040.00000000 2023-11-17T06:33:31.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000040.0 2023-11-17T06:33:31.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:597 5.23 5:c6a0a389:::10000000040.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6e00 con 0x55e90bc2bc00 2023-11-17T06:33:31.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 26 ==== osd_op_reply(597 10000000040.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:31.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000040 2023-11-17T06:33:31.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/63 2023-11-17T06:33:31.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=63 2023-11-17T06:33:31.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:598 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8700 con 0x55e90bc2ac00 2023-11-17T06:33:31.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 101 ==== osd_op_reply(598 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:599 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8380 con 0x55e90bc2a000 2023-11-17T06:33:31.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 245 ==== osd_op_reply(599 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.955+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:600 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8000 con 0x55e90bc2a000 2023-11-17T06:33:31.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 246 ==== osd_op_reply(600 10000000000.01000000 [omap-get-header out=274b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 48 2023-11-17T06:33:31.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:601 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb500 con 0x55e90bc2a000 2023-11-17T06:33:31.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 247 ==== osd_op_reply(601 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=63 frag=0*, r=0 2023-11-17T06:33:31.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48d92e840 20 datascan.read_dentry: 63_head not found in result 2023-11-17T06:33:31.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000040 at 0x0x10000000000/63 with size=2 bytes 2023-11-17T06:33:31.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:602 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1180 con 0x55e90bc2a000 2023-11-17T06:33:31.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 248 ==== osd_op_reply(602 10000000000.01000000 [omap-set-vals] v41'49 uv49 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/63 pointing to 0x0x10000000040 2023-11-17T06:33:31.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.959+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:603 5.13 5:c8000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1880 con 0x55e90bb29400 2023-11-17T06:33:31.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 29 ==== osd_op_reply(603 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:31.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000008.00000000 2023-11-17T06:33:31.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000008.0 2023-11-17T06:33:31.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:604 5.13 5:cabe77c1:::10000000008.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1500 con 0x55e90bb29400 2023-11-17T06:33:31.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 30 ==== osd_op_reply(604 10000000008.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:31.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000008 2023-11-17T06:33:31.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/7 2023-11-17T06:33:31.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=7 2023-11-17T06:33:31.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:605 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc2ac00 2023-11-17T06:33:31.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 102 ==== osd_op_reply(605 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:606 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc2a000 2023-11-17T06:33:31.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 249 ==== osd_op_reply(606 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:607 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2a800 2023-11-17T06:33:31.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 140 ==== osd_op_reply(607 10000000000.01800000 [omap-get-header out=274b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 45 2023-11-17T06:33:31.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.963+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:608 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a800 2023-11-17T06:33:31.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.967+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 141 ==== osd_op_reply(608 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.967+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=7 frag=1*, r=0 2023-11-17T06:33:31.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.967+0000 7fa48d92e840 20 datascan.read_dentry: 7_head not found in result 2023-11-17T06:33:31.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.967+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000008 at 0x0x10000000000/7 with size=1 bytes 2023-11-17T06:33:31.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.967+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:609 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8a80 con 0x55e90bc2a800 2023-11-17T06:33:31.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.967+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 142 ==== osd_op_reply(609 10000000000.01800000 [omap-set-vals] v41'46 uv46 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.967+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/7 pointing to 0x0x10000000008 2023-11-17T06:33:31.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.967+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:610 5.33 5:cc000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8e00 con 0x55e90bb29c00 2023-11-17T06:33:31.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 27 ==== osd_op_reply(610 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000001d.00000000 2023-11-17T06:33:31.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000001d.0 2023-11-17T06:33:31.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:611 5.33 5:cf746ac5:::1000000001d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9c00 con 0x55e90bb29c00 2023-11-17T06:33:31.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.6 v2:172.21.15.93:6826/2665225471 28 ==== osd_op_reply(611 1000000001d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bb29c00 2023-11-17T06:33:31.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000001d 2023-11-17T06:33:31.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/28 2023-11-17T06:33:31.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=28 2023-11-17T06:33:31.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:612 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7180 con 0x55e90bc2ac00 2023-11-17T06:33:31.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 103 ==== osd_op_reply(612 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:613 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6a80 con 0x55e90bc2a000 2023-11-17T06:33:31.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 250 ==== osd_op_reply(613 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:31.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:614 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1180 con 0x55e90bc2a000 2023-11-17T06:33:31.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 251 ==== osd_op_reply(614 10000000000.01000000 [omap-get-header out=274b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 49 2023-11-17T06:33:31.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:31.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.971+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:615 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb500 con 0x55e90bc2a000 2023-11-17T06:33:31.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 252 ==== osd_op_reply(615 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=28 frag=0*, r=0 2023-11-17T06:33:31.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48d92e840 20 datascan.read_dentry: 28_head not found in result 2023-11-17T06:33:31.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000001d at 0x0x10000000000/28 with size=2 bytes 2023-11-17T06:33:31.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:616 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8000 con 0x55e90bc2a000 2023-11-17T06:33:31.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 253 ==== osd_op_reply(616 10000000000.01000000 [omap-set-vals] v41'50 uv50 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/28 pointing to 0x0x1000000001d 2023-11-17T06:33:31.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:617 5.b 5:d0000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8380 con 0x55e90bc2a400 2023-11-17T06:33:31.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 21 ==== osd_op_reply(617 [pgnls-filter start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000022.00000000 2023-11-17T06:33:31.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000022.0 2023-11-17T06:33:31.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.975+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:618 5.b 5:d2626379:::10000000022.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7880 con 0x55e90bc2a400 2023-11-17T06:33:31.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 22 ==== osd_op_reply(618 10000000022.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000022 2023-11-17T06:33:31.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/33 2023-11-17T06:33:31.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=33 2023-11-17T06:33:31.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:619 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34000 con 0x55e90bc2ac00 2023-11-17T06:33:31.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 104 ==== osd_op_reply(619 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:620 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a000 2023-11-17T06:33:31.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 254 ==== osd_op_reply(620 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:621 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2a800 2023-11-17T06:33:31.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 143 ==== osd_op_reply(621 10000000000.01800000 [omap-get-header out=274b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 46 2023-11-17T06:33:31.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:622 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2a800 2023-11-17T06:33:31.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 144 ==== osd_op_reply(622 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=33 frag=1*, r=0 2023-11-17T06:33:31.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 20 datascan.read_dentry: 33_head not found in result 2023-11-17T06:33:31.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000022 at 0x0x10000000000/33 with size=2 bytes 2023-11-17T06:33:31.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.979+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:623 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2a800 2023-11-17T06:33:31.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.983+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 145 ==== osd_op_reply(623 10000000000.01800000 [omap-set-vals] v41'47 uv47 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.983+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/33 pointing to 0x0x10000000022 2023-11-17T06:33:31.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.983+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:624 5.b 5:d30f9a54::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a400 2023-11-17T06:33:31.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.983+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 23 ==== osd_op_reply(624 [pgnls-filter start_epoch 41 out=101b] v41'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000052.00000000 2023-11-17T06:33:31.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000052.0 2023-11-17T06:33:31.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:625 5.b 5:d30f9a54:::10000000052.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ce00 con 0x55e90bc2a400 2023-11-17T06:33:31.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 24 ==== osd_op_reply(625 10000000052.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000052 2023-11-17T06:33:31.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/81 2023-11-17T06:33:31.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=81 2023-11-17T06:33:31.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:626 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc2ac00 2023-11-17T06:33:31.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 105 ==== osd_op_reply(626 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:31.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:31.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:627 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2a000 2023-11-17T06:33:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 255 ==== osd_op_reply(627 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:628 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca700 con 0x55e90bc2a800 2023-11-17T06:33:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 146 ==== osd_op_reply(628 10000000000.01800000 [omap-get-header out=274b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 47 2023-11-17T06:33:31.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.987+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:629 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5caa80 con 0x55e90bc2a800 2023-11-17T06:33:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.991+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 147 ==== osd_op_reply(629 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.991+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=81 frag=1*, r=0 2023-11-17T06:33:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.991+0000 7fa48d92e840 20 datascan.read_dentry: 81_head not found in result 2023-11-17T06:33:31.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.991+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000052 at 0x0x10000000000/81 with size=2 bytes 2023-11-17T06:33:31.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.991+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:630 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cae00 con 0x55e90bc2a800 2023-11-17T06:33:31.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.991+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 148 ==== osd_op_reply(630 10000000000.01800000 [omap-set-vals] v41'48 uv48 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:31.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.991+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/81 pointing to 0x0x10000000052 2023-11-17T06:33:31.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.991+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:631 5.b 5:d3d0d483::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0700 con 0x55e90bc2a400 2023-11-17T06:33:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 25 ==== osd_op_reply(631 [pgnls-filter start_epoch 41 out=81b] v41'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000021.00000000 2023-11-17T06:33:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000021.0 2023-11-17T06:33:31.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:632 5.b 5:d3d0d483:::10000000021.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0380 con 0x55e90bc2a400 2023-11-17T06:33:32.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 26 ==== osd_op_reply(632 10000000021.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:32.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000021 2023-11-17T06:33:32.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/32 2023-11-17T06:33:32.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=32 2023-11-17T06:33:32.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:633 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0e00 con 0x55e90bc2ac00 2023-11-17T06:33:32.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 106 ==== osd_op_reply(633 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:634 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0000 con 0x55e90bc2a000 2023-11-17T06:33:32.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 256 ==== osd_op_reply(634 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:32.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:635 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9180 con 0x55e90bc2a800 2023-11-17T06:33:32.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.995+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 149 ==== osd_op_reply(635 10000000000.01800000 [omap-get-header out=274b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 48 2023-11-17T06:33:32.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:32.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:636 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9880 con 0x55e90bc2a800 2023-11-17T06:33:32.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 150 ==== osd_op_reply(636 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=32 frag=1*, r=0 2023-11-17T06:33:32.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48d92e840 20 datascan.read_dentry: 32_head not found in result 2023-11-17T06:33:32.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000021 at 0x0x10000000000/32 with size=2 bytes 2023-11-17T06:33:32.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:637 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2a800 2023-11-17T06:33:32.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 151 ==== osd_op_reply(637 10000000000.01800000 [omap-set-vals] v41'49 uv49 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/32 pointing to 0x0x10000000021 2023-11-17T06:33:32.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:31.999+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:638 5.2b 5:d4000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c000 con 0x55e90bc2bc00 2023-11-17T06:33:32.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 27 ==== osd_op_reply(638 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:32.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000041.00000000 2023-11-17T06:33:32.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000041.0 2023-11-17T06:33:32.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:639 5.2b 5:d4b9b687:::10000000041.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c700 con 0x55e90bc2bc00 2023-11-17T06:33:32.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 28 ==== osd_op_reply(639 10000000041.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:32.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000041 2023-11-17T06:33:32.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/64 2023-11-17T06:33:32.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=64 2023-11-17T06:33:32.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:640 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cbc00 con 0x55e90bc2ac00 2023-11-17T06:33:32.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 107 ==== osd_op_reply(640 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:641 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb880 con 0x55e90bc2a000 2023-11-17T06:33:32.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 257 ==== osd_op_reply(641 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:32.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:642 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a000 2023-11-17T06:33:32.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 258 ==== osd_op_reply(642 10000000000.01000000 [omap-get-header out=274b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 50 2023-11-17T06:33:32.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:32.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.003+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:643 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2a000 2023-11-17T06:33:32.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 259 ==== osd_op_reply(643 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=64 frag=0*, r=0 2023-11-17T06:33:32.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 20 datascan.read_dentry: 64_head not found in result 2023-11-17T06:33:32.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000041 at 0x0x10000000000/64 with size=2 bytes 2023-11-17T06:33:32.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:644 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7c00 con 0x55e90bc2a000 2023-11-17T06:33:32.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 260 ==== osd_op_reply(644 10000000000.01000000 [omap-set-vals] v41'51 uv51 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/64 pointing to 0x0x10000000041 2023-11-17T06:33:32.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:645 5.2b 5:d747f723::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7500 con 0x55e90bc2bc00 2023-11-17T06:33:32.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 29 ==== osd_op_reply(645 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:32.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000036.00000000 2023-11-17T06:33:32.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000036.0 2023-11-17T06:33:32.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:646 5.2b 5:d747f723:::10000000036.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6e00 con 0x55e90bc2bc00 2023-11-17T06:33:32.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.0 v2:172.21.15.69:6800/3449021474 30 ==== osd_op_reply(646 10000000036.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2bc00 2023-11-17T06:33:32.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000036 2023-11-17T06:33:32.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/53 2023-11-17T06:33:32.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=53 2023-11-17T06:33:32.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.007+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:647 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7880 con 0x55e90bc2ac00 2023-11-17T06:33:32.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 108 ==== osd_op_reply(647 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:648 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a000 2023-11-17T06:33:32.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 261 ==== osd_op_reply(648 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:32.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:649 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8e00 con 0x55e90bc2a000 2023-11-17T06:33:32.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 262 ==== osd_op_reply(649 10000000000.01000000 [omap-get-header out=274b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 51 2023-11-17T06:33:32.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:32.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:650 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9c00 con 0x55e90bc2a000 2023-11-17T06:33:32.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 263 ==== osd_op_reply(650 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=53 frag=0*, r=0 2023-11-17T06:33:32.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 20 datascan.read_dentry: 53_head not found in result 2023-11-17T06:33:32.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000036 at 0x0x10000000000/53 with size=2 bytes 2023-11-17T06:33:32.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.011+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:651 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8380 con 0x55e90bc2a000 2023-11-17T06:33:32.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 264 ==== osd_op_reply(651 10000000000.01000000 [omap-set-vals] v41'52 uv52 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/53 pointing to 0x0x10000000036 2023-11-17T06:33:32.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:652 5.1b 5:d8000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6380 con 0x55e90bc2a800 2023-11-17T06:33:32.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 152 ==== osd_op_reply(652 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000031.00000000 2023-11-17T06:33:32.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000031.0 2023-11-17T06:33:32.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:653 5.1b 5:d88bb762:::10000000031.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7880 con 0x55e90bc2a800 2023-11-17T06:33:32.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 153 ==== osd_op_reply(653 10000000031.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000031 2023-11-17T06:33:32.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/48 2023-11-17T06:33:32.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=48 2023-11-17T06:33:32.022 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.015+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:654 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca000 con 0x55e90bc2ac00 2023-11-17T06:33:32.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 109 ==== osd_op_reply(654 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:655 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca380 con 0x55e90bc2a000 2023-11-17T06:33:32.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 265 ==== osd_op_reply(655 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:32.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:656 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6380 con 0x55e90bc2a800 2023-11-17T06:33:32.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 154 ==== osd_op_reply(656 10000000000.01800000 [omap-get-header out=274b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 49 2023-11-17T06:33:32.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:32.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:657 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8380 con 0x55e90bc2a800 2023-11-17T06:33:32.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 155 ==== osd_op_reply(657 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=48 frag=1*, r=0 2023-11-17T06:33:32.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 20 datascan.read_dentry: 48_head not found in result 2023-11-17T06:33:32.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000031 at 0x0x10000000000/48 with size=2 bytes 2023-11-17T06:33:32.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.019+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:658 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9c00 con 0x55e90bc2a800 2023-11-17T06:33:32.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.023+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 156 ==== osd_op_reply(658 10000000000.01800000 [omap-set-vals] v41'50 uv50 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.023+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/48 pointing to 0x0x10000000031 2023-11-17T06:33:32.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.023+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:659 5.3b 5:dc000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8e00 con 0x55e90bc2a400 2023-11-17T06:33:32.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.023+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 27 ==== osd_op_reply(659 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:32.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.023+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000010.00000000 2023-11-17T06:33:32.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.023+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000010.0 2023-11-17T06:33:32.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.023+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:660 5.3b 5:dde6a3df:::10000000010.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35c00 con 0x55e90bc2a400 2023-11-17T06:33:32.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 <== osd.5 v2:172.21.15.93:6802/753754499 28 ==== osd_op_reply(660 10000000010.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2b40 con 0x55e90bc2a400 2023-11-17T06:33:32.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000010 2023-11-17T06:33:32.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/15 2023-11-17T06:33:32.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=15 2023-11-17T06:33:32.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:661 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81fc00 con 0x55e90bc2ac00 2023-11-17T06:33:32.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 110 ==== osd_op_reply(661 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:662 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a000 2023-11-17T06:33:32.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 266 ==== osd_op_reply(662 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:32.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:663 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb880 con 0x55e90bc2a000 2023-11-17T06:33:32.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 267 ==== osd_op_reply(663 10000000000.01000000 [omap-get-header out=274b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 52 2023-11-17T06:33:32.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:32.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.027+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:664 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2a000 2023-11-17T06:33:32.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.031+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 268 ==== osd_op_reply(664 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.031+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=15 frag=0*, r=0 2023-11-17T06:33:32.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.031+0000 7fa48d92e840 20 datascan.read_dentry: 15_head not found in result 2023-11-17T06:33:32.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.031+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000010 at 0x0x10000000000/15 with size=2 bytes 2023-11-17T06:33:32.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.031+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:665 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9880 con 0x55e90bc2a000 2023-11-17T06:33:32.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.031+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 269 ==== osd_op_reply(665 10000000000.01000000 [omap-set-vals] v41'53 uv53 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.031+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/15 pointing to 0x0x10000000010 2023-11-17T06:33:32.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.031+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:666 5.7 5:e0000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9180 con 0x55e90bc2a000 2023-11-17T06:33:32.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.031+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 270 ==== osd_op_reply(666 [pgnls-filter start_epoch 41 out=101b] v41'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000049.00000000 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000049.0 2023-11-17T06:33:32.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:667 5.7 5:e2d50132:::10000000049.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0000 con 0x55e90bc2a000 2023-11-17T06:33:32.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 271 ==== osd_op_reply(667 10000000049.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000049 2023-11-17T06:33:32.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/72 2023-11-17T06:33:32.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=72 2023-11-17T06:33:32.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:668 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5caa80 con 0x55e90bc2ac00 2023-11-17T06:33:32.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 111 ==== osd_op_reply(668 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:669 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca700 con 0x55e90bc2a000 2023-11-17T06:33:32.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 272 ==== osd_op_reply(669 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:670 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2a800 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 157 ==== osd_op_reply(670 10000000000.01800000 [omap-get-header out=274b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 50 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:32.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:671 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2a800 2023-11-17T06:33:32.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 158 ==== osd_op_reply(671 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=72 frag=1*, r=0 2023-11-17T06:33:32.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 20 datascan.read_dentry: 72_head not found in result 2023-11-17T06:33:32.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000049 at 0x0x10000000000/72 with size=2 bytes 2023-11-17T06:33:32.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.035+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:672 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2a800 2023-11-17T06:33:32.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.039+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 159 ==== osd_op_reply(672 10000000000.01800000 [omap-set-vals] v41'51 uv51 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.039+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/72 pointing to 0x0x10000000049 2023-11-17T06:33:32.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.039+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:673 5.7 5:e2e07930::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6e00 con 0x55e90bc2a000 2023-11-17T06:33:32.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.039+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 273 ==== osd_op_reply(673 [pgnls-filter start_epoch 41 out=81b] v41'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.039+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.039+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000001.0 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.039+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:674 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a000 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 274 ==== osd_op_reply(674 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/0 2023-11-17T06:33:32.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=0 2023-11-17T06:33:32.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:675 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb500 con 0x55e90bc2ac00 2023-11-17T06:33:32.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 112 ==== osd_op_reply(675 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:676 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1180 con 0x55e90bc2a000 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 275 ==== osd_op_reply(676 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:677 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6a80 con 0x55e90bc2a800 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 160 ==== osd_op_reply(677 10000000000.01800000 [omap-get-header out=274b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 51 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:678 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8a80 con 0x55e90bc2a800 2023-11-17T06:33:32.050 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 161 ==== osd_op_reply(678 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=0 frag=1*, r=0 2023-11-17T06:33:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 20 datascan.read_dentry: 0_head not found in result 2023-11-17T06:33:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/0 with size=1 bytes 2023-11-17T06:33:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.043+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:679 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a800 2023-11-17T06:33:32.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.047+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 162 ==== osd_op_reply(679 10000000000.01800000 [omap-set-vals] v41'52 uv52 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.047+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/0 pointing to 0x0x10000000001 2023-11-17T06:33:32.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.047+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:680 5.27 5:e4000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bb29400 2023-11-17T06:33:32.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.047+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 31 ==== osd_op_reply(680 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:32.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.047+0000 7fa4878e1700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:681 5.17 5:e8000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9500 con 0x55e90bb29400 2023-11-17T06:33:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 32 ==== osd_op_reply(681 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000000d.00000000 2023-11-17T06:33:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000000d.0 2023-11-17T06:33:32.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:682 5.17 5:e9ecae36:::1000000000d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bb29400 2023-11-17T06:33:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 33 ==== osd_op_reply(682 1000000000d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000d 2023-11-17T06:33:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/12 2023-11-17T06:33:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=12 2023-11-17T06:33:32.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:683 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35500 con 0x55e90bc2ac00 2023-11-17T06:33:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 113 ==== osd_op_reply(683 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.057 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:684 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1880 con 0x55e90bc2a000 2023-11-17T06:33:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 276 ==== osd_op_reply(684 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:32.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.051+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:685 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb180 con 0x55e90bc2a000 2023-11-17T06:33:32.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 277 ==== osd_op_reply(685 10000000000.01000000 [omap-get-header out=274b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 53 2023-11-17T06:33:32.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:32.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:686 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cbc00 con 0x55e90bc2a000 2023-11-17T06:33:32.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 278 ==== osd_op_reply(686 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=12 frag=0*, r=0 2023-11-17T06:33:32.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48d92e840 20 datascan.read_dentry: 12_head not found in result 2023-11-17T06:33:32.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000d at 0x0x10000000000/12 with size=2 bytes 2023-11-17T06:33:32.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:687 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca000 con 0x55e90bc2a000 2023-11-17T06:33:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 279 ==== osd_op_reply(687 10000000000.01000000 [omap-set-vals] v41'54 uv54 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/12 pointing to 0x0x1000000000d 2023-11-17T06:33:32.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.055+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:688 5.17 5:eb6757d1::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5caa80 con 0x55e90bb29400 2023-11-17T06:33:32.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 34 ==== osd_op_reply(688 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:32.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000023.00000000 2023-11-17T06:33:32.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000023.0 2023-11-17T06:33:32.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:689 5.17 5:eb6757d1:::10000000023.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90b81f880 con 0x55e90bb29400 2023-11-17T06:33:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.4 v2:172.21.15.93:6812/1712617818 35 ==== osd_op_reply(689 10000000023.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bb29400 2023-11-17T06:33:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000023 2023-11-17T06:33:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/34 2023-11-17T06:33:32.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=34 2023-11-17T06:33:32.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:690 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7180 con 0x55e90bc2ac00 2023-11-17T06:33:32.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 114 ==== osd_op_reply(690 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:691 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd7880 con 0x55e90bc2a000 2023-11-17T06:33:32.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 280 ==== osd_op_reply(691 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:32.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:692 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0e00 con 0x55e90bc2a000 2023-11-17T06:33:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 281 ==== osd_op_reply(692 10000000000.01000000 [omap-get-header out=274b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 54 2023-11-17T06:33:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.059+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:693 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7dc00 con 0x55e90bc2a000 2023-11-17T06:33:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.063+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 282 ==== osd_op_reply(693 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.063+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=34 frag=0*, r=0 2023-11-17T06:33:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.063+0000 7fa48d92e840 20 datascan.read_dentry: 34_head not found in result 2023-11-17T06:33:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.063+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000023 at 0x0x10000000000/34 with size=2 bytes 2023-11-17T06:33:32.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.063+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:694 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d180 con 0x55e90bc2a000 2023-11-17T06:33:32.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.063+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 283 ==== osd_op_reply(694 10000000000.01000000 [omap-set-vals] v41'55 uv55 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.063+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/34 pointing to 0x0x10000000023 2023-11-17T06:33:32.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.063+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:695 5.37 5:ec000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34e00 con 0x55e90bc65000 2023-11-17T06:33:32.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 15 ==== osd_op_reply(695 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:32.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000000e.00000000 2023-11-17T06:33:32.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000000e.0 2023-11-17T06:33:32.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:696 5.37 5:eefe613f:::1000000000e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34a80 con 0x55e90bc65000 2023-11-17T06:33:32.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 16 ==== osd_op_reply(696 1000000000e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:32.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000000e 2023-11-17T06:33:32.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/13 2023-11-17T06:33:32.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=13 2023-11-17T06:33:32.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:697 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8700 con 0x55e90bc2ac00 2023-11-17T06:33:32.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 115 ==== osd_op_reply(697 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:698 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca000 con 0x55e90bc2a000 2023-11-17T06:33:32.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 284 ==== osd_op_reply(698 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:32.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:699 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cbc00 con 0x55e90bc2a800 2023-11-17T06:33:32.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 163 ==== osd_op_reply(699 10000000000.01800000 [omap-get-header out=274b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 52 2023-11-17T06:33:32.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:32.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.067+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:700 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb180 con 0x55e90bc2a800 2023-11-17T06:33:32.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.071+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 164 ==== osd_op_reply(700 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.071+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=13 frag=1*, r=0 2023-11-17T06:33:32.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.071+0000 7fa48d92e840 20 datascan.read_dentry: 13_head not found in result 2023-11-17T06:33:32.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.071+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000000e at 0x0x10000000000/13 with size=2 bytes 2023-11-17T06:33:32.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.071+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:701 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1880 con 0x55e90bc2a800 2023-11-17T06:33:32.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.071+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 165 ==== osd_op_reply(701 10000000000.01800000 [omap-set-vals] v41'53 uv53 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.071+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/13 pointing to 0x0x1000000000e 2023-11-17T06:33:32.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.071+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:702 5.f 5:f0000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35180 con 0x55e90bc65000 2023-11-17T06:33:32.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 17 ==== osd_op_reply(702 [pgnls-filter start_epoch 41 out=81b] v41'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:32.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000003a.00000000 2023-11-17T06:33:32.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000003a.0 2023-11-17T06:33:32.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:703 5.f 5:f1a9c549:::1000000003a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1500 con 0x55e90bc65000 2023-11-17T06:33:32.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.1 v2:172.21.15.69:6809/346628569 18 ==== osd_op_reply(703 1000000003a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv3 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc65000 2023-11-17T06:33:32.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000003a 2023-11-17T06:33:32.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/57 2023-11-17T06:33:32.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=57 2023-11-17T06:33:32.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:704 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34380 con 0x55e90bc2ac00 2023-11-17T06:33:32.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 116 ==== osd_op_reply(704 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:705 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc35880 con 0x55e90bc2a000 2023-11-17T06:33:32.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 285 ==== osd_op_reply(705 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:32.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:706 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8a80 con 0x55e90bc2a800 2023-11-17T06:33:32.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.075+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 166 ==== osd_op_reply(706 10000000000.01800000 [omap-get-header out=274b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.079+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 53 2023-11-17T06:33:32.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.079+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:32.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.079+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:707 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6a80 con 0x55e90bc2a800 2023-11-17T06:33:32.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.079+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 167 ==== osd_op_reply(707 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.079+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=57 frag=1*, r=0 2023-11-17T06:33:32.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.079+0000 7fa48d92e840 20 datascan.read_dentry: 57_head not found in result 2023-11-17T06:33:32.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.079+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000003a at 0x0x10000000000/57 with size=2 bytes 2023-11-17T06:33:32.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.079+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:708 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce1180 con 0x55e90bc2a800 2023-11-17T06:33:32.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.079+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 168 ==== osd_op_reply(708 10000000000.01800000 [omap-set-vals] v41'54 uv54 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/57 pointing to 0x0x1000000003a 2023-11-17T06:33:32.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:709 5.2f 5:f4000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc34700 con 0x55e90bc2a000 2023-11-17T06:33:32.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 286 ==== osd_op_reply(709 [pgnls-filter start_epoch 41 out=101b] v41'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 10000000024.00000000 2023-11-17T06:33:32.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 10 datascan.operator(): handling object 10000000024.0 2023-11-17T06:33:32.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:710 5.2f 5:f6ddf183:::10000000024.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8000 con 0x55e90bc2a000 2023-11-17T06:33:32.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 287 ==== osd_op_reply(710 10000000024.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv5 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x10000000024 2023-11-17T06:33:32.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/35 2023-11-17T06:33:32.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=35 2023-11-17T06:33:32.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:711 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca7c00 con 0x55e90bc2ac00 2023-11-17T06:33:32.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 117 ==== osd_op_reply(711 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:712 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6000 con 0x55e90bc2a000 2023-11-17T06:33:32.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 288 ==== osd_op_reply(712 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 1* 2023-11-17T06:33:32.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.083+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:713 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7d500 con 0x55e90bc2a800 2023-11-17T06:33:32.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 169 ==== osd_op_reply(713 10000000000.01800000 [omap-get-header out=274b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 54 2023-11-17T06:33:32.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-11-17T06:33:32.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:714 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5ca700 con 0x55e90bc2a800 2023-11-17T06:33:32.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 170 ==== osd_op_reply(714 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01800000 dname=35 frag=1*, r=0 2023-11-17T06:33:32.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48d92e840 20 datascan.read_dentry: 35_head not found in result 2023-11-17T06:33:32.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000024 at 0x0x10000000000/35 with size=2 bytes 2023-11-17T06:33:32.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:715 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bce0000 con 0x55e90bc2a800 2023-11-17T06:33:32.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 171 ==== osd_op_reply(715 10000000000.01800000 [omap-set-vals] v41'55 uv55 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/35 pointing to 0x0x10000000024 2023-11-17T06:33:32.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.087+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:716 5.2f 5:f7911ae7::::head [pgnls-filter start_epoch 41 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cae00 con 0x55e90bc2a000 2023-11-17T06:33:32.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 289 ==== osd_op_reply(716 [pgnls-filter start_epoch 41 out=81b] v41'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 20 datascan.forall_objects: OSD matched oid 1000000004a.00000000 2023-11-17T06:33:32.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 10 datascan.operator(): handling object 1000000004a.0 2023-11-17T06:33:32.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:717 5.2f 5:f7911ae7:::1000000004a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9180 con 0x55e90bc2a000 2023-11-17T06:33:32.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 290 ==== osd_op_reply(717 1000000004a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 10 datascan.inject_with_backtrace: inode: 0x0x1000000004a 2023-11-17T06:33:32.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/73 2023-11-17T06:33:32.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=73 2023-11-17T06:33:32.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:718 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7c380 con 0x55e90bc2ac00 2023-11-17T06:33:32.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48b8e9700 1 -- 172.21.15.69:0/2277796807 <== osd.7 v2:172.21.15.93:6810/4059179485 118 ==== osd_op_reply(718 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55e90c5c2fc0 con 0x55e90bc2ac00 2023-11-17T06:33:32.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-11-17T06:33:32.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:719 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5cb880 con 0x55e90bc2a000 2023-11-17T06:33:32.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 291 ==== osd_op_reply(719 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-11-17T06:33:32.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-11-17T06:33:32.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 20 datascan.get_frag_of: frag is 0* 2023-11-17T06:33:32.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:720 4.5 4:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bc7ca80 con 0x55e90bc2a000 2023-11-17T06:33:32.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 292 ==== osd_op_reply(720 10000000000.01000000 [omap-get-header out=274b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 10 datascan.find_or_create_dirfrag: read_version = 55 2023-11-17T06:33:32.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-11-17T06:33:32.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:721 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c9c00 con 0x55e90bc2a000 2023-11-17T06:33:32.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 293 ==== osd_op_reply(721 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 20 datascan.read_dentry: oid=10000000000.01000000 dname=73 frag=0*, r=0 2023-11-17T06:33:32.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 20 datascan.read_dentry: 73_head not found in result 2023-11-17T06:33:32.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.091+0000 7fa48d92e840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000004a at 0x0x10000000000/73 with size=2 bytes 2023-11-17T06:33:32.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:722 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90c5c8380 con 0x55e90bc2a000 2023-11-17T06:33:32.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.3 v2:172.21.15.69:6824/183679214 294 ==== osd_op_reply(722 10000000000.01000000 [omap-set-vals] v41'56 uv56 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a000 2023-11-17T06:33:32.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/73 pointing to 0x0x1000000004a 2023-11-17T06:33:32.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:723 5.1f 5:f8000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bca6380 con 0x55e90bc2a800 2023-11-17T06:33:32.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 172 ==== osd_op_reply(723 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa4870e0700 1 -- 172.21.15.69:0/2277796807 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:724 5.3f 5:fc000000::::head [pgnls-filter start_epoch 41 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55e90bcd6380 con 0x55e90bc2a800 2023-11-17T06:33:32.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48c8eb700 1 -- 172.21.15.69:0/2277796807 <== osd.2 v2:172.21.15.69:6808/576340262 173 ==== osd_op_reply(724 [pgnls-filter start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e90c5c3200 con 0x55e90bc2a800 2023-11-17T06:33:32.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x55e90bc2bc00 msgr2=0x55e90bc3ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x55e90bc2bc00 0x55e90bc3ab00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x55e90bc65000 msgr2=0x55e90bc3b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x55e90bc65000 0x55e90bc3b080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x55e90bc2a800 msgr2=0x55e90bc3a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x55e90bc2a800 0x55e90bc3a580 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55e90bc2a000 msgr2=0x55e90b84db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55e90bc2a000 0x55e90b84db80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x55e90bb29400 msgr2=0x55e90bc3c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x55e90bb29400 0x55e90bc3c680 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x55e90bc2a400 msgr2=0x55e90b84d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x55e90bc2a400 0x55e90b84d600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x55e90bb29c00 msgr2=0x55e90b84e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x55e90bb29c00 0x55e90b84e100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x55e90bc2ac00 msgr2=0x55e90bc3a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x55e90bc2ac00 0x55e90bc3a000 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 reap_dead start 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 reap_dead start 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 reap_dead start 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55e90bb29800 msgr2=0x55e90b84f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55e90bb29800 0x55e90b84f700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55e90bad6a80 tx=0x55e90c5c4300 comp rx=0 tx=0).stop 2023-11-17T06:33:32.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28c00 msgr2=0x55e90b84e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 --2- 172.21.15.69:0/2277796807 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90bb28c00 0x55e90b84e680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x55e90b893bf0 tx=0x55e90c5c4120 comp rx=0 tx=0).stop 2023-11-17T06:33:32.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48c0ea700 1 -- 172.21.15.69:0/2277796807 reap_dead start 2023-11-17T06:33:32.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 shutdown_connections 2023-11-17T06:33:32.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.095+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 >> 172.21.15.69:0/2277796807 conn(0x55e90bb28000 msgr2=0x55e90b8a3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 shutdown_connections 2023-11-17T06:33:32.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 -- 172.21.15.69:0/2277796807 wait complete. 2023-11-17T06:33:32.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 -- 172.21.15.69:0/1053898936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90b7d9400 msgr2=0x55e90b84cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 --2- 172.21.15.69:0/1053898936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90b7d9400 0x55e90b84cb00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x55e90b8935f0 tx=0x55e90c5c4480 comp rx=0 tx=0).stop 2023-11-17T06:33:32.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 -- 172.21.15.69:0/1053898936 shutdown_connections 2023-11-17T06:33:32.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 --2- 172.21.15.69:0/1053898936 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55e90b7d9800 0x55e90b84d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 --2- 172.21.15.69:0/1053898936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e90b7d9400 0x55e90b84cb00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 --2- 172.21.15.69:0/1053898936 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e90b7d9000 0x55e90b84c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 -- 172.21.15.69:0/1053898936 >> 172.21.15.69:0/1053898936 conn(0x55e90b7d8c00 msgr2=0x55e90b8a3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 -- 172.21.15.69:0/1053898936 shutdown_connections 2023-11-17T06:33:32.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.099+0000 7fa48d92e840 1 -- 172.21.15.69:0/1053898936 wait complete. 2023-11-17T06:33:32.112 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes'] in time 0:00:00.963995, result: 2023-11-17T06:33:32.112 DEBUG:teuthology.orchestra.run.smithi069:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2023-11-17T06:33:32.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5bd8b840 1 -- start start 2023-11-17T06:33:32.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5bd8b840 1 Processor -- start 2023-11-17T06:33:32.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5bd8b840 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d711d63000 0x55d711dd6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5bd8b840 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d711d63400 0x55d711dd6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5bd8b840 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d711d63800 0x55d711dd7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5bd8b840 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d711d99180 con 0x55d711d63400 2023-11-17T06:33:32.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5bd8b840 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d711d98140 con 0x55d711d63000 2023-11-17T06:33:32.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5bd8b840 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d711d98000 con 0x55d711d63800 2023-11-17T06:33:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc59d46700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d711d63400 0x55d711dd6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc59d46700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d711d63400 0x55d711dd6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34848/0 (socket says 172.21.15.69:34848) 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc59d46700 1 -- 172.21.15.69:0/2031523837 learned_addr learned my addr 172.21.15.69:0/2031523837 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/2031523837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d711d63800 0x55d711dd7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5a547700 1 --2- 172.21.15.69:0/2031523837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d711d63000 0x55d711dd6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc59d46700 1 -- 172.21.15.69:0/2031523837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d711d63800 msgr2=0x55d711dd7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc59d46700 1 --2- 172.21.15.69:0/2031523837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d711d63800 0x55d711dd7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc59d46700 1 -- 172.21.15.69:0/2031523837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d711d63000 msgr2=0x55d711dd6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc59d46700 1 --2- 172.21.15.69:0/2031523837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d711d63000 0x55d711dd6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc59d46700 1 -- 172.21.15.69:0/2031523837 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d711d84b60 con 0x55d711d63400 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/2031523837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d711d63800 0x55d711dd7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc59d46700 1 --2- 172.21.15.69:0/2031523837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d711d63400 0x55d711dd6b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x55d711e1d560 tx=0x55d712b48480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5992d700087b9c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc57d42700 1 -- 172.21.15.69:0/2031523837 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d711d97600 con 0x55d711d63400 2023-11-17T06:33:32.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc57d42700 1 -- 172.21.15.69:0/2031523837 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d711dae480 con 0x55d711d63400 2023-11-17T06:33:32.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc57d42700 1 -- 172.21.15.69:0/2031523837 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d711d971e0 con 0x55d711d63400 2023-11-17T06:33:32.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.215+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/2031523837 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d711d84340 con 0x55d711d63400 2023-11-17T06:33:32.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/2031523837 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d711d84000 con 0x55d711d63400 2023-11-17T06:33:32.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 4 waiting for MDS map... 2023-11-17T06:33:32.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc57d42700 1 -- 172.21.15.69:0/2031523837 <== mon.0 v2:172.21.15.69:3300/0 4 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x55d711d9cc40 con 0x55d711d63400 2023-11-17T06:33:32.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc57d42700 1 -- 172.21.15.69:0/2031523837 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 23) v1 ==== 3298+0+0 (secure 0 0 0) 0x55d712aca000 con 0x55d711d63400 2023-11-17T06:33:32.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 4 Got MDS map 23 2023-11-17T06:33:32.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 4 datascan.main: Using metadata pool output 2023-11-17T06:33:32.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 4 datascan.main: connecting to RADOS... 2023-11-17T06:33:32.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 1 Processor -- start 2023-11-17T06:33:32.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 1 -- start start 2023-11-17T06:33:32.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d7120ae400 0x55d711dd7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d7120aec00 0x55d711dd8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d711d98a00 con 0x55d7120ae800 2023-11-17T06:33:32.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d711dbd180 con 0x55d7120aec00 2023-11-17T06:33:32.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5bd8b840 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d711dbcdc0 con 0x55d7120ae400 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5a547700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5a547700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34854/0 (socket says 172.21.15.69:34854) 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.219+0000 7fcc5a547700 1 -- 172.21.15.69:0/293043908 learned_addr learned my addr 172.21.15.69:0/293043908 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/293043908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d7120ae400 0x55d711dd7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc59d46700 1 --2- 172.21.15.69:0/293043908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d7120aec00 0x55d711dd8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5a547700 1 -- 172.21.15.69:0/293043908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d7120ae400 msgr2=0x55d711dd7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5a547700 1 --2- 172.21.15.69:0/293043908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d7120ae400 0x55d711dd7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5a547700 1 -- 172.21.15.69:0/293043908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d7120aec00 msgr2=0x55d711dd8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5a547700 1 --2- 172.21.15.69:0/293043908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d7120aec00 0x55d711dd8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5a547700 1 -- 172.21.15.69:0/293043908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d711d84ea0 con 0x55d7120ae800 2023-11-17T06:33:32.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc59d46700 1 --2- 172.21.15.69:0/293043908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d7120aec00 0x55d711dd8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5a547700 1 --2- 172.21.15.69:0/293043908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd7b80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x55d712048ae0 tx=0x55d712064c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978672de19a73524 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc55d3e700 1 -- 172.21.15.69:0/293043908 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d711d97600 con 0x55d7120ae800 2023-11-17T06:33:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc55d3e700 1 -- 172.21.15.69:0/293043908 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d711dae900 con 0x55d7120ae800 2023-11-17T06:33:32.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc55d3e700 1 -- 172.21.15.69:0/293043908 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d711d971e0 con 0x55d7120ae800 2023-11-17T06:33:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/293043908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 msgr2=0x55d711dd7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/293043908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd7b80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x55d712048ae0 tx=0x55d712064c00 comp rx=0 tx=0).stop 2023-11-17T06:33:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/293043908 shutdown_connections 2023-11-17T06:33:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/293043908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d7120aec00 0x55d711dd8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/293043908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd7b80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/293043908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d7120ae400 0x55d711dd7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/293043908 >> 172.21.15.69:0/293043908 conn(0x55d7120ae000 msgr2=0x55d711e2d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/293043908 shutdown_connections 2023-11-17T06:33:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/293043908 wait complete. 2023-11-17T06:33:32.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 Processor -- start 2023-11-17T06:33:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.223+0000 7fcc5bd8b840 1 -- start start 2023-11-17T06:33:32.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5bd8b840 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d7120ae400 0x55d711dd9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5bd8b840 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5bd8b840 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d7120aec00 0x55d711dd8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5bd8b840 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d711dbcc80 con 0x55d7120ae800 2023-11-17T06:33:32.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5bd8b840 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d711d98140 con 0x55d7120aec00 2023-11-17T06:33:32.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5bd8b840 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d711d98b40 con 0x55d7120ae400 2023-11-17T06:33:32.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5a547700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5a547700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34870/0 (socket says 172.21.15.69:34870) 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 learned_addr learned my addr 172.21.15.69:0/3648064671 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d7120ae400 0x55d711dd9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d7120aec00 0x55d711dd8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d7120ae400 msgr2=0x55d711dd9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5a547700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d7120ae400 0x55d711dd9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d7120aec00 msgr2=0x55d711dd8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5a547700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d7120aec00 0x55d711dd8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d711d84b60 con 0x55d7120ae800 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5a547700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd8c00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55d7120497a0 tx=0x55d712b483c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5453b700 1 -- 172.21.15.69:0/3648064671 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d711d96dc0 con 0x55d7120ae800 2023-11-17T06:33:32.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5453b700 1 -- 172.21.15.69:0/3648064671 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d711dae480 con 0x55d7120ae800 2023-11-17T06:33:32.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5453b700 1 -- 172.21.15.69:0/3648064671 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d711d97600 con 0x55d7120ae800 2023-11-17T06:33:32.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d711d84340 con 0x55d7120ae800 2023-11-17T06:33:32.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d711d85520 con 0x55d7120ae800 2023-11-17T06:33:32.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.227+0000 7fcc5bd8b840 4 datascan.init: resolving metadata pool 4 2023-11-17T06:33:32.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.231+0000 7fcc5453b700 1 -- 172.21.15.69:0/3648064671 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x55d711db0840 con 0x55d7120ae800 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.231+0000 7fcc5453b700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55d7120af400 0x55d711dd9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.231+0000 7fcc5453b700 1 -- 172.21.15.69:0/3648064671 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x55d711d9ca80 con 0x55d7120ae800 2023-11-17T06:33:32.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.231+0000 7fcc5bd8b840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-11-17T06:33:32.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.231+0000 7fcc5bd8b840 4 datascan.main: resolving metadata pool 4 2023-11-17T06:33:32.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.231+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x55d7120af800 0x55d711dd8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.231+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:1 4.0 4:00000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7120af800 2023-11-17T06:33:32.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.231+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55d7120af400 0x55d711dd9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.231+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x55d7120af800 0x55d711dd8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.235+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55d7120af400 0x55d711dd9700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55d711e1c420 tx=0x55d712b48000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.235+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x55d7120af800 0x55d711dd8100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.235+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 1 ==== osd_op_reply(1 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.235+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x55d7121b8000 0x55d7121ba000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.235+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:2 4.10 4:08000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8000 2023-11-17T06:33:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.235+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x55d7121b8000 0x55d7121ba000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.235+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x55d7121b8000 0x55d7121ba000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.239+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 1 ==== osd_op_reply(2 [pgnls start_epoch 41 out=177b] v40'12 uv12 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.239+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55d7121b8800 0x55d7121ba580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.239+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:3 4.8 4:10000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8800 2023-11-17T06:33:32.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.239+0000 7fcc5a547700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55d7121b8800 0x55d7121ba580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.239+0000 7fcc5a547700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55d7121b8800 0x55d7121ba580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.239+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 1 ==== osd_op_reply(3 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.239+0000 7fcc5a547700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x55d7121b8c00 0x55d7121bab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.239+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:4 4.18 4:18000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.239+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x55d7121b8c00 0x55d7121bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.239+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x55d7121b8c00 0x55d7121bab00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.243+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 1 ==== osd_op_reply(4 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.243+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x55d7121b8400 0x55d7121bb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.243+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:5 4.4 4:20000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8400 2023-11-17T06:33:32.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.243+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x55d7121b8400 0x55d7121bb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.243+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x55d7121b8400 0x55d7121bb080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.243+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 1 ==== osd_op_reply(5 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.243+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:6 4.14 4:28000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8400 2023-11-17T06:33:32.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.247+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 2 ==== osd_op_reply(6 [pgnls start_epoch 41 out=149b] v40'26 uv26 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.247+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x55d7121b9400 0x55d7121bbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.247+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:7 4.c 4:30000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b9400 2023-11-17T06:33:32.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.247+0000 7fcc5a547700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x55d7121b9400 0x55d7121bbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.247+0000 7fcc5a547700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x55d7121b9400 0x55d7121bbb80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.247+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.0 v2:172.21.15.69:6800/3449021474 1 ==== osd_op_reply(7 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b9400 2023-11-17T06:33:32.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.247+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:8 4.1c 4:38000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7120af800 2023-11-17T06:33:32.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.247+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 2 ==== osd_op_reply(8 [pgnls start_epoch 41 out=73b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.247+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:9 4.2 4:40000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8400 2023-11-17T06:33:32.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.251+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 3 ==== osd_op_reply(9 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.251+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:10 4.12 4:48000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7120af800 2023-11-17T06:33:32.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.251+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 3 ==== osd_op_reply(10 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.251+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:11 4.a 4:50000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.251+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 2 ==== osd_op_reply(11 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.251+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:12 4.1a 4:58000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.251+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 3 ==== osd_op_reply(12 [pgnls start_epoch 41 out=49b] v40'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.251+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x55d7121b9c00 0x55d7121bb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.251+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:13 4.6 4:60000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b9c00 2023-11-17T06:33:32.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.251+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x55d7121b9c00 0x55d7121bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.255+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x55d7121b9c00 0x55d7121bb600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.255+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.5 v2:172.21.15.93:6802/753754499 1 ==== osd_op_reply(13 [pgnls start_epoch 41 out=77b] v40'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b9c00 2023-11-17T06:33:32.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.255+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:14 4.16 4:68000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b9c00 2023-11-17T06:33:32.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.255+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.5 v2:172.21.15.93:6802/753754499 2 ==== osd_op_reply(14 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b9c00 2023-11-17T06:33:32.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.255+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:15 4.e 4:70000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.255+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 4 ==== osd_op_reply(15 [pgnls start_epoch 41 out=73b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.255+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:16 4.1e 4:78000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7120af800 2023-11-17T06:33:32.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.255+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 4 ==== osd_op_reply(16 [pgnls start_epoch 41 out=49b] v40'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.255+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:17 4.1 4:80000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.259+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 5 ==== osd_op_reply(17 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.259+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:18 4.11 4:88000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7120af800 2023-11-17T06:33:32.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.259+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 5 ==== osd_op_reply(18 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.259+0000 7fcc59d46700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x55d7121e2000 0x55d7121bc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.259+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:19 4.9 4:90000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121e2000 2023-11-17T06:33:32.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.259+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x55d7121e2000 0x55d7121bc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.259+0000 7fcc5ad48700 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x55d7121e2000 0x55d7121bc680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.263+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.1 v2:172.21.15.69:6809/346628569 1 ==== osd_op_reply(19 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121e2000 2023-11-17T06:33:32.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.263+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:20 4.19 4:98000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8000 2023-11-17T06:33:32.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.263+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 2 ==== osd_op_reply(20 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.263+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:21 4.5 4:a0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8800 2023-11-17T06:33:32.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.263+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 2 ==== osd_op_reply(21 [pgnls start_epoch 41 out=81b] v41'56 uv56 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.263+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:22 4.15 4:a8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8800 2023-11-17T06:33:32.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.263+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 3 ==== osd_op_reply(22 [pgnls start_epoch 41 out=97b] v36'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.263+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:23 4.d 4:b0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8800 2023-11-17T06:33:32.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.263+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 4 ==== osd_op_reply(23 [pgnls start_epoch 41 out=74b] v36'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.263+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:24 4.1d 4:b8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8000 2023-11-17T06:33:32.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.267+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 3 ==== osd_op_reply(24 [pgnls start_epoch 41 out=73b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.267+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:25 4.3 4:c0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8400 2023-11-17T06:33:32.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.267+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 4 ==== osd_op_reply(25 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.267+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:26 4.13 4:c8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.267+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 6 ==== osd_op_reply(26 [pgnls start_epoch 41 out=98b] v39'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.267+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:27 4.b 4:d0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b9c00 2023-11-17T06:33:32.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.267+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.5 v2:172.21.15.93:6802/753754499 3 ==== osd_op_reply(27 [pgnls start_epoch 41 out=76b] v40'4 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b9c00 2023-11-17T06:33:32.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.267+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:28 4.1b 4:d8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.271+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 7 ==== osd_op_reply(28 [pgnls start_epoch 41 out=81b] v41'55 uv55 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.271+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:29 4.7 4:e0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8400 2023-11-17T06:33:32.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.271+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 5 ==== osd_op_reply(29 [pgnls start_epoch 41 out=73b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.271+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:30 4.17 4:e8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b9c00 2023-11-17T06:33:32.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.271+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.5 v2:172.21.15.93:6802/753754499 4 ==== osd_op_reply(30 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b9c00 2023-11-17T06:33:32.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.271+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:31 4.f 4:f0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8000 2023-11-17T06:33:32.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 4 ==== osd_op_reply(31 [pgnls start_epoch 41 out=73b] v36'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:32 4.1f 4:f8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8800 2023-11-17T06:33:32.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 5 ==== osd_op_reply(32 [pgnls start_epoch 41 out=101b] v40'7 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 601.00000000 2023-11-17T06:33:32.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:33 4.10 4:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9c00 con 0x55d7121b8000 2023-11-17T06:33:32.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 5 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 602.00000000 2023-11-17T06:33:32.281 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:34 4.10 4:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8000 2023-11-17T06:33:32.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 6 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-11-17T06:33:32.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.275+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:35 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8380 con 0x55d7121b8000 2023-11-17T06:33:32.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.279+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 7 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=50980b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+50980 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.279+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 600.00000000 2023-11-17T06:33:32.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.279+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:36 4.10 4:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8700 con 0x55d7121b8000 2023-11-17T06:33:32.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.279+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 8 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.279+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 603.00000000 2023-11-17T06:33:32.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.279+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:37 4.10 4:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8000 2023-11-17T06:33:32.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 9 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-11-17T06:33:32.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-11-17T06:33:32.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 200.00000000 2023-11-17T06:33:32.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-11-17T06:33:32.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 200.00000001 2023-11-17T06:33:32.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-11-17T06:33:32.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 606.00000000 2023-11-17T06:33:32.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:38 4.14 4:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9c00 con 0x55d7121b8400 2023-11-17T06:33:32.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 6 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 607.00000000 2023-11-17T06:33:32.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:39 4.1c 4:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7120af800 2023-11-17T06:33:32.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2023-11-17T06:33:32.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-11-17T06:33:32.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 608.00000000 2023-11-17T06:33:32.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:40 4.e 4:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8380 con 0x55d7121b8c00 2023-11-17T06:33:32.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 8 ==== osd_op_reply(40 608.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 10000000000.01000000 2023-11-17T06:33:32.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.283+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:41 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8700 con 0x55d7121b8800 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 6 ==== osd_op_reply(41 10000000000.01000000 [omap-get-vals out=25448b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+25448 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 604.00000000 2023-11-17T06:33:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:42 4.15 4:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 7 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 500.00000000 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 605.00000000 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:43 4.1d 4:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8000 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 10 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 100.00000000 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.287+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:44 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9180 con 0x55d7121b8c00 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 9 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 10000000000.01800000 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:45 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8c00 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 10 ==== osd_op_reply(45 10000000000.01800000 [omap-get-vals out=24452b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+24452 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 609.00000000 2023-11-17T06:33:32.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:46 4.7 4:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8380 con 0x55d7121b8400 2023-11-17T06:33:32.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 7 ==== osd_op_reply(46 609.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 400.00000000 2023-11-17T06:33:32.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-11-17T06:33:32.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-11-17T06:33:32.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-11-17T06:33:32.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 10 datascan.scan_links: step 1: handling object 1.00000000 2023-11-17T06:33:32.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.291+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:47 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9180 con 0x55d7121b8800 2023-11-17T06:33:32.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.295+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 8 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=532b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+532 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.295+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:48 4.0 4:00000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8700 con 0x55d7120af800 2023-11-17T06:33:32.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.295+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 7 ==== osd_op_reply(48 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.295+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:49 4.10 4:08000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8700 con 0x55d7121b8000 2023-11-17T06:33:32.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.295+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 11 ==== osd_op_reply(49 [pgnls start_epoch 41 out=177b] v40'12 uv12 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.295+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:50 4.8 4:10000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8800 2023-11-17T06:33:32.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.299+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 9 ==== osd_op_reply(50 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.299+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:51 4.18 4:18000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.299+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 11 ==== osd_op_reply(51 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.299+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:52 4.4 4:20000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8400 2023-11-17T06:33:32.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.299+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 8 ==== osd_op_reply(52 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.299+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:53 4.14 4:28000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8400 2023-11-17T06:33:32.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.299+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 9 ==== osd_op_reply(53 [pgnls start_epoch 41 out=149b] v40'26 uv26 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.299+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- osd_op(unknown.0.0:54 4.c 4:30000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b9400 2023-11-17T06:33:32.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.303+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.0 v2:172.21.15.69:6800/3449021474 2 ==== osd_op_reply(54 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b9400 2023-11-17T06:33:32.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.303+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:55 4.1c 4:38000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7120af800 2023-11-17T06:33:32.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.303+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 8 ==== osd_op_reply(55 [pgnls start_epoch 41 out=73b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.303+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:56 4.2 4:40000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8400 2023-11-17T06:33:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.303+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 10 ==== osd_op_reply(56 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.303+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:57 4.12 4:48000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7120af800 2023-11-17T06:33:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.303+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 9 ==== osd_op_reply(57 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.303+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:58 4.a 4:50000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.303+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 12 ==== osd_op_reply(58 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.303+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:59 4.1a 4:58000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.307+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 13 ==== osd_op_reply(59 [pgnls start_epoch 41 out=49b] v40'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.307+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:60 4.6 4:60000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b9c00 2023-11-17T06:33:32.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.307+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.5 v2:172.21.15.93:6802/753754499 5 ==== osd_op_reply(60 [pgnls start_epoch 41 out=77b] v40'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b9c00 2023-11-17T06:33:32.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.307+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:61 4.16 4:68000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b9c00 2023-11-17T06:33:32.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.307+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.5 v2:172.21.15.93:6802/753754499 6 ==== osd_op_reply(61 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b9c00 2023-11-17T06:33:32.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.307+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:62 4.e 4:70000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.307+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 14 ==== osd_op_reply(62 [pgnls start_epoch 41 out=73b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.307+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:63 4.1e 4:78000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7120af800 2023-11-17T06:33:32.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.311+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 10 ==== osd_op_reply(63 [pgnls start_epoch 41 out=49b] v40'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.311+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:64 4.1 4:80000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.311+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 15 ==== osd_op_reply(64 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.311+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:65 4.11 4:88000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7120af800 2023-11-17T06:33:32.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.311+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 11 ==== osd_op_reply(65 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.311+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- osd_op(unknown.0.0:66 4.9 4:90000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121e2000 2023-11-17T06:33:32.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.311+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.1 v2:172.21.15.69:6809/346628569 2 ==== osd_op_reply(66 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121e2000 2023-11-17T06:33:32.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.311+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:67 4.19 4:98000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8000 2023-11-17T06:33:32.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.311+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 12 ==== osd_op_reply(67 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.311+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:68 4.5 4:a0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.315+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 10 ==== osd_op_reply(68 [pgnls start_epoch 41 out=81b] v41'56 uv56 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.315+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:69 4.15 4:a8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.315+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 11 ==== osd_op_reply(69 [pgnls start_epoch 41 out=97b] v36'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.315+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:70 4.d 4:b0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.315+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 12 ==== osd_op_reply(70 [pgnls start_epoch 41 out=74b] v36'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.315+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:71 4.1d 4:b8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8000 2023-11-17T06:33:32.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.315+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 13 ==== osd_op_reply(71 [pgnls start_epoch 41 out=73b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.315+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:72 4.3 4:c0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8400 2023-11-17T06:33:32.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.319+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 11 ==== osd_op_reply(72 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.319+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:73 4.13 4:c8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.319+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 16 ==== osd_op_reply(73 [pgnls start_epoch 41 out=98b] v39'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.319+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:74 4.b 4:d0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b9c00 2023-11-17T06:33:32.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.319+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.5 v2:172.21.15.93:6802/753754499 7 ==== osd_op_reply(74 [pgnls start_epoch 41 out=76b] v40'4 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b9c00 2023-11-17T06:33:32.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.319+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:75 4.1b 4:d8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.319+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 17 ==== osd_op_reply(75 [pgnls start_epoch 41 out=81b] v41'55 uv55 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.319+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:76 4.7 4:e0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8400 2023-11-17T06:33:32.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.323+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 12 ==== osd_op_reply(76 [pgnls start_epoch 41 out=73b] v36'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.323+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- osd_op(unknown.0.0:77 4.17 4:e8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b9c00 2023-11-17T06:33:32.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.323+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.5 v2:172.21.15.93:6802/753754499 8 ==== osd_op_reply(77 [pgnls start_epoch 41 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b9c00 2023-11-17T06:33:32.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.323+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:78 4.f 4:f0000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8000 2023-11-17T06:33:32.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.323+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 14 ==== osd_op_reply(78 [pgnls start_epoch 41 out=73b] v36'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.323+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:79 4.1f 4:f8000000::::head [pgnls start_epoch 41 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.323+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 13 ==== osd_op_reply(79 [pgnls start_epoch 41 out=101b] v40'7 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.323+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 601.00000000 2023-11-17T06:33:32.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.323+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:80 4.10 4:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9500 con 0x55d7121b8000 2023-11-17T06:33:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.327+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 15 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.327+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 602.00000000 2023-11-17T06:33:32.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.327+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:81 4.10 4:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8000 2023-11-17T06:33:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.327+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 16 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.327+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-11-17T06:33:32.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.327+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:82 4.10 4:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8000 2023-11-17T06:33:32.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.327+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 17 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=50980b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+50980 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 600.00000000 2023-11-17T06:33:32.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:83 4.10 4:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8700 con 0x55d7121b8000 2023-11-17T06:33:32.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 18 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 603.00000000 2023-11-17T06:33:32.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:84 4.10 4:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8380 con 0x55d7121b8000 2023-11-17T06:33:32.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 19 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-11-17T06:33:32.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-11-17T06:33:32.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 200.00000000 2023-11-17T06:33:32.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-11-17T06:33:32.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 200.00000001 2023-11-17T06:33:32.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-11-17T06:33:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 606.00000000 2023-11-17T06:33:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:85 4.14 4:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9500 con 0x55d7121b8400 2023-11-17T06:33:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 13 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 607.00000000 2023-11-17T06:33:32.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.331+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- osd_op(unknown.0.0:86 4.1c 4:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7120af800 2023-11-17T06:33:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.4 v2:172.21.15.93:6812/1712617818 12 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54b40 con 0x55d7120af800 2023-11-17T06:33:32.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2023-11-17T06:33:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-11-17T06:33:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 608.00000000 2023-11-17T06:33:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:87 4.e 4:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9c00 con 0x55d7121b8c00 2023-11-17T06:33:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 18 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 10000000000.01000000 2023-11-17T06:33:32.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:88 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9c00 con 0x55d7121b8800 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 14 ==== osd_op_reply(88 10000000000.01000000 [omap-get-vals out=25448b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+25448 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000000b for future processing to fix dnfirst 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000000c for future processing to fix dnfirst 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000000d for future processing to fix dnfirst 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000010 for future processing to fix dnfirst 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000014 for future processing to fix dnfirst 2023-11-17T06:33:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000002 for future processing to fix dnfirst 2023-11-17T06:33:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000015 for future processing to fix dnfirst 2023-11-17T06:33:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000016 for future processing to fix dnfirst 2023-11-17T06:33:32.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000001c for future processing to fix dnfirst 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000001d for future processing to fix dnfirst 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000003 for future processing to fix dnfirst 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000020 for future processing to fix dnfirst 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000023 for future processing to fix dnfirst 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000025 for future processing to fix dnfirst 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000027 for future processing to fix dnfirst 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000028 for future processing to fix dnfirst 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000004 for future processing to fix dnfirst 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000002b for future processing to fix dnfirst 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000002c for future processing to fix dnfirst 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000002f for future processing to fix dnfirst 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000005 for future processing to fix dnfirst 2023-11-17T06:33:32.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000033 for future processing to fix dnfirst 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000035 for future processing to fix dnfirst 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000036 for future processing to fix dnfirst 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000038 for future processing to fix dnfirst 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000003c for future processing to fix dnfirst 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000003e for future processing to fix dnfirst 2023-11-17T06:33:32.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000040 for future processing to fix dnfirst 2023-11-17T06:33:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000041 for future processing to fix dnfirst 2023-11-17T06:33:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000042 for future processing to fix dnfirst 2023-11-17T06:33:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000043 for future processing to fix dnfirst 2023-11-17T06:33:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000046 for future processing to fix dnfirst 2023-11-17T06:33:32.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000047 for future processing to fix dnfirst 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000004a for future processing to fix dnfirst 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000004b for future processing to fix dnfirst 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000004c for future processing to fix dnfirst 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000004e for future processing to fix dnfirst 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000051 for future processing to fix dnfirst 2023-11-17T06:33:32.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000054 for future processing to fix dnfirst 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000055 for future processing to fix dnfirst 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000056 for future processing to fix dnfirst 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000057 for future processing to fix dnfirst 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000058 for future processing to fix dnfirst 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000059 for future processing to fix dnfirst 2023-11-17T06:33:32.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000009 for future processing to fix dnfirst 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000005b for future processing to fix dnfirst 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000005d for future processing to fix dnfirst 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000060 for future processing to fix dnfirst 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000061 for future processing to fix dnfirst 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000062 for future processing to fix dnfirst 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000000a for future processing to fix dnfirst 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.335+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 604.00000000 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:89 4.15 4:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8800 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 15 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 500.00000000 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 605.00000000 2023-11-17T06:33:32.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- osd_op(unknown.0.0:90 4.1d 4:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9c00 con 0x55d7121b8000 2023-11-17T06:33:32.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.7 v2:172.21.15.93:6810/4059179485 20 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8000 2023-11-17T06:33:32.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-11-17T06:33:32.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-11-17T06:33:32.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 100.00000000 2023-11-17T06:33:32.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:91 4.13 4:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 19 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 10000000000.01800000 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.339+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:92 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8c00 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 20 ==== osd_op_reply(92 10000000000.01800000 [omap-get-vals out=24452b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+24452 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000000e for future processing to fix dnfirst 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000000f for future processing to fix dnfirst 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000011 for future processing to fix dnfirst 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000012 for future processing to fix dnfirst 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000013 for future processing to fix dnfirst 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000017 for future processing to fix dnfirst 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000018 for future processing to fix dnfirst 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000019 for future processing to fix dnfirst 2023-11-17T06:33:32.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000001a for future processing to fix dnfirst 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000001b for future processing to fix dnfirst 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000001e for future processing to fix dnfirst 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000001f for future processing to fix dnfirst 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000021 for future processing to fix dnfirst 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000022 for future processing to fix dnfirst 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000024 for future processing to fix dnfirst 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000026 for future processing to fix dnfirst 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000029 for future processing to fix dnfirst 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000002a for future processing to fix dnfirst 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000002d for future processing to fix dnfirst 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000002e for future processing to fix dnfirst 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000030 for future processing to fix dnfirst 2023-11-17T06:33:32.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000031 for future processing to fix dnfirst 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000032 for future processing to fix dnfirst 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000034 for future processing to fix dnfirst 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000037 for future processing to fix dnfirst 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000039 for future processing to fix dnfirst 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000003a for future processing to fix dnfirst 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000003b for future processing to fix dnfirst 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000006 for future processing to fix dnfirst 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000003d for future processing to fix dnfirst 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000003f for future processing to fix dnfirst 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000044 for future processing to fix dnfirst 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000045 for future processing to fix dnfirst 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000007 for future processing to fix dnfirst 2023-11-17T06:33:32.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000048 for future processing to fix dnfirst 2023-11-17T06:33:32.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000049 for future processing to fix dnfirst 2023-11-17T06:33:32.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000004d for future processing to fix dnfirst 2023-11-17T06:33:32.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000004f for future processing to fix dnfirst 2023-11-17T06:33:32.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000050 for future processing to fix dnfirst 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000008 for future processing to fix dnfirst 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000052 for future processing to fix dnfirst 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000053 for future processing to fix dnfirst 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000005a for future processing to fix dnfirst 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000005c for future processing to fix dnfirst 2023-11-17T06:33:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000005e for future processing to fix dnfirst 2023-11-17T06:33:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x1000000005f for future processing to fix dnfirst 2023-11-17T06:33:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000063 for future processing to fix dnfirst 2023-11-17T06:33:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: injected ino detected 2023-11-17T06:33:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 20 datascan.scan_links: adding 0x10000000064 for future processing to fix dnfirst 2023-11-17T06:33:32.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 609.00000000 2023-11-17T06:33:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- osd_op(unknown.0.0:93 4.7 4:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9180 con 0x55d7121b8400 2023-11-17T06:33:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5ad48700 1 -- 172.21.15.69:0/3648064671 <== osd.6 v2:172.21.15.93:6826/2665225471 14 ==== osd_op_reply(93 609.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55d712b54d80 con 0x55d7121b8400 2023-11-17T06:33:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 400.00000000 2023-11-17T06:33:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-11-17T06:33:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-11-17T06:33:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-11-17T06:33:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: step 2: handling object 1.00000000 2023-11-17T06:33:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:94 4.1f 4:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 16 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=532b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+532 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: processing 99 dup_primaries, 0 remote_links 2023-11-17T06:33:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000001 2023-11-17T06:33:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000002 2023-11-17T06:33:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000003 2023-11-17T06:33:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000004 2023-11-17T06:33:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000005 2023-11-17T06:33:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000006 2023-11-17T06:33:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000007 2023-11-17T06:33:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000008 2023-11-17T06:33:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000009 2023-11-17T06:33:32.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000000a 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000000b 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000000c 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000000d 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000000e 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000000f 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000010 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000011 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000012 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000013 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000014 2023-11-17T06:33:32.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000015 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000017 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000018 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000019 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000001a 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000001b 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000001c 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000001d 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000001e 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000001f 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000020 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000021 2023-11-17T06:33:32.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000022 2023-11-17T06:33:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000023 2023-11-17T06:33:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000024 2023-11-17T06:33:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000025 2023-11-17T06:33:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000026 2023-11-17T06:33:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000027 2023-11-17T06:33:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000028 2023-11-17T06:33:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000029 2023-11-17T06:33:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000002a 2023-11-17T06:33:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000002b 2023-11-17T06:33:32.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000002c 2023-11-17T06:33:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000002d 2023-11-17T06:33:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000002e 2023-11-17T06:33:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000002f 2023-11-17T06:33:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000030 2023-11-17T06:33:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000031 2023-11-17T06:33:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000032 2023-11-17T06:33:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000033 2023-11-17T06:33:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000034 2023-11-17T06:33:32.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000035 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000036 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000037 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000038 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000039 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000003a 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000003b 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000003c 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000003d 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000003e 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000003f 2023-11-17T06:33:32.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000040 2023-11-17T06:33:32.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000041 2023-11-17T06:33:32.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000042 2023-11-17T06:33:32.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000043 2023-11-17T06:33:32.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000044 2023-11-17T06:33:32.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000045 2023-11-17T06:33:32.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000046 2023-11-17T06:33:32.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000047 2023-11-17T06:33:32.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000048 2023-11-17T06:33:32.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000049 2023-11-17T06:33:32.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000004a 2023-11-17T06:33:32.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000004b 2023-11-17T06:33:32.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000004c 2023-11-17T06:33:32.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000004d 2023-11-17T06:33:32.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000004e 2023-11-17T06:33:32.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000004f 2023-11-17T06:33:32.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000050 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000051 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000052 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000053 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000054 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000055 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000056 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000057 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000058 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000059 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000005a 2023-11-17T06:33:32.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.343+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000005b 2023-11-17T06:33:32.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000005c 2023-11-17T06:33:32.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000005d 2023-11-17T06:33:32.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000005e 2023-11-17T06:33:32.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x1000000005f 2023-11-17T06:33:32.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000060 2023-11-17T06:33:32.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000061 2023-11-17T06:33:32.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000062 2023-11-17T06:33:32.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000063 2023-11-17T06:33:32.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: handling dup 0x10000000064 2023-11-17T06:33:32.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: removing dup dentries from 0 objects 2023-11-17T06:33:32.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: processing 0 bad_nlink_inos 2023-11-17T06:33:32.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: processing 100 injected_inos 2023-11-17T06:33:32.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000001 2023-11-17T06:33:32.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:0 2023-11-17T06:33:32.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:95 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 21 ==== osd_op_reply(95 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=0 frag=1*, r=0 2023-11-17T06:33:32.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.347+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:96 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8c00 2023-11-17T06:33:32.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.351+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 22 ==== osd_op_reply(96 10000000000.01800000 [omap-set-vals] v41'56 uv56 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.351+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/0 pointing to 0x0x10000000001 2023-11-17T06:33:32.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.351+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000002 2023-11-17T06:33:32.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.351+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:1 2023-11-17T06:33:32.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.351+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:97 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8800 2023-11-17T06:33:32.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.351+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 17 ==== osd_op_reply(97 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.351+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=1 frag=0*, r=0 2023-11-17T06:33:32.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.351+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.351+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:98 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9c00 con 0x55d7121b8800 2023-11-17T06:33:32.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.355+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 18 ==== osd_op_reply(98 10000000000.01000000 [omap-set-vals] v41'57 uv57 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.355+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/1 pointing to 0x0x10000000002 2023-11-17T06:33:32.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.355+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000003 2023-11-17T06:33:32.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.355+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:2 2023-11-17T06:33:32.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.355+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:99 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c000 con 0x55d7121b8800 2023-11-17T06:33:32.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.355+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 19 ==== osd_op_reply(99 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv57 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.355+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=2 frag=0*, r=0 2023-11-17T06:33:32.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.355+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.355+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:100 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c380 con 0x55d7121b8800 2023-11-17T06:33:32.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 20 ==== osd_op_reply(100 10000000000.01000000 [omap-set-vals] v41'58 uv58 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/2 pointing to 0x0x10000000003 2023-11-17T06:33:32.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000004 2023-11-17T06:33:32.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:3 2023-11-17T06:33:32.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:101 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8800 2023-11-17T06:33:32.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 21 ==== osd_op_reply(101 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv58 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=3 frag=0*, r=0 2023-11-17T06:33:32.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:102 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8800 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 22 ==== osd_op_reply(102 10000000000.01000000 [omap-set-vals] v41'59 uv59 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/3 pointing to 0x0x10000000004 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000005 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:4 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.359+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:103 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ce00 con 0x55d7121b8800 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 23 ==== osd_op_reply(103 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv59 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=4 frag=0*, r=0 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:104 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d180 con 0x55d7121b8800 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 24 ==== osd_op_reply(104 10000000000.01000000 [omap-set-vals] v41'60 uv60 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/4 pointing to 0x0x10000000005 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000006 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:5 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:105 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d500 con 0x55d7121b8c00 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 23 ==== osd_op_reply(105 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=5 frag=1*, r=0 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.363+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:106 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d880 con 0x55d7121b8c00 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.367+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 24 ==== osd_op_reply(106 10000000000.01800000 [omap-set-vals] v41'57 uv57 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.367+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/5 pointing to 0x0x10000000006 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.367+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000007 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.367+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:6 2023-11-17T06:33:32.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.367+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:107 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228dc00 con 0x55d7121b8c00 2023-11-17T06:33:32.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.367+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 25 ==== osd_op_reply(107 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv57 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.367+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=6 frag=1*, r=0 2023-11-17T06:33:32.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.367+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.367+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:108 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d500 con 0x55d7121b8c00 2023-11-17T06:33:32.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.371+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 26 ==== osd_op_reply(108 10000000000.01800000 [omap-set-vals] v41'58 uv58 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.371+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/6 pointing to 0x0x10000000007 2023-11-17T06:33:32.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.371+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000008 2023-11-17T06:33:32.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.371+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:7 2023-11-17T06:33:32.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.371+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:109 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d880 con 0x55d7121b8c00 2023-11-17T06:33:32.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.371+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 27 ==== osd_op_reply(109 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv58 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.371+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=7 frag=1*, r=0 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.371+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.371+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:110 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c000 con 0x55d7121b8c00 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.375+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 28 ==== osd_op_reply(110 10000000000.01800000 [omap-set-vals] v41'59 uv59 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.375+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/7 pointing to 0x0x10000000008 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.375+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000009 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.375+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:8 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.375+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:111 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c380 con 0x55d7121b8800 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.375+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 25 ==== osd_op_reply(111 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv60 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.375+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=8 frag=0*, r=0 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.375+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.375+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:112 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8800 2023-11-17T06:33:32.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.379+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 26 ==== osd_op_reply(112 10000000000.01000000 [omap-set-vals] v41'61 uv61 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.379+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/8 pointing to 0x0x10000000009 2023-11-17T06:33:32.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.379+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000000a 2023-11-17T06:33:32.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.379+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:9 2023-11-17T06:33:32.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.379+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:113 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8800 2023-11-17T06:33:32.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.379+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 27 ==== osd_op_reply(113 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv61 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.379+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=9 frag=0*, r=0 2023-11-17T06:33:32.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.379+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.379+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:114 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8800 2023-11-17T06:33:32.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 28 ==== osd_op_reply(114 10000000000.01000000 [omap-set-vals] v41'62 uv62 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/9 pointing to 0x0x1000000000a 2023-11-17T06:33:32.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000000b 2023-11-17T06:33:32.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:10 2023-11-17T06:33:32.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:115 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 29 ==== osd_op_reply(115 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv62 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=10 frag=0*, r=0 2023-11-17T06:33:32.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:116 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8800 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 30 ==== osd_op_reply(116 10000000000.01000000 [omap-set-vals] v41'63 uv63 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/10 pointing to 0x0x1000000000b 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000000c 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:11 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.383+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:117 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9c00 con 0x55d7121b8800 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 31 ==== osd_op_reply(117 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv63 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=11 frag=0*, r=0 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:118 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8800 2023-11-17T06:33:32.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 32 ==== osd_op_reply(118 10000000000.01000000 [omap-set-vals] v41'64 uv64 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/11 pointing to 0x0x1000000000c 2023-11-17T06:33:32.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000000d 2023-11-17T06:33:32.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:12 2023-11-17T06:33:32.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:119 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8800 2023-11-17T06:33:32.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 33 ==== osd_op_reply(119 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv64 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=12 frag=0*, r=0 2023-11-17T06:33:32.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.387+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:120 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8800 2023-11-17T06:33:32.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.391+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 34 ==== osd_op_reply(120 10000000000.01000000 [omap-set-vals] v41'65 uv65 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.391+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/12 pointing to 0x0x1000000000d 2023-11-17T06:33:32.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.391+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000000e 2023-11-17T06:33:32.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.391+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:13 2023-11-17T06:33:32.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.391+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:121 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8c00 2023-11-17T06:33:32.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.391+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 29 ==== osd_op_reply(121 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv59 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.391+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=13 frag=1*, r=0 2023-11-17T06:33:32.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.391+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.398 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.391+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:122 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ce00 con 0x55d7121b8c00 2023-11-17T06:33:32.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.395+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 30 ==== osd_op_reply(122 10000000000.01800000 [omap-set-vals] v41'60 uv60 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.395+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/13 pointing to 0x0x1000000000e 2023-11-17T06:33:32.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.395+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000000f 2023-11-17T06:33:32.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.395+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:14 2023-11-17T06:33:32.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.395+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:123 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d180 con 0x55d7121b8c00 2023-11-17T06:33:32.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.395+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 31 ==== osd_op_reply(123 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv60 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.395+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=14 frag=1*, r=0 2023-11-17T06:33:32.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.395+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.395+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:124 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c380 con 0x55d7121b8c00 2023-11-17T06:33:32.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 32 ==== osd_op_reply(124 10000000000.01800000 [omap-set-vals] v41'61 uv61 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/14 pointing to 0x0x1000000000f 2023-11-17T06:33:32.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000010 2023-11-17T06:33:32.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:15 2023-11-17T06:33:32.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:125 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8800 2023-11-17T06:33:32.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 35 ==== osd_op_reply(125 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv65 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=15 frag=0*, r=0 2023-11-17T06:33:32.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:126 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228dc00 con 0x55d7121b8800 2023-11-17T06:33:32.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 36 ==== osd_op_reply(126 10000000000.01000000 [omap-set-vals] v41'66 uv66 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/15 pointing to 0x0x10000000010 2023-11-17T06:33:32.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000011 2023-11-17T06:33:32.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:16 2023-11-17T06:33:32.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.399+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:127 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d500 con 0x55d7121b8c00 2023-11-17T06:33:32.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.403+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 33 ==== osd_op_reply(127 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv61 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.403+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=16 frag=1*, r=0 2023-11-17T06:33:32.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.403+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.403+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:128 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d880 con 0x55d7121b8c00 2023-11-17T06:33:32.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.403+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 34 ==== osd_op_reply(128 10000000000.01800000 [omap-set-vals] v41'62 uv62 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.403+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/16 pointing to 0x0x10000000011 2023-11-17T06:33:32.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.403+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000012 2023-11-17T06:33:32.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.403+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:17 2023-11-17T06:33:32.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.403+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:129 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c000 con 0x55d7121b8c00 2023-11-17T06:33:32.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 35 ==== osd_op_reply(129 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv62 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=17 frag=1*, r=0 2023-11-17T06:33:32.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:130 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8c00 2023-11-17T06:33:32.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 36 ==== osd_op_reply(130 10000000000.01800000 [omap-set-vals] v41'63 uv63 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.413 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/17 pointing to 0x0x10000000012 2023-11-17T06:33:32.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000013 2023-11-17T06:33:32.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:18 2023-11-17T06:33:32.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:131 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ce00 con 0x55d7121b8c00 2023-11-17T06:33:32.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 37 ==== osd_op_reply(131 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv63 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=18 frag=1*, r=0 2023-11-17T06:33:32.414 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.407+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:132 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.411+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 38 ==== osd_op_reply(132 10000000000.01800000 [omap-set-vals] v41'64 uv64 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.411+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/18 pointing to 0x0x10000000013 2023-11-17T06:33:32.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.411+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000014 2023-11-17T06:33:32.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.411+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:19 2023-11-17T06:33:32.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.411+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:133 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8800 2023-11-17T06:33:32.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.411+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 37 ==== osd_op_reply(133 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv66 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.411+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=19 frag=0*, r=0 2023-11-17T06:33:32.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.411+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.411+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:134 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9c00 con 0x55d7121b8800 2023-11-17T06:33:32.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.415+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 38 ==== osd_op_reply(134 10000000000.01000000 [omap-set-vals] v41'67 uv67 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.415+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/19 pointing to 0x0x10000000014 2023-11-17T06:33:32.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.415+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000015 2023-11-17T06:33:32.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.415+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:20 2023-11-17T06:33:32.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.415+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:135 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8800 2023-11-17T06:33:32.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.415+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 39 ==== osd_op_reply(135 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv67 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.415+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=20 frag=0*, r=0 2023-11-17T06:33:32.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.415+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.415+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:136 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8800 2023-11-17T06:33:32.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.419+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 40 ==== osd_op_reply(136 10000000000.01000000 [omap-set-vals] v41'68 uv68 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.419+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/20 pointing to 0x0x10000000015 2023-11-17T06:33:32.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.419+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000016 2023-11-17T06:33:32.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.419+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:21 2023-11-17T06:33:32.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.419+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:137 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8800 2023-11-17T06:33:32.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.419+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 41 ==== osd_op_reply(137 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv68 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.419+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=21 frag=0*, r=0 2023-11-17T06:33:32.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.419+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.419+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:138 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c000 con 0x55d7121b8800 2023-11-17T06:33:32.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.423+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 42 ==== osd_op_reply(138 10000000000.01000000 [omap-set-vals] v41'69 uv69 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.423+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/21 pointing to 0x0x10000000016 2023-11-17T06:33:32.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.423+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000017 2023-11-17T06:33:32.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.423+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:22 2023-11-17T06:33:32.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.423+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:139 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c380 con 0x55d7121b8c00 2023-11-17T06:33:32.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.423+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 39 ==== osd_op_reply(139 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv64 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.423+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=22 frag=1*, r=0 2023-11-17T06:33:32.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.423+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.423+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:140 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8c00 2023-11-17T06:33:32.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 40 ==== osd_op_reply(140 10000000000.01800000 [omap-set-vals] v41'65 uv65 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/22 pointing to 0x0x10000000017 2023-11-17T06:33:32.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000018 2023-11-17T06:33:32.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:23 2023-11-17T06:33:32.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:141 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8c00 2023-11-17T06:33:32.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 41 ==== osd_op_reply(141 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv65 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=23 frag=1*, r=0 2023-11-17T06:33:32.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:142 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ce00 con 0x55d7121b8c00 2023-11-17T06:33:32.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 42 ==== osd_op_reply(142 10000000000.01800000 [omap-set-vals] v41'66 uv66 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/23 pointing to 0x0x10000000018 2023-11-17T06:33:32.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000019 2023-11-17T06:33:32.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:24 2023-11-17T06:33:32.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.427+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:143 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d180 con 0x55d7121b8c00 2023-11-17T06:33:32.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.431+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 43 ==== osd_op_reply(143 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv66 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.431+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=24 frag=1*, r=0 2023-11-17T06:33:32.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.431+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.431+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:144 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d500 con 0x55d7121b8c00 2023-11-17T06:33:32.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.431+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 44 ==== osd_op_reply(144 10000000000.01800000 [omap-set-vals] v41'67 uv67 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.431+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/24 pointing to 0x0x10000000019 2023-11-17T06:33:32.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.431+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000001a 2023-11-17T06:33:32.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.431+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:25 2023-11-17T06:33:32.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.431+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:145 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d880 con 0x55d7121b8c00 2023-11-17T06:33:32.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.431+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 45 ==== osd_op_reply(145 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv67 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=25 frag=1*, r=0 2023-11-17T06:33:32.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:146 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228dc00 con 0x55d7121b8c00 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 46 ==== osd_op_reply(146 10000000000.01800000 [omap-set-vals] v41'68 uv68 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/25 pointing to 0x0x1000000001a 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000001b 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:26 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:147 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c380 con 0x55d7121b8c00 2023-11-17T06:33:32.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 47 ==== osd_op_reply(147 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv68 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=26 frag=1*, r=0 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.435+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:148 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8c00 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.439+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 48 ==== osd_op_reply(148 10000000000.01800000 [omap-set-vals] v41'69 uv69 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.439+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/26 pointing to 0x0x1000000001b 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.439+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000001c 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.439+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:27 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.439+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:149 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8800 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.439+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 43 ==== osd_op_reply(149 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv69 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.439+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=27 frag=0*, r=0 2023-11-17T06:33:32.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.439+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.439+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:150 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ce00 con 0x55d7121b8800 2023-11-17T06:33:32.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 44 ==== osd_op_reply(150 10000000000.01000000 [omap-set-vals] v41'70 uv70 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/27 pointing to 0x0x1000000001c 2023-11-17T06:33:32.447 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000001d 2023-11-17T06:33:32.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:28 2023-11-17T06:33:32.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:151 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d180 con 0x55d7121b8800 2023-11-17T06:33:32.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 45 ==== osd_op_reply(151 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv70 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.448 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=28 frag=0*, r=0 2023-11-17T06:33:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:152 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d500 con 0x55d7121b8800 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 46 ==== osd_op_reply(152 10000000000.01000000 [omap-set-vals] v41'71 uv71 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/28 pointing to 0x0x1000000001d 2023-11-17T06:33:32.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000001e 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:29 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.443+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:153 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d880 con 0x55d7121b8c00 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 49 ==== osd_op_reply(153 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv69 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=29 frag=1*, r=0 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:154 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 50 ==== osd_op_reply(154 10000000000.01800000 [omap-set-vals] v41'70 uv70 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/29 pointing to 0x0x1000000001e 2023-11-17T06:33:32.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000001f 2023-11-17T06:33:32.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:30 2023-11-17T06:33:32.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:155 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c000 con 0x55d7121b8c00 2023-11-17T06:33:32.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 51 ==== osd_op_reply(155 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv70 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=30 frag=1*, r=0 2023-11-17T06:33:32.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.447+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:156 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8c00 2023-11-17T06:33:32.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.451+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 52 ==== osd_op_reply(156 10000000000.01800000 [omap-set-vals] v41'71 uv71 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.451+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/30 pointing to 0x0x1000000001f 2023-11-17T06:33:32.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.451+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000020 2023-11-17T06:33:32.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.451+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:31 2023-11-17T06:33:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.451+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:157 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ce00 con 0x55d7121b8800 2023-11-17T06:33:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.451+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 47 ==== osd_op_reply(157 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv71 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.451+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=31 frag=0*, r=0 2023-11-17T06:33:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.451+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.451+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:158 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d180 con 0x55d7121b8800 2023-11-17T06:33:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.455+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 48 ==== osd_op_reply(158 10000000000.01000000 [omap-set-vals] v41'72 uv72 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.455+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/31 pointing to 0x0x10000000020 2023-11-17T06:33:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.455+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000021 2023-11-17T06:33:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.455+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:32 2023-11-17T06:33:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.455+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:159 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.455+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 53 ==== osd_op_reply(159 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv71 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.455+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=32 frag=1*, r=0 2023-11-17T06:33:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.455+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.455+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:160 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8c00 2023-11-17T06:33:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.459+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 54 ==== osd_op_reply(160 10000000000.01800000 [omap-set-vals] v41'72 uv72 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.459+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/32 pointing to 0x0x10000000021 2023-11-17T06:33:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.459+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000022 2023-11-17T06:33:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.459+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:33 2023-11-17T06:33:32.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.459+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:161 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9c00 con 0x55d7121b8c00 2023-11-17T06:33:32.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.459+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 55 ==== osd_op_reply(161 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv72 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.459+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=33 frag=1*, r=0 2023-11-17T06:33:32.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.459+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.459+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:162 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8c00 2023-11-17T06:33:32.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.463+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 56 ==== osd_op_reply(162 10000000000.01800000 [omap-set-vals] v41'73 uv73 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.463+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/33 pointing to 0x0x10000000022 2023-11-17T06:33:32.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.463+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000023 2023-11-17T06:33:32.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.463+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:34 2023-11-17T06:33:32.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.463+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:163 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8800 2023-11-17T06:33:32.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.463+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 49 ==== osd_op_reply(163 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv72 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.463+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=34 frag=0*, r=0 2023-11-17T06:33:32.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.463+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.463+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:164 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 50 ==== osd_op_reply(164 10000000000.01000000 [omap-set-vals] v41'73 uv73 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/34 pointing to 0x0x10000000023 2023-11-17T06:33:32.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000024 2023-11-17T06:33:32.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:35 2023-11-17T06:33:32.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:165 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8c00 2023-11-17T06:33:32.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 57 ==== osd_op_reply(165 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv73 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=35 frag=1*, r=0 2023-11-17T06:33:32.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:166 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 58 ==== osd_op_reply(166 10000000000.01800000 [omap-set-vals] v41'74 uv74 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/35 pointing to 0x0x10000000024 2023-11-17T06:33:32.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000025 2023-11-17T06:33:32.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:36 2023-11-17T06:33:32.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.467+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:167 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228dc00 con 0x55d7121b8800 2023-11-17T06:33:32.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 51 ==== osd_op_reply(167 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv73 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=36 frag=0*, r=0 2023-11-17T06:33:32.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:168 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c380 con 0x55d7121b8800 2023-11-17T06:33:32.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 52 ==== osd_op_reply(168 10000000000.01000000 [omap-set-vals] v41'74 uv74 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/36 pointing to 0x0x10000000025 2023-11-17T06:33:32.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000026 2023-11-17T06:33:32.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:37 2023-11-17T06:33:32.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:169 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8c00 2023-11-17T06:33:32.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 59 ==== osd_op_reply(169 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv74 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=37 frag=1*, r=0 2023-11-17T06:33:32.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.471+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:170 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d880 con 0x55d7121b8c00 2023-11-17T06:33:32.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.475+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 60 ==== osd_op_reply(170 10000000000.01800000 [omap-set-vals] v41'75 uv75 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.475+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/37 pointing to 0x0x10000000026 2023-11-17T06:33:32.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.475+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000027 2023-11-17T06:33:32.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.475+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:38 2023-11-17T06:33:32.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.475+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:171 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c000 con 0x55d7121b8800 2023-11-17T06:33:32.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.475+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 53 ==== osd_op_reply(171 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv74 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.475+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=38 frag=0*, r=0 2023-11-17T06:33:32.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.475+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.475+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:172 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8800 2023-11-17T06:33:32.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.479+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 54 ==== osd_op_reply(172 10000000000.01000000 [omap-set-vals] v41'75 uv75 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.479+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/38 pointing to 0x0x10000000027 2023-11-17T06:33:32.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.479+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000028 2023-11-17T06:33:32.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.479+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:39 2023-11-17T06:33:32.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.479+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:173 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6000 con 0x55d7121b8800 2023-11-17T06:33:32.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.479+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 55 ==== osd_op_reply(173 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv75 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.479+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=39 frag=0*, r=0 2023-11-17T06:33:32.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.479+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.479+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:174 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6380 con 0x55d7121b8800 2023-11-17T06:33:32.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.483+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 56 ==== osd_op_reply(174 10000000000.01000000 [omap-set-vals] v41'76 uv76 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.483+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/39 pointing to 0x0x10000000028 2023-11-17T06:33:32.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.483+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000029 2023-11-17T06:33:32.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.483+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:40 2023-11-17T06:33:32.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.483+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:175 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6700 con 0x55d7121b8c00 2023-11-17T06:33:32.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.483+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 61 ==== osd_op_reply(175 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv75 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.483+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=40 frag=1*, r=0 2023-11-17T06:33:32.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.483+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.483+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:176 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6a80 con 0x55d7121b8c00 2023-11-17T06:33:32.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 62 ==== osd_op_reply(176 10000000000.01800000 [omap-set-vals] v41'76 uv76 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/40 pointing to 0x0x10000000029 2023-11-17T06:33:32.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000002a 2023-11-17T06:33:32.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:41 2023-11-17T06:33:32.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:177 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6e00 con 0x55d7121b8c00 2023-11-17T06:33:32.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 63 ==== osd_op_reply(177 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv76 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=41 frag=1*, r=0 2023-11-17T06:33:32.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:178 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7180 con 0x55d7121b8c00 2023-11-17T06:33:32.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 64 ==== osd_op_reply(178 10000000000.01800000 [omap-set-vals] v41'77 uv77 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/41 pointing to 0x0x1000000002a 2023-11-17T06:33:32.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000002b 2023-11-17T06:33:32.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:42 2023-11-17T06:33:32.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.487+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:179 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7500 con 0x55d7121b8800 2023-11-17T06:33:32.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 57 ==== osd_op_reply(179 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv76 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=42 frag=0*, r=0 2023-11-17T06:33:32.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:180 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7880 con 0x55d7121b8800 2023-11-17T06:33:32.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 58 ==== osd_op_reply(180 10000000000.01000000 [omap-set-vals] v41'77 uv77 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/42 pointing to 0x0x1000000002b 2023-11-17T06:33:32.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000002c 2023-11-17T06:33:32.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:43 2023-11-17T06:33:32.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:181 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7c00 con 0x55d7121b8800 2023-11-17T06:33:32.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 59 ==== osd_op_reply(181 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv77 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=43 frag=0*, r=0 2023-11-17T06:33:32.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.491+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:182 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6700 con 0x55d7121b8800 2023-11-17T06:33:32.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.495+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 60 ==== osd_op_reply(182 10000000000.01000000 [omap-set-vals] v41'78 uv78 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.495+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/43 pointing to 0x0x1000000002c 2023-11-17T06:33:32.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.495+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000002d 2023-11-17T06:33:32.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.495+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:44 2023-11-17T06:33:32.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.495+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:183 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6a80 con 0x55d7121b8c00 2023-11-17T06:33:32.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.495+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 65 ==== osd_op_reply(183 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv77 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.495+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=44 frag=1*, r=0 2023-11-17T06:33:32.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.495+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.495+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:184 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6e00 con 0x55d7121b8c00 2023-11-17T06:33:32.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.499+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 66 ==== osd_op_reply(184 10000000000.01800000 [omap-set-vals] v41'78 uv78 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.499+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/44 pointing to 0x0x1000000002d 2023-11-17T06:33:32.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.499+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000002e 2023-11-17T06:33:32.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.499+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:45 2023-11-17T06:33:32.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.499+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:185 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7180 con 0x55d7121b8c00 2023-11-17T06:33:32.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.499+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 67 ==== osd_op_reply(185 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv78 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.499+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=45 frag=1*, r=0 2023-11-17T06:33:32.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.499+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.499+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:186 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6000 con 0x55d7121b8c00 2023-11-17T06:33:32.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.503+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 68 ==== osd_op_reply(186 10000000000.01800000 [omap-set-vals] v41'79 uv79 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.503+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/45 pointing to 0x0x1000000002e 2023-11-17T06:33:32.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.503+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000002f 2023-11-17T06:33:32.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.503+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:46 2023-11-17T06:33:32.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.503+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:187 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9c00 con 0x55d7121b8800 2023-11-17T06:33:32.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.503+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 61 ==== osd_op_reply(187 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv78 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.503+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=46 frag=0*, r=0 2023-11-17T06:33:32.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.503+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.503+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:188 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8800 2023-11-17T06:33:32.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.507+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 62 ==== osd_op_reply(188 10000000000.01000000 [omap-set-vals] v41'79 uv79 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.507+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/46 pointing to 0x0x1000000002f 2023-11-17T06:33:32.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.507+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000030 2023-11-17T06:33:32.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.507+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:47 2023-11-17T06:33:32.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.507+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:189 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8c00 2023-11-17T06:33:32.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.507+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 69 ==== osd_op_reply(189 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv79 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.507+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=47 frag=1*, r=0 2023-11-17T06:33:32.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.507+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.507+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:190 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8c00 2023-11-17T06:33:32.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.511+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 70 ==== osd_op_reply(190 10000000000.01800000 [omap-set-vals] v41'80 uv80 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.511+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/47 pointing to 0x0x10000000030 2023-11-17T06:33:32.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.511+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000031 2023-11-17T06:33:32.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.511+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:48 2023-11-17T06:33:32.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.511+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:191 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.511+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 71 ==== osd_op_reply(191 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv80 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.511+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=48 frag=1*, r=0 2023-11-17T06:33:32.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.511+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.511+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:192 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.515+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 72 ==== osd_op_reply(192 10000000000.01800000 [omap-set-vals] v41'81 uv81 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.515+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/48 pointing to 0x0x10000000031 2023-11-17T06:33:32.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.515+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000032 2023-11-17T06:33:32.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.515+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:49 2023-11-17T06:33:32.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.515+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:193 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c000 con 0x55d7121b8c00 2023-11-17T06:33:32.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.515+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 73 ==== osd_op_reply(193 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv81 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.515+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=49 frag=1*, r=0 2023-11-17T06:33:32.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.515+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.515+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:194 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c380 con 0x55d7121b8c00 2023-11-17T06:33:32.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.519+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 74 ==== osd_op_reply(194 10000000000.01800000 [omap-set-vals] v41'82 uv82 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.519+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/49 pointing to 0x0x10000000032 2023-11-17T06:33:32.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.519+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000033 2023-11-17T06:33:32.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.519+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:50 2023-11-17T06:33:32.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.519+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:195 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8800 2023-11-17T06:33:32.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.519+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 63 ==== osd_op_reply(195 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv79 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.519+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=50 frag=0*, r=0 2023-11-17T06:33:32.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.519+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.519+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:196 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8800 2023-11-17T06:33:32.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 64 ==== osd_op_reply(196 10000000000.01000000 [omap-set-vals] v41'80 uv80 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/50 pointing to 0x0x10000000033 2023-11-17T06:33:32.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000034 2023-11-17T06:33:32.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:51 2023-11-17T06:33:32.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:197 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ce00 con 0x55d7121b8c00 2023-11-17T06:33:32.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 75 ==== osd_op_reply(197 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv82 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=51 frag=1*, r=0 2023-11-17T06:33:32.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:198 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d180 con 0x55d7121b8c00 2023-11-17T06:33:32.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 76 ==== osd_op_reply(198 10000000000.01800000 [omap-set-vals] v41'83 uv83 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/51 pointing to 0x0x10000000034 2023-11-17T06:33:32.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000035 2023-11-17T06:33:32.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:52 2023-11-17T06:33:32.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.523+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:199 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d500 con 0x55d7121b8800 2023-11-17T06:33:32.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 65 ==== osd_op_reply(199 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv80 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=52 frag=0*, r=0 2023-11-17T06:33:32.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:200 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d880 con 0x55d7121b8800 2023-11-17T06:33:32.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 66 ==== osd_op_reply(200 10000000000.01000000 [omap-set-vals] v41'81 uv81 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/52 pointing to 0x0x10000000035 2023-11-17T06:33:32.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000036 2023-11-17T06:33:32.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:53 2023-11-17T06:33:32.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:201 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228dc00 con 0x55d7121b8800 2023-11-17T06:33:32.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 67 ==== osd_op_reply(201 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv81 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=53 frag=0*, r=0 2023-11-17T06:33:32.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.527+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:202 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8800 2023-11-17T06:33:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.531+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 68 ==== osd_op_reply(202 10000000000.01000000 [omap-set-vals] v41'82 uv82 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.531+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/53 pointing to 0x0x10000000036 2023-11-17T06:33:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.531+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000037 2023-11-17T06:33:32.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.531+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:54 2023-11-17T06:33:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.531+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:203 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8c00 2023-11-17T06:33:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.531+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 77 ==== osd_op_reply(203 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv83 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.531+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=54 frag=1*, r=0 2023-11-17T06:33:32.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.531+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.531+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:204 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d500 con 0x55d7121b8c00 2023-11-17T06:33:32.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 78 ==== osd_op_reply(204 10000000000.01800000 [omap-set-vals] v41'84 uv84 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/54 pointing to 0x0x10000000037 2023-11-17T06:33:32.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000038 2023-11-17T06:33:32.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:55 2023-11-17T06:33:32.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:205 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d880 con 0x55d7121b8800 2023-11-17T06:33:32.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 69 ==== osd_op_reply(205 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv82 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=55 frag=0*, r=0 2023-11-17T06:33:32.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:206 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c000 con 0x55d7121b8800 2023-11-17T06:33:32.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 70 ==== osd_op_reply(206 10000000000.01000000 [omap-set-vals] v41'83 uv83 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/55 pointing to 0x0x10000000038 2023-11-17T06:33:32.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000039 2023-11-17T06:33:32.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:56 2023-11-17T06:33:32.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.535+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:207 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c380 con 0x55d7121b8c00 2023-11-17T06:33:32.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 79 ==== osd_op_reply(207 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv84 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=56 frag=1*, r=0 2023-11-17T06:33:32.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:208 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ce00 con 0x55d7121b8c00 2023-11-17T06:33:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 80 ==== osd_op_reply(208 10000000000.01800000 [omap-set-vals] v41'85 uv85 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/56 pointing to 0x0x10000000039 2023-11-17T06:33:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000003a 2023-11-17T06:33:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:57 2023-11-17T06:33:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:209 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 81 ==== osd_op_reply(209 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv85 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=57 frag=1*, r=0 2023-11-17T06:33:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.539+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:210 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9c00 con 0x55d7121b8c00 2023-11-17T06:33:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.543+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 82 ==== osd_op_reply(210 10000000000.01800000 [omap-set-vals] v41'86 uv86 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.543+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/57 pointing to 0x0x1000000003a 2023-11-17T06:33:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.543+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000003b 2023-11-17T06:33:32.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.543+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:58 2023-11-17T06:33:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.543+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:211 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8c00 2023-11-17T06:33:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.543+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 83 ==== osd_op_reply(211 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv86 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.543+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=58 frag=1*, r=0 2023-11-17T06:33:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.543+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.543+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:212 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8c00 2023-11-17T06:33:32.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.547+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 84 ==== osd_op_reply(212 10000000000.01800000 [omap-set-vals] v41'87 uv87 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.547+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/58 pointing to 0x0x1000000003b 2023-11-17T06:33:32.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.547+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000003c 2023-11-17T06:33:32.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.547+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:59 2023-11-17T06:33:32.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.547+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:213 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8800 2023-11-17T06:33:32.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.547+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 71 ==== osd_op_reply(213 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv83 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.547+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=59 frag=0*, r=0 2023-11-17T06:33:32.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.547+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.547+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:214 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.551+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 72 ==== osd_op_reply(214 10000000000.01000000 [omap-set-vals] v41'84 uv84 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.551+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/59 pointing to 0x0x1000000003c 2023-11-17T06:33:32.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.551+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000003d 2023-11-17T06:33:32.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.551+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:60 2023-11-17T06:33:32.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.551+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:215 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6000 con 0x55d7121b8c00 2023-11-17T06:33:32.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.551+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 85 ==== osd_op_reply(215 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv87 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.551+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=60 frag=1*, r=0 2023-11-17T06:33:32.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.551+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.551+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:216 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6380 con 0x55d7121b8c00 2023-11-17T06:33:32.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 86 ==== osd_op_reply(216 10000000000.01800000 [omap-set-vals] v41'88 uv88 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/60 pointing to 0x0x1000000003d 2023-11-17T06:33:32.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000003e 2023-11-17T06:33:32.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:61 2023-11-17T06:33:32.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:217 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6700 con 0x55d7121b8800 2023-11-17T06:33:32.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 73 ==== osd_op_reply(217 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv84 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=61 frag=0*, r=0 2023-11-17T06:33:32.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:218 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6a80 con 0x55d7121b8800 2023-11-17T06:33:32.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 74 ==== osd_op_reply(218 10000000000.01000000 [omap-set-vals] v41'85 uv85 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/61 pointing to 0x0x1000000003e 2023-11-17T06:33:32.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000003f 2023-11-17T06:33:32.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:62 2023-11-17T06:33:32.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.555+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:219 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6e00 con 0x55d7121b8c00 2023-11-17T06:33:32.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 87 ==== osd_op_reply(219 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv88 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=62 frag=1*, r=0 2023-11-17T06:33:32.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:220 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7180 con 0x55d7121b8c00 2023-11-17T06:33:32.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 88 ==== osd_op_reply(220 10000000000.01800000 [omap-set-vals] v41'89 uv89 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/62 pointing to 0x0x1000000003f 2023-11-17T06:33:32.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000040 2023-11-17T06:33:32.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:63 2023-11-17T06:33:32.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:221 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7500 con 0x55d7121b8800 2023-11-17T06:33:32.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 75 ==== osd_op_reply(221 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv85 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=63 frag=0*, r=0 2023-11-17T06:33:32.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.559+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:222 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7880 con 0x55d7121b8800 2023-11-17T06:33:32.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.563+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 76 ==== osd_op_reply(222 10000000000.01000000 [omap-set-vals] v41'86 uv86 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.563+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/63 pointing to 0x0x10000000040 2023-11-17T06:33:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.563+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000041 2023-11-17T06:33:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.563+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:64 2023-11-17T06:33:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.563+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:223 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7c00 con 0x55d7121b8800 2023-11-17T06:33:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.563+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 77 ==== osd_op_reply(223 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv86 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.563+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=64 frag=0*, r=0 2023-11-17T06:33:32.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.563+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.563+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:224 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6000 con 0x55d7121b8800 2023-11-17T06:33:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 78 ==== osd_op_reply(224 10000000000.01000000 [omap-set-vals] v41'87 uv87 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/64 pointing to 0x0x10000000041 2023-11-17T06:33:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000042 2023-11-17T06:33:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:65 2023-11-17T06:33:32.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:225 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6380 con 0x55d7121b8800 2023-11-17T06:33:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 79 ==== osd_op_reply(225 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv87 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=65 frag=0*, r=0 2023-11-17T06:33:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:226 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6e00 con 0x55d7121b8800 2023-11-17T06:33:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 80 ==== osd_op_reply(226 10000000000.01000000 [omap-set-vals] v41'88 uv88 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/65 pointing to 0x0x10000000042 2023-11-17T06:33:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000043 2023-11-17T06:33:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:66 2023-11-17T06:33:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.567+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:227 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9c00 con 0x55d7121b8800 2023-11-17T06:33:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 81 ==== osd_op_reply(227 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv88 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=66 frag=0*, r=0 2023-11-17T06:33:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:228 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8800 2023-11-17T06:33:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 82 ==== osd_op_reply(228 10000000000.01000000 [omap-set-vals] v41'89 uv89 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/66 pointing to 0x0x10000000043 2023-11-17T06:33:32.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000044 2023-11-17T06:33:32.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:67 2023-11-17T06:33:32.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:229 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8c00 2023-11-17T06:33:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 89 ==== osd_op_reply(229 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv89 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=67 frag=1*, r=0 2023-11-17T06:33:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.571+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:230 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8c00 2023-11-17T06:33:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.575+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 90 ==== osd_op_reply(230 10000000000.01800000 [omap-set-vals] v41'90 uv90 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.575+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/67 pointing to 0x0x10000000044 2023-11-17T06:33:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.575+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000045 2023-11-17T06:33:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.575+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:68 2023-11-17T06:33:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.575+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:231 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d180 con 0x55d7121b8c00 2023-11-17T06:33:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.575+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 91 ==== osd_op_reply(231 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv90 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.575+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=68 frag=1*, r=0 2023-11-17T06:33:32.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.575+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.575+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:232 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8c00 2023-11-17T06:33:32.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.579+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 92 ==== osd_op_reply(232 10000000000.01800000 [omap-set-vals] v41'91 uv91 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.579+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/68 pointing to 0x0x10000000045 2023-11-17T06:33:32.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.579+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000046 2023-11-17T06:33:32.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.579+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:69 2023-11-17T06:33:32.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.579+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:233 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d500 con 0x55d7121b8800 2023-11-17T06:33:32.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.579+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 83 ==== osd_op_reply(233 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv89 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.579+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=69 frag=0*, r=0 2023-11-17T06:33:32.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.579+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.579+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:234 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c380 con 0x55d7121b8800 2023-11-17T06:33:32.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.583+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 84 ==== osd_op_reply(234 10000000000.01000000 [omap-set-vals] v41'90 uv90 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.583+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/69 pointing to 0x0x10000000046 2023-11-17T06:33:32.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.583+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000047 2023-11-17T06:33:32.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.583+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:70 2023-11-17T06:33:32.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.583+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:235 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ce00 con 0x55d7121b8800 2023-11-17T06:33:32.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.583+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 85 ==== osd_op_reply(235 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv90 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.583+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=70 frag=0*, r=0 2023-11-17T06:33:32.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.583+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.583+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:236 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6700 con 0x55d7121b8800 2023-11-17T06:33:32.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 86 ==== osd_op_reply(236 10000000000.01000000 [omap-set-vals] v41'91 uv91 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/70 pointing to 0x0x10000000047 2023-11-17T06:33:32.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000048 2023-11-17T06:33:32.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:71 2023-11-17T06:33:32.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:237 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6a80 con 0x55d7121b8c00 2023-11-17T06:33:32.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 93 ==== osd_op_reply(237 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv91 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=71 frag=1*, r=0 2023-11-17T06:33:32.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:238 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7500 con 0x55d7121b8c00 2023-11-17T06:33:32.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 94 ==== osd_op_reply(238 10000000000.01800000 [omap-set-vals] v41'92 uv92 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/71 pointing to 0x0x10000000048 2023-11-17T06:33:32.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000049 2023-11-17T06:33:32.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:72 2023-11-17T06:33:32.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.587+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:239 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7880 con 0x55d7121b8c00 2023-11-17T06:33:32.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.591+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 95 ==== osd_op_reply(239 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv92 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.591+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=72 frag=1*, r=0 2023-11-17T06:33:32.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.591+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.591+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:240 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7c00 con 0x55d7121b8c00 2023-11-17T06:33:32.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.591+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 96 ==== osd_op_reply(240 10000000000.01800000 [omap-set-vals] v41'93 uv93 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.591+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/72 pointing to 0x0x10000000049 2023-11-17T06:33:32.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.591+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000004a 2023-11-17T06:33:32.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.591+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:73 2023-11-17T06:33:32.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.591+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:241 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6000 con 0x55d7121b8800 2023-11-17T06:33:32.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 87 ==== osd_op_reply(241 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv91 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=73 frag=0*, r=0 2023-11-17T06:33:32.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:242 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8800 2023-11-17T06:33:32.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 88 ==== osd_op_reply(242 10000000000.01000000 [omap-set-vals] v41'92 uv92 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/73 pointing to 0x0x1000000004a 2023-11-17T06:33:32.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000004b 2023-11-17T06:33:32.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:74 2023-11-17T06:33:32.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:243 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 89 ==== osd_op_reply(243 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv92 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=74 frag=0*, r=0 2023-11-17T06:33:32.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.595+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:244 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228dc00 con 0x55d7121b8800 2023-11-17T06:33:32.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.599+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 90 ==== osd_op_reply(244 10000000000.01000000 [omap-set-vals] v41'93 uv93 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.599+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/74 pointing to 0x0x1000000004b 2023-11-17T06:33:32.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.599+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000004c 2023-11-17T06:33:32.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.599+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:75 2023-11-17T06:33:32.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.599+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:245 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8800 2023-11-17T06:33:32.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.599+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 91 ==== osd_op_reply(245 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv93 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.599+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=75 frag=0*, r=0 2023-11-17T06:33:32.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.599+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.607 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.599+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:246 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d880 con 0x55d7121b8800 2023-11-17T06:33:32.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.603+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 92 ==== osd_op_reply(246 10000000000.01000000 [omap-set-vals] v41'94 uv94 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.603+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/75 pointing to 0x0x1000000004c 2023-11-17T06:33:32.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.603+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000004d 2023-11-17T06:33:32.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.603+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:76 2023-11-17T06:33:32.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.603+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:247 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c000 con 0x55d7121b8c00 2023-11-17T06:33:32.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.603+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 97 ==== osd_op_reply(247 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv93 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.603+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=76 frag=1*, r=0 2023-11-17T06:33:32.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.603+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.603+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:248 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d500 con 0x55d7121b8c00 2023-11-17T06:33:32.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.607+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 98 ==== osd_op_reply(248 10000000000.01800000 [omap-set-vals] v41'94 uv94 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.607+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/76 pointing to 0x0x1000000004d 2023-11-17T06:33:32.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.607+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000004e 2023-11-17T06:33:32.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.607+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:77 2023-11-17T06:33:32.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.607+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:249 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c380 con 0x55d7121b8800 2023-11-17T06:33:32.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.607+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 93 ==== osd_op_reply(249 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv94 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.607+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=77 frag=0*, r=0 2023-11-17T06:33:32.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.607+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.607+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:250 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ce00 con 0x55d7121b8800 2023-11-17T06:33:32.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.611+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 94 ==== osd_op_reply(250 10000000000.01000000 [omap-set-vals] v41'95 uv95 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.611+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/77 pointing to 0x0x1000000004e 2023-11-17T06:33:32.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.611+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000004f 2023-11-17T06:33:32.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.611+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:78 2023-11-17T06:33:32.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.611+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:251 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228dc00 con 0x55d7121b8c00 2023-11-17T06:33:32.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.611+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 99 ==== osd_op_reply(251 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv94 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.611+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=78 frag=1*, r=0 2023-11-17T06:33:32.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.611+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.611+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:252 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8c00 2023-11-17T06:33:32.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 100 ==== osd_op_reply(252 10000000000.01800000 [omap-set-vals] v41'95 uv95 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/78 pointing to 0x0x1000000004f 2023-11-17T06:33:32.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000050 2023-11-17T06:33:32.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:79 2023-11-17T06:33:32.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:253 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9c00 con 0x55d7121b8c00 2023-11-17T06:33:32.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 101 ==== osd_op_reply(253 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv95 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=79 frag=1*, r=0 2023-11-17T06:33:32.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:254 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8c00 2023-11-17T06:33:32.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 102 ==== osd_op_reply(254 10000000000.01800000 [omap-set-vals] v41'96 uv96 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/79 pointing to 0x0x10000000050 2023-11-17T06:33:32.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000051 2023-11-17T06:33:32.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:80 2023-11-17T06:33:32.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.615+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:255 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8800 2023-11-17T06:33:32.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 95 ==== osd_op_reply(255 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv95 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=80 frag=0*, r=0 2023-11-17T06:33:32.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:256 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 96 ==== osd_op_reply(256 10000000000.01000000 [omap-set-vals] v41'96 uv96 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/80 pointing to 0x0x10000000051 2023-11-17T06:33:32.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000052 2023-11-17T06:33:32.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:81 2023-11-17T06:33:32.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:257 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6380 con 0x55d7121b8c00 2023-11-17T06:33:32.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 103 ==== osd_op_reply(257 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv96 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=81 frag=1*, r=0 2023-11-17T06:33:32.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.619+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:258 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6e00 con 0x55d7121b8c00 2023-11-17T06:33:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.623+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 104 ==== osd_op_reply(258 10000000000.01800000 [omap-set-vals] v41'97 uv97 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.623+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/81 pointing to 0x0x10000000052 2023-11-17T06:33:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.623+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000053 2023-11-17T06:33:32.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.623+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:82 2023-11-17T06:33:32.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.623+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:259 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6700 con 0x55d7121b8c00 2023-11-17T06:33:32.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.623+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 105 ==== osd_op_reply(259 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv97 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.623+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=82 frag=1*, r=0 2023-11-17T06:33:32.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.623+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.623+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:260 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6000 con 0x55d7121b8c00 2023-11-17T06:33:32.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.627+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 106 ==== osd_op_reply(260 10000000000.01800000 [omap-set-vals] v41'98 uv98 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.627+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/82 pointing to 0x0x10000000053 2023-11-17T06:33:32.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.627+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000054 2023-11-17T06:33:32.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.627+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:83 2023-11-17T06:33:32.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.627+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:261 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d180 con 0x55d7121b8800 2023-11-17T06:33:32.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.627+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 97 ==== osd_op_reply(261 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv96 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.627+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=83 frag=0*, r=0 2023-11-17T06:33:32.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.627+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.627+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:262 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228ca80 con 0x55d7121b8800 2023-11-17T06:33:32.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.631+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 98 ==== osd_op_reply(262 10000000000.01000000 [omap-set-vals] v41'97 uv97 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.631+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/83 pointing to 0x0x10000000054 2023-11-17T06:33:32.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.631+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000055 2023-11-17T06:33:32.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.631+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:84 2023-11-17T06:33:32.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.631+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:263 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c000 con 0x55d7121b8800 2023-11-17T06:33:32.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.631+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 99 ==== osd_op_reply(263 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv97 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.631+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=84 frag=0*, r=0 2023-11-17T06:33:32.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.631+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.631+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:264 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228d500 con 0x55d7121b8800 2023-11-17T06:33:32.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.635+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 100 ==== osd_op_reply(264 10000000000.01000000 [omap-set-vals] v41'98 uv98 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.635+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/84 pointing to 0x0x10000000055 2023-11-17T06:33:32.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.635+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000056 2023-11-17T06:33:32.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.635+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:85 2023-11-17T06:33:32.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.635+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:265 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228dc00 con 0x55d7121b8800 2023-11-17T06:33:32.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.635+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 101 ==== osd_op_reply(265 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv98 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.635+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=85 frag=0*, r=0 2023-11-17T06:33:32.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.635+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.635+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:266 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d71228c700 con 0x55d7121b8800 2023-11-17T06:33:32.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 102 ==== osd_op_reply(266 10000000000.01000000 [omap-set-vals] v41'99 uv99 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/85 pointing to 0x0x10000000056 2023-11-17T06:33:32.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000057 2023-11-17T06:33:32.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:86 2023-11-17T06:33:32.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:267 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7180 con 0x55d7121b8800 2023-11-17T06:33:32.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 103 ==== osd_op_reply(267 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv99 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=86 frag=0*, r=0 2023-11-17T06:33:32.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:268 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6a80 con 0x55d7121b8800 2023-11-17T06:33:32.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 104 ==== osd_op_reply(268 10000000000.01000000 [omap-set-vals] v41'100 uv100 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/86 pointing to 0x0x10000000057 2023-11-17T06:33:32.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000058 2023-11-17T06:33:32.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:87 2023-11-17T06:33:32.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:269 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7500 con 0x55d7121b8800 2023-11-17T06:33:32.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 105 ==== osd_op_reply(269 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv100 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=87 frag=0*, r=0 2023-11-17T06:33:32.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.639+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:270 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7880 con 0x55d7121b8800 2023-11-17T06:33:32.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.643+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 106 ==== osd_op_reply(270 10000000000.01000000 [omap-set-vals] v41'101 uv101 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.643+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/87 pointing to 0x0x10000000058 2023-11-17T06:33:32.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.643+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000059 2023-11-17T06:33:32.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.643+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:88 2023-11-17T06:33:32.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.643+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:271 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7c00 con 0x55d7121b8800 2023-11-17T06:33:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.643+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 107 ==== osd_op_reply(271 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv101 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.643+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=88 frag=0*, r=0 2023-11-17T06:33:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.643+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.643+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:272 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711da9880 con 0x55d7121b8800 2023-11-17T06:33:32.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.647+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 108 ==== osd_op_reply(272 10000000000.01000000 [omap-set-vals] v41'102 uv102 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.647+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/88 pointing to 0x0x10000000059 2023-11-17T06:33:32.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.647+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000005a 2023-11-17T06:33:32.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.647+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:89 2023-11-17T06:33:32.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.647+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:273 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8c00 2023-11-17T06:33:32.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.647+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 107 ==== osd_op_reply(273 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv98 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.647+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=89 frag=1*, r=0 2023-11-17T06:33:32.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.647+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.647+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:274 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7180 con 0x55d7121b8c00 2023-11-17T06:33:32.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 108 ==== osd_op_reply(274 10000000000.01800000 [omap-set-vals] v41'99 uv99 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/89 pointing to 0x0x1000000005a 2023-11-17T06:33:32.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000005b 2023-11-17T06:33:32.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:90 2023-11-17T06:33:32.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:275 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad6a80 con 0x55d7121b8800 2023-11-17T06:33:32.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 109 ==== osd_op_reply(275 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv102 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=90 frag=0*, r=0 2023-11-17T06:33:32.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:276 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d712ad7500 con 0x55d7121b8800 2023-11-17T06:33:32.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 110 ==== osd_op_reply(276 10000000000.01000000 [omap-set-vals] v41'103 uv103 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/90 pointing to 0x0x1000000005b 2023-11-17T06:33:32.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000005c 2023-11-17T06:33:32.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:91 2023-11-17T06:33:32.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:277 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8c00 2023-11-17T06:33:32.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 109 ==== osd_op_reply(277 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv99 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=91 frag=1*, r=0 2023-11-17T06:33:32.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.651+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:278 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.655+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 110 ==== osd_op_reply(278 10000000000.01800000 [omap-set-vals] v41'100 uv100 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.655+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/91 pointing to 0x0x1000000005c 2023-11-17T06:33:32.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.655+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000005d 2023-11-17T06:33:32.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.655+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:92 2023-11-17T06:33:32.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.655+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:279 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb8000 con 0x55d7121b8800 2023-11-17T06:33:32.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.655+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 111 ==== osd_op_reply(279 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv103 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.655+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=92 frag=0*, r=0 2023-11-17T06:33:32.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.655+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.655+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:280 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb8380 con 0x55d7121b8800 2023-11-17T06:33:32.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.659+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 112 ==== osd_op_reply(280 10000000000.01000000 [omap-set-vals] v41'104 uv104 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.659+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/92 pointing to 0x0x1000000005d 2023-11-17T06:33:32.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.659+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000005e 2023-11-17T06:33:32.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.659+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:93 2023-11-17T06:33:32.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.659+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:281 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb8700 con 0x55d7121b8c00 2023-11-17T06:33:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.659+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 111 ==== osd_op_reply(281 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv100 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.659+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=93 frag=1*, r=0 2023-11-17T06:33:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.659+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.659+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:282 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb8a80 con 0x55d7121b8c00 2023-11-17T06:33:32.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.663+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 112 ==== osd_op_reply(282 10000000000.01800000 [omap-set-vals] v41'101 uv101 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.663+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/93 pointing to 0x0x1000000005e 2023-11-17T06:33:32.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.663+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x1000000005f 2023-11-17T06:33:32.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.663+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:94 2023-11-17T06:33:32.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.663+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:283 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb8e00 con 0x55d7121b8c00 2023-11-17T06:33:32.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.663+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 113 ==== osd_op_reply(283 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv101 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.663+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=94 frag=1*, r=0 2023-11-17T06:33:32.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.663+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.663+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:284 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb9180 con 0x55d7121b8c00 2023-11-17T06:33:32.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.667+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 114 ==== osd_op_reply(284 10000000000.01800000 [omap-set-vals] v41'102 uv102 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.667+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/94 pointing to 0x0x1000000005f 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.667+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000060 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.667+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:95 2023-11-17T06:33:32.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.667+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:285 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb9500 con 0x55d7121b8800 2023-11-17T06:33:32.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.667+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 113 ==== osd_op_reply(285 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv104 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.667+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=95 frag=0*, r=0 2023-11-17T06:33:32.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.667+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.667+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:286 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb9880 con 0x55d7121b8800 2023-11-17T06:33:32.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 114 ==== osd_op_reply(286 10000000000.01000000 [omap-set-vals] v41'105 uv105 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/95 pointing to 0x0x10000000060 2023-11-17T06:33:32.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000061 2023-11-17T06:33:32.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:96 2023-11-17T06:33:32.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:287 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb9c00 con 0x55d7121b8800 2023-11-17T06:33:32.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 115 ==== osd_op_reply(287 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv105 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=96 frag=0*, r=0 2023-11-17T06:33:32.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:288 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb8700 con 0x55d7121b8800 2023-11-17T06:33:32.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 116 ==== osd_op_reply(288 10000000000.01000000 [omap-set-vals] v41'106 uv106 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/96 pointing to 0x0x10000000061 2023-11-17T06:33:32.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000062 2023-11-17T06:33:32.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:97 2023-11-17T06:33:32.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:289 4.5 4:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb8a80 con 0x55d7121b8800 2023-11-17T06:33:32.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 117 ==== osd_op_reply(289 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv106 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01000000 dname=97 frag=0*, r=0 2023-11-17T06:33:32.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.671+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.675+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:290 4.5 4:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb8e00 con 0x55d7121b8800 2023-11-17T06:33:32.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.675+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 118 ==== osd_op_reply(290 10000000000.01000000 [omap-set-vals] v41'107 uv107 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.675+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/97 pointing to 0x0x10000000062 2023-11-17T06:33:32.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.675+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000063 2023-11-17T06:33:32.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.675+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:98 2023-11-17T06:33:32.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.675+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:291 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d711eb9180 con 0x55d7121b8c00 2023-11-17T06:33:32.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.675+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 115 ==== osd_op_reply(291 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv102 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.675+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=98 frag=1*, r=0 2023-11-17T06:33:32.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.675+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.675+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:292 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9c00 con 0x55d7121b8c00 2023-11-17T06:33:32.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.679+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 116 ==== osd_op_reply(292 10000000000.01800000 [omap-set-vals] v41'103 uv103 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.679+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/98 pointing to 0x0x10000000063 2023-11-17T06:33:32.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.679+0000 7fcc5bd8b840 10 datascan.scan_links: handling injected_ino 0x10000000064 2023-11-17T06:33:32.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.679+0000 7fcc5bd8b840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:99 2023-11-17T06:33:32.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.679+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:293 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8e00 con 0x55d7121b8c00 2023-11-17T06:33:32.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.679+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 117 ==== osd_op_reply(293 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv103 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.679+0000 7fcc5bd8b840 20 datascan.read_dentry: oid=10000000000.01800000 dname=99 frag=1*, r=0 2023-11-17T06:33:32.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.679+0000 7fcc5bd8b840 20 datascan.scan_links: first is now 2 2023-11-17T06:33:32.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.679+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:294 4.1b 4:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e9880 con 0x55d7121b8c00 2023-11-17T06:33:32.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 118 ==== osd_op_reply(294 10000000000.01800000 [omap-set-vals] v41'104 uv104 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/99 pointing to 0x0x10000000064 2023-11-17T06:33:32.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 10 datascan.scan_links: updating inotable 2023-11-17T06:33:32.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- osd_op(unknown.0.0:295 4.13 4:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8000 con 0x55d7121b8c00 2023-11-17T06:33:32.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc59d46700 1 -- 172.21.15.69:0/3648064671 <== osd.2 v2:172.21.15.69:6808/576340262 119 ==== osd_op_reply(295 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55d712b54b40 con 0x55d7121b8c00 2023-11-17T06:33:32.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 10 datascan.scan_links: updating snaptable 2023-11-17T06:33:32.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:296 4.d 4:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55d7121e8a80 con 0x55d7121b8800 2023-11-17T06:33:32.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 <== osd.3 v2:172.21.15.69:6824/183679214 119 ==== osd_op_reply(296 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55d712b54fc0 con 0x55d7121b8800 2023-11-17T06:33:32.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x55d7121b9400 msgr2=0x55d7121bbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x55d7121b9400 0x55d7121bbb80 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x55d7121e2000 msgr2=0x55d7121bc680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x55d7121e2000 0x55d7121bc680 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x55d7121b8c00 msgr2=0x55d7121bab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x55d7121b8c00 0x55d7121bab00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55d7121b8800 msgr2=0x55d7121ba580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55d7121b8800 0x55d7121ba580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x55d7120af800 msgr2=0x55d711dd8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x55d7120af800 0x55d711dd8100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x55d7121b9c00 msgr2=0x55d7121bb600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x55d7121b9c00 0x55d7121bb600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x55d7121b8400 msgr2=0x55d7121bb080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x55d7121b8400 0x55d7121bb080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x55d7121b8000 msgr2=0x55d7121ba000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x55d7121b8000 0x55d7121ba000 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 reap_dead start 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 reap_dead start 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5a547700 1 -- 172.21.15.69:0/3648064671 reap_dead start 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55d7120af400 msgr2=0x55d711dd9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55d7120af400 0x55d711dd9700 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55d711e1c420 tx=0x55d712b48000 comp rx=0 tx=0).stop 2023-11-17T06:33:32.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 msgr2=0x55d711dd8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd8c00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55d7120497a0 tx=0x55d712b483c0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 shutdown_connections 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x55d7120af400 0x55d711dd9700 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/3648064671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d7120ae800 0x55d711dd8c00 secure :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55d7120497a0 tx=0x55d712b483c0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.683+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 >> 172.21.15.69:0/3648064671 conn(0x55d7120ae000 msgr2=0x55d711e2d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 shutdown_connections 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/3648064671 wait complete. 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/2031523837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d711d63400 msgr2=0x55d711dd6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/2031523837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d711d63400 0x55d711dd6b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x55d711e1d560 tx=0x55d712b48480 comp rx=0 tx=0).stop 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/2031523837 shutdown_connections 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/2031523837 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55d711d63800 0x55d711dd7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/2031523837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d711d63400 0x55d711dd6b00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 --2- 172.21.15.69:0/2031523837 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d711d63000 0x55d711dd6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/2031523837 >> 172.21.15.69:0/2031523837 conn(0x55d711d62c00 msgr2=0x55d711e2d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/2031523837 shutdown_connections 2023-11-17T06:33:32.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.687+0000 7fcc5bd8b840 1 -- 172.21.15.69:0/2031523837 wait complete. 2023-11-17T06:33:32.700 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.587666, result: 2023-11-17T06:33:32.700 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.01000000 2023-11-17T06:33:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e48ee140 1 Processor -- start 2023-11-17T06:33:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e48ee140 1 -- start start 2023-11-17T06:33:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e48ee140 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a1a8a00 0x55dc1a283cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e48ee140 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55dc1a1adb90 0x55dc1a1f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e48ee140 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55dc1a1adf70 0x55dc1a309d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e48ee140 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc1a13ed40 con 0x55dc1a1a8a00 2023-11-17T06:33:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e48ee140 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc1a0fcba0 con 0x55dc1a1adf70 2023-11-17T06:33:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e48ee140 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc1a0fb4e0 con 0x55dc1a1adb90 2023-11-17T06:33:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e2428700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a1a8a00 0x55dc1a283cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e2428700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a1a8a00 0x55dc1a283cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34900/0 (socket says 172.21.15.69:34900) 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e2428700 1 -- 172.21.15.69:0/941128171 learned_addr learned my addr 172.21.15.69:0/941128171 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e1c27700 1 --2- 172.21.15.69:0/941128171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55dc1a1adb90 0x55dc1a1f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e2c29700 1 --2- 172.21.15.69:0/941128171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55dc1a1adf70 0x55dc1a309d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e2428700 1 -- 172.21.15.69:0/941128171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55dc1a1adb90 msgr2=0x55dc1a1f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e2428700 1 --2- 172.21.15.69:0/941128171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55dc1a1adb90 0x55dc1a1f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e2428700 1 -- 172.21.15.69:0/941128171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55dc1a1adf70 msgr2=0x55dc1a309d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e2428700 1 --2- 172.21.15.69:0/941128171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55dc1a1adf70 0x55dc1a309d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e2428700 1 -- 172.21.15.69:0/941128171 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25cc005d20 con 0x55dc1a1a8a00 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.807+0000 7f25e2428700 1 --2- 172.21.15.69:0/941128171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a1a8a00 0x55dc1a283cb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f25d4001540 tx=0x7f25d4001850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb77db9bc63558f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e0c25700 1 -- 172.21.15.69:0/941128171 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4011440 con 0x55dc1a1a8a00 2023-11-17T06:33:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e0c25700 1 -- 172.21.15.69:0/941128171 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d40115a0 con 0x55dc1a1a8a00 2023-11-17T06:33:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e0c25700 1 -- 172.21.15.69:0/941128171 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4011950 con 0x55dc1a1a8a00 2023-11-17T06:33:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 -- 172.21.15.69:0/941128171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a1a8a00 msgr2=0x55dc1a283cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 --2- 172.21.15.69:0/941128171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a1a8a00 0x55dc1a283cb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f25d4001540 tx=0x7f25d4001850 comp rx=0 tx=0).stop 2023-11-17T06:33:32.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 -- 172.21.15.69:0/941128171 shutdown_connections 2023-11-17T06:33:32.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 --2- 172.21.15.69:0/941128171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55dc1a1adf70 0x55dc1a309d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 --2- 172.21.15.69:0/941128171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55dc1a1adb90 0x55dc1a1f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 --2- 172.21.15.69:0/941128171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a1a8a00 0x55dc1a283cb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 -- 172.21.15.69:0/941128171 >> 172.21.15.69:0/941128171 conn(0x55dc1a1aea10 msgr2=0x55dc1a1aae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 -- 172.21.15.69:0/941128171 shutdown_connections 2023-11-17T06:33:32.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 -- 172.21.15.69:0/941128171 wait complete. 2023-11-17T06:33:32.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 Processor -- start 2023-11-17T06:33:32.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 -- start start 2023-11-17T06:33:32.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55dc1a1adb90 0x55dc1a1ef090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55dc1a1adf70 0x55dc1a282720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a282c60 0x55dc1a2839c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc1a0ce240 con 0x55dc1a282c60 2023-11-17T06:33:32.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc1a283490 con 0x55dc1a1adf70 2023-11-17T06:33:32.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.811+0000 7f25e48ee140 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dc1a30f1b0 con 0x55dc1a1adb90 2023-11-17T06:33:32.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e2c29700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a282c60 0x55dc1a2839c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e2c29700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a282c60 0x55dc1a2839c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34906/0 (socket says 172.21.15.69:34906) 2023-11-17T06:33:32.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e2c29700 1 -- 172.21.15.69:0/3309696429 learned_addr learned my addr 172.21.15.69:0/3309696429 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:32.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e1c27700 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55dc1a1adf70 0x55dc1a282720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e2428700 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55dc1a1adb90 0x55dc1a1ef090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e2c29700 1 -- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55dc1a1adb90 msgr2=0x55dc1a1ef090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e2c29700 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x55dc1a1adb90 0x55dc1a1ef090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e2c29700 1 -- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55dc1a1adf70 msgr2=0x55dc1a282720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e2c29700 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55dc1a1adf70 0x55dc1a282720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e2c29700 1 -- 172.21.15.69:0/3309696429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc1a100390 con 0x55dc1a282c60 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e2c29700 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a282c60 0x55dc1a2839c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00ded0 tx=0x7f25dc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25db7fe700 1 -- 172.21.15.69:0/3309696429 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc00bdd0 con 0x55dc1a282c60 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25db7fe700 1 -- 172.21.15.69:0/3309696429 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25dc010410 con 0x55dc1a282c60 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25db7fe700 1 -- 172.21.15.69:0/3309696429 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc0107c0 con 0x55dc1a282c60 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e48ee140 1 -- 172.21.15.69:0/3309696429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dc1a0d9550 con 0x55dc1a282c60 2023-11-17T06:33:32.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.815+0000 7f25e48ee140 1 -- 172.21.15.69:0/3309696429 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dc1a0d8fb0 con 0x55dc1a282c60 2023-11-17T06:33:32.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.819+0000 7f25db7fe700 1 -- 172.21.15.69:0/3309696429 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f25dc010920 con 0x55dc1a282c60 2023-11-17T06:33:32.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.819+0000 7f25db7fe700 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f25c4064e40 0x7f25c4067300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.819+0000 7f25db7fe700 1 -- 172.21.15.69:0/3309696429 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f25dc00a040 con 0x55dc1a282c60 2023-11-17T06:33:32.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.819+0000 7f25e48ee140 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55dc1a283f00 0x55dc1a1ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:32.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.819+0000 7f25e48ee140 1 -- 172.21.15.69:0/3309696429 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- osd_op(unknown.0.0:1 4.5 4:a40620de:::10000000000.01000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v8 -- 0x55dc1a1ed770 con 0x55dc1a283f00 2023-11-17T06:33:32.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.819+0000 7f25e2428700 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f25c4064e40 0x7f25c4067300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.819+0000 7f25e1c27700 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55dc1a283f00 0x55dc1a1ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:32.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.819+0000 7f25e1c27700 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55dc1a283f00 0x55dc1a1ed230 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.819+0000 7f25e2428700 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f25c4064e40 0x7f25c4067300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55dc1a1da9c0 tx=0x7f25d4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:32.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e1c27700 1 -- 172.21.15.69:0/3309696429 <== osd.3 v2:172.21.15.69:6824/183679214 1 ==== osd_op_reply(1 10000000000.01000000 [omap-get-keys out=560b] v0'0 uv107 ondisk = 0) v8 ==== 164+0+560 (crc 0 0 0) 0x7f25cc0089e0 con 0x55dc1a283f00 2023-11-17T06:33:32.828 INFO:teuthology.orchestra.run.smithi069.stdout:10_head 2023-11-17T06:33:32.828 INFO:teuthology.orchestra.run.smithi069.stdout:11_head 2023-11-17T06:33:32.828 INFO:teuthology.orchestra.run.smithi069.stdout:12_head 2023-11-17T06:33:32.828 INFO:teuthology.orchestra.run.smithi069.stdout:15_head 2023-11-17T06:33:32.828 INFO:teuthology.orchestra.run.smithi069.stdout:19_head 2023-11-17T06:33:32.828 INFO:teuthology.orchestra.run.smithi069.stdout:1_head 2023-11-17T06:33:32.828 INFO:teuthology.orchestra.run.smithi069.stdout:20_head 2023-11-17T06:33:32.828 INFO:teuthology.orchestra.run.smithi069.stdout:21_head 2023-11-17T06:33:32.828 INFO:teuthology.orchestra.run.smithi069.stdout:27_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:28_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:2_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:31_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:34_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:36_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:38_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:39_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:3_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:42_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:43_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:46_head 2023-11-17T06:33:32.829 INFO:teuthology.orchestra.run.smithi069.stdout:4_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:50_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:52_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:53_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:55_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:59_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:61_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:63_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:64_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:65_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:66_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:69_head 2023-11-17T06:33:32.830 INFO:teuthology.orchestra.run.smithi069.stdout:70_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:73_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:74_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:75_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:77_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:80_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:83_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:84_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:85_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:86_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:87_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:88_head 2023-11-17T06:33:32.831 INFO:teuthology.orchestra.run.smithi069.stdout:8_head 2023-11-17T06:33:32.832 INFO:teuthology.orchestra.run.smithi069.stdout:90_head 2023-11-17T06:33:32.832 INFO:teuthology.orchestra.run.smithi069.stdout:92_head 2023-11-17T06:33:32.832 INFO:teuthology.orchestra.run.smithi069.stdout:95_head 2023-11-17T06:33:32.832 INFO:teuthology.orchestra.run.smithi069.stdout:96_head 2023-11-17T06:33:32.832 INFO:teuthology.orchestra.run.smithi069.stdout:97_head 2023-11-17T06:33:32.832 INFO:teuthology.orchestra.run.smithi069.stdout:9_head 2023-11-17T06:33:32.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e48ee140 1 -- 172.21.15.69:0/3309696429 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55dc1a283f00 msgr2=0x55dc1a1ed230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e48ee140 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x55dc1a283f00 0x55dc1a1ed230 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e48ee140 1 -- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f25c4064e40 msgr2=0x7f25c4067300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e48ee140 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f25c4064e40 0x7f25c4067300 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55dc1a1da9c0 tx=0x7f25d4008030 comp rx=0 tx=0).stop 2023-11-17T06:33:32.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e48ee140 1 -- 172.21.15.69:0/3309696429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a282c60 msgr2=0x55dc1a2839c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:32.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e48ee140 1 --2- 172.21.15.69:0/3309696429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc1a282c60 0x55dc1a2839c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00ded0 tx=0x7f25dc00b4f0 comp rx=0 tx=0).stop 2023-11-17T06:33:32.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e2c29700 1 -- 172.21.15.69:0/3309696429 reap_dead start 2023-11-17T06:33:32.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e48ee140 1 -- 172.21.15.69:0/3309696429 shutdown_connections 2023-11-17T06:33:32.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e48ee140 1 -- 172.21.15.69:0/3309696429 >> 172.21.15.69:0/3309696429 conn(0x55dc1a1aea10 msgr2=0x55dc1a197c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:32.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e48ee140 1 -- 172.21.15.69:0/3309696429 shutdown_connections 2023-11-17T06:33:32.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:32.823+0000 7f25e48ee140 1 -- 172.21.15.69:0/3309696429 wait complete. 2023-11-17T06:33:32.835 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-11-17T06:33:33.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.015+0000 7f8d3692b700 1 Processor -- start 2023-11-17T06:33:33.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.015+0000 7f8d3692b700 1 -- start start 2023-11-17T06:33:33.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d3692b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8d3015d4a0 0x7f8d3015d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d3692b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d300b8c40 0x7f8d300ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d3692b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3015ddc0 con 0x7f8d300b9080 2023-11-17T06:33:33.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d3692b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d3015e050 con 0x7f8d3015d4a0 2023-11-17T06:33:33.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d3692b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3015e330 con 0x7f8d300b8c40 2023-11-17T06:33:33.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8d3015d4a0 0x7f8d3015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d277fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d300b8c40 0x7f8d300ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8d3015d4a0 0x7f8d3015d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34916/0 (socket says 172.21.15.69:34916) 2023-11-17T06:33:33.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2ffff700 1 -- 172.21.15.69:0/3082772836 learned_addr learned my addr 172.21.15.69:0/3082772836 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:33.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d34ec8700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8d300b9080 0x7f8d300b4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:49340/0 (socket says 172.21.15.69:49340) 2023-11-17T06:33:33.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2ffff700 1 -- 172.21.15.69:0/3082772836 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d300b8c40 msgr2=0x7f8d300ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:33.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2ffff700 1 --2- 172.21.15.69:0/3082772836 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d300b8c40 0x7f8d300ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.025 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2ffff700 1 -- 172.21.15.69:0/3082772836 >> v1:172.21.15.69:6789/0 conn(0x7f8d300b9080 legacy=0x7f8d300b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2ffff700 1 -- 172.21.15.69:0/3082772836 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3015e610 con 0x7f8d3015d4a0 2023-11-17T06:33:33.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2ffff700 1 --2- 172.21.15.69:0/3082772836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 0x7f8d3015d880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009910 tx=0x7f8d20009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec4b8358f24569b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:33.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2f7fe700 1 -- 172.21.15.69:0/3082772836 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20011830 con 0x7f8d3015d4a0 2023-11-17T06:33:33.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2f7fe700 1 -- 172.21.15.69:0/3082772836 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d20011990 con 0x7f8d3015d4a0 2023-11-17T06:33:33.026 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.019+0000 7f8d2f7fe700 1 -- 172.21.15.69:0/3082772836 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20011d40 con 0x7f8d3015d4a0 2023-11-17T06:33:33.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.023+0000 7f8d3692b700 1 -- 172.21.15.69:0/3082772836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 msgr2=0x7f8d3015d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.027 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.023+0000 7f8d3692b700 1 --2- 172.21.15.69:0/3082772836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 0x7f8d3015d880 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009910 tx=0x7f8d20009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.023+0000 7f8d3692b700 1 -- 172.21.15.69:0/3082772836 shutdown_connections 2023-11-17T06:33:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.023+0000 7f8d3692b700 1 --2- 172.21.15.69:0/3082772836 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d300b8c40 0x7f8d300ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.023+0000 7f8d3692b700 1 --2- 172.21.15.69:0/3082772836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 0x7f8d3015d880 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.023+0000 7f8d3692b700 1 -- 172.21.15.69:0/3082772836 >> 172.21.15.69:0/3082772836 conn(0x7f8d3006b830 msgr2=0x7f8d3006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.023+0000 7f8d3692b700 1 -- 172.21.15.69:0/3082772836 shutdown_connections 2023-11-17T06:33:33.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.023+0000 7f8d3692b700 1 -- 172.21.15.69:0/3082772836 wait complete. 2023-11-17T06:33:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.023+0000 7f8d3692b700 1 Processor -- start 2023-11-17T06:33:33.030 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.023+0000 7f8d3692b700 1 -- start start 2023-11-17T06:33:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d3692b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d300b8c40 0x7f8d300cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d3692b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 0x7f8d301f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d3692b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d30156a60 0x7f8d301553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d3692b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d30156640 con 0x7f8d3015d4a0 2023-11-17T06:33:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d3692b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d300cbec0 con 0x7f8d30156a60 2023-11-17T06:33:33.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d3692b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d300cbbe0 con 0x7f8d300b8c40 2023-11-17T06:33:33.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d277fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 0x7f8d301f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d277fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 0x7f8d301f2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34920/0 (socket says 172.21.15.69:34920) 2023-11-17T06:33:33.033 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d277fe700 1 -- 172.21.15.69:0/3625420083 learned_addr learned my addr 172.21.15.69:0/3625420083 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:33.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d2ffff700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d300b8c40 0x7f8d300cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d34ec8700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d30156a60 0x7f8d301553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d277fe700 1 -- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d300b8c40 msgr2=0x7f8d300cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d277fe700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d300b8c40 0x7f8d300cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d277fe700 1 -- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d30156a60 msgr2=0x7f8d301553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:33.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d277fe700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d30156a60 0x7f8d301553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:33.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d277fe700 1 -- 172.21.15.69:0/3625420083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20009570 con 0x7f8d3015d4a0 2023-11-17T06:33:33.034 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d34ec8700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d30156a60 0x7f8d301553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:33.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d277fe700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 0x7f8d301f2990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800e9d0 tx=0x7f8d1800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:33.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d2d7fa700 1 -- 172.21.15.69:0/3625420083 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18009720 con 0x7f8d3015d4a0 2023-11-17T06:33:33.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d2d7fa700 1 -- 172.21.15.69:0/3625420083 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d1800c850 con 0x7f8d3015d4a0 2023-11-17T06:33:33.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d2d7fa700 1 -- 172.21.15.69:0/3625420083 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d1800cbc0 con 0x7f8d3015d4a0 2023-11-17T06:33:33.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d3692b700 1 -- 172.21.15.69:0/3625420083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d30155f80 con 0x7f8d3015d4a0 2023-11-17T06:33:33.035 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.027+0000 7f8d3692b700 1 -- 172.21.15.69:0/3625420083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d301f2ed0 con 0x7f8d3015d4a0 2023-11-17T06:33:33.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.031+0000 7f8d3692b700 1 -- 172.21.15.69:0/3625420083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3004e6c0 con 0x7f8d3015d4a0 2023-11-17T06:33:33.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.031+0000 7f8d2d7fa700 1 -- 172.21.15.69:0/3625420083 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8d1800cd20 con 0x7f8d3015d4a0 2023-11-17T06:33:33.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.035+0000 7f8d2d7fa700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d10066510 0x7f8d100689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:33.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.035+0000 7f8d2d7fa700 1 -- 172.21.15.69:0/3625420083 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f8d18083fa0 con 0x7f8d3015d4a0 2023-11-17T06:33:33.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.035+0000 7f8d2ffff700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d10066510 0x7f8d100689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:33.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.039+0000 7f8d2ffff700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d10066510 0x7f8d100689d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d20000c00 tx=0x7f8d20008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:33.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.043+0000 7f8d2d7fa700 1 -- 172.21.15.69:0/3625420083 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8d180b5090 con 0x7f8d3015d4a0 2023-11-17T06:33:33.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:33.255+0000 7f8d3692b700 1 -- 172.21.15.69:0/3625420083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f8d300cefa0 con 0x7f8d3015d4a0 2023-11-17T06:33:34.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.155+0000 7f8d2d7fa700 1 -- 172.21.15.69:0/3625420083 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v24) v1 ==== 162+0+0 (secure 0 0 0) 0x7f8d18051390 con 0x7f8d3015d4a0 2023-11-17T06:33:34.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 -- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d10066510 msgr2=0x7f8d100689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d10066510 0x7f8d100689d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8d20000c00 tx=0x7f8d20008030 comp rx=0 tx=0).stop 2023-11-17T06:33:34.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 -- 172.21.15.69:0/3625420083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 msgr2=0x7f8d301f2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 0x7f8d301f2990 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800e9d0 tx=0x7f8d1800ece0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 -- 172.21.15.69:0/3625420083 shutdown_connections 2023-11-17T06:33:34.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8d10066510 0x7f8d100689d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d30156a60 0x7f8d301553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d3015d4a0 0x7f8d301f2990 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 --2- 172.21.15.69:0/3625420083 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8d300b8c40 0x7f8d300cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 -- 172.21.15.69:0/3625420083 >> 172.21.15.69:0/3625420083 conn(0x7f8d3006b830 msgr2=0x7f8d300b6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:34.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 -- 172.21.15.69:0/3625420083 shutdown_connections 2023-11-17T06:33:34.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.159+0000 7f8d3692b700 1 -- 172.21.15.69:0/3625420083 wait complete. 2023-11-17T06:33:34.168 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked joinable; MDS may join as newly active. 2023-11-17T06:33:34.191 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:34.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c06cf3700 1 Processor -- start 2023-11-17T06:33:34.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c06cf3700 1 -- start start 2023-11-17T06:33:34.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c06cf3700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c0006fe60 0x7f4c0015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c06cf3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4c000cab00 0x7f4c000caf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c06cf3700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0015f160 con 0x7f4c0015b2f0 2023-11-17T06:33:34.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c06cf3700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c000cb4d0 con 0x7f4c000cab00 2023-11-17T06:33:34.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c06cf3700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0015b6d0 con 0x7f4c0006fe60 2023-11-17T06:33:34.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c05290700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4c000cab00 0x7f4c000caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c05290700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4c000cab00 0x7f4c000caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42104/0 (socket says 172.21.15.69:42104) 2023-11-17T06:33:34.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c05290700 1 -- 172.21.15.69:0/2247100067 learned_addr learned my addr 172.21.15.69:0/2247100067 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:34.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4bfffff700 1 --2- 172.21.15.69:0/2247100067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c0006fe60 0x7f4c0015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c05290700 1 -- 172.21.15.69:0/2247100067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c0006fe60 msgr2=0x7f4c0015c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:34.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c05290700 1 --2- 172.21.15.69:0/2247100067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c0006fe60 0x7f4c0015c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.375+0000 7f4c05290700 1 -- 172.21.15.69:0/2247100067 >> v1:172.21.15.93:6789/0 conn(0x7f4c0015b2f0 legacy=0x7f4c0015f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4c05290700 1 -- 172.21.15.69:0/2247100067 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0006db30 con 0x7f4c000cab00 2023-11-17T06:33:34.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4c05290700 1 --2- 172.21.15.69:0/2247100067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c000cab00 0x7f4c000caf90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009e50 tx=0x7f4bf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39316e6753c99e62 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:34.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4bff7fe700 1 -- 172.21.15.69:0/2247100067 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf800e070 con 0x7f4c000cab00 2023-11-17T06:33:34.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4bff7fe700 1 -- 172.21.15.69:0/2247100067 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf800b9c0 con 0x7f4c000cab00 2023-11-17T06:33:34.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4bff7fe700 1 -- 172.21.15.69:0/2247100067 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf800bd70 con 0x7f4c000cab00 2023-11-17T06:33:34.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4c06cf3700 1 -- 172.21.15.69:0/2247100067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c000cab00 msgr2=0x7f4c000caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4c06cf3700 1 --2- 172.21.15.69:0/2247100067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c000cab00 0x7f4c000caf90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009e50 tx=0x7f4bf800b330 comp rx=0 tx=0).stop 2023-11-17T06:33:34.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4c06cf3700 1 -- 172.21.15.69:0/2247100067 shutdown_connections 2023-11-17T06:33:34.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4c06cf3700 1 --2- 172.21.15.69:0/2247100067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c000cab00 0x7f4c000caf90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4c06cf3700 1 --2- 172.21.15.69:0/2247100067 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c0006fe60 0x7f4c0015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4c06cf3700 1 -- 172.21.15.69:0/2247100067 >> 172.21.15.69:0/2247100067 conn(0x7f4c000cee40 msgr2=0x7f4c000cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:34.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4c06cf3700 1 -- 172.21.15.69:0/2247100067 shutdown_connections 2023-11-17T06:33:34.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.379+0000 7f4c06cf3700 1 -- 172.21.15.69:0/2247100067 wait complete. 2023-11-17T06:33:34.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c06cf3700 1 Processor -- start 2023-11-17T06:33:34.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c06cf3700 1 -- start start 2023-11-17T06:33:34.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c06cf3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c0006fe60 0x7f4c00159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c06cf3700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c000cab00 0x7f4c000cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c06cf3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c0015b2f0 0x7f4c001f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c06cf3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00157170 con 0x7f4c0006fe60 2023-11-17T06:33:34.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c06cf3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000ccbb0 con 0x7f4c0015b2f0 2023-11-17T06:33:34.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c06cf3700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000cce90 con 0x7f4c000cab00 2023-11-17T06:33:34.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c04a8f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c0006fe60 0x7f4c00159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c04a8f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c0006fe60 0x7f4c00159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42120/0 (socket says 172.21.15.69:42120) 2023-11-17T06:33:34.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c04a8f700 1 -- 172.21.15.69:0/4001191078 learned_addr learned my addr 172.21.15.69:0/4001191078 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:34.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4bfffff700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c000cab00 0x7f4c000cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c05290700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c0015b2f0 0x7f4c001f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c04a8f700 1 -- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c000cab00 msgr2=0x7f4c000cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c04a8f700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c000cab00 0x7f4c000cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c04a8f700 1 -- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c0015b2f0 msgr2=0x7f4c001f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c04a8f700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c0015b2f0 0x7f4c001f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c04a8f700 1 -- 172.21.15.69:0/4001191078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8009b30 con 0x7f4c0006fe60 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.383+0000 7f4c05290700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c0015b2f0 0x7f4c001f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.387+0000 7f4c04a8f700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c0006fe60 0x7f4c00159dc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400c4f0 tx=0x7f4bf400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.387+0000 7f4bfd7fa700 1 -- 172.21.15.69:0/4001191078 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf40052d0 con 0x7f4c0006fe60 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.387+0000 7f4bfd7fa700 1 -- 172.21.15.69:0/4001191078 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf4005430 con 0x7f4c0006fe60 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.387+0000 7f4bfd7fa700 1 -- 172.21.15.69:0/4001191078 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4003930 con 0x7f4c0006fe60 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.387+0000 7f4c06cf3700 1 -- 172.21.15.69:0/4001191078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c000cd170 con 0x7f4c0006fe60 2023-11-17T06:33:34.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.387+0000 7f4c06cf3700 1 -- 172.21.15.69:0/4001191078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0015a300 con 0x7f4c0006fe60 2023-11-17T06:33:34.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.387+0000 7f4c06cf3700 1 -- 172.21.15.69:0/4001191078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0004e650 con 0x7f4c0006fe60 2023-11-17T06:33:34.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.387+0000 7f4bfd7fa700 1 -- 172.21.15.69:0/4001191078 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4bf4003a90 con 0x7f4c0006fe60 2023-11-17T06:33:34.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.391+0000 7f4bfd7fa700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4be4066510 0x7f4be40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:34.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.391+0000 7f4bfd7fa700 1 -- 172.21.15.69:0/4001191078 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f4bf4083470 con 0x7f4c0006fe60 2023-11-17T06:33:34.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.391+0000 7f4bfffff700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4be4066510 0x7f4be40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:34.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.391+0000 7f4bfffff700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4be4066510 0x7f4be40689d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4c0014f660 tx=0x7f4bec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:34.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.399+0000 7f4bfd7fa700 1 -- 172.21.15.69:0/4001191078 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4bf4050730 con 0x7f4c0006fe60 2023-11-17T06:33:34.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.603+0000 7f4c06cf3700 1 -- 172.21.15.69:0/4001191078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c000ca6a0 con 0x7f4c0006fe60 2023-11-17T06:33:34.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.607+0000 7f4bfd7fa700 1 -- 172.21.15.69:0/4001191078 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4911 (secure 0 0 0) 0x7f4bf4053d50 con 0x7f4c0006fe60 2023-11-17T06:33:34.611 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:34.612 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":25,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:33:34.161826+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"c","rank":0,"incarnation":25,"state":"up:replay","state_seq":1,"addr":"172.21.15.69:6835/377943606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":377943606},{"type":"v1","addr":"172.21.15.69:6835","nonce":377943606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:34.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 -- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4be4066510 msgr2=0x7f4be40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4be4066510 0x7f4be40689d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4c0014f660 tx=0x7f4bec008040 comp rx=0 tx=0).stop 2023-11-17T06:33:34.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 -- 172.21.15.69:0/4001191078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c0006fe60 msgr2=0x7f4c00159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c0006fe60 0x7f4c00159dc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400c4f0 tx=0x7f4bf400c800 comp rx=0 tx=0).stop 2023-11-17T06:33:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 -- 172.21.15.69:0/4001191078 shutdown_connections 2023-11-17T06:33:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4be4066510 0x7f4be40689d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4c0015b2f0 0x7f4c001f5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4c000cab00 0x7f4c000cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 --2- 172.21.15.69:0/4001191078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c0006fe60 0x7f4c00159dc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 -- 172.21.15.69:0/4001191078 >> 172.21.15.69:0/4001191078 conn(0x7f4c000cee40 msgr2=0x7f4c000ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 -- 172.21.15.69:0/4001191078 shutdown_connections 2023-11-17T06:33:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:34.611+0000 7f4c06cf3700 1 -- 172.21.15.69:0/4001191078 wait complete. 2023-11-17T06:33:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 25 2023-11-17T06:33:35.042 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:25.683625+0000', 'modified': '2023-11-17T06:33:34.161826+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 41, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5655}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5655': {'gid': 5655, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.69:6835/377943606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6834', 'nonce': 377943606}, {'type': 'v1', 'addr': '172.21.15.69:6835', 'nonce': 377943606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:33:35.042 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5655:up:replay 2023-11-17T06:33:36.043 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:36.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.219+0000 7f554d362700 1 Processor -- start 2023-11-17T06:33:36.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f554d362700 1 -- start start 2023-11-17T06:33:36.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f554d362700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 0x7f55480ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f554d362700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5548071340 0x7f55480c93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f554d362700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554806cce0 con 0x7f5548070080 2023-11-17T06:33:36.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f554d362700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554815a470 con 0x7f5548071340 2023-11-17T06:33:36.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f554d362700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55480ce9a0 con 0x7f554815a090 2023-11-17T06:33:36.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f554cb61700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5548071340 0x7f55480c93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f554cb61700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5548071340 0x7f55480c93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42130/0 (socket says 172.21.15.69:42130) 2023-11-17T06:33:36.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f554cb61700 1 -- 172.21.15.69:0/2391574668 learned_addr learned my addr 172.21.15.69:0/2391574668 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:36.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f553f7fe700 1 --1- 172.21.15.69:0/2391574668 >> v1:172.21.15.69:6789/0 conn(0x7f5548070080 0x7f5548070c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44840/0 (socket says 172.21.15.69:44840) 2023-11-17T06:33:36.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.223+0000 7f5547fff700 1 --2- 172.21.15.69:0/2391574668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 0x7f55480ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554cb61700 1 -- 172.21.15.69:0/2391574668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 msgr2=0x7f55480ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:36.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554cb61700 1 --2- 172.21.15.69:0/2391574668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 0x7f55480ce460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554cb61700 1 -- 172.21.15.69:0/2391574668 >> v1:172.21.15.69:6789/0 conn(0x7f5548070080 legacy=0x7f5548070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554cb61700 1 -- 172.21.15.69:0/2391574668 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554806cf30 con 0x7f5548071340 2023-11-17T06:33:36.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554cb61700 1 --2- 172.21.15.69:0/2391574668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 0x7f55480c93c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5540009e50 tx=0x7f554000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08e03b634f6fd7e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:36.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f55477fe700 1 -- 172.21.15.69:0/2391574668 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554000e070 con 0x7f5548071340 2023-11-17T06:33:36.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f55477fe700 1 -- 172.21.15.69:0/2391574668 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554000b910 con 0x7f5548071340 2023-11-17T06:33:36.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f55477fe700 1 -- 172.21.15.69:0/2391574668 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554000bcc0 con 0x7f5548071340 2023-11-17T06:33:36.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554d362700 1 -- 172.21.15.69:0/2391574668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 msgr2=0x7f55480c93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554d362700 1 --2- 172.21.15.69:0/2391574668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 0x7f55480c93c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5540009e50 tx=0x7f554000b330 comp rx=0 tx=0).stop 2023-11-17T06:33:36.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554d362700 1 -- 172.21.15.69:0/2391574668 shutdown_connections 2023-11-17T06:33:36.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554d362700 1 --2- 172.21.15.69:0/2391574668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 0x7f55480c93c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554d362700 1 --2- 172.21.15.69:0/2391574668 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 0x7f55480ce460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554d362700 1 -- 172.21.15.69:0/2391574668 >> 172.21.15.69:0/2391574668 conn(0x7f55480cece0 msgr2=0x7f55480cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:36.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554d362700 1 -- 172.21.15.69:0/2391574668 shutdown_connections 2023-11-17T06:33:36.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.227+0000 7f554d362700 1 -- 172.21.15.69:0/2391574668 wait complete. 2023-11-17T06:33:36.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554d362700 1 Processor -- start 2023-11-17T06:33:36.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554d362700 1 -- start start 2023-11-17T06:33:36.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554d362700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5548070080 0x7f554814f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554d362700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 0x7f55481f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554d362700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 0x7f55480c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554d362700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55480c66e0 con 0x7f5548071340 2023-11-17T06:33:36.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554d362700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554814fa00 con 0x7f5548070080 2023-11-17T06:33:36.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554d362700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55480c4eb0 con 0x7f554815a090 2023-11-17T06:33:36.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f553f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 0x7f55481f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f553f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 0x7f55481f6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42138/0 (socket says 172.21.15.69:42138) 2023-11-17T06:33:36.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f553f7fe700 1 -- 172.21.15.69:0/1170804514 learned_addr learned my addr 172.21.15.69:0/1170804514 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:36.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f5547fff700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5548070080 0x7f554814f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554cb61700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 0x7f55480c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f553f7fe700 1 -- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 msgr2=0x7f55480c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f553f7fe700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 0x7f55480c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f553f7fe700 1 -- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5548070080 msgr2=0x7f554814f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f553f7fe700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5548070080 0x7f554814f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f553f7fe700 1 -- 172.21.15.69:0/1170804514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5540009b30 con 0x7f5548071340 2023-11-17T06:33:36.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f5547fff700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5548070080 0x7f554814f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:36.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554cb61700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 0x7f55480c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:36.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f553f7fe700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 0x7f55481f6470 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f553000c500 tx=0x7f553000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:36.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f55457fa700 1 -- 172.21.15.69:0/1170804514 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530005cd0 con 0x7f5548071340 2023-11-17T06:33:36.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f55457fa700 1 -- 172.21.15.69:0/1170804514 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5530005e30 con 0x7f5548071340 2023-11-17T06:33:36.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f554d362700 1 -- 172.21.15.69:0/1170804514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55480c5db0 con 0x7f5548071340 2023-11-17T06:33:36.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.231+0000 7f55457fa700 1 -- 172.21.15.69:0/1170804514 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300072d0 con 0x7f5548071340 2023-11-17T06:33:36.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.235+0000 7f554d362700 1 -- 172.21.15.69:0/1170804514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55480c6370 con 0x7f5548071340 2023-11-17T06:33:36.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.235+0000 7f554d362700 1 -- 172.21.15.69:0/1170804514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55480c6890 con 0x7f5548071340 2023-11-17T06:33:36.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.235+0000 7f55457fa700 1 -- 172.21.15.69:0/1170804514 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5530007430 con 0x7f5548071340 2023-11-17T06:33:36.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.239+0000 7f55457fa700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f552c066510 0x7f552c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:36.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.239+0000 7f55457fa700 1 -- 172.21.15.69:0/1170804514 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f5530083360 con 0x7f5548071340 2023-11-17T06:33:36.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.239+0000 7f5547fff700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f552c066510 0x7f552c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:36.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.239+0000 7f5547fff700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f552c066510 0x7f552c0689d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5538009b70 tx=0x7f5538008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:36.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.243+0000 7f55457fa700 1 -- 172.21.15.69:0/1170804514 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f55480c6890 con 0x7f5548071340 2023-11-17T06:33:36.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.467+0000 7f554d362700 1 -- 172.21.15.69:0/1170804514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55480c6890 con 0x7f5548071340 2023-11-17T06:33:36.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.467+0000 7f55457fa700 1 -- 172.21.15.69:0/1170804514 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4911 (secure 0 0 0) 0x7f55480c6890 con 0x7f5548071340 2023-11-17T06:33:36.472 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:36.473 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:33:35.185625+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"c","rank":0,"incarnation":25,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.69:6835/377943606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":377943606},{"type":"v1","addr":"172.21.15.69:6835","nonce":377943606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:36.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 -- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f552c066510 msgr2=0x7f552c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f552c066510 0x7f552c0689d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5538009b70 tx=0x7f5538008040 comp rx=0 tx=0).stop 2023-11-17T06:33:36.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 -- 172.21.15.69:0/1170804514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 msgr2=0x7f55481f6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:36.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 0x7f55481f6470 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f553000c500 tx=0x7f553000c8c0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 -- 172.21.15.69:0/1170804514 shutdown_connections 2023-11-17T06:33:36.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f552c066510 0x7f552c0689d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f554815a090 0x7f55480c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5548071340 0x7f55481f6470 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 --2- 172.21.15.69:0/1170804514 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5548070080 0x7f554814f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:36.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 -- 172.21.15.69:0/1170804514 >> 172.21.15.69:0/1170804514 conn(0x7f55480cece0 msgr2=0x7f55480b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:36.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 -- 172.21.15.69:0/1170804514 shutdown_connections 2023-11-17T06:33:36.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:36.471+0000 7f554d362700 1 -- 172.21.15.69:0/1170804514 wait complete. 2023-11-17T06:33:36.480 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 27 2023-11-17T06:33:36.905 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:25.683625+0000', 'modified': '2023-11-17T06:33:35.185625+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 41, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5655}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5655': {'gid': 5655, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.69:6835/377943606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6834', 'nonce': 377943606}, {'type': 'v1', 'addr': '172.21.15.69:6835', 'nonce': 377943606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:33:36.905 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5655:up:rejoin 2023-11-17T06:33:37.906 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:38.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.087+0000 7ffab52cb700 1 Processor -- start 2023-11-17T06:33:38.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.087+0000 7ffab52cb700 1 -- start start 2023-11-17T06:33:38.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffab52cb700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffab015d870 0x7ffab00d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffab52cb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffab0161be0 0x7ffab00ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffab52cb700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab00ceba0 con 0x7ffab00ce1e0 2023-11-17T06:33:38.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffab52cb700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab00d21a0 con 0x7ffab015d870 2023-11-17T06:33:38.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffab52cb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab015dc50 con 0x7ffab0161be0 2023-11-17T06:33:38.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffaaeffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffab015d870 0x7ffab00d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffaaeffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffab015d870 0x7ffab00d2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42140/0 (socket says 172.21.15.69:42140) 2023-11-17T06:33:38.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffaaeffd700 1 -- 172.21.15.69:0/2496811318 learned_addr learned my addr 172.21.15.69:0/2496811318 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:38.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffab0161be0 0x7ffab00ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffaae7fc700 1 --1- 172.21.15.69:0/2496811318 >> v1:172.21.15.93:6789/0 conn(0x7ffab00ce1e0 0x7ffab01614d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:57528/0 (socket says 172.21.15.69:57528) 2023-11-17T06:33:38.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffaaeffd700 1 -- 172.21.15.69:0/2496811318 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffab0161be0 msgr2=0x7ffab00ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:38.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffaaeffd700 1 --2- 172.21.15.69:0/2496811318 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffab0161be0 0x7ffab00ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffaaeffd700 1 -- 172.21.15.69:0/2496811318 >> v1:172.21.15.93:6789/0 conn(0x7ffab00ce1e0 legacy=0x7ffab01614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.091+0000 7ffaaeffd700 1 -- 172.21.15.69:0/2496811318 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00d1870 con 0x7ffab015d870 2023-11-17T06:33:38.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffaaeffd700 1 --2- 172.21.15.69:0/2496811318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab015d870 0x7ffab00d2630 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009910 tx=0x7ffaa0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eef08254244f351 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:38.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffaadffb700 1 -- 172.21.15.69:0/2496811318 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0011830 con 0x7ffab015d870 2023-11-17T06:33:38.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffaadffb700 1 -- 172.21.15.69:0/2496811318 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa0011990 con 0x7ffab015d870 2023-11-17T06:33:38.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffaadffb700 1 -- 172.21.15.69:0/2496811318 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa0011d40 con 0x7ffab015d870 2023-11-17T06:33:38.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffab52cb700 1 -- 172.21.15.69:0/2496811318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab015d870 msgr2=0x7ffab00d2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffab52cb700 1 --2- 172.21.15.69:0/2496811318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab015d870 0x7ffab00d2630 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009910 tx=0x7ffaa0009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:38.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffab52cb700 1 -- 172.21.15.69:0/2496811318 shutdown_connections 2023-11-17T06:33:38.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffab52cb700 1 --2- 172.21.15.69:0/2496811318 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffab0161be0 0x7ffab00ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffab52cb700 1 --2- 172.21.15.69:0/2496811318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab015d870 0x7ffab00d2630 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffab52cb700 1 -- 172.21.15.69:0/2496811318 >> 172.21.15.69:0/2496811318 conn(0x7ffab00d3250 msgr2=0x7ffab00d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:38.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffab52cb700 1 -- 172.21.15.69:0/2496811318 shutdown_connections 2023-11-17T06:33:38.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.095+0000 7ffab52cb700 1 -- 172.21.15.69:0/2496811318 wait complete. 2023-11-17T06:33:38.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.099+0000 7ffab52cb700 1 Processor -- start 2023-11-17T06:33:38.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.099+0000 7ffab52cb700 1 -- start start 2023-11-17T06:33:38.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.099+0000 7ffab52cb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffab00ce1e0 0x7ffab00b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.099+0000 7ffab52cb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab015d870 0x7ffab01f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.099+0000 7ffab52cb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0161be0 0x7ffab014b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.099+0000 7ffab52cb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00b4cf0 con 0x7ffab0161be0 2023-11-17T06:33:38.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.099+0000 7ffab52cb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab01f7650 con 0x7ffab015d870 2023-11-17T06:33:38.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.099+0000 7ffab52cb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab00b56c0 con 0x7ffab00ce1e0 2023-11-17T06:33:38.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0161be0 0x7ffab014b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaaf7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0161be0 0x7ffab014b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42144/0 (socket says 172.21.15.69:42144) 2023-11-17T06:33:38.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaaf7fe700 1 -- 172.21.15.69:0/4050980784 learned_addr learned my addr 172.21.15.69:0/4050980784 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:38.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaaeffd700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffab00ce1e0 0x7ffab00b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaae7fc700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab015d870 0x7ffab01f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaaf7fe700 1 -- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffab00ce1e0 msgr2=0x7ffab00b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaaf7fe700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffab00ce1e0 0x7ffab00b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaaf7fe700 1 -- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab015d870 msgr2=0x7ffab01f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaaf7fe700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab015d870 0x7ffab01f6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaaf7fe700 1 -- 172.21.15.69:0/4050980784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa0009570 con 0x7ffab0161be0 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaae7fc700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab015d870 0x7ffab01f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaaf7fe700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0161be0 0x7ffab014b240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800efc0 tx=0x7ffaa800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaa77fe700 1 -- 172.21.15.69:0/4050980784 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8009ba0 con 0x7ffab0161be0 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaa77fe700 1 -- 172.21.15.69:0/4050980784 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa800f040 con 0x7ffab0161be0 2023-11-17T06:33:38.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffab52cb700 1 -- 172.21.15.69:0/4050980784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab00b40e0 con 0x7ffab0161be0 2023-11-17T06:33:38.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffaa77fe700 1 -- 172.21.15.69:0/4050980784 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8014480 con 0x7ffab0161be0 2023-11-17T06:33:38.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffab52cb700 1 -- 172.21.15.69:0/4050980784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab00b46a0 con 0x7ffab0161be0 2023-11-17T06:33:38.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.103+0000 7ffab52cb700 1 -- 172.21.15.69:0/4050980784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab00b4ea0 con 0x7ffab0161be0 2023-11-17T06:33:38.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.107+0000 7ffaa77fe700 1 -- 172.21.15.69:0/4050980784 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ffaa80145e0 con 0x7ffab0161be0 2023-11-17T06:33:38.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.107+0000 7ffaa77fe700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa98066510 0x7ffa980689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.107+0000 7ffaa77fe700 1 -- 172.21.15.69:0/4050980784 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7ffaa8084b20 con 0x7ffab0161be0 2023-11-17T06:33:38.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.107+0000 7ffaaeffd700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa98066510 0x7ffa980689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.111+0000 7ffaaeffd700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa98066510 0x7ffa980689d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009c60 tx=0x7ffaa0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:38.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.115+0000 7ffaa77fe700 1 -- 172.21.15.69:0/4050980784 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ffaa8051e80 con 0x7ffab0161be0 2023-11-17T06:33:38.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.335+0000 7ffab52cb700 1 -- 172.21.15.69:0/4050980784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffab004e650 con 0x7ffab0161be0 2023-11-17T06:33:38.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.335+0000 7ffaa77fe700 1 -- 172.21.15.69:0/4050980784 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4911 (secure 0 0 0) 0x7ffaa8018020 con 0x7ffab0161be0 2023-11-17T06:33:38.342 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:38.342 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:33:36.198455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":4,"addr":"172.21.15.69:6835/377943606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":377943606},{"type":"v1","addr":"172.21.15.69:6835","nonce":377943606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:38.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 -- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa98066510 msgr2=0x7ffa980689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa98066510 0x7ffa980689d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffaa0009c60 tx=0x7ffaa0008030 comp rx=0 tx=0).stop 2023-11-17T06:33:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 -- 172.21.15.69:0/4050980784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0161be0 msgr2=0x7ffab014b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0161be0 0x7ffab014b240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ffaa800efc0 tx=0x7ffaa800c3a0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 -- 172.21.15.69:0/4050980784 shutdown_connections 2023-11-17T06:33:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ffa98066510 0x7ffa980689d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffab0161be0 0x7ffab014b240 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab015d870 0x7ffab01f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 --2- 172.21.15.69:0/4050980784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ffab00ce1e0 0x7ffab00b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 -- 172.21.15.69:0/4050980784 >> 172.21.15.69:0/4050980784 conn(0x7ffab00d3250 msgr2=0x7ffab00b66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 -- 172.21.15.69:0/4050980784 shutdown_connections 2023-11-17T06:33:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.339+0000 7ffab52cb700 1 -- 172.21.15.69:0/4050980784 wait complete. 2023-11-17T06:33:38.346 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2023-11-17T06:33:38.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-17T06:31:25.683625+0000', 'modified': '2023-11-17T06:33:36.198455+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 41, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5655}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5655': {'gid': 5655, 'name': 'c', 'rank': 0, 'incarnation': 25, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.69:6835/377943606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6834', 'nonce': 377943606}, {'type': 'v1', 'addr': '172.21.15.69:6835', 'nonce': 377943606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-17T06:33:38.768 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-17T06:33:38.768 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-17T06:33:38.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.943+0000 7f81170cb700 1 Processor -- start 2023-11-17T06:33:38.949 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.943+0000 7f81170cb700 1 -- start start 2023-11-17T06:33:38.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f81170cb700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f81100d0140 0x7f81100b2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f81170cb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f81100b48f0 0x7f81100b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f81170cb700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81100cf340 con 0x7f811015d8f0 2023-11-17T06:33:38.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f81170cb700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81100ceae0 con 0x7f81100d0140 2023-11-17T06:33:38.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f81170cb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81100ced80 con 0x7f81100b48f0 2023-11-17T06:33:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f8107fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f81100d0140 0x7f81100b2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f8115668700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f81100b48f0 0x7f81100b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f8114e67700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f811015d8f0 0x7f81100cfa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:57544/0 (socket says 172.21.15.69:57544) 2023-11-17T06:33:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f8107fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f81100d0140 0x7f81100b2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42148/0 (socket says 172.21.15.69:42148) 2023-11-17T06:33:38.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f8114e67700 1 -- 172.21.15.69:0/3016401250 learned_addr learned my addr 172.21.15.69:0/3016401250 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:38.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f8107fff700 1 -- 172.21.15.69:0/3016401250 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f81100b48f0 msgr2=0x7f81100b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:38.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f8107fff700 1 --2- 172.21.15.69:0/3016401250 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f81100b48f0 0x7f81100b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f8107fff700 1 -- 172.21.15.69:0/3016401250 >> v1:172.21.15.93:6789/0 conn(0x7f811015d8f0 legacy=0x7f81100cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f8107fff700 1 -- 172.21.15.69:0/3016401250 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81100cf060 con 0x7f81100d0140 2023-11-17T06:33:38.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f8107fff700 1 --2- 172.21.15.69:0/3016401250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100d0140 0x7f81100b2ca0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8100009850 tx=0x7f8100009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7692a150cef0d649 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f81077fe700 1 -- 172.21.15.69:0/3016401250 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100011830 con 0x7f81100d0140 2023-11-17T06:33:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f81077fe700 1 -- 172.21.15.69:0/3016401250 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100011990 con 0x7f81100d0140 2023-11-17T06:33:38.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f81077fe700 1 -- 172.21.15.69:0/3016401250 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100011d40 con 0x7f81100d0140 2023-11-17T06:33:38.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f81170cb700 1 -- 172.21.15.69:0/3016401250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100d0140 msgr2=0x7f81100b2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.947+0000 7f81170cb700 1 --2- 172.21.15.69:0/3016401250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100d0140 0x7f81100b2ca0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8100009850 tx=0x7f8100009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:38.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.951+0000 7f81170cb700 1 -- 172.21.15.69:0/3016401250 shutdown_connections 2023-11-17T06:33:38.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.951+0000 7f81170cb700 1 --2- 172.21.15.69:0/3016401250 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f81100b48f0 0x7f81100b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.951+0000 7f81170cb700 1 --2- 172.21.15.69:0/3016401250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100d0140 0x7f81100b2ca0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.951+0000 7f81170cb700 1 -- 172.21.15.69:0/3016401250 >> 172.21.15.69:0/3016401250 conn(0x7f81100d3340 msgr2=0x7f81100d3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:38.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.951+0000 7f81170cb700 1 -- 172.21.15.69:0/3016401250 shutdown_connections 2023-11-17T06:33:38.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.951+0000 7f81170cb700 1 -- 172.21.15.69:0/3016401250 wait complete. 2023-11-17T06:33:38.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.951+0000 7f81170cb700 1 Processor -- start 2023-11-17T06:33:38.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.951+0000 7f81170cb700 1 -- start start 2023-11-17T06:33:38.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f81170cb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100b48f0 0x7f811015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f81170cb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81100d0140 0x7f81100b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f81170cb700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f811015d8f0 0x7f81100b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f81170cb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811015a940 con 0x7f81100b48f0 2023-11-17T06:33:38.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f81170cb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811009d090 con 0x7f81100d0140 2023-11-17T06:33:38.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f81170cb700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811009d370 con 0x7f811015d8f0 2023-11-17T06:33:38.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8114e67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100b48f0 0x7f811015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8114e67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100b48f0 0x7f811015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42164/0 (socket says 172.21.15.69:42164) 2023-11-17T06:33:38.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8114e67700 1 -- 172.21.15.69:0/233936150 learned_addr learned my addr 172.21.15.69:0/233936150 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8107fff700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81100d0140 0x7f81100b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8115668700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f811015d8f0 0x7f81100b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8114e67700 1 -- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f811015d8f0 msgr2=0x7f81100b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8114e67700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f811015d8f0 0x7f81100b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8114e67700 1 -- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81100d0140 msgr2=0x7f81100b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8114e67700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81100d0140 0x7f81100b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8114e67700 1 -- 172.21.15.69:0/233936150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81000094b0 con 0x7f81100b48f0 2023-11-17T06:33:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f8114e67700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100b48f0 0x7f811015a400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f810c001eb0 tx=0x7f810c00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f81057fa700 1 -- 172.21.15.69:0/233936150 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c005d90 con 0x7f81100b48f0 2023-11-17T06:33:38.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f81057fa700 1 -- 172.21.15.69:0/233936150 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c0070d0 con 0x7f81100b48f0 2023-11-17T06:33:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f81057fa700 1 -- 172.21.15.69:0/233936150 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c007440 con 0x7f81100b48f0 2023-11-17T06:33:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.955+0000 7f81170cb700 1 -- 172.21.15.69:0/233936150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811009d650 con 0x7f81100b48f0 2023-11-17T06:33:38.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.959+0000 7f81170cb700 1 -- 172.21.15.69:0/233936150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811009dc10 con 0x7f81100b48f0 2023-11-17T06:33:38.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.959+0000 7f81057fa700 1 -- 172.21.15.69:0/233936150 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f810c0075a0 con 0x7f81100b48f0 2023-11-17T06:33:38.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.963+0000 7f81057fa700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80fc066510 0x7f80fc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.963+0000 7f81057fa700 1 -- 172.21.15.69:0/233936150 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f810c083170 con 0x7f81100b48f0 2023-11-17T06:33:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.963+0000 7f8107fff700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80fc066510 0x7f80fc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.963+0000 7f811a396740 1 Processor -- start 2023-11-17T06:33:38.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.963+0000 7f811a396740 1 -- start start 2023-11-17T06:33:38.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.963+0000 7f8107fff700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80fc066510 0x7f80fc0689d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f81000090b0 tx=0x7f8100008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:38.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293d530 0x293d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293b750 0x293de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x293e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x286d620 con 0x293d530 2023-11-17T06:33:38.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x286ad10 con 0x293b750 2023-11-17T06:33:38.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x2866600 con 0x293e390 2023-11-17T06:33:38.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8114e67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293d530 0x293d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8114e67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293d530 0x293d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42180/0 (socket says 172.21.15.69:42180) 2023-11-17T06:33:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8114e67700 1 -- 172.21.15.69:0/4013482898 learned_addr learned my addr 172.21.15.69:0/4013482898 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8115668700 1 --2- 172.21.15.69:0/4013482898 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x293e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8107fff700 1 --2- 172.21.15.69:0/4013482898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293b750 0x293de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8114e67700 1 -- 172.21.15.69:0/4013482898 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 msgr2=0x293e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8114e67700 1 --2- 172.21.15.69:0/4013482898 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x293e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8114e67700 1 -- 172.21.15.69:0/4013482898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293b750 msgr2=0x293de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8114e67700 1 --2- 172.21.15.69:0/4013482898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293b750 0x293de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8114e67700 1 -- 172.21.15.69:0/4013482898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x288b850 con 0x293d530 2023-11-17T06:33:38.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f8114e67700 1 --2- 172.21.15.69:0/4013482898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293d530 0x293d910 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f810c0814e0 tx=0x7f810c054000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9dad87216452e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f80f67fc700 1 -- 172.21.15.69:0/4013482898 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c053b90 con 0x293d530 2023-11-17T06:33:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f80f67fc700 1 -- 172.21.15.69:0/4013482898 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c054230 con 0x293d530 2023-11-17T06:33:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f80f67fc700 1 -- 172.21.15.69:0/4013482898 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c0582d0 con 0x293d530 2023-11-17T06:33:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 -- 172.21.15.69:0/4013482898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293d530 msgr2=0x293d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 --2- 172.21.15.69:0/4013482898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293d530 0x293d910 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f810c0814e0 tx=0x7f810c054000 comp rx=0 tx=0).stop 2023-11-17T06:33:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 -- 172.21.15.69:0/4013482898 shutdown_connections 2023-11-17T06:33:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 --2- 172.21.15.69:0/4013482898 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x293e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 --2- 172.21.15.69:0/4013482898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293b750 0x293de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 --2- 172.21.15.69:0/4013482898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293d530 0x293d910 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 -- 172.21.15.69:0/4013482898 >> 172.21.15.69:0/4013482898 conn(0x268b4d0 msgr2=0x2926160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:38.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 -- 172.21.15.69:0/4013482898 shutdown_connections 2023-11-17T06:33:38.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.967+0000 7f811a396740 1 -- 172.21.15.69:0/4013482898 wait complete. 2023-11-17T06:33:38.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f811a396740 1 -- start start 2023-11-17T06:33:38.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f811a396740 1 Processor -- start 2023-11-17T06:33:38.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f811a396740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293b750 0x28fe640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f811a396740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 0x2922ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f811a396740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x29231e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f811a396740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x28246e0 con 0x293b750 2023-11-17T06:33:38.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f811a396740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x2824380 con 0x293d530 2023-11-17T06:33:38.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f811a396740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x270faa0 con 0x293e390 2023-11-17T06:33:38.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f811a396740 10 client.0 _ll_register_callbacks cb 0x2813a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:33:38.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f8115668700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x29231e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f8114e67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293b750 0x28fe640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f8115668700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x29231e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:50618/0 (socket says 172.21.15.69:50618) 2023-11-17T06:33:38.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f8107fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 0x2922ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.971+0000 7f8115668700 1 -- 172.21.15.69:0/2052751999 learned_addr learned my addr 172.21.15.69:0/2052751999 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:38.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f8114e67700 1 -- 172.21.15.69:0/2052751999 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 msgr2=0x29231e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:38.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f8114e67700 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x29231e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f8114e67700 1 -- 172.21.15.69:0/2052751999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 msgr2=0x2922ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:38.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f8114e67700 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 0x2922ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f8114e67700 1 -- 172.21.15.69:0/2052751999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811009dc10 con 0x293b750 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f8115668700 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x29231e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f8107fff700 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 0x2922ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f8114e67700 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293b750 0x28fe640 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f810c053f30 tx=0x7f810c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52791d93d158e72 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f80ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2052751999 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c05c1f0 con 0x293b750 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2052751999 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f810c05c480 con 0x293b750 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f811a396740 1 -- 172.21.15.69:0/2052751999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x285f5e0 con 0x293b750 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2052751999 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f810c053b90 con 0x293b750 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f811a396740 10 client.5739 fetch_fsmap learned FSMap version 28 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f811a396740 1 -- 172.21.15.69:0/2052751999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x26d6960 con 0x293b750 2023-11-17T06:33:38.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2052751999 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x285f5e0 con 0x293b750 2023-11-17T06:33:38.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2052751999 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f810c050020 con 0x293b750 2023-11-17T06:33:38.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f811a396740 10 client.5739 fetch_fsmap finished waiting for FSMap version 28 2023-11-17T06:33:38.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f811a396740 10 client.5739 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-17T06:33:38.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f811a396740 20 client.5739 populate_metadata read hostname 'smithi069' 2023-11-17T06:33:38.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f811a396740 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.69:6834/377943606,v1:172.21.15.69:6835/377943606] conn(0x28fb6d0 0x28fbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:38.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f811a396740 4 client.5739 mds_command: new command op to 5655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-17T06:33:38.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f811a396740 1 -- 172.21.15.69:0/2052751999 --> [v2:172.21.15.69:6834/377943606,v1:172.21.15.69:6835/377943606] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x281f470 con 0x28fb6d0 2023-11-17T06:33:38.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f8107fff700 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.69:6834/377943606,v1:172.21.15.69:6835/377943606] conn(0x28fb6d0 0x28fbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:38.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f8107fff700 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.69:6834/377943606,v1:172.21.15.69:6835/377943606] conn(0x28fb6d0 0x28fbab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cff6de15711f025 server_cookie=618a35ceeb7de57c in_seq=0 out_seq=0 2023-11-17T06:33:38.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.975+0000 7f80ef7fe700 10 client.5739 ms_handle_connect on v2:172.21.15.69:6834/377943606 2023-11-17T06:33:38.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2052751999 <== mds.0 v2:172.21.15.69:6834/377943606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x281f470 con 0x28fb6d0 2023-11-17T06:33:38.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f80ef7fe700 10 client.5739 handle_command_reply: tid=0 2023-11-17T06:33:38.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 client.5739 shutdown 2023-11-17T06:33:38.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 -- 172.21.15.69:0/2052751999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293b750 msgr2=0x28fe640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:38.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293b750 0x28fe640 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f810c053f30 tx=0x7f810c01d000 comp rx=0 tx=0).stop 2023-11-17T06:33:38.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 -- 172.21.15.69:0/2052751999 shutdown_connections 2023-11-17T06:33:38.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.69:6834/377943606,v1:172.21.15.69:6835/377943606] conn(0x28fb6d0 0x28fbab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x29231e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 0x2922ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 --2- 172.21.15.69:0/2052751999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293b750 0x28fe640 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:38.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f80ef7fe700 0 client.5739 ms_handle_reset on v2:172.21.15.69:6834/377943606 2023-11-17T06:33:38.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 -- 172.21.15.69:0/2052751999 >> 172.21.15.69:0/2052751999 conn(0x268b4d0 msgr2=0x293e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:38.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 -- 172.21.15.69:0/2052751999 shutdown_connections 2023-11-17T06:33:38.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 1 -- 172.21.15.69:0/2052751999 wait complete. 2023-11-17T06:33:38.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.979+0000 7f811a396740 20 client.5739 trim_cache size 0 max 16384 2023-11-17T06:33:39.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.999+0000 7f811a396740 1 Processor -- start 2023-11-17T06:33:39.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:38.999+0000 7f811a396740 1 -- start start 2023-11-17T06:33:39.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 0x293a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293e390 0x293adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x294d970 0x294dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x28314f0 con 0x293e390 2023-11-17T06:33:39.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x28126d0 con 0x293d530 2023-11-17T06:33:39.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x2820f80 con 0x294d970 2023-11-17T06:33:39.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8107fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293e390 0x293adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8114e67700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 0x293a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8107fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293e390 0x293adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42206/0 (socket says 172.21.15.69:42206) 2023-11-17T06:33:39.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8107fff700 1 -- 172.21.15.69:0/599652564 learned_addr learned my addr 172.21.15.69:0/599652564 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:39.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8115668700 1 --2- 172.21.15.69:0/599652564 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x294d970 0x294dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8114e67700 1 -- 172.21.15.69:0/599652564 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x294d970 msgr2=0x294dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:39.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8114e67700 1 --2- 172.21.15.69:0/599652564 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x294d970 0x294dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8114e67700 1 -- 172.21.15.69:0/599652564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293e390 msgr2=0x293adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:39.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8114e67700 1 --2- 172.21.15.69:0/599652564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293e390 0x293adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8114e67700 1 -- 172.21.15.69:0/599652564 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28294f0 con 0x293d530 2023-11-17T06:33:39.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8107fff700 1 --2- 172.21.15.69:0/599652564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293e390 0x293adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:39.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f8114e67700 1 --2- 172.21.15.69:0/599652564 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 0x293a870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f810c052580 tx=0x7f810c058000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7adc2b022ddb42f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f80f6ffd700 1 -- 172.21.15.69:0/599652564 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c053b90 con 0x293d530 2023-11-17T06:33:39.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f80f6ffd700 1 -- 172.21.15.69:0/599652564 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c05c480 con 0x293d530 2023-11-17T06:33:39.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f80f6ffd700 1 -- 172.21.15.69:0/599652564 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c05c230 con 0x293d530 2023-11-17T06:33:39.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 -- 172.21.15.69:0/599652564 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 msgr2=0x293a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 --2- 172.21.15.69:0/599652564 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 0x293a870 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f810c052580 tx=0x7f810c058000 comp rx=0 tx=0).stop 2023-11-17T06:33:39.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 -- 172.21.15.69:0/599652564 shutdown_connections 2023-11-17T06:33:39.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 --2- 172.21.15.69:0/599652564 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x294d970 0x294dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 --2- 172.21.15.69:0/599652564 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x293e390 0x293adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 --2- 172.21.15.69:0/599652564 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x293d530 0x293a870 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 -- 172.21.15.69:0/599652564 >> 172.21.15.69:0/599652564 conn(0x268b4d0 msgr2=0x28fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:39.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 -- 172.21.15.69:0/599652564 shutdown_connections 2023-11-17T06:33:39.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.003+0000 7f811a396740 1 -- 172.21.15.69:0/599652564 wait complete. 2023-11-17T06:33:39.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f811a396740 1 -- start start 2023-11-17T06:33:39.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f811a396740 1 Processor -- start 2023-11-17T06:33:39.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f811a396740 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x2922b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f811a396740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x294d970 0x29ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f811a396740 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x295a1c0 0x29aee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f811a396740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x293d210 con 0x294d970 2023-11-17T06:33:39.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f811a396740 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x2927430 con 0x295a1c0 2023-11-17T06:33:39.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f811a396740 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x28fcbc0 con 0x293e390 2023-11-17T06:33:39.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f811a396740 10 client.0 _ll_register_callbacks cb 0x282b4b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-17T06:33:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8107fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x294d970 0x29ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8107fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x294d970 0x29ae8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42218/0 (socket says 172.21.15.69:42218) 2023-11-17T06:33:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8107fff700 1 -- 172.21.15.69:0/2202995854 learned_addr learned my addr 172.21.15.69:0/2202995854 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8115668700 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x295a1c0 0x29aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8114e67700 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x2922b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8107fff700 1 -- 172.21.15.69:0/2202995854 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 msgr2=0x2922b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8107fff700 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x2922b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8107fff700 1 -- 172.21.15.69:0/2202995854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x295a1c0 msgr2=0x29aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8107fff700 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x295a1c0 0x29aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8107fff700 1 -- 172.21.15.69:0/2202995854 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81100cf060 con 0x294d970 2023-11-17T06:33:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f8107fff700 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x294d970 0x29ae8f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8100009eb0 tx=0x7f81000047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67078552a1a0614 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.007+0000 7f80ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-11-17T06:33:39.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2202995854 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100020070 con 0x294d970 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2202995854 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f81000044a0 con 0x294d970 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 -- 172.21.15.69:0/2202995854 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f810c054230 con 0x294d970 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2202995854 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8100035070 con 0x294d970 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 10 client.5745 fetch_fsmap learned FSMap version 28 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 -- 172.21.15.69:0/2202995854 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x26d6960 con 0x294d970 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2202995854 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c054230 con 0x294d970 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2202995854 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f81000351d0 con 0x294d970 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 10 client.5745 fetch_fsmap finished waiting for FSMap version 28 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 10 client.5745 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 20 client.5745 populate_metadata read hostname 'smithi069' 2023-11-17T06:33:39.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.69:6834/377943606,v1:172.21.15.69:6835/377943606] conn(0x2959630 0x295aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 4 client.5745 mds_command: new command op to 5655 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-17T06:33:39.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 -- 172.21.15.69:0/2202995854 --> [v2:172.21.15.69:6834/377943606,v1:172.21.15.69:6835/377943606] -- command(tid 0: {"prefix": "status"}) v1 -- 0x26e2460 con 0x2959630 2023-11-17T06:33:39.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f8114e67700 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.69:6834/377943606,v1:172.21.15.69:6835/377943606] conn(0x2959630 0x295aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f8114e67700 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.69:6834/377943606,v1:172.21.15.69:6835/377943606] conn(0x2959630 0x295aa50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf84f36b65013137 server_cookie=59a00a75cd9ecaa4 in_seq=0 out_seq=0 2023-11-17T06:33:39.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f80ef7fe700 10 client.5745 ms_handle_connect on v2:172.21.15.69:6834/377943606 2023-11-17T06:33:39.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f80ef7fe700 1 -- 172.21.15.69:0/2202995854 <== mds.0 v2:172.21.15.69:6834/377943606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x26e2460 con 0x2959630 2023-11-17T06:33:39.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f80ef7fe700 10 client.5745 handle_command_reply: tid=0 2023-11-17T06:33:39.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 client.5745 shutdown 2023-11-17T06:33:39.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 -- 172.21.15.69:0/2202995854 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x294d970 msgr2=0x29ae8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x294d970 0x29ae8f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8100009eb0 tx=0x7f81000047e0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 -- 172.21.15.69:0/2202995854 shutdown_connections 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.69:6834/377943606,v1:172.21.15.69:6835/377943606] conn(0x2959630 0x295aa50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x295a1c0 0x29aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x294d970 0x29ae8f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 --2- 172.21.15.69:0/2202995854 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x293e390 0x2922b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 -- 172.21.15.69:0/2202995854 >> 172.21.15.69:0/2202995854 conn(0x268b4d0 msgr2=0x28fc330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f80ef7fe700 0 client.5745 ms_handle_reset on v2:172.21.15.69:6834/377943606 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 -- 172.21.15.69:0/2202995854 shutdown_connections 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 1 -- 172.21.15.69:0/2202995854 wait complete. 2023-11-17T06:33:39.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.011+0000 7f811a396740 20 client.5745 trim_cache size 0 max 16384 2023-11-17T06:33:39.021 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:33:39.021 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "473113af-218f-4c66-9eb3-2c30c3150d71", 2023-11-17T06:33:39.021 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2023-11-17T06:33:39.021 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 5655, 2023-11-17T06:33:39.021 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-11-17T06:33:39.021 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-11-17T06:33:39.021 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-11-17T06:33:39.021 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 4.849705342, 2023-11-17T06:33:39.022 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 28, 2023-11-17T06:33:39.022 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 41, 2023-11-17T06:33:39.022 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 41, 2023-11-17T06:33:39.022 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 8.4149145139999995 2023-11-17T06:33:39.022 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:33:39.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 -- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80fc066510 msgr2=0x7f80fc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80fc066510 0x7f80fc0689d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f81000090b0 tx=0x7f8100008030 comp rx=0 tx=0).stop 2023-11-17T06:33:39.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 -- 172.21.15.69:0/233936150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100b48f0 msgr2=0x7f811015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100b48f0 0x7f811015a400 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f810c001eb0 tx=0x7f810c00c7b0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 -- 172.21.15.69:0/233936150 shutdown_connections 2023-11-17T06:33:39.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f80fc066510 0x7f80fc0689d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f811015d8f0 0x7f81100b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.023 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81100d0140 0x7f81100b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 --2- 172.21.15.69:0/233936150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81100b48f0 0x7f811015a400 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 -- 172.21.15.69:0/233936150 >> 172.21.15.69:0/233936150 conn(0x7f81100d3340 msgr2=0x7f811006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:39.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 -- 172.21.15.69:0/233936150 shutdown_connections 2023-11-17T06:33:39.024 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.015+0000 7f81170cb700 1 -- 172.21.15.69:0/233936150 wait complete. 2023-11-17T06:33:39.044 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-17T06:33:39.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.223+0000 7f7cf54f9700 1 Processor -- start 2023-11-17T06:33:39.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.223+0000 7f7cf54f9700 1 -- start start 2023-11-17T06:33:39.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7cf0070ad0 0x7f7cf006ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf0159bc0 con 0x7f7cf006d850 2023-11-17T06:33:39.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf006c7b0 con 0x7f7cf01597e0 2023-11-17T06:33:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf006b880 con 0x7f7cf0070ad0 2023-11-17T06:33:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cef7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7cf0070ad0 0x7f7cf006ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf4cf8700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7cf006d850 0x7f7cf006bfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44844/0 (socket says 172.21.15.69:44844) 2023-11-17T06:33:39.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf4cf8700 1 -- 172.21.15.69:0/3318179654 learned_addr learned my addr 172.21.15.69:0/3318179654 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cef7fe700 1 -- 172.21.15.69:0/3318179654 >> v1:172.21.15.93:6789/0 conn(0x7f7cf01597e0 legacy=0x7f7cf00703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cef7fe700 1 -- 172.21.15.69:0/3318179654 >> v1:172.21.15.69:6789/0 conn(0x7f7cf006d850 legacy=0x7f7cf006bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cef7fe700 1 -- 172.21.15.69:0/3318179654 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf006ca90 con 0x7f7cf0070ad0 2023-11-17T06:33:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cef7fe700 1 --2- 172.21.15.69:0/3318179654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 0x7f7cf006ba60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009850 tx=0x7f7ce4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf1608c0e30596a server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7ceeffd700 1 -- 172.21.15.69:0/3318179654 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400f940 con 0x7f7cf0070ad0 2023-11-17T06:33:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7ceeffd700 1 -- 172.21.15.69:0/3318179654 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce400faa0 con 0x7f7cf0070ad0 2023-11-17T06:33:39.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7ceeffd700 1 -- 172.21.15.69:0/3318179654 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400fe30 con 0x7f7cf0070ad0 2023-11-17T06:33:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 -- 172.21.15.69:0/3318179654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 msgr2=0x7f7cf006ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 --2- 172.21.15.69:0/3318179654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 0x7f7cf006ba60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009850 tx=0x7f7ce4009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 -- 172.21.15.69:0/3318179654 shutdown_connections 2023-11-17T06:33:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 --2- 172.21.15.69:0/3318179654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 0x7f7cf006ba60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 -- 172.21.15.69:0/3318179654 >> 172.21.15.69:0/3318179654 conn(0x7f7cf00cece0 msgr2=0x7f7cf00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:39.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 -- 172.21.15.69:0/3318179654 shutdown_connections 2023-11-17T06:33:39.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.227+0000 7f7cf54f9700 1 -- 172.21.15.69:0/3318179654 wait complete. 2023-11-17T06:33:39.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.231+0000 7f7cf54f9700 1 Processor -- start 2023-11-17T06:33:39.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.231+0000 7f7cf54f9700 1 -- start start 2023-11-17T06:33:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cf54f9700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cf006d850 0x7f7cf01f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cf54f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 0x7f7cf00c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cf54f9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cf01597e0 0x7f7cf00c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cf54f9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf00c78a0 con 0x7f7cf0070ad0 2023-11-17T06:33:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cf54f9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf00c3d80 con 0x7f7cf01597e0 2023-11-17T06:33:39.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cf54f9700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf00c48a0 con 0x7f7cf006d850 2023-11-17T06:33:39.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cef7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 0x7f7cf00c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cef7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 0x7f7cf00c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42228/0 (socket says 172.21.15.69:42228) 2023-11-17T06:33:39.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cef7fe700 1 -- 172.21.15.69:0/2732536842 learned_addr learned my addr 172.21.15.69:0/2732536842 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:39.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cf4cf8700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cf01597e0 0x7f7cf00c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7ceffff700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cf006d850 0x7f7cf01f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cef7fe700 1 -- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cf006d850 msgr2=0x7f7cf01f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cef7fe700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cf006d850 0x7f7cf01f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cef7fe700 1 -- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cf01597e0 msgr2=0x7f7cf00c3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cef7fe700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cf01597e0 0x7f7cf00c3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cef7fe700 1 -- 172.21.15.69:0/2732536842 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce40094b0 con 0x7f7cf0070ad0 2023-11-17T06:33:39.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cef7fe700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 0x7f7cf00c5db0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40090b0 tx=0x7f7ce4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cecff9700 1 -- 172.21.15.69:0/2732536842 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4003990 con 0x7f7cf0070ad0 2023-11-17T06:33:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cecff9700 1 -- 172.21.15.69:0/2732536842 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce4003af0 con 0x7f7cf0070ad0 2023-11-17T06:33:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cecff9700 1 -- 172.21.15.69:0/2732536842 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4003c80 con 0x7f7cf0070ad0 2023-11-17T06:33:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cf54f9700 1 -- 172.21.15.69:0/2732536842 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf00c4000 con 0x7f7cf0070ad0 2023-11-17T06:33:39.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.235+0000 7f7cf54f9700 1 -- 172.21.15.69:0/2732536842 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf00c45c0 con 0x7f7cf0070ad0 2023-11-17T06:33:39.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.239+0000 7f7cf54f9700 1 -- 172.21.15.69:0/2732536842 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf004e650 con 0x7f7cf0070ad0 2023-11-17T06:33:39.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.239+0000 7f7cecff9700 1 -- 172.21.15.69:0/2732536842 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7ce4021450 con 0x7f7cf0070ad0 2023-11-17T06:33:39.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.239+0000 7f7cecff9700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7cdc066510 0x7f7cdc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:39.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.239+0000 7f7cecff9700 1 -- 172.21.15.69:0/2732536842 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f7ce4013070 con 0x7f7cf0070ad0 2023-11-17T06:33:39.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.239+0000 7f7ceffff700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7cdc066510 0x7f7cdc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:39.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.243+0000 7f7ceffff700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7cdc066510 0x7f7cdc0689d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0000f60 tx=0x7f7ce0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:39.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.247+0000 7f7cecff9700 1 -- 172.21.15.69:0/2732536842 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ce4054bc0 con 0x7f7cf0070ad0 2023-11-17T06:33:39.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.451+0000 7f7cf54f9700 1 -- 172.21.15.69:0/2732536842 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7cf00b4c60 con 0x7f7cf0070ad0 2023-11-17T06:33:39.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cecff9700 1 -- 172.21.15.69:0/2732536842 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7ce40581e0 con 0x7f7cf0070ad0 2023-11-17T06:33:39.459 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-17T06:33:39.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 -- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7cdc066510 msgr2=0x7f7cdc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7cdc066510 0x7f7cdc0689d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ce0000f60 tx=0x7f7ce0009040 comp rx=0 tx=0).stop 2023-11-17T06:33:39.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 -- 172.21.15.69:0/2732536842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 msgr2=0x7f7cf00c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:39.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 0x7f7cf00c5db0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40090b0 tx=0x7f7ce4004770 comp rx=0 tx=0).stop 2023-11-17T06:33:39.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 -- 172.21.15.69:0/2732536842 shutdown_connections 2023-11-17T06:33:39.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7cdc066510 0x7f7cdc0689d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7cf01597e0 0x7f7cf00c3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7cf0070ad0 0x7f7cf00c5db0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 --2- 172.21.15.69:0/2732536842 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7cf006d850 0x7f7cf01f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:39.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 -- 172.21.15.69:0/2732536842 >> 172.21.15.69:0/2732536842 conn(0x7f7cf00cece0 msgr2=0x7f7cf015c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:39.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 -- 172.21.15.69:0/2732536842 shutdown_connections 2023-11-17T06:33:39.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:39.455+0000 7f7cf54f9700 1 -- 172.21.15.69:0/2732536842 wait complete. 2023-11-17T06:33:39.483 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-17T06:33:39.484 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-17T06:33:39.484 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2023-11-17T06:33:39.484 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-17T06:33:39.484 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:39.484 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-17T06:33:39.484 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-17T06:33:39.484 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-17T06:33:39.484 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:33:39.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:39.484 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2023-11-17T06:33:39.500 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-17T06:33:39.500 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-17T06:33:39.500 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-11-17T06:33:39.500 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:39.500 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-11-17T06:33:39.500 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:39.500 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:33:39.500 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42024sec preferred_lft 42024sec 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2023-11-17T06:33:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 02:42:2e:aa:f1:0b brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 62:b7:9e:10:0f:21 brd ff:ff:ff:ff:ff:ff 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::3479:73ff:fe34:bc0f/64 scope link 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:39.502 INFO:teuthology.orchestra.run.smithi069.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:33:39.503 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 62:b7:9e:10:0f:21 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:39.503 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::60b7:9eff:fe10:f21/64 scope link 2023-11-17T06:33:39.503 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:39.503 INFO:teuthology.orchestra.run.smithi069.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-17T06:33:39.503 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 92:c9:1c:aa:d1:2c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:39.503 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::90c9:1cff:feaa:d12c/64 scope link 2023-11-17T06:33:39.503 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-11-17T06:33:39.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:39.504 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-17T06:33:39.586 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-11-17T06:33:39.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:39.589 DEBUG:teuthology.orchestra.run.smithi069:> route 2023-11-17T06:33:39.653 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2023-11-17T06:33:39.653 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-17T06:33:39.653 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-17T06:33:39.653 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-17T06:33:39.653 INFO:teuthology.orchestra.run.smithi069.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-17T06:33:39.653 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-11-17T06:33:39.653 INFO:teuthology.orchestra.run.smithi069.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-17T06:33:39.653 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-17T06:33:39.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:39.654 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-11-17T06:33:39.654 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-11-17T06:33:39.654 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-17T06:33:39.655 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-17T06:33:39.655 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-17T06:33:39.655 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-11-17T06:33:39.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:39.795 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-11-17T06:33:39.812 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-17T06:33:39.812 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-17T06:33:39.813 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:33:39.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:39.813 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2023-11-17T06:33:39.890 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-17T06:33:39.890 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:33:39.890 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:39.949 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-17T06:33:39.950 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-17T06:33:39.950 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:40.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:33:40.089 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:33:40.155 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:33:40.155 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:33:40.156 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:33:40.157 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:33:40.158 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:40.159 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:40.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:40.160 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:33:40.224 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-17T06:33:40.225 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-17T06:33:40.277 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:33:40.309 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:33:40.372 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:33:40.372 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:33:40.372 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:33:40.372 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:33:40.372 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:33:40.372 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:33:40.372 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:33:40.372 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:33:40.372 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:33:40.373 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:33:40.374 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:33:40.375 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:33:40.375 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:33:40.375 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:33:40.375 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:33:40.375 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:33:40.375 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:33:40.375 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:40.375 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:40.375 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:40.375 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:40.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:40.377 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:33:40.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:2023-11-17T06:33:40.415+0000 7f7f0586a640 -1 init, newargv = 0x560bcd6a5920 newargc=15 2023-11-17T06:33:40.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[48007]: starting ceph client 2023-11-17T06:33:40.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[48007]: starting fuse 2023-11-17T06:33:41.533 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2023-11-17T06:33:41.540 INFO:tasks.ceph.mds.c.smithi069.stderr:2023-11-17T06:33:41.531+0000 7f79d0a41700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:33:41.572 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2023-11-17T06:33:41.636 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2023-11-17T06:33:41.636 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2023-11-17T06:33:41.636 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2023-11-17T06:33:41.636 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/run/lock 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/unified 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/systemd 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/pids 2023-11-17T06:33:41.637 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/memory 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/freezer 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/devices 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/hugetlb 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/blkio 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/perf_event 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup/cpuset 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2023-11-17T06:33:41.638 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/run/rpc_pipefs 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/fs/nfsd 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-0 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-1 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-2 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph/osd/ceph-3 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:41.639 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:41.640 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:41.640 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:41.640 INFO:teuthology.orchestra.run.smithi069.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:41.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:41.641 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2023-11-17T06:33:41.704 INFO:teuthology.orchestra.run.smithi069.stdout:49 2023-11-17T06:33:41.704 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-11-17T06:33:41.704 DEBUG:teuthology.orchestra.run.smithi069:> sudo stdin-killer -- python3 -c ' 2023-11-17T06:33:41.704 DEBUG:teuthology.orchestra.run.smithi069:> import glob 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> import re 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> import os 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> import subprocess 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> def _find_admin_socket(client_name): 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> files = glob.glob(asok_path) 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> # Given a non-glob path, it better be there 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> if "*" not in asok_path: 2023-11-17T06:33:41.705 DEBUG:teuthology.orchestra.run.smithi069:> assert(len(files) == 1) 2023-11-17T06:33:41.706 DEBUG:teuthology.orchestra.run.smithi069:> return files[0] 2023-11-17T06:33:41.706 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:33:41.706 DEBUG:teuthology.orchestra.run.smithi069:> for f in files: 2023-11-17T06:33:41.706 DEBUG:teuthology.orchestra.run.smithi069:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-17T06:33:41.706 DEBUG:teuthology.orchestra.run.smithi069:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-17T06:33:41.706 DEBUG:teuthology.orchestra.run.smithi069:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-17T06:33:41.706 DEBUG:teuthology.orchestra.run.smithi069:> contents = proc_f.read() 2023-11-17T06:33:41.706 DEBUG:teuthology.orchestra.run.smithi069:> if mountpoint in contents: 2023-11-17T06:33:41.706 DEBUG:teuthology.orchestra.run.smithi069:> return f 2023-11-17T06:33:41.707 DEBUG:teuthology.orchestra.run.smithi069:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-17T06:33:41.707 DEBUG:teuthology.orchestra.run.smithi069:> 2023-11-17T06:33:41.707 DEBUG:teuthology.orchestra.run.smithi069:> print(_find_admin_socket("client.0")) 2023-11-17T06:33:41.707 DEBUG:teuthology.orchestra.run.smithi069:> ' 2023-11-17T06:33:41.865 INFO:teuthology.orchestra.run.smithi069.stdout:/var/run/ceph/ceph-client.0.48007.asok 2023-11-17T06:33:41.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-17T06:33:41.888 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48007.asok 2023-11-17T06:33:41.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:41.889 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48007.asok status 2023-11-17T06:33:42.084 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:33:42.084 INFO:teuthology.orchestra.run.smithi069.stdout: "metadata": { 2023-11-17T06:33:42.084 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_sha1": "895e5adad9a763a0f13587c485b17f1ad3f04528", 2023-11-17T06:33:42.084 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 18.0.0-6612-g895e5ada (895e5adad9a763a0f13587c485b17f1ad3f04528) reef (dev)", 2023-11-17T06:33:42.084 INFO:teuthology.orchestra.run.smithi069.stdout: "entity_id": "0", 2023-11-17T06:33:42.084 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": "smithi069", 2023-11-17T06:33:42.084 INFO:teuthology.orchestra.run.smithi069.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "pid": "48007", 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "root": "/" 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_count": 0, 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_pinned_count": 0, 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 5760, 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "inst": { 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "name": { 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "client", 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "num": 5760 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-11-17T06:33:42.085 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 671508459 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 671508459 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: "inst_str": "client.5760 192.168.0.1:0/671508459", 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: "addr_str": "192.168.0.1:0/671508459", 2023-11-17T06:33:42.086 INFO:teuthology.orchestra.run.smithi069.stdout: "inode_count": 1, 2023-11-17T06:33:42.087 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_epoch": 28, 2023-11-17T06:33:42.087 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch": 41, 2023-11-17T06:33:42.087 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch_barrier": 0, 2023-11-17T06:33:42.087 INFO:teuthology.orchestra.run.smithi069.stdout: "blocklisted": false, 2023-11-17T06:33:42.087 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs" 2023-11-17T06:33:42.087 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:33:42.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:42.097 DEBUG:teuthology.orchestra.run.smithi069:> stat --file-system '--printf=%T 2023-11-17T06:33:42.097 DEBUG:teuthology.orchestra.run.smithi069:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:42.116 INFO:teuthology.orchestra.run.smithi069.stdout:fuseblk 2023-11-17T06:33:42.117 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:42.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:42.117 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:42.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:42.194 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -l subdir/) 2023-11-17T06:33:42.456 INFO:teuthology.orchestra.run.smithi069.stdout:total 50 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:32 0 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:32 1 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 10 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 11 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 12 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 13 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 14 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 15 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 16 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 17 2023-11-17T06:33:42.457 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 18 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 19 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:32 2 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 20 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 22 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 23 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 24 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 25 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 26 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 27 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 28 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 29 2023-11-17T06:33:42.458 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:32 3 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 30 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 31 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 32 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 33 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 34 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 35 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 36 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 37 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 38 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 39 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:32 4 2023-11-17T06:33:42.459 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 40 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 41 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 42 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 43 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 44 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 45 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 46 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 47 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 48 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 49 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:32 5 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 50 2023-11-17T06:33:42.460 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 51 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 52 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 53 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 54 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 55 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 56 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 57 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 58 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 59 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:32 6 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 60 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 61 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 62 2023-11-17T06:33:42.461 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 63 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 64 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 65 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 66 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 67 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 68 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 69 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:32 7 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 70 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 71 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 72 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 73 2023-11-17T06:33:42.462 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 74 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 75 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 76 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 77 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 78 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 79 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:32 8 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 80 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 81 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 82 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 83 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 84 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 85 2023-11-17T06:33:42.463 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 86 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 87 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 88 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 89 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Nov 17 06:32 9 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 90 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 91 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 92 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 93 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 94 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 95 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 96 2023-11-17T06:33:42.464 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 97 2023-11-17T06:33:42.465 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 98 2023-11-17T06:33:42.465 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Nov 17 06:32 99 2023-11-17T06:33:42.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:42.466 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo cat subdir/21') 2023-11-17T06:33:42.509 INFO:teuthology.orchestra.run.smithi069.stderr:cat: subdir/21: No such file or directory 2023-11-17T06:33:42.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:33:42.513 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-17T06:33:42.514 DEBUG:teuthology.orchestra.run.smithi069:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-17T06:33:42.607 DEBUG:teuthology.orchestra.run.smithi093:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-17T06:33:42.651 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-17T06:33:42.651 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:33:42.651 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:42.672 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:42.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.883+0000 7f4e3d6a0700 1 Processor -- start 2023-11-17T06:33:42.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.887+0000 7f4e3d6a0700 1 -- start start 2023-11-17T06:33:42.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.887+0000 7f4e3d6a0700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e380b2800 0x7f4e380cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.887+0000 7f4e3d6a0700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4e380cc390 0x7f4e3815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.887+0000 7f4e3d6a0700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3815dc30 con 0x7f4e38154700 2023-11-17T06:33:42.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.887+0000 7f4e3d6a0700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e3815e8b0 con 0x7f4e380cc390 2023-11-17T06:33:42.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.887+0000 7f4e3d6a0700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e38154ae0 con 0x7f4e380b2800 2023-11-17T06:33:42.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.887+0000 7f4e36ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f4e38154700 0x7f4e380b20f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44848/0 (socket says 172.21.15.69:44848) 2023-11-17T06:33:42.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e36ffd700 1 -- 172.21.15.69:0/3889339110 learned_addr learned my addr 172.21.15.69:0/3889339110 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:42.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e37fff700 1 --2- 172.21.15.69:0/3889339110 >> v2:172.21.15.69:3300/0 conn(0x7f4e380cc390 0x7f4e3815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e367fc700 1 --2- 172.21.15.69:0/3889339110 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e380b2800 0x7f4e380cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e37fff700 1 -- 172.21.15.69:0/3889339110 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e380b2800 msgr2=0x7f4e380cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:42.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e37fff700 1 --2- 172.21.15.69:0/3889339110 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e380b2800 0x7f4e380cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e37fff700 1 -- 172.21.15.69:0/3889339110 >> v1:172.21.15.69:6789/0 conn(0x7f4e38154700 legacy=0x7f4e380b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e37fff700 1 -- 172.21.15.69:0/3889339110 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3815df10 con 0x7f4e380cc390 2023-11-17T06:33:42.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e35ffb700 1 -- 172.21.15.69:0/3889339110 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179077302 0 0) 0x7f4e3815dc30 con 0x7f4e38154700 2023-11-17T06:33:42.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e37fff700 1 --2- 172.21.15.69:0/3889339110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e380cc390 0x7f4e3815a5a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009dc0 tx=0x7f4e3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614dcfba71cbe5d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e35ffb700 1 -- 172.21.15.69:0/3889339110 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000e070 con 0x7f4e380cc390 2023-11-17T06:33:42.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e35ffb700 1 -- 172.21.15.69:0/3889339110 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3000bae0 con 0x7f4e380cc390 2023-11-17T06:33:42.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e35ffb700 1 -- 172.21.15.69:0/3889339110 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000be90 con 0x7f4e380cc390 2023-11-17T06:33:42.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/3889339110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e380cc390 msgr2=0x7f4e3815a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e3d6a0700 1 --2- 172.21.15.69:0/3889339110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e380cc390 0x7f4e3815a5a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009dc0 tx=0x7f4e3000b330 comp rx=0 tx=0).stop 2023-11-17T06:33:42.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/3889339110 shutdown_connections 2023-11-17T06:33:42.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e3d6a0700 1 --2- 172.21.15.69:0/3889339110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e380cc390 0x7f4e3815a5a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e3d6a0700 1 --2- 172.21.15.69:0/3889339110 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e380b2800 0x7f4e380cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/3889339110 >> 172.21.15.69:0/3889339110 conn(0x7f4e380cd0f0 msgr2=0x7f4e380cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:42.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/3889339110 shutdown_connections 2023-11-17T06:33:42.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.891+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/3889339110 wait complete. 2023-11-17T06:33:42.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.895+0000 7f4e3d6a0700 1 Processor -- start 2023-11-17T06:33:42.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.895+0000 7f4e3d6a0700 1 -- start start 2023-11-17T06:33:42.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.895+0000 7f4e3d6a0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e380b2800 0x7f4e381526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.895+0000 7f4e3d6a0700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e380cc390 0x7f4e381520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.895+0000 7f4e3d6a0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e38154700 0x7f4e380b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.895+0000 7f4e3d6a0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e380c9490 con 0x7f4e38154700 2023-11-17T06:33:42.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.895+0000 7f4e3d6a0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e380c8b20 con 0x7f4e380b2800 2023-11-17T06:33:42.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.895+0000 7f4e3d6a0700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e380c8e00 con 0x7f4e380cc390 2023-11-17T06:33:42.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e37fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e38154700 0x7f4e380b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e37fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e38154700 0x7f4e380b5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42246/0 (socket says 172.21.15.69:42246) 2023-11-17T06:33:42.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e37fff700 1 -- 172.21.15.69:0/2679219132 learned_addr learned my addr 172.21.15.69:0/2679219132 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:42.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e367fc700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e380cc390 0x7f4e381520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e36ffd700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e380b2800 0x7f4e381526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e37fff700 1 -- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e380cc390 msgr2=0x7f4e381520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e37fff700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e380cc390 0x7f4e381520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e37fff700 1 -- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e380b2800 msgr2=0x7f4e381526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:42.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e37fff700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e380b2800 0x7f4e381526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:42.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e37fff700 1 -- 172.21.15.69:0/2679219132 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30009a70 con 0x7f4e38154700 2023-11-17T06:33:42.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e37fff700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e38154700 0x7f4e380b5de0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4e30014040 tx=0x7f4e30004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e1f7fe700 1 -- 172.21.15.69:0/2679219132 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300045d0 con 0x7f4e38154700 2023-11-17T06:33:42.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e1f7fe700 1 -- 172.21.15.69:0/2679219132 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e30020070 con 0x7f4e38154700 2023-11-17T06:33:42.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e1f7fe700 1 -- 172.21.15.69:0/2679219132 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30004970 con 0x7f4e38154700 2023-11-17T06:33:42.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/2679219132 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e38152db0 con 0x7f4e38154700 2023-11-17T06:33:42.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/2679219132 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e381f2d30 con 0x7f4e38154700 2023-11-17T06:33:42.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.899+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/2679219132 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3804e650 con 0x7f4e38154700 2023-11-17T06:33:42.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.903+0000 7f4e1f7fe700 1 -- 172.21.15.69:0/2679219132 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4e30012430 con 0x7f4e38154700 2023-11-17T06:33:42.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.903+0000 7f4e1f7fe700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e24066510 0x7f4e240689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:42.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.903+0000 7f4e1f7fe700 1 -- 172.21.15.69:0/2679219132 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f4e30022070 con 0x7f4e38154700 2023-11-17T06:33:42.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.903+0000 7f4e36ffd700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e24066510 0x7f4e240689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:42.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.907+0000 7f4e36ffd700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e24066510 0x7f4e240689d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4e28000f60 tx=0x7f4e28007cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:42.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:42.911+0000 7f4e1f7fe700 1 -- 172.21.15.69:0/2679219132 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4e30056aa0 con 0x7f4e38154700 2023-11-17T06:33:43.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.095+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/2679219132 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e380cdeb0 con 0x7f4e38154700 2023-11-17T06:33:43.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.095+0000 7f4e1f7fe700 1 -- 172.21.15.69:0/2679219132 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16933 (secure 0 0 0) 0x7f4e30056630 con 0x7f4e38154700 2023-11-17T06:33:43.103 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:43.103 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":41,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:33:30.515083+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6835/1050522275":"2023-11-18T06:33:30.515033+0000","172.21.15.69:6834/1050522275":"2023-11-18T06:33:30.515033+0000","172.21.15.93:6837/4181304583":"2023-11-18T06:33:11.857552+0000","172.21.15.93:6836/4181304583":"2023-11-18T06:33:11.857552+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e24066510 msgr2=0x7f4e240689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e24066510 0x7f4e240689d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4e28000f60 tx=0x7f4e28007cb0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/2679219132 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e38154700 msgr2=0x7f4e380b5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e38154700 0x7f4e380b5de0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f4e30014040 tx=0x7f4e30004af0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/2679219132 shutdown_connections 2023-11-17T06:33:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4e24066510 0x7f4e240689d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e38154700 0x7f4e380b5de0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4e380cc390 0x7f4e381520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 --2- 172.21.15.69:0/2679219132 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4e380b2800 0x7f4e381526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/2679219132 >> 172.21.15.69:0/2679219132 conn(0x7f4e380cd0f0 msgr2=0x7f4e3806b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/2679219132 shutdown_connections 2023-11-17T06:33:43.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.103+0000 7f4e3d6a0700 1 -- 172.21.15.69:0/2679219132 wait complete. 2023-11-17T06:33:43.128 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:23.624321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:24.717590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:33:43.129 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:33:43.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.299+0000 7f1b766dd700 1 Processor -- start 2023-11-17T06:33:43.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.299+0000 7f1b766dd700 1 -- start start 2023-11-17T06:33:43.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b766dd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1b700b8c40 0x7f1b700ce060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b766dd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1b700b9090 0x7f1b700ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b766dd700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7015e050 con 0x7f1b7015d4a0 2023-11-17T06:33:43.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b766dd700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7015e330 con 0x7f1b700b8c40 2023-11-17T06:33:43.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b766dd700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7015e610 con 0x7f1b700b9090 2023-11-17T06:33:43.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b677fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1b700b8c40 0x7f1b700ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b6ffff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1b7015d4a0 0x7f1b7015d880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44860/0 (socket says 172.21.15.69:44860) 2023-11-17T06:33:43.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b6ffff700 1 -- 172.21.15.69:0/1475554356 learned_addr learned my addr 172.21.15.69:0/1475554356 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:43.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b74c7a700 1 --2- 172.21.15.69:0/1475554356 >> v2:172.21.15.93:3300/0 conn(0x7f1b700b9090 0x7f1b700ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b6f7fe700 1 -- 172.21.15.69:0/1475554356 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512835897 0 0) 0x7f1b7015e050 con 0x7f1b7015d4a0 2023-11-17T06:33:43.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b6f7fe700 1 -- 172.21.15.69:0/1475554356 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b5c0035d0 con 0x7f1b7015d4a0 2023-11-17T06:33:43.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b677fe700 1 -- 172.21.15.69:0/1475554356 >> v2:172.21.15.93:3300/0 conn(0x7f1b700b9090 msgr2=0x7f1b700ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:43.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b677fe700 1 --2- 172.21.15.69:0/1475554356 >> v2:172.21.15.93:3300/0 conn(0x7f1b700b9090 0x7f1b700ce5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.313 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b677fe700 1 -- 172.21.15.69:0/1475554356 >> v1:172.21.15.69:6789/0 conn(0x7f1b7015d4a0 legacy=0x7f1b7015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.303+0000 7f1b677fe700 1 -- 172.21.15.69:0/1475554356 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7015e8f0 con 0x7f1b700b8c40 2023-11-17T06:33:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b677fe700 1 --2- 172.21.15.69:0/1475554356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b700b8c40 0x7f1b700ce060 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1b700d31d0 tx=0x7f1b58009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d85d42a6480fc2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b6f7fe700 1 -- 172.21.15.69:0/1475554356 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58011830 con 0x7f1b700b8c40 2023-11-17T06:33:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b6f7fe700 1 -- 172.21.15.69:0/1475554356 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58011990 con 0x7f1b700b8c40 2023-11-17T06:33:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b6f7fe700 1 -- 172.21.15.69:0/1475554356 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58011d00 con 0x7f1b700b8c40 2023-11-17T06:33:43.314 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b766dd700 1 -- 172.21.15.69:0/1475554356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b700b8c40 msgr2=0x7f1b700ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b766dd700 1 --2- 172.21.15.69:0/1475554356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b700b8c40 0x7f1b700ce060 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1b700d31d0 tx=0x7f1b58009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b766dd700 1 -- 172.21.15.69:0/1475554356 shutdown_connections 2023-11-17T06:33:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b766dd700 1 --2- 172.21.15.69:0/1475554356 >> v2:172.21.15.93:3300/0 conn(0x7f1b700b9090 0x7f1b700ce5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b766dd700 1 --2- 172.21.15.69:0/1475554356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b700b8c40 0x7f1b700ce060 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b766dd700 1 -- 172.21.15.69:0/1475554356 >> 172.21.15.69:0/1475554356 conn(0x7f1b7006b830 msgr2=0x7f1b7006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b766dd700 1 -- 172.21.15.69:0/1475554356 shutdown_connections 2023-11-17T06:33:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b766dd700 1 -- 172.21.15.69:0/1475554356 wait complete. 2023-11-17T06:33:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b766dd700 1 Processor -- start 2023-11-17T06:33:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.307+0000 7f1b766dd700 1 -- start start 2023-11-17T06:33:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b766dd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b700b8c40 0x7f1b700ca810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b766dd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b700b9090 0x7f1b700b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b766dd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1b7015d4a0 0x7f1b700ccd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b766dd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700cbff0 con 0x7f1b700b9090 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b766dd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700cc870 con 0x7f1b700b8c40 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b766dd700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700b58c0 con 0x7f1b7015d4a0 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b677fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b700b9090 0x7f1b700b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b700b8c40 0x7f1b700ca810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b74c7a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1b7015d4a0 0x7f1b700ccd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b700b8c40 0x7f1b700ca810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:42558/0 (socket says 172.21.15.69:42558) 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6ffff700 1 -- 172.21.15.69:0/2250633360 learned_addr learned my addr 172.21.15.69:0/2250633360 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:43.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b677fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b700b9090 0x7f1b700b4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42270/0 (socket says 172.21.15.69:42270) 2023-11-17T06:33:43.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6ffff700 1 -- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1b7015d4a0 msgr2=0x7f1b700ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6ffff700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1b7015d4a0 0x7f1b700ccd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6ffff700 1 -- 172.21.15.69:0/2250633360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b700b9090 msgr2=0x7f1b700b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6ffff700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b700b9090 0x7f1b700b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6ffff700 1 -- 172.21.15.69:0/2250633360 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580094b0 con 0x7f1b700b8c40 2023-11-17T06:33:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6ffff700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b700b8c40 0x7f1b700ca810 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000cad0 tx=0x7f1b6000cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6d7fa700 1 -- 172.21.15.69:0/2250633360 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60007480 con 0x7f1b700b8c40 2023-11-17T06:33:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6d7fa700 1 -- 172.21.15.69:0/2250633360 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b600075e0 con 0x7f1b700b8c40 2023-11-17T06:33:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b766dd700 1 -- 172.21.15.69:0/2250633360 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b700b55e0 con 0x7f1b700b8c40 2023-11-17T06:33:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b6d7fa700 1 -- 172.21.15.69:0/2250633360 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60007970 con 0x7f1b700b8c40 2023-11-17T06:33:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.311+0000 7f1b766dd700 1 -- 172.21.15.69:0/2250633360 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b700cc500 con 0x7f1b700b8c40 2023-11-17T06:33:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.315+0000 7f1b766dd700 1 -- 172.21.15.69:0/2250633360 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7004e6c0 con 0x7f1b700b8c40 2023-11-17T06:33:43.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.315+0000 7f1b6d7fa700 1 -- 172.21.15.69:0/2250633360 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1b6001b3b0 con 0x7f1b700b8c40 2023-11-17T06:33:43.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.319+0000 7f1b6d7fa700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b50066510 0x7f1b500689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.319+0000 7f1b6d7fa700 1 -- 172.21.15.69:0/2250633360 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f1b60083920 con 0x7f1b700b8c40 2023-11-17T06:33:43.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.319+0000 7f1b677fe700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b50066510 0x7f1b500689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.319+0000 7f1b677fe700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b50066510 0x7f1b500689d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1b58000c00 tx=0x7f1b58008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.327+0000 7f1b6d7fa700 1 -- 172.21.15.69:0/2250633360 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1b60054680 con 0x7f1b700b8c40 2023-11-17T06:33:43.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.503+0000 7f1b766dd700 1 -- 172.21.15.69:0/2250633360 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1b7015dd90 con 0x7f1b700b8c40 2023-11-17T06:33:43.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.507+0000 7f1b6d7fa700 1 -- 172.21.15.69:0/2250633360 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1b60017020 con 0x7f1b700b8c40 2023-11-17T06:33:43.512 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:33:43.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.507+0000 7f1b766dd700 1 -- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b50066510 msgr2=0x7f1b500689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.507+0000 7f1b766dd700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b50066510 0x7f1b500689d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1b58000c00 tx=0x7f1b58008030 comp rx=0 tx=0).stop 2023-11-17T06:33:43.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.507+0000 7f1b766dd700 1 -- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b700b8c40 msgr2=0x7f1b700ca810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.507+0000 7f1b766dd700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b700b8c40 0x7f1b700ca810 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b6000cad0 tx=0x7f1b6000cb00 comp rx=0 tx=0).stop 2023-11-17T06:33:43.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.511+0000 7f1b766dd700 1 -- 172.21.15.69:0/2250633360 shutdown_connections 2023-11-17T06:33:43.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.511+0000 7f1b766dd700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b50066510 0x7f1b500689d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.511+0000 7f1b766dd700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1b7015d4a0 0x7f1b700ccd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.511+0000 7f1b766dd700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b700b9090 0x7f1b700b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.511+0000 7f1b766dd700 1 --2- 172.21.15.69:0/2250633360 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1b700b8c40 0x7f1b700ca810 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.511+0000 7f1b766dd700 1 -- 172.21.15.69:0/2250633360 >> 172.21.15.69:0/2250633360 conn(0x7f1b7006b830 msgr2=0x7f1b701524a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.511+0000 7f1b766dd700 1 -- 172.21.15.69:0/2250633360 shutdown_connections 2023-11-17T06:33:43.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.511+0000 7f1b766dd700 1 -- 172.21.15.69:0/2250633360 wait complete. 2023-11-17T06:33:43.535 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:33:43.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.711+0000 7fdd217d5700 1 Processor -- start 2023-11-17T06:33:43.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.711+0000 7fdd217d5700 1 -- start start 2023-11-17T06:33:43.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd217d5700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c15a290 0x7fdd1c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd217d5700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdd1c0b2870 0x7fdd1c071420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd217d5700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1c15e0c0 con 0x7fdd1c0cb200 2023-11-17T06:33:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd217d5700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1c0cedf0 con 0x7fdd1c0b2870 2023-11-17T06:33:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd217d5700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c15e3a0 con 0x7fdd1c15a290 2023-11-17T06:33:43.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1affd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c15a290 0x7fdd1c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1b7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fdd1c0b2870 0x7fdd1c071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1affd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c15a290 0x7fdd1c0cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:50682/0 (socket says 172.21.15.69:50682) 2023-11-17T06:33:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1affd700 1 -- 172.21.15.69:0/3731838008 learned_addr learned my addr 172.21.15.69:0/3731838008 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:43.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1a7fc700 1 -- 172.21.15.69:0/3731838008 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1007880739 0 0) 0x7fdd1c15e0c0 con 0x7fdd1c0cb200 2023-11-17T06:33:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1a7fc700 1 -- 172.21.15.69:0/3731838008 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd080035d0 con 0x7fdd1c0cb200 2023-11-17T06:33:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1b7fe700 1 -- 172.21.15.69:0/3731838008 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c15a290 msgr2=0x7fdd1c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1b7fe700 1 --2- 172.21.15.69:0/3731838008 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c15a290 0x7fdd1c0cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1b7fe700 1 -- 172.21.15.69:0/3731838008 >> v1:172.21.15.93:6789/0 conn(0x7fdd1c0cb200 legacy=0x7fdd1c0b2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1b7fe700 1 -- 172.21.15.69:0/3731838008 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c15e680 con 0x7fdd1c0b2870 2023-11-17T06:33:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1affd700 1 --2- 172.21.15.69:0/3731838008 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c15a290 0x7fdd1c0cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1b7fe700 1 --2- 172.21.15.69:0/3731838008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd1c0b2870 0x7fdd1c071420 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009d90 tx=0x7fdd1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f53a9fdb62c355a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1a7fc700 1 -- 172.21.15.69:0/3731838008 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1400e070 con 0x7fdd1c0b2870 2023-11-17T06:33:43.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1a7fc700 1 -- 172.21.15.69:0/3731838008 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1400bb20 con 0x7fdd1c0b2870 2023-11-17T06:33:43.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.715+0000 7fdd1a7fc700 1 -- 172.21.15.69:0/3731838008 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14012430 con 0x7fdd1c0b2870 2023-11-17T06:33:43.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 -- 172.21.15.69:0/3731838008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd1c0b2870 msgr2=0x7fdd1c071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 --2- 172.21.15.69:0/3731838008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd1c0b2870 0x7fdd1c071420 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdd14009d90 tx=0x7fdd1400b330 comp rx=0 tx=0).stop 2023-11-17T06:33:43.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 -- 172.21.15.69:0/3731838008 shutdown_connections 2023-11-17T06:33:43.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 --2- 172.21.15.69:0/3731838008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd1c0b2870 0x7fdd1c071420 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 --2- 172.21.15.69:0/3731838008 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c15a290 0x7fdd1c0cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 -- 172.21.15.69:0/3731838008 >> 172.21.15.69:0/3731838008 conn(0x7fdd1c0737c0 msgr2=0x7fdd1c06e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 -- 172.21.15.69:0/3731838008 shutdown_connections 2023-11-17T06:33:43.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 -- 172.21.15.69:0/3731838008 wait complete. 2023-11-17T06:33:43.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 Processor -- start 2023-11-17T06:33:43.725 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 -- start start 2023-11-17T06:33:43.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c0b2870 0x7fdd1c14a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd1c0cb200 0x7fdd1c0c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd1c15a290 0x7fdd1c150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c14d4e0 con 0x7fdd1c15a290 2023-11-17T06:33:43.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c14d780 con 0x7fdd1c0cb200 2023-11-17T06:33:43.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.719+0000 7fdd217d5700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c14da60 con 0x7fdd1c0b2870 2023-11-17T06:33:43.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd1b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd1c15a290 0x7fdd1c150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd1b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd1c15a290 0x7fdd1c150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42274/0 (socket says 172.21.15.69:42274) 2023-11-17T06:33:43.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd1b7fe700 1 -- 172.21.15.69:0/2320208235 learned_addr learned my addr 172.21.15.69:0/2320208235 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:43.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd1affd700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c0b2870 0x7fdd1c14a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd13fff700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd1c0cb200 0x7fdd1c0c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd1b7fe700 1 -- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c0b2870 msgr2=0x7fdd1c14a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd1b7fe700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c0b2870 0x7fdd1c14a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd1b7fe700 1 -- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd1c0cb200 msgr2=0x7fdd1c0c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd1b7fe700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd1c0cb200 0x7fdd1c0c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd1b7fe700 1 -- 172.21.15.69:0/2320208235 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c009570 con 0x7fdd1c15a290 2023-11-17T06:33:43.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd13fff700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd1c0cb200 0x7fdd1c0c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:43.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd1b7fe700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd1c15a290 0x7fdd1c150930 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdd14014040 tx=0x7fdd14004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd137fe700 1 -- 172.21.15.69:0/2320208235 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14012430 con 0x7fdd1c15a290 2023-11-17T06:33:43.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd137fe700 1 -- 172.21.15.69:0/2320208235 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd14020070 con 0x7fdd1c15a290 2023-11-17T06:33:43.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd217d5700 1 -- 172.21.15.69:0/2320208235 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd14009a70 con 0x7fdd1c15a290 2023-11-17T06:33:43.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd137fe700 1 -- 172.21.15.69:0/2320208235 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14004280 con 0x7fdd1c15a290 2023-11-17T06:33:43.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd217d5700 1 -- 172.21.15.69:0/2320208235 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd1c14e020 con 0x7fdd1c15a290 2023-11-17T06:33:43.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.723+0000 7fdd217d5700 1 -- 172.21.15.69:0/2320208235 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1c0676d0 con 0x7fdd1c15a290 2023-11-17T06:33:43.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.727+0000 7fdd137fe700 1 -- 172.21.15.69:0/2320208235 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdd140043e0 con 0x7fdd1c15a290 2023-11-17T06:33:43.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.727+0000 7fdd137fe700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066510 0x7fdcfc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:43.733 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.727+0000 7fdd137fe700 1 -- 172.21.15.69:0/2320208235 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7fdd14022070 con 0x7fdd1c15a290 2023-11-17T06:33:43.734 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.727+0000 7fdd1affd700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066510 0x7fdcfc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:43.736 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.731+0000 7fdd1affd700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066510 0x7fdcfc0689d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c006d50 tx=0x7fdd0c0092e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:43.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.735+0000 7fdd137fe700 1 -- 172.21.15.69:0/2320208235 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdd14052f50 con 0x7fdd1c15a290 2023-11-17T06:33:43.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 -- 172.21.15.69:0/2320208235 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd1c0ccc40 con 0x7fdd1c15a290 2023-11-17T06:33:43.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd137fe700 1 -- 172.21.15.69:0/2320208235 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd1402c020 con 0x7fdd1c15a290 2023-11-17T06:33:43.912 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:33:43.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 -- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066510 msgr2=0x7fdcfc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066510 0x7fdcfc0689d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c006d50 tx=0x7fdd0c0092e0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 -- 172.21.15.69:0/2320208235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd1c15a290 msgr2=0x7fdd1c150930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:43.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd1c15a290 0x7fdd1c150930 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdd14014040 tx=0x7fdd14004af0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 -- 172.21.15.69:0/2320208235 shutdown_connections 2023-11-17T06:33:43.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdcfc066510 0x7fdcfc0689d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd1c15a290 0x7fdd1c150930 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd1c0cb200 0x7fdd1c0c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 --2- 172.21.15.69:0/2320208235 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdd1c0b2870 0x7fdd1c14a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:43.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.907+0000 7fdd217d5700 1 -- 172.21.15.69:0/2320208235 >> 172.21.15.69:0/2320208235 conn(0x7fdd1c0737c0 msgr2=0x7fdd1c14f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:43.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.911+0000 7fdd217d5700 1 -- 172.21.15.69:0/2320208235 shutdown_connections 2023-11-17T06:33:43.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:43.911+0000 7fdd217d5700 1 -- 172.21.15.69:0/2320208235 wait complete. 2023-11-17T06:33:43.935 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:33:44.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.115+0000 7fa6f32e2700 1 Processor -- start 2023-11-17T06:33:44.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.115+0000 7fa6f32e2700 1 -- start start 2023-11-17T06:33:44.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f32e2700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 0x7fa6ec142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f32e2700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa6ec1423e0 0x7fa6ec155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f32e2700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6ec0cca30 con 0x7fa6ec142000 2023-11-17T06:33:44.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f22e0700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa6ec142000 0x7fa6ec06b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39752/0 (socket says 172.21.15.69:39752) 2023-11-17T06:33:44.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f22e0700 1 -- 172.21.15.69:0/2937733439 learned_addr learned my addr 172.21.15.69:0/2937733439 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:44.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f32e2700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6ec0ccd10 con 0x7fa6ec1423e0 2023-11-17T06:33:44.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2937733439 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0ccff0 con 0x7fa6ec06d5d0 2023-11-17T06:33:44.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f2ae1700 1 --2- 172.21.15.69:0/2937733439 >> v2:172.21.15.69:3300/0 conn(0x7fa6ec1423e0 0x7fa6ec155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f12de700 1 -- 172.21.15.69:0/2937733439 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811753429 0 0) 0x7fa6ec0cca30 con 0x7fa6ec142000 2023-11-17T06:33:44.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f1adf700 1 --2- 172.21.15.69:0/2937733439 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 0x7fa6ec142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f12de700 1 -- 172.21.15.69:0/2937733439 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d80035d0 con 0x7fa6ec142000 2023-11-17T06:33:44.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f12de700 1 -- 172.21.15.69:0/2937733439 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4148938488 0 0) 0x7fa6d80035d0 con 0x7fa6ec142000 2023-11-17T06:33:44.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f2ae1700 1 -- 172.21.15.69:0/2937733439 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 msgr2=0x7fa6ec142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:44.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f2ae1700 1 --2- 172.21.15.69:0/2937733439 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 0x7fa6ec142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f2ae1700 1 -- 172.21.15.69:0/2937733439 >> v1:172.21.15.69:6789/0 conn(0x7fa6ec142000 legacy=0x7fa6ec06b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f2ae1700 1 -- 172.21.15.69:0/2937733439 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ec0cd2d0 con 0x7fa6ec1423e0 2023-11-17T06:33:44.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f2ae1700 1 --2- 172.21.15.69:0/2937733439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec1423e0 0x7fa6ec155300 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009d90 tx=0x7fa6e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69b4da941a229f74 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f12de700 1 -- 172.21.15.69:0/2937733439 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e400e070 con 0x7fa6ec1423e0 2023-11-17T06:33:44.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f12de700 1 -- 172.21.15.69:0/2937733439 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e4003a40 con 0x7fa6ec1423e0 2023-11-17T06:33:44.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.119+0000 7fa6f12de700 1 -- 172.21.15.69:0/2937733439 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8001670 con 0x7fa6ec1423e0 2023-11-17T06:33:44.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.123+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2937733439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec1423e0 msgr2=0x7fa6ec155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.123+0000 7fa6f32e2700 1 --2- 172.21.15.69:0/2937733439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec1423e0 0x7fa6ec155300 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009d90 tx=0x7fa6e400b330 comp rx=0 tx=0).stop 2023-11-17T06:33:44.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.123+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2937733439 shutdown_connections 2023-11-17T06:33:44.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.123+0000 7fa6f32e2700 1 --2- 172.21.15.69:0/2937733439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec1423e0 0x7fa6ec155300 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.123+0000 7fa6f32e2700 1 --2- 172.21.15.69:0/2937733439 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 0x7fa6ec142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.123+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2937733439 >> 172.21.15.69:0/2937733439 conn(0x7fa6ec0cedc0 msgr2=0x7fa6ec0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:44.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.123+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2937733439 shutdown_connections 2023-11-17T06:33:44.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.123+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2937733439 wait complete. 2023-11-17T06:33:44.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.123+0000 7fa6f32e2700 1 Processor -- start 2023-11-17T06:33:44.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.123+0000 7fa6f32e2700 1 -- start start 2023-11-17T06:33:44.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f32e2700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 0x7fa6ec154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f32e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec142000 0x7fa6ec15b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f32e2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6ec1423e0 0x7fa6ec15bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f32e2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec154870 con 0x7fa6ec142000 2023-11-17T06:33:44.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f32e2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0c89d0 con 0x7fa6ec1423e0 2023-11-17T06:33:44.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f32e2700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0c8cb0 con 0x7fa6ec06d5d0 2023-11-17T06:33:44.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f1adf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec142000 0x7fa6ec15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f1adf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec142000 0x7fa6ec15b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55570/0 (socket says 172.21.15.69:55570) 2023-11-17T06:33:44.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f1adf700 1 -- 172.21.15.69:0/2502003267 learned_addr learned my addr 172.21.15.69:0/2502003267 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:44.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f22e0700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 0x7fa6ec154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f2ae1700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6ec1423e0 0x7fa6ec15bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f1adf700 1 -- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 msgr2=0x7fa6ec154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f1adf700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 0x7fa6ec154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f1adf700 1 -- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6ec1423e0 msgr2=0x7fa6ec15bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f1adf700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6ec1423e0 0x7fa6ec15bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f1adf700 1 -- 172.21.15.69:0/2502003267 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4009a70 con 0x7fa6ec142000 2023-11-17T06:33:44.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f2ae1700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6ec1423e0 0x7fa6ec15bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:44.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f22e0700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 0x7fa6ec154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:44.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f1adf700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec142000 0x7fa6ec15b650 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00e9d0 tx=0x7fa6dc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6e2ffd700 1 -- 172.21.15.69:0/2502003267 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc009720 con 0x7fa6ec142000 2023-11-17T06:33:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6e2ffd700 1 -- 172.21.15.69:0/2502003267 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6dc00c850 con 0x7fa6ec142000 2023-11-17T06:33:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2502003267 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec15edb0 con 0x7fa6ec142000 2023-11-17T06:33:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6e2ffd700 1 -- 172.21.15.69:0/2502003267 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00cbc0 con 0x7fa6ec142000 2023-11-17T06:33:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.127+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2502003267 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec15f090 con 0x7fa6ec142000 2023-11-17T06:33:44.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.131+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2502003267 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ec04e650 con 0x7fa6ec142000 2023-11-17T06:33:44.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.131+0000 7fa6e2ffd700 1 -- 172.21.15.69:0/2502003267 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa6dc00cd20 con 0x7fa6ec142000 2023-11-17T06:33:44.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.131+0000 7fa6e2ffd700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa6d0066510 0x7fa6d00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.131+0000 7fa6e2ffd700 1 -- 172.21.15.69:0/2502003267 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7fa6dc0840d0 con 0x7fa6ec142000 2023-11-17T06:33:44.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.131+0000 7fa6f22e0700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa6d0066510 0x7fa6d00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.135+0000 7fa6f22e0700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa6d0066510 0x7fa6d00689d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8001860 tx=0x7fa6e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.139+0000 7fa6e2ffd700 1 -- 172.21.15.69:0/2502003267 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa6dc051430 con 0x7fa6ec142000 2023-11-17T06:33:44.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.319+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2502003267 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6ec0af160 con 0x7fa6ec142000 2023-11-17T06:33:44.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.319+0000 7fa6e2ffd700 1 -- 172.21.15.69:0/2502003267 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6dc054a50 con 0x7fa6ec142000 2023-11-17T06:33:44.324 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:33:44.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa6d0066510 msgr2=0x7fa6d00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa6d0066510 0x7fa6d00689d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8001860 tx=0x7fa6e8009040 comp rx=0 tx=0).stop 2023-11-17T06:33:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2502003267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec142000 msgr2=0x7fa6ec15b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec142000 0x7fa6ec15b650 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc00e9d0 tx=0x7fa6dc00ed90 comp rx=0 tx=0).stop 2023-11-17T06:33:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2502003267 shutdown_connections 2023-11-17T06:33:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa6d0066510 0x7fa6d00689d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6ec1423e0 0x7fa6ec15bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec142000 0x7fa6ec15b650 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 --2- 172.21.15.69:0/2502003267 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa6ec06d5d0 0x7fa6ec154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2502003267 >> 172.21.15.69:0/2502003267 conn(0x7fa6ec0cedc0 msgr2=0x7fa6ec0b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2502003267 shutdown_connections 2023-11-17T06:33:44.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.323+0000 7fa6f32e2700 1 -- 172.21.15.69:0/2502003267 wait complete. 2023-11-17T06:33:44.350 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-17T06:33:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.527+0000 7f2b54876700 1 Processor -- start 2023-11-17T06:33:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.527+0000 7f2b54876700 1 -- start start 2023-11-17T06:33:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.527+0000 7f2b54876700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 0x7f2b50071c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.527+0000 7f2b54876700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2b500c9c20 0x7f2b5006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.527+0000 7f2b54876700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b500704c0 con 0x7f2b5015c360 2023-11-17T06:33:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.527+0000 7f2b54876700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b500cb6c0 con 0x7f2b500c9c20 2023-11-17T06:33:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.527+0000 7f2b54876700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5015c7e0 con 0x7f2b5006d9f0 2023-11-17T06:33:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.527+0000 7f2b45d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f2b5015c360 0x7f2b500c9510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39756/0 (socket says 172.21.15.69:39756) 2023-11-17T06:33:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.527+0000 7f2b45d9b700 1 -- 172.21.15.69:0/1511734171 learned_addr learned my addr 172.21.15.69:0/1511734171 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4ed9d700 1 --2- 172.21.15.69:0/1511734171 >> v2:172.21.15.93:3300/0 conn(0x7f2b500c9c20 0x7f2b5006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4e59c700 1 --2- 172.21.15.69:0/1511734171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 0x7f2b50071c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4dd9b700 1 -- 172.21.15.69:0/1511734171 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856781440 0 0) 0x7f2b500704c0 con 0x7f2b5015c360 2023-11-17T06:33:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4dd9b700 1 -- 172.21.15.69:0/1511734171 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b3c0035d0 con 0x7f2b5015c360 2023-11-17T06:33:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4ed9d700 1 -- 172.21.15.69:0/1511734171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 msgr2=0x7f2b50071c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4ed9d700 1 --2- 172.21.15.69:0/1511734171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 0x7f2b50071c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4ed9d700 1 -- 172.21.15.69:0/1511734171 >> v1:172.21.15.69:6789/0 conn(0x7f2b5015c360 legacy=0x7f2b500c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4ed9d700 1 -- 172.21.15.69:0/1511734171 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b500cb100 con 0x7f2b500c9c20 2023-11-17T06:33:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4e59c700 1 --2- 172.21.15.69:0/1511734171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 0x7f2b50071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4ed9d700 1 --2- 172.21.15.69:0/1511734171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b500c9c20 0x7f2b5006bd80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009d90 tx=0x7f2b4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d1a4c9a9ece37c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4dd9b700 1 -- 172.21.15.69:0/1511734171 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b4800e070 con 0x7f2b500c9c20 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4dd9b700 1 -- 172.21.15.69:0/1511734171 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4800bb20 con 0x7f2b500c9c20 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b4dd9b700 1 -- 172.21.15.69:0/1511734171 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48012430 con 0x7f2b500c9c20 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b54876700 1 -- 172.21.15.69:0/1511734171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b500c9c20 msgr2=0x7f2b5006bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b54876700 1 --2- 172.21.15.69:0/1511734171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b500c9c20 0x7f2b5006bd80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2b48009d90 tx=0x7f2b4800b330 comp rx=0 tx=0).stop 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b54876700 1 -- 172.21.15.69:0/1511734171 shutdown_connections 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b54876700 1 --2- 172.21.15.69:0/1511734171 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b500c9c20 0x7f2b5006bd80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b54876700 1 --2- 172.21.15.69:0/1511734171 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 0x7f2b50071c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b54876700 1 -- 172.21.15.69:0/1511734171 >> 172.21.15.69:0/1511734171 conn(0x7f2b500ceec0 msgr2=0x7f2b500cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b54876700 1 -- 172.21.15.69:0/1511734171 shutdown_connections 2023-11-17T06:33:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.531+0000 7f2b54876700 1 -- 172.21.15.69:0/1511734171 wait complete. 2023-11-17T06:33:44.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.535+0000 7f2b54876700 1 Processor -- start 2023-11-17T06:33:44.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.535+0000 7f2b54876700 1 -- start start 2023-11-17T06:33:44.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b54876700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 0x7f2b501f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b54876700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b500c9c20 0x7f2b500c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b54876700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b5015c360 0x7f2b5014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b54876700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500c7160 con 0x7f2b5015c360 2023-11-17T06:33:44.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b54876700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b501f3800 con 0x7f2b500c9c20 2023-11-17T06:33:44.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b54876700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b500c6900 con 0x7f2b5006d9f0 2023-11-17T06:33:44.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b4ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b5015c360 0x7f2b5014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b4ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b5015c360 0x7f2b5014fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55582/0 (socket says 172.21.15.69:55582) 2023-11-17T06:33:44.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b4ed9d700 1 -- 172.21.15.69:0/1756780188 learned_addr learned my addr 172.21.15.69:0/1756780188 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:44.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b45d9b700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b500c9c20 0x7f2b500c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b4e59c700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 0x7f2b501f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b4ed9d700 1 -- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 msgr2=0x7f2b501f32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b4ed9d700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 0x7f2b501f32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b4ed9d700 1 -- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b500c9c20 msgr2=0x7f2b500c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b4ed9d700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b500c9c20 0x7f2b500c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b4ed9d700 1 -- 172.21.15.69:0/1756780188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400094b0 con 0x7f2b5015c360 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b45d9b700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b500c9c20 0x7f2b500c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b4ed9d700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b5015c360 0x7f2b5014fa60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2b48014040 tx=0x7f2b48004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b477fe700 1 -- 172.21.15.69:0/1756780188 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48012430 con 0x7f2b5015c360 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b477fe700 1 -- 172.21.15.69:0/1756780188 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b48020070 con 0x7f2b5015c360 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b54876700 1 -- 172.21.15.69:0/1756780188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b48009a70 con 0x7f2b5015c360 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b477fe700 1 -- 172.21.15.69:0/1756780188 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b48004280 con 0x7f2b5015c360 2023-11-17T06:33:44.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.539+0000 7f2b54876700 1 -- 172.21.15.69:0/1756780188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b500c6e80 con 0x7f2b5015c360 2023-11-17T06:33:44.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.543+0000 7f2b54876700 1 -- 172.21.15.69:0/1756780188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5004e6c0 con 0x7f2b5015c360 2023-11-17T06:33:44.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.543+0000 7f2b477fe700 1 -- 172.21.15.69:0/1756780188 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2b480043e0 con 0x7f2b5015c360 2023-11-17T06:33:44.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.543+0000 7f2b477fe700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b30066510 0x7f2b300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:44.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.543+0000 7f2b477fe700 1 -- 172.21.15.69:0/1756780188 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f2b48022070 con 0x7f2b5015c360 2023-11-17T06:33:44.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.543+0000 7f2b4e59c700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b30066510 0x7f2b300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:44.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.547+0000 7f2b4e59c700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b30066510 0x7f2b300689d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2b50070cc0 tx=0x7f2b40009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:44.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.551+0000 7f2b477fe700 1 -- 172.21.15.69:0/1756780188 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2b480532d0 con 0x7f2b5015c360 2023-11-17T06:33:44.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b54876700 1 -- 172.21.15.69:0/1756780188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2b5015bc10 con 0x7f2b5015c360 2023-11-17T06:33:44.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b477fe700 1 -- 172.21.15.69:0/1756780188 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v41) v1 ==== 80+0+244 (secure 0 0 0) 0x7f2b480568f0 con 0x7f2b5015c360 2023-11-17T06:33:44.744 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6835/1050522275 2023-11-18T06:33:30.515033+0000 2023-11-17T06:33:44.744 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6834/1050522275 2023-11-18T06:33:30.515033+0000 2023-11-17T06:33:44.744 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.93:6837/4181304583 2023-11-18T06:33:11.857552+0000 2023-11-17T06:33:44.744 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.93:6836/4181304583 2023-11-18T06:33:11.857552+0000 2023-11-17T06:33:44.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b54876700 1 -- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b30066510 msgr2=0x7f2b300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b54876700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b30066510 0x7f2b300689d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2b50070cc0 tx=0x7f2b40009240 comp rx=0 tx=0).stop 2023-11-17T06:33:44.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b54876700 1 -- 172.21.15.69:0/1756780188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b5015c360 msgr2=0x7f2b5014fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:44.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b54876700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b5015c360 0x7f2b5014fa60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2b48014040 tx=0x7f2b48004af0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b54876700 1 -- 172.21.15.69:0/1756780188 shutdown_connections 2023-11-17T06:33:44.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b54876700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2b30066510 0x7f2b300689d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b54876700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b5015c360 0x7f2b5014fa60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b54876700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2b500c9c20 0x7f2b500c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.739+0000 7f2b54876700 1 --2- 172.21.15.69:0/1756780188 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2b5006d9f0 0x7f2b501f32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:44.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.743+0000 7f2b54876700 1 -- 172.21.15.69:0/1756780188 >> 172.21.15.69:0/1756780188 conn(0x7f2b500ceec0 msgr2=0x7f2b5006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:44.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.743+0000 7f2b54876700 1 -- 172.21.15.69:0/1756780188 shutdown_connections 2023-11-17T06:33:44.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:44.743+0000 7f2b54876700 1 -- 172.21.15.69:0/1756780188 wait complete. 2023-11-17T06:33:44.750 INFO:teuthology.orchestra.run.smithi069.stderr:listed 4 entries 2023-11-17T06:33:44.768 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi069.front.sepia.ceph.com... 2023-11-17T06:33:44.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:44.769 DEBUG:teuthology.orchestra.run.smithi069:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-17T06:33:44.802 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[48007]: fuse finished with error 0 and tester_r 0 2023-11-17T06:33:44.809 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:33:44.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:44.810 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-17T06:33:44.995 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:33:44.996 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:45.015 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352148k,nr_inodes=4088037,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6763 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-17T06:33:45.015 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:33:45.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:45.015 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-17T06:33:45.078 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-17T06:33:45.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:33:45.079 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:33:45.079 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:45.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352148k,nr_inodes=4088037,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4305 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-17T06:33:45.100 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:33:45.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:45.100 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-17T06:33:45.164 INFO:teuthology.orchestra.run.smithi069.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-17T06:33:45.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:33:45.165 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:33:45.166 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:45.186 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352148k,nr_inodes=4088037,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6763 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-17T06:33:45.186 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:33:45.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:45.186 DEBUG:teuthology.orchestra.run.smithi093:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-17T06:33:45.248 INFO:teuthology.orchestra.run.smithi093.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-17T06:33:45.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:33:45.249 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:45.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.419+0000 7efc826f9700 1 Processor -- start 2023-11-17T06:33:45.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.419+0000 7efc826f9700 1 -- start start 2023-11-17T06:33:45.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.419+0000 7efc826f9700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c0c23f0 0x7efc7c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.419+0000 7efc826f9700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efc7c165e80 0x7efc7c165190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.419+0000 7efc826f9700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7c0cde30 con 0x7efc7c1656d0 2023-11-17T06:33:45.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.419+0000 7efc826f9700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c165b60 con 0x7efc7c165e80 2023-11-17T06:33:45.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.419+0000 7efc826f9700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0cd220 con 0x7efc7c0c23f0 2023-11-17T06:33:45.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.419+0000 7efc80ef6700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7efc7c165e80 0x7efc7c165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.419+0000 7efc816f7700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c0c23f0 0x7efc7c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc81ef8700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7efc7c1656d0 0x7efc7c161b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:33548/0 (socket says 172.21.15.69:33548) 2023-11-17T06:33:45.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc81ef8700 1 -- 172.21.15.69:0/3336231230 learned_addr learned my addr 172.21.15.69:0/3336231230 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:45.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc73fff700 1 -- 172.21.15.69:0/3336231230 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841564732 0 0) 0x7efc7c0cde30 con 0x7efc7c1656d0 2023-11-17T06:33:45.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc73fff700 1 -- 172.21.15.69:0/3336231230 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc680035d0 con 0x7efc7c1656d0 2023-11-17T06:33:45.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc80ef6700 1 -- 172.21.15.69:0/3336231230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c0c23f0 msgr2=0x7efc7c0cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:45.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc80ef6700 1 --2- 172.21.15.69:0/3336231230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c0c23f0 0x7efc7c0cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc80ef6700 1 -- 172.21.15.69:0/3336231230 >> v1:172.21.15.93:6789/0 conn(0x7efc7c1656d0 legacy=0x7efc7c161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc80ef6700 1 -- 172.21.15.69:0/3336231230 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0cd500 con 0x7efc7c165e80 2023-11-17T06:33:45.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc816f7700 1 --2- 172.21.15.69:0/3336231230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c0c23f0 0x7efc7c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:45.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc80ef6700 1 --2- 172.21.15.69:0/3336231230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c165e80 0x7efc7c165190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009850 tx=0x7efc6c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1a20770a2a87199 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc73fff700 1 -- 172.21.15.69:0/3336231230 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c011830 con 0x7efc7c165e80 2023-11-17T06:33:45.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc73fff700 1 -- 172.21.15.69:0/3336231230 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c011990 con 0x7efc7c165e80 2023-11-17T06:33:45.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc73fff700 1 -- 172.21.15.69:0/3336231230 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c011d40 con 0x7efc7c165e80 2023-11-17T06:33:45.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc826f9700 1 -- 172.21.15.69:0/3336231230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c165e80 msgr2=0x7efc7c165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc826f9700 1 --2- 172.21.15.69:0/3336231230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c165e80 0x7efc7c165190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009850 tx=0x7efc6c009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:45.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc826f9700 1 -- 172.21.15.69:0/3336231230 shutdown_connections 2023-11-17T06:33:45.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc826f9700 1 --2- 172.21.15.69:0/3336231230 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c165e80 0x7efc7c165190 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc826f9700 1 --2- 172.21.15.69:0/3336231230 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c0c23f0 0x7efc7c0cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.423+0000 7efc826f9700 1 -- 172.21.15.69:0/3336231230 >> 172.21.15.69:0/3336231230 conn(0x7efc7c0cece0 msgr2=0x7efc7c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:45.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.427+0000 7efc826f9700 1 -- 172.21.15.69:0/3336231230 shutdown_connections 2023-11-17T06:33:45.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.427+0000 7efc826f9700 1 -- 172.21.15.69:0/3336231230 wait complete. 2023-11-17T06:33:45.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.427+0000 7efc826f9700 1 Processor -- start 2023-11-17T06:33:45.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.427+0000 7efc826f9700 1 -- start start 2023-11-17T06:33:45.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.427+0000 7efc826f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc7c0c23f0 0x7efc7c0c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.427+0000 7efc826f9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c1656d0 0x7efc7c0c1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.427+0000 7efc826f9700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c165e80 0x7efc7c1fa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.427+0000 7efc826f9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c14cf80 con 0x7efc7c0c23f0 2023-11-17T06:33:45.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.427+0000 7efc826f9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0c5b20 con 0x7efc7c1656d0 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.427+0000 7efc826f9700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0c1a40 con 0x7efc7c165e80 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc816f7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc7c0c23f0 0x7efc7c0c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc816f7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc7c0c23f0 0x7efc7c0c55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55592/0 (socket says 172.21.15.69:55592) 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc816f7700 1 -- 172.21.15.69:0/2945481816 learned_addr learned my addr 172.21.15.69:0/2945481816 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc80ef6700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c1656d0 0x7efc7c0c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc81ef8700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c165e80 0x7efc7c1fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc816f7700 1 -- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c165e80 msgr2=0x7efc7c1fa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc816f7700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c165e80 0x7efc7c1fa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc816f7700 1 -- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c1656d0 msgr2=0x7efc7c0c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc816f7700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c1656d0 0x7efc7c0c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc816f7700 1 -- 172.21.15.69:0/2945481816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc780094b0 con 0x7efc7c0c23f0 2023-11-17T06:33:45.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc81ef8700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c165e80 0x7efc7c1fa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:45.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc80ef6700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c1656d0 0x7efc7c0c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:45.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc816f7700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc7c0c23f0 0x7efc7c0c55e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efc7800ebe0 tx=0x7efc78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc71ffb700 1 -- 172.21.15.69:0/2945481816 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7800c8b0 con 0x7efc7c0c23f0 2023-11-17T06:33:45.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc71ffb700 1 -- 172.21.15.69:0/2945481816 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7800ca10 con 0x7efc7c0c23f0 2023-11-17T06:33:45.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc826f9700 1 -- 172.21.15.69:0/2945481816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c0094b0 con 0x7efc7c0c23f0 2023-11-17T06:33:45.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc71ffb700 1 -- 172.21.15.69:0/2945481816 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7800cda0 con 0x7efc7c0c23f0 2023-11-17T06:33:45.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.431+0000 7efc826f9700 1 -- 172.21.15.69:0/2945481816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c0c80b0 con 0x7efc7c0c23f0 2023-11-17T06:33:45.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.435+0000 7efc826f9700 1 -- 172.21.15.69:0/2945481816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c04e650 con 0x7efc7c0c23f0 2023-11-17T06:33:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.435+0000 7efc71ffb700 1 -- 172.21.15.69:0/2945481816 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efc78013470 con 0x7efc7c0c23f0 2023-11-17T06:33:45.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.435+0000 7efc71ffb700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc60066540 0x7efc60068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.435+0000 7efc71ffb700 1 -- 172.21.15.69:0/2945481816 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7efc78084160 con 0x7efc7c0c23f0 2023-11-17T06:33:45.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.435+0000 7efc80ef6700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc60066540 0x7efc60068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.439+0000 7efc80ef6700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc60066540 0x7efc60068a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0090b0 tx=0x7efc6c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.439+0000 7efc71ffb700 1 -- 172.21.15.69:0/2945481816 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efc780513a0 con 0x7efc7c0c23f0 2023-11-17T06:33:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.647+0000 7efc826f9700 1 -- 172.21.15.69:0/2945481816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc7c0cafe0 con 0x7efc7c0c23f0 2023-11-17T06:33:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc71ffb700 1 -- 172.21.15.69:0/2945481816 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4911 (secure 0 0 0) 0x7efc780549c0 con 0x7efc7c0c23f0 2023-11-17T06:33:45.656 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:45.656 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:33:36.198455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":4,"addr":"172.21.15.69:6835/377943606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":377943606},{"type":"v1","addr":"172.21.15.69:6835","nonce":377943606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:45.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc826f9700 1 -- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc60066540 msgr2=0x7efc60068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc826f9700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc60066540 0x7efc60068a00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0090b0 tx=0x7efc6c008030 comp rx=0 tx=0).stop 2023-11-17T06:33:45.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc826f9700 1 -- 172.21.15.69:0/2945481816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc7c0c23f0 msgr2=0x7efc7c0c55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc826f9700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc7c0c23f0 0x7efc7c0c55e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efc7800ebe0 tx=0x7efc78009e30 comp rx=0 tx=0).stop 2023-11-17T06:33:45.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc826f9700 1 -- 172.21.15.69:0/2945481816 shutdown_connections 2023-11-17T06:33:45.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc826f9700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc60066540 0x7efc60068a00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc826f9700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc7c165e80 0x7efc7c1fa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc826f9700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c1656d0 0x7efc7c0c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc826f9700 1 --2- 172.21.15.69:0/2945481816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc7c0c23f0 0x7efc7c0c55e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.651+0000 7efc826f9700 1 -- 172.21.15.69:0/2945481816 >> 172.21.15.69:0/2945481816 conn(0x7efc7c0cece0 msgr2=0x7efc7c0cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:45.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.655+0000 7efc826f9700 1 -- 172.21.15.69:0/2945481816 shutdown_connections 2023-11-17T06:33:45.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.655+0000 7efc826f9700 1 -- 172.21.15.69:0/2945481816 wait complete. 2023-11-17T06:33:45.661 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2023-11-17T06:33:45.682 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:45.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.843+0000 7f4d120af700 1 Processor -- start 2023-11-17T06:33:45.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.843+0000 7f4d120af700 1 -- start start 2023-11-17T06:33:45.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d120af700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d0c0c23f0 0x7f4d0c0cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d120af700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0cde30 con 0x7f4d0c165e80 2023-11-17T06:33:45.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d120af700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0c0cd220 con 0x7f4d0c1658a0 2023-11-17T06:33:45.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d120af700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d0c0cd500 con 0x7f4d0c0c23f0 2023-11-17T06:33:45.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d110ad700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d0c0c23f0 0x7f4d0c0cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d108ac700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f4d0c165e80 0x7f4d0c165190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39758/0 (socket says 172.21.15.69:39758) 2023-11-17T06:33:45.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d108ac700 1 -- 172.21.15.69:0/3143072987 learned_addr learned my addr 172.21.15.69:0/3143072987 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:45.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d110ad700 1 -- 172.21.15.69:0/3143072987 >> v1:172.21.15.93:6789/0 conn(0x7f4d0c1658a0 legacy=0x7f4d0c0c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d110ad700 1 -- 172.21.15.69:0/3143072987 >> v1:172.21.15.69:6789/0 conn(0x7f4d0c165e80 legacy=0x7f4d0c165190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d110ad700 1 -- 172.21.15.69:0/3143072987 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c0cd7e0 con 0x7f4d0c0c23f0 2023-11-17T06:33:45.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d110ad700 1 --2- 172.21.15.69:0/3143072987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c0c23f0 0x7f4d0c0cc8b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009850 tx=0x7f4d08009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c8a1e462d91caf server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d03fff700 1 -- 172.21.15.69:0/3143072987 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08011830 con 0x7f4d0c0c23f0 2023-11-17T06:33:45.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d03fff700 1 -- 172.21.15.69:0/3143072987 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d08011990 con 0x7f4d0c0c23f0 2023-11-17T06:33:45.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.847+0000 7f4d03fff700 1 -- 172.21.15.69:0/3143072987 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08011d20 con 0x7f4d0c0c23f0 2023-11-17T06:33:45.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.851+0000 7f4d120af700 1 -- 172.21.15.69:0/3143072987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c0c23f0 msgr2=0x7f4d0c0cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.851+0000 7f4d120af700 1 --2- 172.21.15.69:0/3143072987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c0c23f0 0x7f4d0c0cc8b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009850 tx=0x7f4d08009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.851+0000 7f4d120af700 1 -- 172.21.15.69:0/3143072987 shutdown_connections 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.851+0000 7f4d120af700 1 --2- 172.21.15.69:0/3143072987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c0c23f0 0x7f4d0c0cc8b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.851+0000 7f4d120af700 1 -- 172.21.15.69:0/3143072987 >> 172.21.15.69:0/3143072987 conn(0x7f4d0c0cece0 msgr2=0x7f4d0c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.851+0000 7f4d120af700 1 -- 172.21.15.69:0/3143072987 shutdown_connections 2023-11-17T06:33:45.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.851+0000 7f4d120af700 1 -- 172.21.15.69:0/3143072987 wait complete. 2023-11-17T06:33:45.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.851+0000 7f4d120af700 1 Processor -- start 2023-11-17T06:33:45.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d120af700 1 -- start start 2023-11-17T06:33:45.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d120af700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d0c0c23f0 0x7f4d0c0c0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d120af700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d0c1658a0 0x7f4d0c0be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d120af700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c165e80 0x7f4d0c06c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d120af700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0c09c0 con 0x7f4d0c165e80 2023-11-17T06:33:45.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d120af700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0c0ca0 con 0x7f4d0c0c23f0 2023-11-17T06:33:45.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d120af700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0c0c0f80 con 0x7f4d0c1658a0 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d118ae700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c165e80 0x7f4d0c06c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d118ae700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c165e80 0x7f4d0c06c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55598/0 (socket says 172.21.15.69:55598) 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d118ae700 1 -- 172.21.15.69:0/4251583628 learned_addr learned my addr 172.21.15.69:0/4251583628 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d110ad700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d0c0c23f0 0x7f4d0c0c0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d108ac700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d0c1658a0 0x7f4d0c0be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d118ae700 1 -- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d0c1658a0 msgr2=0x7f4d0c0be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d118ae700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d0c1658a0 0x7f4d0c0be8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d118ae700 1 -- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d0c0c23f0 msgr2=0x7f4d0c0c0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d118ae700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d0c0c23f0 0x7f4d0c0c0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d118ae700 1 -- 172.21.15.69:0/4251583628 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d080094b0 con 0x7f4d0c165e80 2023-11-17T06:33:45.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d118ae700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c165e80 0x7f4d0c06c460 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400cc50 tx=0x7f4d0400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d01ffb700 1 -- 172.21.15.69:0/4251583628 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04003c20 con 0x7f4d0c165e80 2023-11-17T06:33:45.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d01ffb700 1 -- 172.21.15.69:0/4251583628 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d04003d80 con 0x7f4d0c165e80 2023-11-17T06:33:45.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d120af700 1 -- 172.21.15.69:0/4251583628 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c0c1260 con 0x7f4d0c165e80 2023-11-17T06:33:45.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.855+0000 7f4d01ffb700 1 -- 172.21.15.69:0/4251583628 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0400aab0 con 0x7f4d0c165e80 2023-11-17T06:33:45.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.859+0000 7f4d120af700 1 -- 172.21.15.69:0/4251583628 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d0c0bee20 con 0x7f4d0c165e80 2023-11-17T06:33:45.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.859+0000 7f4d120af700 1 -- 172.21.15.69:0/4251583628 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0c0cfc80 con 0x7f4d0c165e80 2023-11-17T06:33:45.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.859+0000 7f4d01ffb700 1 -- 172.21.15.69:0/4251583628 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4d0400ac10 con 0x7f4d0c165e80 2023-11-17T06:33:45.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.863+0000 7f4d01ffb700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4cf0066510 0x7f4cf00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:45.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.863+0000 7f4d01ffb700 1 -- 172.21.15.69:0/4251583628 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f4d04083f30 con 0x7f4d0c165e80 2023-11-17T06:33:45.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.863+0000 7f4d110ad700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4cf0066510 0x7f4cf00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:45.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.863+0000 7f4d110ad700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4cf0066510 0x7f4cf00689d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009fd0 tx=0x7f4d08008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:45.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:45.867+0000 7f4d01ffb700 1 -- 172.21.15.69:0/4251583628 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f4d04051280 con 0x7f4d0c165e80 2023-11-17T06:33:46.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.043+0000 7f4d120af700 1 -- 172.21.15.69:0/4251583628 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d0c0c1780 con 0x7f4d0c165e80 2023-11-17T06:33:46.051 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d01ffb700 1 -- 172.21.15.69:0/4251583628 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16933 (secure 0 0 0) 0x7f4d0c0c1780 con 0x7f4d0c165e80 2023-11-17T06:33:46.052 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:46.052 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":41,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:33:30.515083+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6835/1050522275":"2023-11-18T06:33:30.515033+0000","172.21.15.69:6834/1050522275":"2023-11-18T06:33:30.515033+0000","172.21.15.93:6837/4181304583":"2023-11-18T06:33:11.857552+0000","172.21.15.93:6836/4181304583":"2023-11-18T06:33:11.857552+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:46.054 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d120af700 1 -- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4cf0066510 msgr2=0x7f4cf00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d120af700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4cf0066510 0x7f4cf00689d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4d08009fd0 tx=0x7f4d08008030 comp rx=0 tx=0).stop 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d120af700 1 -- 172.21.15.69:0/4251583628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c165e80 msgr2=0x7f4d0c06c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d120af700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c165e80 0x7f4d0c06c460 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400cc50 tx=0x7f4d0400cf60 comp rx=0 tx=0).stop 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d120af700 1 -- 172.21.15.69:0/4251583628 shutdown_connections 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d120af700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4cf0066510 0x7f4cf00689d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d120af700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d0c165e80 0x7f4d0c06c460 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d120af700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d0c1658a0 0x7f4d0c0be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d120af700 1 --2- 172.21.15.69:0/4251583628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d0c0c23f0 0x7f4d0c0c0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.047+0000 7f4d120af700 1 -- 172.21.15.69:0/4251583628 >> 172.21.15.69:0/4251583628 conn(0x7f4d0c0cece0 msgr2=0x7f4d0c163f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.051+0000 7f4d120af700 1 -- 172.21.15.69:0/4251583628 shutdown_connections 2023-11-17T06:33:46.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.051+0000 7f4d120af700 1 -- 172.21.15.69:0/4251583628 wait complete. 2023-11-17T06:33:46.075 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-17T06:29:46.467332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-17T06:31:23.624321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-17T06:31:24.717590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-17T06:33:46.076 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-17T06:33:46.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.251+0000 7f606820f700 1 Processor -- start 2023-11-17T06:33:46.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.251+0000 7f606820f700 1 -- start start 2023-11-17T06:33:46.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f606820f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 0x7f606015d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f606820f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606015ddc0 con 0x7f60600b8c40 2023-11-17T06:33:46.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f606820f700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606015e050 con 0x7f60600b9080 2023-11-17T06:33:46.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f606820f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606015e330 con 0x7f606015d4a0 2023-11-17T06:33:46.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f60657aa700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f60600b8c40 0x7f60600ce060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39762/0 (socket says 172.21.15.69:39762) 2023-11-17T06:33:46.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f60657aa700 1 -- 172.21.15.69:0/571203505 learned_addr learned my addr 172.21.15.69:0/571203505 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:46.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f6065fab700 1 --2- 172.21.15.69:0/571203505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 0x7f606015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f6065fab700 1 -- 172.21.15.69:0/571203505 >> v1:172.21.15.93:6789/0 conn(0x7f60600b9080 legacy=0x7f60600d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f6065fab700 1 -- 172.21.15.69:0/571203505 >> v1:172.21.15.69:6789/0 conn(0x7f60600b8c40 legacy=0x7f60600ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f6065fab700 1 -- 172.21.15.69:0/571203505 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f606015e610 con 0x7f606015d4a0 2023-11-17T06:33:46.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.255+0000 7f6065fab700 1 --2- 172.21.15.69:0/571203505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 0x7f606015d880 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f605c009880 tx=0x7f605c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb7c1b4d93dc5096 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.259+0000 7f6064fa9700 1 -- 172.21.15.69:0/571203505 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c011830 con 0x7f606015d4a0 2023-11-17T06:33:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.259+0000 7f6064fa9700 1 -- 172.21.15.69:0/571203505 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c011990 con 0x7f606015d4a0 2023-11-17T06:33:46.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.259+0000 7f6064fa9700 1 -- 172.21.15.69:0/571203505 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c011d20 con 0x7f606015d4a0 2023-11-17T06:33:46.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.263+0000 7f606820f700 1 -- 172.21.15.69:0/571203505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 msgr2=0x7f606015d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.263+0000 7f606820f700 1 --2- 172.21.15.69:0/571203505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 0x7f606015d880 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f605c009880 tx=0x7f605c009b90 comp rx=0 tx=0).stop 2023-11-17T06:33:46.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.263+0000 7f606820f700 1 -- 172.21.15.69:0/571203505 shutdown_connections 2023-11-17T06:33:46.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.263+0000 7f606820f700 1 --2- 172.21.15.69:0/571203505 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 0x7f606015d880 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.263+0000 7f606820f700 1 -- 172.21.15.69:0/571203505 >> 172.21.15.69:0/571203505 conn(0x7f606006b830 msgr2=0x7f606006bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.263+0000 7f606820f700 1 -- 172.21.15.69:0/571203505 shutdown_connections 2023-11-17T06:33:46.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.263+0000 7f606820f700 1 -- 172.21.15.69:0/571203505 wait complete. 2023-11-17T06:33:46.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.263+0000 7f606820f700 1 Processor -- start 2023-11-17T06:33:46.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.263+0000 7f606820f700 1 -- start start 2023-11-17T06:33:46.271 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f606820f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60600b8c40 0x7f606014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f606820f700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 0x7f6060158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f606820f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6060159020 0x7f60601594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f606820f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60600a9e40 con 0x7f60600b8c40 2023-11-17T06:33:46.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f606820f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606014dc10 con 0x7f6060159020 2023-11-17T06:33:46.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f606820f700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f606015ad10 con 0x7f606015d4a0 2023-11-17T06:33:46.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f6065fab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60600b8c40 0x7f606014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f6065fab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60600b8c40 0x7f606014d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55614/0 (socket says 172.21.15.69:55614) 2023-11-17T06:33:46.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f6065fab700 1 -- 172.21.15.69:0/1838208998 learned_addr learned my addr 172.21.15.69:0/1838208998 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:46.272 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f60657aa700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 0x7f6060158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f60667ac700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6060159020 0x7f60601594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f6065fab700 1 -- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 msgr2=0x7f6060158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f6065fab700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 0x7f6060158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f6065fab700 1 -- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6060159020 msgr2=0x7f60601594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f6065fab700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6060159020 0x7f60601594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f6065fab700 1 -- 172.21.15.69:0/1838208998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c0094b0 con 0x7f60600b8c40 2023-11-17T06:33:46.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f60657aa700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 0x7f6060158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:46.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f6065fab700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60600b8c40 0x7f606014d6d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f605c0090b0 tx=0x7f605c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f60567fc700 1 -- 172.21.15.69:0/1838208998 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c0036c0 con 0x7f60600b8c40 2023-11-17T06:33:46.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f60567fc700 1 -- 172.21.15.69:0/1838208998 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605c01e070 con 0x7f60600b8c40 2023-11-17T06:33:46.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f606820f700 1 -- 172.21.15.69:0/1838208998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606015aff0 con 0x7f60600b8c40 2023-11-17T06:33:46.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f60567fc700 1 -- 172.21.15.69:0/1838208998 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605c003a80 con 0x7f60600b8c40 2023-11-17T06:33:46.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.267+0000 7f606820f700 1 -- 172.21.15.69:0/1838208998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60601f4440 con 0x7f60600b8c40 2023-11-17T06:33:46.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.271+0000 7f606820f700 1 -- 172.21.15.69:0/1838208998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f606015b510 con 0x7f60600b8c40 2023-11-17T06:33:46.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.271+0000 7f60567fc700 1 -- 172.21.15.69:0/1838208998 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f605c02d450 con 0x7f60600b8c40 2023-11-17T06:33:46.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.275+0000 7f60567fc700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6044066540 0x7f6044068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.275+0000 7f60567fc700 1 -- 172.21.15.69:0/1838208998 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f605c085170 con 0x7f60600b8c40 2023-11-17T06:33:46.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.275+0000 7f60657aa700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6044066540 0x7f6044068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.280 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.275+0000 7f60657aa700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6044066540 0x7f6044068a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f60600b7770 tx=0x7f6050009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.279+0000 7f60567fc700 1 -- 172.21.15.69:0/1838208998 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f606015b510 con 0x7f60600b8c40 2023-11-17T06:33:46.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.451+0000 7f606820f700 1 -- 172.21.15.69:0/1838208998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f606015b510 con 0x7f60600b8c40 2023-11-17T06:33:46.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.455+0000 7f60567fc700 1 -- 172.21.15.69:0/1838208998 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f606015b510 con 0x7f60600b8c40 2023-11-17T06:33:46.460 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-11-17T06:33:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 -- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6044066540 msgr2=0x7f6044068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6044066540 0x7f6044068a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f60600b7770 tx=0x7f6050009040 comp rx=0 tx=0).stop 2023-11-17T06:33:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 -- 172.21.15.69:0/1838208998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60600b8c40 msgr2=0x7f606014d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60600b8c40 0x7f606014d6d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f605c0090b0 tx=0x7f605c004770 comp rx=0 tx=0).stop 2023-11-17T06:33:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 -- 172.21.15.69:0/1838208998 shutdown_connections 2023-11-17T06:33:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6044066540 0x7f6044068a00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6060159020 0x7f60601594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f606015d4a0 0x7f6060158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 --2- 172.21.15.69:0/1838208998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60600b8c40 0x7f606014d6d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 -- 172.21.15.69:0/1838208998 >> 172.21.15.69:0/1838208998 conn(0x7f606006b830 msgr2=0x7f60600b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 -- 172.21.15.69:0/1838208998 shutdown_connections 2023-11-17T06:33:46.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.459+0000 7f606820f700 1 -- 172.21.15.69:0/1838208998 wait complete. 2023-11-17T06:33:46.485 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-17T06:33:46.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.655+0000 7efc61924700 1 Processor -- start 2023-11-17T06:33:46.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.655+0000 7efc61924700 1 -- start start 2023-11-17T06:33:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.655+0000 7efc61924700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 0x7efc5c15dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc61924700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5c15e720 con 0x7efc5c15e2e0 2023-11-17T06:33:46.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc61924700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5c06db30 con 0x7efc5c15a330 2023-11-17T06:33:46.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc61924700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c070800 con 0x7efc5c159f50 2023-11-17T06:33:46.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc5b7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7efc5c15e2e0 0x7efc5c06d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39774/0 (socket says 172.21.15.69:39774) 2023-11-17T06:33:46.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc5b7fe700 1 -- 172.21.15.69:0/527304715 learned_addr learned my addr 172.21.15.69:0/527304715 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc5affd700 1 --2- 172.21.15.69:0/527304715 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 0x7efc5c15dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc59ffb700 1 -- 172.21.15.69:0/527304715 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1460923169 0 0) 0x7efc5c15e720 con 0x7efc5c15e2e0 2023-11-17T06:33:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc59ffb700 1 -- 172.21.15.69:0/527304715 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc440035d0 con 0x7efc5c15e2e0 2023-11-17T06:33:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc59ffb700 1 -- 172.21.15.69:0/527304715 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856171798 0 0) 0x7efc5c06db30 con 0x7efc5c15a330 2023-11-17T06:33:46.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc59ffb700 1 -- 172.21.15.69:0/527304715 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc5c15e720 con 0x7efc5c15a330 2023-11-17T06:33:46.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc5affd700 1 -- 172.21.15.69:0/527304715 >> v1:172.21.15.93:6789/0 conn(0x7efc5c15a330 legacy=0x7efc5c0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc5affd700 1 -- 172.21.15.69:0/527304715 >> v1:172.21.15.69:6789/0 conn(0x7efc5c15e2e0 legacy=0x7efc5c06d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc5affd700 1 -- 172.21.15.69:0/527304715 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c070aa0 con 0x7efc5c159f50 2023-11-17T06:33:46.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc5affd700 1 --2- 172.21.15.69:0/527304715 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 0x7efc5c15dda0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009880 tx=0x7efc4c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9929ade29a36b5c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc59ffb700 1 -- 172.21.15.69:0/527304715 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c011830 con 0x7efc5c159f50 2023-11-17T06:33:46.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc59ffb700 1 -- 172.21.15.69:0/527304715 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c011990 con 0x7efc5c159f50 2023-11-17T06:33:46.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.659+0000 7efc59ffb700 1 -- 172.21.15.69:0/527304715 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c011d20 con 0x7efc5c159f50 2023-11-17T06:33:46.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.663+0000 7efc61924700 1 -- 172.21.15.69:0/527304715 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 msgr2=0x7efc5c15dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.663+0000 7efc61924700 1 --2- 172.21.15.69:0/527304715 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 0x7efc5c15dda0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efc4c009880 tx=0x7efc4c009b90 comp rx=0 tx=0).stop 2023-11-17T06:33:46.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.663+0000 7efc61924700 1 -- 172.21.15.69:0/527304715 shutdown_connections 2023-11-17T06:33:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.663+0000 7efc61924700 1 --2- 172.21.15.69:0/527304715 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 0x7efc5c15dda0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.663+0000 7efc61924700 1 -- 172.21.15.69:0/527304715 >> 172.21.15.69:0/527304715 conn(0x7efc5c0cedc0 msgr2=0x7efc5c0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.663+0000 7efc61924700 1 -- 172.21.15.69:0/527304715 shutdown_connections 2023-11-17T06:33:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.663+0000 7efc61924700 1 -- 172.21.15.69:0/527304715 wait complete. 2023-11-17T06:33:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.663+0000 7efc61924700 1 Processor -- start 2023-11-17T06:33:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.663+0000 7efc61924700 1 -- start start 2023-11-17T06:33:46.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.663+0000 7efc61924700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 0x7efc5c15c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc61924700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c15a330 0x7efc5c14a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc61924700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc5c15e2e0 0x7efc5c0ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc61924700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0c6250 con 0x7efc5c15a330 2023-11-17T06:33:46.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc61924700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c15b870 con 0x7efc5c15e2e0 2023-11-17T06:33:46.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc61924700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0c7ce0 con 0x7efc5c159f50 2023-11-17T06:33:46.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c15a330 0x7efc5c14a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c15a330 0x7efc5c14a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55624/0 (socket says 172.21.15.69:55624) 2023-11-17T06:33:46.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5a7fc700 1 -- 172.21.15.69:0/2618699027 learned_addr learned my addr 172.21.15.69:0/2618699027 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:46.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5affd700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 0x7efc5c15c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5b7fe700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc5c15e2e0 0x7efc5c0ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5a7fc700 1 -- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 msgr2=0x7efc5c15c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5a7fc700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 0x7efc5c15c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5a7fc700 1 -- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc5c15e2e0 msgr2=0x7efc5c0ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5a7fc700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc5c15e2e0 0x7efc5c0ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5a7fc700 1 -- 172.21.15.69:0/2618699027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c0094b0 con 0x7efc5c15a330 2023-11-17T06:33:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5affd700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 0x7efc5c15c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc5a7fc700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c15a330 0x7efc5c14a2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efc5000c490 tx=0x7efc5000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc43fff700 1 -- 172.21.15.69:0/2618699027 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc500052d0 con 0x7efc5c15a330 2023-11-17T06:33:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc43fff700 1 -- 172.21.15.69:0/2618699027 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc50005450 con 0x7efc5c15a330 2023-11-17T06:33:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc43fff700 1 -- 172.21.15.69:0/2618699027 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc500038e0 con 0x7efc5c15a330 2023-11-17T06:33:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc61924700 1 -- 172.21.15.69:0/2618699027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c15bac0 con 0x7efc5c15a330 2023-11-17T06:33:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc61924700 1 -- 172.21.15.69:0/2618699027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c15c080 con 0x7efc5c15a330 2023-11-17T06:33:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.667+0000 7efc61924700 1 -- 172.21.15.69:0/2618699027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c15c2a0 con 0x7efc5c15a330 2023-11-17T06:33:46.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.671+0000 7efc43fff700 1 -- 172.21.15.69:0/2618699027 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7efc50003a40 con 0x7efc5c15a330 2023-11-17T06:33:46.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.675+0000 7efc43fff700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc48066510 0x7efc480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:46.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.675+0000 7efc43fff700 1 -- 172.21.15.69:0/2618699027 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7efc50083460 con 0x7efc5c15a330 2023-11-17T06:33:46.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.675+0000 7efc5affd700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc48066510 0x7efc480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:46.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.675+0000 7efc5affd700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc48066510 0x7efc480689d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0090b0 tx=0x7efc4c01c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:46.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.679+0000 7efc43fff700 1 -- 172.21.15.69:0/2618699027 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7efc500507b0 con 0x7efc5c15a330 2023-11-17T06:33:46.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.859+0000 7efc61924700 1 -- 172.21.15.69:0/2618699027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc5c04e650 con 0x7efc5c15a330 2023-11-17T06:33:46.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc43fff700 1 -- 172.21.15.69:0/2618699027 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc50053dd0 con 0x7efc5c15a330 2023-11-17T06:33:46.867 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-11-17T06:33:46.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 -- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc48066510 msgr2=0x7efc480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc48066510 0x7efc480689d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0090b0 tx=0x7efc4c01c040 comp rx=0 tx=0).stop 2023-11-17T06:33:46.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 -- 172.21.15.69:0/2618699027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c15a330 msgr2=0x7efc5c14a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:46.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c15a330 0x7efc5c14a2f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efc5000c490 tx=0x7efc5000c850 comp rx=0 tx=0).stop 2023-11-17T06:33:46.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 -- 172.21.15.69:0/2618699027 shutdown_connections 2023-11-17T06:33:46.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7efc48066510 0x7efc480689d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc5c15e2e0 0x7efc5c0ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc5c15a330 0x7efc5c14a2f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 --2- 172.21.15.69:0/2618699027 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7efc5c159f50 0x7efc5c15c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:46.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 -- 172.21.15.69:0/2618699027 >> 172.21.15.69:0/2618699027 conn(0x7efc5c0cedc0 msgr2=0x7efc5c06fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:46.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 -- 172.21.15.69:0/2618699027 shutdown_connections 2023-11-17T06:33:46.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:46.863+0000 7efc61924700 1 -- 172.21.15.69:0/2618699027 wait complete. 2023-11-17T06:33:46.893 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-17T06:33:47.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.063+0000 7f86fc6db700 1 Processor -- start 2023-11-17T06:33:47.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.063+0000 7f86fc6db700 1 -- start start 2023-11-17T06:33:47.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86fc6db700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f86f40caac0 0x7f86f4071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.073 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86fc6db700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86f406c870 0x7f86f406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86fc6db700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f4144e80 con 0x7f86f406bd80 2023-11-17T06:33:47.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86fc6db700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f406d200 con 0x7f86f40caac0 2023-11-17T06:33:47.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86fc6db700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40c95d0 con 0x7f86f406c870 2023-11-17T06:33:47.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86fa477700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f86f406bd80 0x7f86f406c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39788/0 (socket says 172.21.15.69:39788) 2023-11-17T06:33:47.074 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86fa477700 1 -- 172.21.15.69:0/3910384784 learned_addr learned my addr 172.21.15.69:0/3910384784 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:47.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86f9c76700 1 --2- 172.21.15.69:0/3910384784 >> v2:172.21.15.69:3300/0 conn(0x7f86f40caac0 0x7f86f4071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375920272 0 0) 0x7f86f4144e80 con 0x7f86f406bd80 2023-11-17T06:33:47.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86fac78700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86f406c870 0x7f86f406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86e00035d0 con 0x7f86f406bd80 2023-11-17T06:33:47.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 453534906 0 0) 0x7f86e00035d0 con 0x7f86f406bd80 2023-11-17T06:33:47.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86f406c870 msgr2=0x7f86f406ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:47.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.067+0000 7f86f9475700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86f406c870 0x7f86f406ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 >> v2:172.21.15.69:3300/0 conn(0x7f86f40caac0 msgr2=0x7f86f4071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:47.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 --2- 172.21.15.69:0/3910384784 >> v2:172.21.15.69:3300/0 conn(0x7f86f40caac0 0x7f86f4071db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f406d400 con 0x7f86f406bd80 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f86f0001690 con 0x7f86f406bd80 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 >> v1:172.21.15.69:6789/0 conn(0x7f86f406bd80 legacy=0x7f86f406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86e0003a20 0x7f86e0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86f406c870 0x7f86e0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e0004db0 0x7f86e0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f406d200 con 0x7f86e0004db0 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40c95d0 con 0x7f86e0003a20 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e000ba30 con 0x7f86f406c870 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fac78700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e0004db0 0x7f86e0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fa477700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86e0003a20 0x7f86e0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9c76700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86f406c870 0x7f86e0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fac78700 1 -- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86f406c870 msgr2=0x7f86e0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:47.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fac78700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86f406c870 0x7f86e0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fac78700 1 -- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86e0003a20 msgr2=0x7f86e0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:47.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fac78700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86e0003a20 0x7f86e0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fac78700 1 -- 172.21.15.69:0/3910384784 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e00035d0 con 0x7f86e0004db0 2023-11-17T06:33:47.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9c76700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86f406c870 0x7f86e0004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:47.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fa477700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86e0003a20 0x7f86e0003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:47.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fac78700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e0004db0 0x7f86e0005230 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009fa0 tx=0x7f86e00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc997c540f01032b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:47.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec003a40 con 0x7f86e0004db0 2023-11-17T06:33:47.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec00f040 con 0x7f86e0004db0 2023-11-17T06:33:47.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86f9475700 1 -- 172.21.15.69:0/3910384784 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec003de0 con 0x7f86e0004db0 2023-11-17T06:33:47.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fc6db700 1 -- 172.21.15.69:0/3910384784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e0004db0 msgr2=0x7f86e0005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fc6db700 1 --2- 172.21.15.69:0/3910384784 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86e0004db0 0x7f86e0005230 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009fa0 tx=0x7f86e00058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.071+0000 7f86fac78700 1 -- 172.21.15.69:0/3910384784 reap_dead start 2023-11-17T06:33:47.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.075+0000 7f86fc6db700 1 -- 172.21.15.69:0/3910384784 shutdown_connections 2023-11-17T06:33:47.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.075+0000 7f86fc6db700 1 -- 172.21.15.69:0/3910384784 >> 172.21.15.69:0/3910384784 conn(0x7f86f40ceee0 msgr2=0x7f86f40cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:47.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.075+0000 7f86fc6db700 1 -- 172.21.15.69:0/3910384784 shutdown_connections 2023-11-17T06:33:47.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.075+0000 7f86fc6db700 1 -- 172.21.15.69:0/3910384784 wait complete. 2023-11-17T06:33:47.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.075+0000 7f86fc6db700 1 Processor -- start 2023-11-17T06:33:47.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.075+0000 7f86fc6db700 1 -- start start 2023-11-17T06:33:47.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fc6db700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86e0004db0 0x7f86f41f34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fc6db700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86f40bc190 0x7f86f415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fc6db700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86f40c39c0 0x7f86f40c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fc6db700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40c4380 con 0x7f86f40bc190 2023-11-17T06:33:47.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fc6db700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41f3a30 con 0x7f86f40c39c0 2023-11-17T06:33:47.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fc6db700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40ccfa0 con 0x7f86e0004db0 2023-11-17T06:33:47.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86f9c76700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86f40bc190 0x7f86f415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86f9c76700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86f40bc190 0x7f86f415acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55664/0 (socket says 172.21.15.69:55664) 2023-11-17T06:33:47.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86f9c76700 1 -- 172.21.15.69:0/1237021094 learned_addr learned my addr 172.21.15.69:0/1237021094 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fac78700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86f40c39c0 0x7f86f40c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fa477700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86e0004db0 0x7f86f41f34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86f9c76700 1 -- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86e0004db0 msgr2=0x7f86f41f34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86f9c76700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86e0004db0 0x7f86f41f34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86f9c76700 1 -- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86f40c39c0 msgr2=0x7f86f40c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86f9c76700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86f40c39c0 0x7f86f40c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86f9c76700 1 -- 172.21.15.69:0/1237021094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f40bc9e0 con 0x7f86f40bc190 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fac78700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86f40c39c0 0x7f86f40c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86f9c76700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86f40bc190 0x7f86f415acf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f86e40118d0 tx=0x7f86e4011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86eaffd700 1 -- 172.21.15.69:0/1237021094 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4004220 con 0x7f86f40bc190 2023-11-17T06:33:47.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86eaffd700 1 -- 172.21.15.69:0/1237021094 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e4004380 con 0x7f86f40bc190 2023-11-17T06:33:47.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86eaffd700 1 -- 172.21.15.69:0/1237021094 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e40036c0 con 0x7f86f40bc190 2023-11-17T06:33:47.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fc6db700 1 -- 172.21.15.69:0/1237021094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f40bccc0 con 0x7f86f40bc190 2023-11-17T06:33:47.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.079+0000 7f86fc6db700 1 -- 172.21.15.69:0/1237021094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f40bd280 con 0x7f86f40bc190 2023-11-17T06:33:47.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.083+0000 7f86fc6db700 1 -- 172.21.15.69:0/1237021094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f40cd150 con 0x7f86f40bc190 2023-11-17T06:33:47.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.083+0000 7f86eaffd700 1 -- 172.21.15.69:0/1237021094 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f86e4003820 con 0x7f86f40bc190 2023-11-17T06:33:47.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.083+0000 7f86eaffd700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f86d8066510 0x7f86d80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.083+0000 7f86eaffd700 1 -- 172.21.15.69:0/1237021094 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f86e4084840 con 0x7f86f40bc190 2023-11-17T06:33:47.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.087+0000 7f86fa477700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f86d8066510 0x7f86d80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.087+0000 7f86fa477700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f86d8066510 0x7f86d80689d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f86f0000fd0 tx=0x7f86f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:47.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.091+0000 7f86eaffd700 1 -- 172.21.15.69:0/1237021094 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f86f40cd150 con 0x7f86f40bc190 2023-11-17T06:33:47.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.263+0000 7f86fc6db700 1 -- 172.21.15.69:0/1237021094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86f40cd110 con 0x7f86f40bc190 2023-11-17T06:33:47.270 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.263+0000 7f86eaffd700 1 -- 172.21.15.69:0/1237021094 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86e4022020 con 0x7f86f40bc190 2023-11-17T06:33:47.270 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-11-17T06:33:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 -- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f86d8066510 msgr2=0x7f86d80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f86d8066510 0x7f86d80689d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f86f0000fd0 tx=0x7f86f0009040 comp rx=0 tx=0).stop 2023-11-17T06:33:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 -- 172.21.15.69:0/1237021094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86f40bc190 msgr2=0x7f86f415acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86f40bc190 0x7f86f415acf0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f86e40118d0 tx=0x7f86e4011c90 comp rx=0 tx=0).stop 2023-11-17T06:33:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 -- 172.21.15.69:0/1237021094 shutdown_connections 2023-11-17T06:33:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f86d8066510 0x7f86d80689d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86f40c39c0 0x7f86f40c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86f40bc190 0x7f86f415acf0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 --2- 172.21.15.69:0/1237021094 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f86e0004db0 0x7f86f41f34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 -- 172.21.15.69:0/1237021094 >> 172.21.15.69:0/1237021094 conn(0x7f86f40ceee0 msgr2=0x7f86f415cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:47.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 -- 172.21.15.69:0/1237021094 shutdown_connections 2023-11-17T06:33:47.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.267+0000 7f86fc6db700 1 -- 172.21.15.69:0/1237021094 wait complete. 2023-11-17T06:33:47.294 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:47.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.459+0000 7f9adabfa700 1 Processor -- start 2023-11-17T06:33:47.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9adabfa700 1 -- start start 2023-11-17T06:33:47.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9adabfa700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9ad415d620 0x7f9ad40b6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9adabfa700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9ad4161340 0x7f9ad40cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9adabfa700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad40ce360 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9adabfa700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40ce640 con 0x7f9ad4161340 2023-11-17T06:33:47.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9adabfa700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad40d13e0 con 0x7f9ad415d620 2023-11-17T06:33:47.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9ad93f7700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9ad4161340 0x7f9ad40cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9ad93f7700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9ad4161340 0x7f9ad40cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55672/0 (socket says 172.21.15.69:55672) 2023-11-17T06:33:47.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9ad93f7700 1 -- 172.21.15.69:0/2929030364 learned_addr learned my addr 172.21.15.69:0/2929030364 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:47.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9ad9bf8700 1 --2- 172.21.15.69:0/2929030364 >> v2:172.21.15.93:3300/0 conn(0x7f9ad415d620 0x7f9ad40b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9ad93f7700 1 -- 172.21.15.69:0/2929030364 >> v2:172.21.15.93:3300/0 conn(0x7f9ad415d620 msgr2=0x7f9ad40b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:47.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9ad93f7700 1 --2- 172.21.15.69:0/2929030364 >> v2:172.21.15.93:3300/0 conn(0x7f9ad415d620 0x7f9ad40b6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9ad93f7700 1 -- 172.21.15.69:0/2929030364 >> v1:172.21.15.93:6789/0 conn(0x7f9ad40b4bf0 legacy=0x7f9ad40b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9ad93f7700 1 -- 172.21.15.69:0/2929030364 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad40d16c0 con 0x7f9ad4161340 2023-11-17T06:33:47.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9ad9bf8700 1 --2- 172.21.15.69:0/2929030364 >> v2:172.21.15.93:3300/0 conn(0x7f9ad415d620 0x7f9ad40b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:47.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.463+0000 7f9ad93f7700 1 --2- 172.21.15.69:0/2929030364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4161340 0x7f9ad40cda60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9ad406b360 tx=0x7f9ac4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ff1ee1fe8ee74b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:47.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9ad8bf6700 1 -- 172.21.15.69:0/2929030364 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400b8a0 con 0x7f9ad4161340 2023-11-17T06:33:47.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9ad8bf6700 1 -- 172.21.15.69:0/2929030364 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac400ba00 con 0x7f9ad4161340 2023-11-17T06:33:47.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9ad8bf6700 1 -- 172.21.15.69:0/2929030364 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac400bd90 con 0x7f9ad4161340 2023-11-17T06:33:47.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9adabfa700 1 -- 172.21.15.69:0/2929030364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4161340 msgr2=0x7f9ad40cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9adabfa700 1 --2- 172.21.15.69:0/2929030364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4161340 0x7f9ad40cda60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9ad406b360 tx=0x7f9ac4009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9adabfa700 1 -- 172.21.15.69:0/2929030364 shutdown_connections 2023-11-17T06:33:47.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9adabfa700 1 --2- 172.21.15.69:0/2929030364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad4161340 0x7f9ad40cda60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9adabfa700 1 --2- 172.21.15.69:0/2929030364 >> v2:172.21.15.93:3300/0 conn(0x7f9ad415d620 0x7f9ad40b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9adabfa700 1 -- 172.21.15.69:0/2929030364 >> 172.21.15.69:0/2929030364 conn(0x7f9ad40cfbf0 msgr2=0x7f9ad40cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:47.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9adabfa700 1 -- 172.21.15.69:0/2929030364 shutdown_connections 2023-11-17T06:33:47.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.467+0000 7f9adabfa700 1 -- 172.21.15.69:0/2929030364 wait complete. 2023-11-17T06:33:47.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9adabfa700 1 Processor -- start 2023-11-17T06:33:47.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9adabfa700 1 -- start start 2023-11-17T06:33:47.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9adabfa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad40b4bf0 0x7f9ad41f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9adabfa700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ad415d620 0x7f9ad41f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9adabfa700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad4161340 0x7f9ad41527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9adabfa700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad40cd0d0 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9adabfa700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad41f6b10 con 0x7f9ad4161340 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9adabfa700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad4152040 con 0x7f9ad415d620 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad9bf8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad40b4bf0 0x7f9ad41f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad9bf8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad40b4bf0 0x7f9ad41f65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55686/0 (socket says 172.21.15.69:55686) 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad9bf8700 1 -- 172.21.15.69:0/2954129023 learned_addr learned my addr 172.21.15.69:0/2954129023 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad93f7700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ad415d620 0x7f9ad41f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ada3f9700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad4161340 0x7f9ad41527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad9bf8700 1 -- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ad415d620 msgr2=0x7f9ad41f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.479 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad9bf8700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ad415d620 0x7f9ad41f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad9bf8700 1 -- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad4161340 msgr2=0x7f9ad41527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:47.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad9bf8700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad4161340 0x7f9ad41527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:47.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad9bf8700 1 -- 172.21.15.69:0/2954129023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4009570 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad93f7700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ad415d620 0x7f9ad41f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:47.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9ad9bf8700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad40b4bf0 0x7f9ad41f65d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009fc0 tx=0x7f9ad000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:47.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9aca7fc700 1 -- 172.21.15.69:0/2954129023 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0003a40 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9aca7fc700 1 -- 172.21.15.69:0/2954129023 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad000f040 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9adabfa700 1 -- 172.21.15.69:0/2954129023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad40ceaa0 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9aca7fc700 1 -- 172.21.15.69:0/2954129023 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0003e00 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.480 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.471+0000 7f9adabfa700 1 -- 172.21.15.69:0/2954129023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad41f6df0 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.475+0000 7f9adabfa700 1 -- 172.21.15.69:0/2954129023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad40676d0 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.475+0000 7f9aca7fc700 1 -- 172.21.15.69:0/2954129023 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9ad0004030 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.475+0000 7f9aca7fc700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ab8066510 0x7f9ab80689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:47.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.475+0000 7f9aca7fc700 1 -- 172.21.15.69:0/2954129023 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f9ad00841c0 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.483 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.479+0000 7f9ad93f7700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ab8066510 0x7f9ab80689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:47.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.479+0000 7f9ad93f7700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ab8066510 0x7f9ab80689d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4000c00 tx=0x7f9ac4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:47.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.483+0000 7f9aca7fc700 1 -- 172.21.15.69:0/2954129023 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9ad00514b0 con 0x7f9ad40b4bf0 2023-11-17T06:33:47.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.699+0000 7f9adabfa700 1 -- 172.21.15.69:0/2954129023 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ad40d0ef0 con 0x7f9ad40b4bf0 2023-11-17T06:33:48.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.703+0000 7f9aca7fc700 1 -- 172.21.15.69:0/2954129023 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4911 (secure 0 0 0) 0x7f9ad0054ad0 con 0x7f9ad40b4bf0 2023-11-17T06:33:48.037 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:48.037 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:33:36.198455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":4,"addr":"172.21.15.69:6835/377943606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":377943606},{"type":"v1","addr":"172.21.15.69:6835","nonce":377943606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:48.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 -- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ab8066510 msgr2=0x7f9ab80689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ab8066510 0x7f9ab80689d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4000c00 tx=0x7f9ac4008030 comp rx=0 tx=0).stop 2023-11-17T06:33:48.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 -- 172.21.15.69:0/2954129023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad40b4bf0 msgr2=0x7f9ad41f65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad40b4bf0 0x7f9ad41f65d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0009fc0 tx=0x7f9ad000d460 comp rx=0 tx=0).stop 2023-11-17T06:33:48.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 -- 172.21.15.69:0/2954129023 shutdown_connections 2023-11-17T06:33:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ab8066510 0x7f9ab80689d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad4161340 0x7f9ad41527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9ad415d620 0x7f9ad41f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 --2- 172.21.15.69:0/2954129023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ad40b4bf0 0x7f9ad41f65d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 -- 172.21.15.69:0/2954129023 >> 172.21.15.69:0/2954129023 conn(0x7f9ad40cfbf0 msgr2=0x7f9ad415c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 -- 172.21.15.69:0/2954129023 shutdown_connections 2023-11-17T06:33:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:47.707+0000 7f9adabfa700 1 -- 172.21.15.69:0/2954129023 wait complete. 2023-11-17T06:33:48.040 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2023-11-17T06:33:48.041 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:48.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f12a55bd700 1 Processor -- start 2023-11-17T06:33:48.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f12a55bd700 1 -- start start 2023-11-17T06:33:48.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f12a55bd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12a00b6500 0x7f12a015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f12a55bd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f12a01619c0 0x7f12a00b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f12a55bd700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a00b6e20 con 0x7f12a00cf0d0 2023-11-17T06:33:48.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f12a55bd700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a00cf920 con 0x7f12a00b6500 2023-11-17T06:33:48.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f12a55bd700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a00cfc00 con 0x7f12a01619c0 2023-11-17T06:33:48.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f129effd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12a00b6500 0x7f12a015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f129e7fc700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f12a01619c0 0x7f12a00b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f129ffff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f12a00cf0d0 0x7f12a00d2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39794/0 (socket says 172.21.15.69:39794) 2023-11-17T06:33:48.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f129ffff700 1 -- 172.21.15.69:0/2615164251 learned_addr learned my addr 172.21.15.69:0/2615164251 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:48.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f129effd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12a00b6500 0x7f12a015e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55696/0 (socket says 172.21.15.69:55696) 2023-11-17T06:33:48.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f129e7fc700 1 -- 172.21.15.69:0/2615164251 >> v2:172.21.15.69:3300/0 conn(0x7f12a00b6500 msgr2=0x7f12a015e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:48.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f129e7fc700 1 --2- 172.21.15.69:0/2615164251 >> v2:172.21.15.69:3300/0 conn(0x7f12a00b6500 0x7f12a015e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f129e7fc700 1 -- 172.21.15.69:0/2615164251 >> v1:172.21.15.69:6789/0 conn(0x7f12a00cf0d0 legacy=0x7f12a00d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.227+0000 7f129e7fc700 1 -- 172.21.15.69:0/2615164251 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a015dbb0 con 0x7f12a01619c0 2023-11-17T06:33:48.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f129e7fc700 1 --2- 172.21.15.69:0/2615164251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12a01619c0 0x7f12a00b68e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f12a0070e80 tx=0x7f1294009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18a7c163f8746dd9 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:48.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f129dffb700 1 -- 172.21.15.69:0/2615164251 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294011830 con 0x7f12a01619c0 2023-11-17T06:33:48.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f129dffb700 1 -- 172.21.15.69:0/2615164251 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1294011990 con 0x7f12a01619c0 2023-11-17T06:33:48.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f129dffb700 1 -- 172.21.15.69:0/2615164251 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294011d20 con 0x7f12a01619c0 2023-11-17T06:33:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f12a55bd700 1 -- 172.21.15.69:0/2615164251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12a01619c0 msgr2=0x7f12a00b68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f12a55bd700 1 --2- 172.21.15.69:0/2615164251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12a01619c0 0x7f12a00b68e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f12a0070e80 tx=0x7f1294009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f12a55bd700 1 -- 172.21.15.69:0/2615164251 shutdown_connections 2023-11-17T06:33:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f12a55bd700 1 --2- 172.21.15.69:0/2615164251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12a01619c0 0x7f12a00b68e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f12a55bd700 1 --2- 172.21.15.69:0/2615164251 >> v2:172.21.15.69:3300/0 conn(0x7f12a00b6500 0x7f12a015e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f12a55bd700 1 -- 172.21.15.69:0/2615164251 >> 172.21.15.69:0/2615164251 conn(0x7f12a00d1500 msgr2=0x7f12a00d1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:48.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f12a55bd700 1 -- 172.21.15.69:0/2615164251 shutdown_connections 2023-11-17T06:33:48.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.231+0000 7f12a55bd700 1 -- 172.21.15.69:0/2615164251 wait complete. 2023-11-17T06:33:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f12a55bd700 1 Processor -- start 2023-11-17T06:33:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f12a55bd700 1 -- start start 2023-11-17T06:33:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f12a55bd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12a00b6500 0x7f12a00cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f12a55bd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a00cf0d0 0x7f12a01f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f12a55bd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f12a01619c0 0x7f12a01f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f12a55bd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00ccaa0 con 0x7f12a00cf0d0 2023-11-17T06:33:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f12a55bd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a01f2f80 con 0x7f12a00b6500 2023-11-17T06:33:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f12a55bd700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00b8290 con 0x7f12a01619c0 2023-11-17T06:33:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f129e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a00cf0d0 0x7f12a01f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f129e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a00cf0d0 0x7f12a01f2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55712/0 (socket says 172.21.15.69:55712) 2023-11-17T06:33:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f129e7fc700 1 -- 172.21.15.69:0/1962229954 learned_addr learned my addr 172.21.15.69:0/1962229954 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f129effd700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12a00b6500 0x7f12a00cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f129ffff700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f12a01619c0 0x7f12a01f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f129e7fc700 1 -- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f12a01619c0 msgr2=0x7f12a01f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f129e7fc700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f12a01619c0 0x7f12a01f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f129e7fc700 1 -- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12a00b6500 msgr2=0x7f12a00cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f129e7fc700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12a00b6500 0x7f12a00cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.235+0000 7f129e7fc700 1 -- 172.21.15.69:0/1962229954 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940094b0 con 0x7f12a00cf0d0 2023-11-17T06:33:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.239+0000 7f129e7fc700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a00cf0d0 0x7f12a01f2a40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f12940090b0 tx=0x7f1294004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.239+0000 7f12877fe700 1 -- 172.21.15.69:0/1962229954 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12940036c0 con 0x7f12a00cf0d0 2023-11-17T06:33:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.239+0000 7f12877fe700 1 -- 172.21.15.69:0/1962229954 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129401e070 con 0x7f12a00cf0d0 2023-11-17T06:33:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.239+0000 7f12a55bd700 1 -- 172.21.15.69:0/1962229954 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a00b76a0 con 0x7f12a00cf0d0 2023-11-17T06:33:48.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.239+0000 7f12877fe700 1 -- 172.21.15.69:0/1962229954 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294003a60 con 0x7f12a00cf0d0 2023-11-17T06:33:48.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.239+0000 7f12a55bd700 1 -- 172.21.15.69:0/1962229954 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a00b7c40 con 0x7f12a00cf0d0 2023-11-17T06:33:48.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.239+0000 7f12a55bd700 1 -- 172.21.15.69:0/1962229954 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a015d830 con 0x7f12a00cf0d0 2023-11-17T06:33:48.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.243+0000 7f12877fe700 1 -- 172.21.15.69:0/1962229954 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1294003bc0 con 0x7f12a00cf0d0 2023-11-17T06:33:48.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.243+0000 7f12877fe700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f128c066510 0x7f128c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.243+0000 7f12877fe700 1 -- 172.21.15.69:0/1962229954 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f12940851c0 con 0x7f12a00cf0d0 2023-11-17T06:33:48.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.243+0000 7f129effd700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f128c066510 0x7f128c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.243+0000 7f129effd700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f128c066510 0x7f128c0689d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1290009b80 tx=0x7f1290008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:48.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.247+0000 7f12877fe700 1 -- 172.21.15.69:0/1962229954 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f12a015d830 con 0x7f12a00cf0d0 2023-11-17T06:33:48.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.427+0000 7f12a55bd700 1 -- 172.21.15.69:0/1962229954 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12a015d830 con 0x7f12a00cf0d0 2023-11-17T06:33:48.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12877fe700 1 -- 172.21.15.69:0/1962229954 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16933 (secure 0 0 0) 0x7f12a015d830 con 0x7f12a00cf0d0 2023-11-17T06:33:48.436 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:48.436 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":41,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:33:30.515083+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6835/1050522275":"2023-11-18T06:33:30.515033+0000","172.21.15.69:6834/1050522275":"2023-11-18T06:33:30.515033+0000","172.21.15.93:6837/4181304583":"2023-11-18T06:33:11.857552+0000","172.21.15.93:6836/4181304583":"2023-11-18T06:33:11.857552+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:48.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 -- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f128c066510 msgr2=0x7f128c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f128c066510 0x7f128c0689d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1290009b80 tx=0x7f1290008040 comp rx=0 tx=0).stop 2023-11-17T06:33:48.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 -- 172.21.15.69:0/1962229954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a00cf0d0 msgr2=0x7f12a01f2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a00cf0d0 0x7f12a01f2a40 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f12940090b0 tx=0x7f1294004770 comp rx=0 tx=0).stop 2023-11-17T06:33:48.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 -- 172.21.15.69:0/1962229954 shutdown_connections 2023-11-17T06:33:48.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f128c066510 0x7f128c0689d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f12a01619c0 0x7f12a01f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12a00cf0d0 0x7f12a01f2a40 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 --2- 172.21.15.69:0/1962229954 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f12a00b6500 0x7f12a00cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 -- 172.21.15.69:0/1962229954 >> 172.21.15.69:0/1962229954 conn(0x7f12a00d1500 msgr2=0x7f12a015f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:48.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 -- 172.21.15.69:0/1962229954 shutdown_connections 2023-11-17T06:33:48.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.431+0000 7f12a55bd700 1 -- 172.21.15.69:0/1962229954 wait complete. 2023-11-17T06:33:48.460 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-17T06:33:48.460 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:48.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.627+0000 7f7078154700 1 Processor -- start 2023-11-17T06:33:48.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.627+0000 7f7078154700 1 -- start start 2023-11-17T06:33:48.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f707015d870 0x7f70700d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7070161be0 0x7f70700ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70700ceba0 con 0x7f70700ce1e0 2023-11-17T06:33:48.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70700d21a0 con 0x7f7070161be0 2023-11-17T06:33:48.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f707015dc50 con 0x7f707015d870 2023-11-17T06:33:48.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f70766f1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7070161be0 0x7f70700ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f70766f1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7070161be0 0x7f70700ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55718/0 (socket says 172.21.15.69:55718) 2023-11-17T06:33:48.636 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f70766f1700 1 -- 172.21.15.69:0/2487231521 learned_addr learned my addr 172.21.15.69:0/2487231521 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:48.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7075ef0700 1 --2- 172.21.15.69:0/2487231521 >> v2:172.21.15.93:3300/0 conn(0x7f707015d870 0x7f70700d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f70766f1700 1 -- 172.21.15.69:0/2487231521 >> v2:172.21.15.93:3300/0 conn(0x7f707015d870 msgr2=0x7f70700d2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:48.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f70766f1700 1 --2- 172.21.15.69:0/2487231521 >> v2:172.21.15.93:3300/0 conn(0x7f707015d870 0x7f70700d2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f70766f1700 1 -- 172.21.15.69:0/2487231521 >> v1:172.21.15.93:6789/0 conn(0x7f70700ce1e0 legacy=0x7f70701614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:48.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f70766f1700 1 -- 172.21.15.69:0/2487231521 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70700d1870 con 0x7f7070161be0 2023-11-17T06:33:48.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f70766f1700 1 --2- 172.21.15.69:0/2487231521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 0x7f70700ce660 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f70700cfc30 tx=0x7f706800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a167e8b65421195c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:48.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7074eee700 1 -- 172.21.15.69:0/2487231521 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706800e070 con 0x7f7070161be0 2023-11-17T06:33:48.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7074eee700 1 -- 172.21.15.69:0/2487231521 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7068003a40 con 0x7f7070161be0 2023-11-17T06:33:48.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7074eee700 1 -- 172.21.15.69:0/2487231521 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068003df0 con 0x7f7070161be0 2023-11-17T06:33:48.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 -- 172.21.15.69:0/2487231521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 msgr2=0x7f70700ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 --2- 172.21.15.69:0/2487231521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 0x7f70700ce660 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f70700cfc30 tx=0x7f706800b330 comp rx=0 tx=0).stop 2023-11-17T06:33:48.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 -- 172.21.15.69:0/2487231521 shutdown_connections 2023-11-17T06:33:48.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 --2- 172.21.15.69:0/2487231521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 0x7f70700ce660 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.639 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 --2- 172.21.15.69:0/2487231521 >> v2:172.21.15.93:3300/0 conn(0x7f707015d870 0x7f70700d2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.631+0000 7f7078154700 1 -- 172.21.15.69:0/2487231521 >> 172.21.15.69:0/2487231521 conn(0x7f70700d3250 msgr2=0x7f70700d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:48.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.635+0000 7f7078154700 1 -- 172.21.15.69:0/2487231521 shutdown_connections 2023-11-17T06:33:48.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.635+0000 7f7078154700 1 -- 172.21.15.69:0/2487231521 wait complete. 2023-11-17T06:33:48.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.635+0000 7f7078154700 1 Processor -- start 2023-11-17T06:33:48.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.635+0000 7f7078154700 1 -- start start 2023-11-17T06:33:48.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f7078154700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70700ce1e0 0x7f7070148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f7078154700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f707015d870 0x7f70701f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f7078154700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 0x7f70700b80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f7078154700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70701f6410 con 0x7f7070161be0 2023-11-17T06:33:48.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f7078154700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7070159650 con 0x7f70700ce1e0 2023-11-17T06:33:48.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f7078154700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7070159930 con 0x7f707015d870 2023-11-17T06:33:48.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70766f1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 0x7f70700b80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70766f1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 0x7f70700b80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55720/0 (socket says 172.21.15.69:55720) 2023-11-17T06:33:48.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70766f1700 1 -- 172.21.15.69:0/3841625845 learned_addr learned my addr 172.21.15.69:0/3841625845 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:48.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f7075ef0700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70700ce1e0 0x7f7070148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70756ef700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f707015d870 0x7f70701f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70766f1700 1 -- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f707015d870 msgr2=0x7f70701f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70766f1700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f707015d870 0x7f70701f6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70766f1700 1 -- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70700ce1e0 msgr2=0x7f7070148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70766f1700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70700ce1e0 0x7f7070148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70766f1700 1 -- 172.21.15.69:0/3841625845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7068009b30 con 0x7f7070161be0 2023-11-17T06:33:48.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f7075ef0700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70700ce1e0 0x7f7070148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:48.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70756ef700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f707015d870 0x7f70701f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:33:48.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70766f1700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 0x7f70700b80d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f706800b370 tx=0x7f7068004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:48.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70667fc700 1 -- 172.21.15.69:0/3841625845 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068004440 con 0x7f7070161be0 2023-11-17T06:33:48.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70667fc700 1 -- 172.21.15.69:0/3841625845 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70680045a0 con 0x7f7070161be0 2023-11-17T06:33:48.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f7078154700 1 -- 172.21.15.69:0/3841625845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7070159c10 con 0x7f7070161be0 2023-11-17T06:33:48.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f70667fc700 1 -- 172.21.15.69:0/3841625845 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068004950 con 0x7f7070161be0 2023-11-17T06:33:48.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.639+0000 7f7078154700 1 -- 172.21.15.69:0/3841625845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7070148b80 con 0x7f7070161be0 2023-11-17T06:33:48.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.643+0000 7f7078154700 1 -- 172.21.15.69:0/3841625845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70701f6550 con 0x7f7070161be0 2023-11-17T06:33:48.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.643+0000 7f70667fc700 1 -- 172.21.15.69:0/3841625845 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7068012430 con 0x7f7070161be0 2023-11-17T06:33:48.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.647+0000 7f70667fc700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7054066560 0x7f7054068a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:48.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.647+0000 7f70667fc700 1 -- 172.21.15.69:0/3841625845 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f7068085320 con 0x7f7070161be0 2023-11-17T06:33:48.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.647+0000 7f7075ef0700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7054066560 0x7f7054068a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:48.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.647+0000 7f7075ef0700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7054066560 0x7f7054068a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f706c009a20 tx=0x7f706c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:48.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.651+0000 7f70667fc700 1 -- 172.21.15.69:0/3841625845 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f70701f6550 con 0x7f7070161be0 2023-11-17T06:33:48.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.863+0000 7f7078154700 1 -- 172.21.15.69:0/3841625845 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70701f6550 con 0x7f7070161be0 2023-11-17T06:33:48.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.867+0000 7f70667fc700 1 -- 172.21.15.69:0/3841625845 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4911 (secure 0 0 0) 0x7f70701f6550 con 0x7f7070161be0 2023-11-17T06:33:48.872 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:48.872 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:33:36.198455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":4,"addr":"172.21.15.69:6835/377943606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":377943606},{"type":"v1","addr":"172.21.15.69:6835","nonce":377943606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:48.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.867+0000 7f7078154700 1 -- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7054066560 msgr2=0x7f7054068a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.867+0000 7f7078154700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7054066560 0x7f7054068a20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f706c009a20 tx=0x7f706c008040 comp rx=0 tx=0).stop 2023-11-17T06:33:48.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.871+0000 7f7078154700 1 -- 172.21.15.69:0/3841625845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 msgr2=0x7f70700b80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:48.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.871+0000 7f7078154700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 0x7f70700b80d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f706800b370 tx=0x7f7068004af0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.871+0000 7f7078154700 1 -- 172.21.15.69:0/3841625845 shutdown_connections 2023-11-17T06:33:48.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.871+0000 7f7078154700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7054066560 0x7f7054068a20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.871+0000 7f7078154700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7070161be0 0x7f70700b80d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.871+0000 7f7078154700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f707015d870 0x7f70701f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.871+0000 7f7078154700 1 --2- 172.21.15.69:0/3841625845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f70700ce1e0 0x7f7070148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:48.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.871+0000 7f7078154700 1 -- 172.21.15.69:0/3841625845 >> 172.21.15.69:0/3841625845 conn(0x7f70700d3250 msgr2=0x7f707006a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:48.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.871+0000 7f7078154700 1 -- 172.21.15.69:0/3841625845 shutdown_connections 2023-11-17T06:33:48.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:48.871+0000 7f7078154700 1 -- 172.21.15.69:0/3841625845 wait complete. 2023-11-17T06:33:48.879 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2023-11-17T06:33:48.900 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:33:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.071+0000 7f1bbfc32700 1 Processor -- start 2023-11-17T06:33:49.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.071+0000 7f1bbfc32700 1 -- start start 2023-11-17T06:33:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbfc32700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1bb815d870 0x7f1bb80d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbfc32700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1bb80ce1e0 0x7f1bb80ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbfc32700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb80ceba0 con 0x7f1bb81614d0 2023-11-17T06:33:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbfc32700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb80d21a0 con 0x7f1bb815d870 2023-11-17T06:33:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbfc32700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb815dc50 con 0x7f1bb80ce1e0 2023-11-17T06:33:49.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbe1cf700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1bb81614d0 0x7f1bb8161960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39810/0 (socket says 172.21.15.69:39810) 2023-11-17T06:33:49.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbd9ce700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1bb815d870 0x7f1bb80d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbe1cf700 1 -- 172.21.15.69:0/3796357431 learned_addr learned my addr 172.21.15.69:0/3796357431 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:49.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbd1cd700 1 --2- 172.21.15.69:0/3796357431 >> v2:172.21.15.93:3300/0 conn(0x7f1bb80ce1e0 0x7f1bb80ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbc9cc700 1 -- 172.21.15.69:0/3796357431 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149056686 0 0) 0x7f1bb80ceba0 con 0x7f1bb81614d0 2023-11-17T06:33:49.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbc9cc700 1 -- 172.21.15.69:0/3796357431 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ba40035d0 con 0x7f1bb81614d0 2023-11-17T06:33:49.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbd9ce700 1 -- 172.21.15.69:0/3796357431 >> v2:172.21.15.93:3300/0 conn(0x7f1bb80ce1e0 msgr2=0x7f1bb80ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:49.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbd9ce700 1 --2- 172.21.15.69:0/3796357431 >> v2:172.21.15.93:3300/0 conn(0x7f1bb80ce1e0 0x7f1bb80ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbd9ce700 1 -- 172.21.15.69:0/3796357431 >> v1:172.21.15.69:6789/0 conn(0x7f1bb81614d0 legacy=0x7f1bb8161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbd9ce700 1 -- 172.21.15.69:0/3796357431 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb80d1870 con 0x7f1bb815d870 2023-11-17T06:33:49.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbd9ce700 1 --2- 172.21.15.69:0/3796357431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb815d870 0x7f1bb80d2630 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80d0d40 tx=0x7f1bb4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7eb126e748e760 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:49.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbc9cc700 1 -- 172.21.15.69:0/3796357431 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4011830 con 0x7f1bb815d870 2023-11-17T06:33:49.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbc9cc700 1 -- 172.21.15.69:0/3796357431 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb4011990 con 0x7f1bb815d870 2023-11-17T06:33:49.083 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.075+0000 7f1bbc9cc700 1 -- 172.21.15.69:0/3796357431 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4011d20 con 0x7f1bb815d870 2023-11-17T06:33:49.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.079+0000 7f1bbfc32700 1 -- 172.21.15.69:0/3796357431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb815d870 msgr2=0x7f1bb80d2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.079+0000 7f1bbfc32700 1 --2- 172.21.15.69:0/3796357431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb815d870 0x7f1bb80d2630 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80d0d40 tx=0x7f1bb4009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:49.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.079+0000 7f1bbfc32700 1 -- 172.21.15.69:0/3796357431 shutdown_connections 2023-11-17T06:33:49.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.079+0000 7f1bbfc32700 1 --2- 172.21.15.69:0/3796357431 >> v2:172.21.15.93:3300/0 conn(0x7f1bb80ce1e0 0x7f1bb80ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.079+0000 7f1bbfc32700 1 --2- 172.21.15.69:0/3796357431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb815d870 0x7f1bb80d2630 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.079+0000 7f1bbfc32700 1 -- 172.21.15.69:0/3796357431 >> 172.21.15.69:0/3796357431 conn(0x7f1bb80d3250 msgr2=0x7f1bb80d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:49.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.079+0000 7f1bbfc32700 1 -- 172.21.15.69:0/3796357431 shutdown_connections 2023-11-17T06:33:49.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.079+0000 7f1bbfc32700 1 -- 172.21.15.69:0/3796357431 wait complete. 2023-11-17T06:33:49.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.079+0000 7f1bbfc32700 1 Processor -- start 2023-11-17T06:33:49.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.079+0000 7f1bbfc32700 1 -- start start 2023-11-17T06:33:49.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbfc32700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bb80ce1e0 0x7f1bb81503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbfc32700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bb815d870 0x7f1bb8150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbfc32700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb81614d0 0x7f1bb81f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbfc32700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80c7700 con 0x7f1bb81614d0 2023-11-17T06:33:49.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbfc32700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80c7950 con 0x7f1bb815d870 2023-11-17T06:33:49.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbfc32700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80c7c30 con 0x7f1bb80ce1e0 2023-11-17T06:33:49.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbe1cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb81614d0 0x7f1bb81f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbe1cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb81614d0 0x7f1bb81f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55736/0 (socket says 172.21.15.69:55736) 2023-11-17T06:33:49.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbe1cf700 1 -- 172.21.15.69:0/2898722786 learned_addr learned my addr 172.21.15.69:0/2898722786 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:49.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbd9ce700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bb80ce1e0 0x7f1bb81503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbd1cd700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bb815d870 0x7f1bb8150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbe1cf700 1 -- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bb80ce1e0 msgr2=0x7f1bb81503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbe1cf700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bb80ce1e0 0x7f1bb81503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbe1cf700 1 -- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bb815d870 msgr2=0x7f1bb8150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbe1cf700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bb815d870 0x7f1bb8150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbe1cf700 1 -- 172.21.15.69:0/2898722786 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40094b0 con 0x7f1bb81614d0 2023-11-17T06:33:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbe1cf700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb81614d0 0x7f1bb81f60a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000caa0 tx=0x7f1bb000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bae7fc700 1 -- 172.21.15.69:0/2898722786 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0007480 con 0x7f1bb81614d0 2023-11-17T06:33:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bae7fc700 1 -- 172.21.15.69:0/2898722786 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb00075e0 con 0x7f1bb81614d0 2023-11-17T06:33:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbfc32700 1 -- 172.21.15.69:0/2898722786 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb80c7f10 con 0x7f1bb81614d0 2023-11-17T06:33:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bae7fc700 1 -- 172.21.15.69:0/2898722786 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0007970 con 0x7f1bb81614d0 2023-11-17T06:33:49.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.083+0000 7f1bbfc32700 1 -- 172.21.15.69:0/2898722786 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb8151110 con 0x7f1bb81614d0 2023-11-17T06:33:49.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.087+0000 7f1bbfc32700 1 -- 172.21.15.69:0/2898722786 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb80c8430 con 0x7f1bb81614d0 2023-11-17T06:33:49.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.087+0000 7f1bae7fc700 1 -- 172.21.15.69:0/2898722786 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1bb001b3b0 con 0x7f1bb81614d0 2023-11-17T06:33:49.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.091+0000 7f1bae7fc700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b9c066510 0x7f1b9c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.091+0000 7f1bae7fc700 1 -- 172.21.15.69:0/2898722786 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f1bb0083820 con 0x7f1bb81614d0 2023-11-17T06:33:49.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.091+0000 7f1bbd9ce700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b9c066510 0x7f1b9c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.091+0000 7f1bbd9ce700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b9c066510 0x7f1b9c0689d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4000c00 tx=0x7f1bb4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:49.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.095+0000 7f1bae7fc700 1 -- 172.21.15.69:0/2898722786 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1bb80c8430 con 0x7f1bb81614d0 2023-11-17T06:33:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.307+0000 7f1bbfc32700 1 -- 172.21.15.69:0/2898722786 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bb80c8430 con 0x7f1bb81614d0 2023-11-17T06:33:49.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.307+0000 7f1bae7fc700 1 -- 172.21.15.69:0/2898722786 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4911 (secure 0 0 0) 0x7f1bb80c8430 con 0x7f1bb81614d0 2023-11-17T06:33:49.315 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:49.316 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-17T06:31:25.683625+0000","modified":"2023-11-17T06:33:36.198455+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":41,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"c","rank":0,"incarnation":25,"state":"up:active","state_seq":4,"addr":"172.21.15.69:6835/377943606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":377943606},{"type":"v1","addr":"172.21.15.69:6835","nonce":377943606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-17T06:33:49.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 -- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b9c066510 msgr2=0x7f1b9c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b9c066510 0x7f1b9c0689d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4000c00 tx=0x7f1bb4008030 comp rx=0 tx=0).stop 2023-11-17T06:33:49.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 -- 172.21.15.69:0/2898722786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb81614d0 msgr2=0x7f1bb81f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb81614d0 0x7f1bb81f60a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000caa0 tx=0x7f1bb000cad0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 -- 172.21.15.69:0/2898722786 shutdown_connections 2023-11-17T06:33:49.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1b9c066510 0x7f1b9c0689d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bb81614d0 0x7f1bb81f60a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bb815d870 0x7f1bb8150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 --2- 172.21.15.69:0/2898722786 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bb80ce1e0 0x7f1bb81503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 -- 172.21.15.69:0/2898722786 >> 172.21.15.69:0/2898722786 conn(0x7f1bb80d3250 msgr2=0x7f1bb80ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:49.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 -- 172.21.15.69:0/2898722786 shutdown_connections 2023-11-17T06:33:49.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.311+0000 7f1bbfc32700 1 -- 172.21.15.69:0/2898722786 wait complete. 2023-11-17T06:33:49.318 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 28 2023-11-17T06:33:49.337 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:49.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.511+0000 7f9b0a696700 1 Processor -- start 2023-11-17T06:33:49.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.511+0000 7f9b0a696700 1 -- start start 2023-11-17T06:33:49.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b0a696700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9b041619a0 0x7f9b040cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b0a696700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b040cded0 0x7f9b04165480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b0a696700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b04161d80 con 0x7f9b041659c0 2023-11-17T06:33:49.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b0a696700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b040c9490 con 0x7f9b041619a0 2023-11-17T06:33:49.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b0a696700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040cb6b0 con 0x7f9b040cded0 2023-11-17T06:33:49.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b03fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9b041619a0 0x7f9b040cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b03fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9b041619a0 0x7f9b040cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55746/0 (socket says 172.21.15.69:55746) 2023-11-17T06:33:49.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b03fff700 1 -- 172.21.15.69:0/2760657737 learned_addr learned my addr 172.21.15.69:0/2760657737 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:49.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9afb7fe700 1 --2- 172.21.15.69:0/2760657737 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b040cded0 0x7f9b04165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b03fff700 1 -- 172.21.15.69:0/2760657737 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b040cded0 msgr2=0x7f9b04165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:49.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b03fff700 1 --2- 172.21.15.69:0/2760657737 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b040cded0 0x7f9b04165480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b03fff700 1 -- 172.21.15.69:0/2760657737 >> v1:172.21.15.93:6789/0 conn(0x7f9b041659c0 legacy=0x7f9b040cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b03fff700 1 -- 172.21.15.69:0/2760657737 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b041661c0 con 0x7f9b041619a0 2023-11-17T06:33:49.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b03fff700 1 --2- 172.21.15.69:0/2760657737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b041619a0 0x7f9b040cb170 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009900 tx=0x7f9af4009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b9e94e602362c3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:49.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b037fe700 1 -- 172.21.15.69:0/2760657737 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af400ba60 con 0x7f9b041619a0 2023-11-17T06:33:49.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b037fe700 1 -- 172.21.15.69:0/2760657737 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af400bbc0 con 0x7f9b041619a0 2023-11-17T06:33:49.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.515+0000 7f9b037fe700 1 -- 172.21.15.69:0/2760657737 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af4009e50 con 0x7f9b041619a0 2023-11-17T06:33:49.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.519+0000 7f9b0a696700 1 -- 172.21.15.69:0/2760657737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b041619a0 msgr2=0x7f9b040cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.519+0000 7f9b0a696700 1 --2- 172.21.15.69:0/2760657737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b041619a0 0x7f9b040cb170 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009900 tx=0x7f9af4009c10 comp rx=0 tx=0).stop 2023-11-17T06:33:49.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.519+0000 7f9b0a696700 1 -- 172.21.15.69:0/2760657737 shutdown_connections 2023-11-17T06:33:49.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.519+0000 7f9b0a696700 1 --2- 172.21.15.69:0/2760657737 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b040cded0 0x7f9b04165480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.519+0000 7f9b0a696700 1 --2- 172.21.15.69:0/2760657737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b041619a0 0x7f9b040cb170 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.519+0000 7f9b0a696700 1 -- 172.21.15.69:0/2760657737 >> 172.21.15.69:0/2760657737 conn(0x7f9b040cee40 msgr2=0x7f9b040cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:49.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.519+0000 7f9b0a696700 1 -- 172.21.15.69:0/2760657737 shutdown_connections 2023-11-17T06:33:49.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.519+0000 7f9b0a696700 1 -- 172.21.15.69:0/2760657737 wait complete. 2023-11-17T06:33:49.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.519+0000 7f9b0a696700 1 Processor -- start 2023-11-17T06:33:49.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.519+0000 7f9b0a696700 1 -- start start 2023-11-17T06:33:49.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b0a696700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b040cded0 0x7f9b041fb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b0a696700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b041619a0 0x7f9b04152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b0a696700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b041659c0 0x7f9b04164670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b0a696700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b041530a0 con 0x7f9b041659c0 2023-11-17T06:33:49.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b0a696700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c3440 con 0x7f9b040cded0 2023-11-17T06:33:49.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b0a696700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c2b10 con 0x7f9b041619a0 2023-11-17T06:33:49.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b08c33700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b041659c0 0x7f9b04164670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9afb7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b041619a0 0x7f9b04152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b03fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b040cded0 0x7f9b041fb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9afb7fe700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b041619a0 0x7f9b04152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:45718/0 (socket says 172.21.15.69:45718) 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9afb7fe700 1 -- 172.21.15.69:0/3370003872 learned_addr learned my addr 172.21.15.69:0/3370003872 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b08c33700 1 -- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b041619a0 msgr2=0x7f9b04152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b08c33700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b041619a0 0x7f9b04152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b08c33700 1 -- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b040cded0 msgr2=0x7f9b041fb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b08c33700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b040cded0 0x7f9b041fb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b08c33700 1 -- 172.21.15.69:0/3370003872 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af4009510 con 0x7f9b041659c0 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9afb7fe700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b041619a0 0x7f9b04152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b08c33700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b041659c0 0x7f9b04164670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00c400 tx=0x7f9afc00c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:49.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b017fa700 1 -- 172.21.15.69:0/3370003872 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0052d0 con 0x7f9b041659c0 2023-11-17T06:33:49.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b017fa700 1 -- 172.21.15.69:0/3370003872 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc005430 con 0x7f9b041659c0 2023-11-17T06:33:49.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b0a696700 1 -- 172.21.15.69:0/3370003872 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b040c2df0 con 0x7f9b041659c0 2023-11-17T06:33:49.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b017fa700 1 -- 172.21.15.69:0/3370003872 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0055a0 con 0x7f9b041659c0 2023-11-17T06:33:49.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.523+0000 7f9b0a696700 1 -- 172.21.15.69:0/3370003872 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b04152d90 con 0x7f9b041659c0 2023-11-17T06:33:49.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.527+0000 7f9b0a696700 1 -- 172.21.15.69:0/3370003872 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0404e650 con 0x7f9b041659c0 2023-11-17T06:33:49.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.527+0000 7f9b017fa700 1 -- 172.21.15.69:0/3370003872 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9afc0038c0 con 0x7f9b041659c0 2023-11-17T06:33:49.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.531+0000 7f9b017fa700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ae4066510 0x7f9ae40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.531+0000 7f9b017fa700 1 -- 172.21.15.69:0/3370003872 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f9afc0831c0 con 0x7f9b041659c0 2023-11-17T06:33:49.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.531+0000 7f9b03fff700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ae4066510 0x7f9ae40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.531+0000 7f9b03fff700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ae4066510 0x7f9ae40689d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009c50 tx=0x7f9af4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:49.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.535+0000 7f9b017fa700 1 -- 172.21.15.69:0/3370003872 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9afc050480 con 0x7f9b041659c0 2023-11-17T06:33:49.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.711+0000 7f9b0a696700 1 -- 172.21.15.69:0/3370003872 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b040c3580 con 0x7f9b041659c0 2023-11-17T06:33:49.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b017fa700 1 -- 172.21.15.69:0/3370003872 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16933 (secure 0 0 0) 0x7f9afc053aa0 con 0x7f9b041659c0 2023-11-17T06:33:49.720 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:49.720 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":41,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:33:30.515083+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-17T06:31:23.624321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-17T06:31:24.717590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.14","mappings":[{"from":4,"to":5}]},{"pgid":"5.1d","mappings":[{"from":4,"to":5}]},{"pgid":"5.36","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6835/1050522275":"2023-11-18T06:33:30.515033+0000","172.21.15.69:6834/1050522275":"2023-11-18T06:33:30.515033+0000","172.21.15.93:6837/4181304583":"2023-11-18T06:33:11.857552+0000","172.21.15.93:6836/4181304583":"2023-11-18T06:33:11.857552+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:49.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b0a696700 1 -- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ae4066510 msgr2=0x7f9ae40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b0a696700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ae4066510 0x7f9ae40689d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9af4009c50 tx=0x7f9af4008030 comp rx=0 tx=0).stop 2023-11-17T06:33:49.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b0a696700 1 -- 172.21.15.69:0/3370003872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b041659c0 msgr2=0x7f9b04164670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b0a696700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b041659c0 0x7f9b04164670 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00c400 tx=0x7f9afc00c710 comp rx=0 tx=0).stop 2023-11-17T06:33:49.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b0a696700 1 -- 172.21.15.69:0/3370003872 shutdown_connections 2023-11-17T06:33:49.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b0a696700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9ae4066510 0x7f9ae40689d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b0a696700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b041659c0 0x7f9b04164670 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b0a696700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9b041619a0 0x7f9b04152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b0a696700 1 --2- 172.21.15.69:0/3370003872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b040cded0 0x7f9b041fb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.715+0000 7f9b0a696700 1 -- 172.21.15.69:0/3370003872 >> 172.21.15.69:0/3370003872 conn(0x7f9b040cee40 msgr2=0x7f9b0406bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:49.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.719+0000 7f9b0a696700 1 -- 172.21.15.69:0/3370003872 shutdown_connections 2023-11-17T06:33:49.726 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.719+0000 7f9b0a696700 1 -- 172.21.15.69:0/3370003872 wait complete. 2023-11-17T06:33:49.744 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-17T06:33:49.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.919+0000 7faadeb87700 1 Processor -- start 2023-11-17T06:33:49.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.919+0000 7faadeb87700 1 -- start start 2023-11-17T06:33:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadeb87700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7faad815d550 0x7faad80d2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadeb87700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faad80d2c60 0x7faad806cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadeb87700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad806d620 con 0x7faad806d1d0 2023-11-17T06:33:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadeb87700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad80cf400 con 0x7faad80d2c60 2023-11-17T06:33:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadeb87700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faad80d2340 con 0x7faad815d550 2023-11-17T06:33:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadd384700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faad80d2c60 0x7faad806cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faade386700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7faad806d1d0 0x7faad806b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39824/0 (socket says 172.21.15.69:39824) 2023-11-17T06:33:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faade386700 1 -- 172.21.15.69:0/3734849730 learned_addr learned my addr 172.21.15.69:0/3734849730 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faaddb85700 1 --2- 172.21.15.69:0/3734849730 >> v2:172.21.15.93:3300/0 conn(0x7faad815d550 0x7faad80d2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadcb83700 1 -- 172.21.15.69:0/3734849730 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240857920 0 0) 0x7faad0001490 con 0x7faad806d1d0 2023-11-17T06:33:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadcb83700 1 -- 172.21.15.69:0/3734849730 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac40035d0 con 0x7faad806d1d0 2023-11-17T06:33:49.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadd384700 1 -- 172.21.15.69:0/3734849730 >> v2:172.21.15.93:3300/0 conn(0x7faad815d550 msgr2=0x7faad80d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:49.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadd384700 1 --2- 172.21.15.69:0/3734849730 >> v2:172.21.15.93:3300/0 conn(0x7faad815d550 0x7faad80d2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadd384700 1 -- 172.21.15.69:0/3734849730 >> v1:172.21.15.69:6789/0 conn(0x7faad806d1d0 legacy=0x7faad806b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadd384700 1 -- 172.21.15.69:0/3734849730 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80d1730 con 0x7faad80d2c60 2023-11-17T06:33:49.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faaddb85700 1 --2- 172.21.15.69:0/3734849730 >> v2:172.21.15.93:3300/0 conn(0x7faad815d550 0x7faad80d2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:49.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadd384700 1 --2- 172.21.15.69:0/3734849730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad80d2c60 0x7faad806cc90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faad808b0a0 tx=0x7faac8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f656829d7b26f8 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:49.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadcb83700 1 -- 172.21.15.69:0/3734849730 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8011830 con 0x7faad80d2c60 2023-11-17T06:33:49.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadcb83700 1 -- 172.21.15.69:0/3734849730 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac8011990 con 0x7faad80d2c60 2023-11-17T06:33:49.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.923+0000 7faadcb83700 1 -- 172.21.15.69:0/3734849730 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8011d20 con 0x7faad80d2c60 2023-11-17T06:33:49.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.927+0000 7faadeb87700 1 -- 172.21.15.69:0/3734849730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad80d2c60 msgr2=0x7faad806cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.927+0000 7faadeb87700 1 --2- 172.21.15.69:0/3734849730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad80d2c60 0x7faad806cc90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7faad808b0a0 tx=0x7faac8009b30 comp rx=0 tx=0).stop 2023-11-17T06:33:49.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.927+0000 7faadeb87700 1 -- 172.21.15.69:0/3734849730 shutdown_connections 2023-11-17T06:33:49.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.927+0000 7faadeb87700 1 --2- 172.21.15.69:0/3734849730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad80d2c60 0x7faad806cc90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.927+0000 7faadeb87700 1 --2- 172.21.15.69:0/3734849730 >> v2:172.21.15.93:3300/0 conn(0x7faad815d550 0x7faad80d2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.927+0000 7faadeb87700 1 -- 172.21.15.69:0/3734849730 >> 172.21.15.69:0/3734849730 conn(0x7faad80b4cb0 msgr2=0x7faad80b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:49.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.927+0000 7faadeb87700 1 -- 172.21.15.69:0/3734849730 shutdown_connections 2023-11-17T06:33:49.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.927+0000 7faadeb87700 1 -- 172.21.15.69:0/3734849730 wait complete. 2023-11-17T06:33:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.927+0000 7faadeb87700 1 Processor -- start 2023-11-17T06:33:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.927+0000 7faadeb87700 1 -- start start 2023-11-17T06:33:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faadeb87700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faad806d1d0 0x7faad815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faadeb87700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faad80d2c60 0x7faad815be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faadeb87700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad815d550 0x7faad815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faadeb87700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad815afb0 con 0x7faad815d550 2023-11-17T06:33:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faadeb87700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad8160060 con 0x7faad806d1d0 2023-11-17T06:33:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faadeb87700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad80cce80 con 0x7faad80d2c60 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faade386700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad815d550 0x7faad815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faade386700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad815d550 0x7faad815c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55770/0 (socket says 172.21.15.69:55770) 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faade386700 1 -- 172.21.15.69:0/638759565 learned_addr learned my addr 172.21.15.69:0/638759565 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faaddb85700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faad806d1d0 0x7faad815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faadd384700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faad80d2c60 0x7faad815be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faade386700 1 -- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faad80d2c60 msgr2=0x7faad815be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faade386700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faad80d2c60 0x7faad815be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faade386700 1 -- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faad806d1d0 msgr2=0x7faad815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faade386700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faad806d1d0 0x7faad815aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faade386700 1 -- 172.21.15.69:0/638759565 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40094b0 con 0x7faad815d550 2023-11-17T06:33:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faaddb85700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faad806d1d0 0x7faad815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faade386700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad815d550 0x7faad815c3a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faad000cb40 tx=0x7faad000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faace7fc700 1 -- 172.21.15.69:0/638759565 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad000a9e0 con 0x7faad815d550 2023-11-17T06:33:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faace7fc700 1 -- 172.21.15.69:0/638759565 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad000ab40 con 0x7faad815d550 2023-11-17T06:33:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faadeb87700 1 -- 172.21.15.69:0/638759565 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac80094b0 con 0x7faad815d550 2023-11-17T06:33:49.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faace7fc700 1 -- 172.21.15.69:0/638759565 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad000ce60 con 0x7faad815d550 2023-11-17T06:33:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.931+0000 7faadeb87700 1 -- 172.21.15.69:0/638759565 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad80c7060 con 0x7faad815d550 2023-11-17T06:33:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.935+0000 7faadeb87700 1 -- 172.21.15.69:0/638759565 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad804e650 con 0x7faad815d550 2023-11-17T06:33:49.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.935+0000 7faace7fc700 1 -- 172.21.15.69:0/638759565 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7faad001b3b0 con 0x7faad815d550 2023-11-17T06:33:49.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.935+0000 7faace7fc700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faabc066510 0x7faabc0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:49.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.939+0000 7faace7fc700 1 -- 172.21.15.69:0/638759565 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5997+0+0 (secure 0 0 0) 0x7faad00838a0 con 0x7faad815d550 2023-11-17T06:33:49.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.939+0000 7faaddb85700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faabc066510 0x7faabc0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:49.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.939+0000 7faaddb85700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faabc066510 0x7faabc0689d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faad4009d30 tx=0x7faad4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:49.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:49.943+0000 7faace7fc700 1 -- 172.21.15.69:0/638759565 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7faad0050bf0 con 0x7faad815d550 2023-11-17T06:33:50.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.147+0000 7faadeb87700 1 -- 172.21.15.69:0/638759565 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faad806d620 con 0x7faad815d550 2023-11-17T06:33:50.155 INFO:tasks.ceph.mon.a.smithi069.stderr:2023-11-17T06:33:50.151+0000 7f1481df4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-17T06:33:50.160 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.155+0000 7faace7fc700 1 -- 172.21.15.69:0/638759565 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7faad806d620 con 0x7faad815d550 2023-11-17T06:33:50.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 -- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faabc066510 msgr2=0x7faabc0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:50.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faabc066510 0x7faabc0689d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7faad4009d30 tx=0x7faad4008040 comp rx=0 tx=0).stop 2023-11-17T06:33:50.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 -- 172.21.15.69:0/638759565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad815d550 msgr2=0x7faad815c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:50.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad815d550 0x7faad815c3a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7faad000cb40 tx=0x7faad000cc20 comp rx=0 tx=0).stop 2023-11-17T06:33:50.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 -- 172.21.15.69:0/638759565 shutdown_connections 2023-11-17T06:33:50.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7faabc066510 0x7faabc0689d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:50.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faad815d550 0x7faad815c3a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:50.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7faad80d2c60 0x7faad815be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:50.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 --2- 172.21.15.69:0/638759565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faad806d1d0 0x7faad815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:50.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 -- 172.21.15.69:0/638759565 >> 172.21.15.69:0/638759565 conn(0x7faad80b4cb0 msgr2=0x7faad815b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:50.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 -- 172.21.15.69:0/638759565 shutdown_connections 2023-11-17T06:33:50.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.159+0000 7faadeb87700 1 -- 172.21.15.69:0/638759565 wait complete. 2023-11-17T06:33:50.167 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-17T06:33:50.175 INFO:tasks.ceph.mds.c.smithi069.stderr: -2377> 2023-11-17T06:33:41.531+0000 7f79d0a41700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-17T06:33:50.184 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-17T06:33:50.235 INFO:tasks.ceph.mds.c.smithi069.stdout:starting mds.c at 2023-11-17T06:33:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.355+0000 7f1c0337a700 1 Processor -- start 2023-11-17T06:33:50.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.355+0000 7f1c0337a700 1 -- start start 2023-11-17T06:33:50.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c0337a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1bfc142000 0x7f1bfc142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:50.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c0337a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bfc1423e0 0x7f1bfc155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:50.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c0337a700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc0cca30 con 0x7f1bfc06d5d0 2023-11-17T06:33:50.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c0337a700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc0ccd10 con 0x7f1bfc142000 2023-11-17T06:33:50.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c0337a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0ccff0 con 0x7f1bfc1423e0 2023-11-17T06:33:50.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c02378700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1bfc142000 0x7f1bfc142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:50.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c02378700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1bfc142000 0x7f1bfc142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:42106/0 (socket says 172.21.15.69:42106) 2023-11-17T06:33:50.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c02378700 1 -- 172.21.15.69:0/1763435825 learned_addr learned my addr 172.21.15.69:0/1763435825 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:50.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c02b79700 1 --2- 172.21.15.69:0/1763435825 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bfc1423e0 0x7f1bfc155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:50.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c02378700 1 -- 172.21.15.69:0/1763435825 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bfc1423e0 msgr2=0x7f1bfc155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:50.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c02378700 1 --2- 172.21.15.69:0/1763435825 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bfc1423e0 0x7f1bfc155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:50.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c02378700 1 -- 172.21.15.69:0/1763435825 >> v1:172.21.15.93:6789/0 conn(0x7f1bfc06d5d0 legacy=0x7f1bfc06b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:50.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c02378700 1 -- 172.21.15.69:0/1763435825 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0cd2d0 con 0x7f1bfc142000 2023-11-17T06:33:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c02378700 1 --2- 172.21.15.69:0/1763435825 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bfc142000 0x7f1bfc142e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009910 tx=0x7f1bf8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b03b1bf4b066f422 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c01376700 1 -- 172.21.15.69:0/1763435825 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8011830 con 0x7f1bfc142000 2023-11-17T06:33:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c01376700 1 -- 172.21.15.69:0/1763435825 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf8011990 con 0x7f1bfc142000 2023-11-17T06:33:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.359+0000 7f1c01376700 1 -- 172.21.15.69:0/1763435825 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8011d40 con 0x7f1bfc142000 2023-11-17T06:33:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.363+0000 7f1c0337a700 1 -- 172.21.15.69:0/1763435825 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bfc142000 msgr2=0x7f1bfc142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:50.366 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.363+0000 7f1c0337a700 1 --2- 172.21.15.69:0/1763435825 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bfc142000 0x7f1bfc142e10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009910 tx=0x7f1bf8009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.363+0000 7f1c0337a700 1 -- 172.21.15.69:0/1763435825 shutdown_connections 2023-11-17T06:33:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.363+0000 7f1c0337a700 1 --2- 172.21.15.69:0/1763435825 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bfc1423e0 0x7f1bfc155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.363+0000 7f1c0337a700 1 --2- 172.21.15.69:0/1763435825 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bfc142000 0x7f1bfc142e10 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.363+0000 7f1c0337a700 1 -- 172.21.15.69:0/1763435825 >> 172.21.15.69:0/1763435825 conn(0x7f1bfc0cedc0 msgr2=0x7f1bfc0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.363+0000 7f1c0337a700 1 -- 172.21.15.69:0/1763435825 shutdown_connections 2023-11-17T06:33:50.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.363+0000 7f1c0337a700 1 -- 172.21.15.69:0/1763435825 wait complete. 2023-11-17T06:33:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.363+0000 7f1c0337a700 1 Processor -- start 2023-11-17T06:33:50.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.363+0000 7f1c0337a700 1 -- start start 2023-11-17T06:33:50.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c0337a700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bfc06d5d0 0x7f1bfc0b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:50.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c0337a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bfc142000 0x7f1bfc1f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:50.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c0337a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bfc1423e0 0x7f1bfc0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:50.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c0337a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b3ad0 con 0x7f1bfc142000 2023-11-17T06:33:50.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c0337a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b3d00 con 0x7f1bfc1423e0 2023-11-17T06:33:50.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c0337a700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0c3f80 con 0x7f1bfc06d5d0 2023-11-17T06:33:50.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c01b77700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bfc142000 0x7f1bfc1f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:50.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c01b77700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bfc142000 0x7f1bfc1f19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55790/0 (socket says 172.21.15.69:55790) 2023-11-17T06:33:50.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c01b77700 1 -- 172.21.15.69:0/2498245069 learned_addr learned my addr 172.21.15.69:0/2498245069 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:50.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c02378700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bfc06d5d0 0x7f1bfc0b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:50.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c02b79700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bfc1423e0 0x7f1bfc0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:50.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c01b77700 1 -- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bfc06d5d0 msgr2=0x7f1bfc0b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:50.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c01b77700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bfc06d5d0 0x7f1bfc0b4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:50.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c01b77700 1 -- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bfc1423e0 msgr2=0x7f1bfc0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:50.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c01b77700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bfc1423e0 0x7f1bfc0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:50.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c01b77700 1 -- 172.21.15.69:0/2498245069 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8009570 con 0x7f1bfc142000 2023-11-17T06:33:50.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c01b77700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bfc142000 0x7f1bfc1f19b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00c500 tx=0x7f1bec00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:50.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1bf2ffd700 1 -- 172.21.15.69:0/2498245069 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0052d0 con 0x7f1bfc142000 2023-11-17T06:33:50.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1bf2ffd700 1 -- 172.21.15.69:0/2498245069 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec005430 con 0x7f1bfc142000 2023-11-17T06:33:50.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c0337a700 1 -- 172.21.15.69:0/2498245069 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc0c4260 con 0x7f1bfc142000 2023-11-17T06:33:50.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1bf2ffd700 1 -- 172.21.15.69:0/2498245069 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec0055a0 con 0x7f1bfc142000 2023-11-17T06:33:50.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.367+0000 7f1c0337a700 1 -- 172.21.15.69:0/2498245069 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc0b3fe0 con 0x7f1bfc142000 2023-11-17T06:33:50.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.371+0000 7f1c0337a700 1 -- 172.21.15.69:0/2498245069 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc04e650 con 0x7f1bfc142000 2023-11-17T06:33:50.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.371+0000 7f1bf2ffd700 1 -- 172.21.15.69:0/2498245069 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1bec0038e0 con 0x7f1bfc142000 2023-11-17T06:33:50.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.371+0000 7f1bf2ffd700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be0066510 0x7f1be00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:50.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.371+0000 7f1bf2ffd700 1 -- 172.21.15.69:0/2498245069 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f1bec083400 con 0x7f1bfc142000 2023-11-17T06:33:50.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.375+0000 7f1c02378700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be0066510 0x7f1be00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:50.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.375+0000 7f1c02378700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be0066510 0x7f1be00689d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8000c00 tx=0x7f1bf8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:50.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.379+0000 7f1bf2ffd700 1 -- 172.21.15.69:0/2498245069 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f1bec050700 con 0x7f1bfc142000 2023-11-17T06:33:50.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:50.587+0000 7f1c0337a700 1 -- 172.21.15.69:0/2498245069 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1bfc0cf460 con 0x7f1bfc142000 2023-11-17T06:33:51.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.159+0000 7f1bf2ffd700 1 -- 172.21.15.69:0/2498245069 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1bec053d20 con 0x7f1bfc142000 2023-11-17T06:33:51.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 -- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be0066510 msgr2=0x7f1be00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be0066510 0x7f1be00689d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8000c00 tx=0x7f1bf8008030 comp rx=0 tx=0).stop 2023-11-17T06:33:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 -- 172.21.15.69:0/2498245069 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bfc142000 msgr2=0x7f1bfc1f19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bfc142000 0x7f1bfc1f19b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1bec00c500 tx=0x7f1bec00c810 comp rx=0 tx=0).stop 2023-11-17T06:33:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 -- 172.21.15.69:0/2498245069 shutdown_connections 2023-11-17T06:33:51.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1be0066510 0x7f1be00689d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1bfc1423e0 0x7f1bfc0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1bfc142000 0x7f1bfc1f19b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 --2- 172.21.15.69:0/2498245069 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f1bfc06d5d0 0x7f1bfc0b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 -- 172.21.15.69:0/2498245069 >> 172.21.15.69:0/2498245069 conn(0x7f1bfc0cedc0 msgr2=0x7f1bfc0af530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 -- 172.21.15.69:0/2498245069 shutdown_connections 2023-11-17T06:33:51.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.163+0000 7f1c0337a700 1 -- 172.21.15.69:0/2498245069 wait complete. 2023-11-17T06:33:51.195 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-17T06:33:51.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.379+0000 7fb494a4e700 1 Processor -- start 2023-11-17T06:33:51.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.379+0000 7fb494a4e700 1 -- start start 2023-11-17T06:33:51.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb494a4e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb4900cf820 0x7fb4900d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:51.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb494a4e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4900d1bf0 con 0x7fb49015d750 2023-11-17T06:33:51.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb494a4e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4900d1ed0 con 0x7fb4900ce530 2023-11-17T06:33:51.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb494a4e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4900d21b0 con 0x7fb4900cf820 2023-11-17T06:33:51.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48e59c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb49015d750 0x7fb4900cfc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39840/0 (socket says 172.21.15.69:39840) 2023-11-17T06:33:51.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48e59c700 1 -- 172.21.15.69:0/4035295020 learned_addr learned my addr 172.21.15.69:0/4035295020 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:51.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48ed9d700 1 --2- 172.21.15.69:0/4035295020 >> v2:172.21.15.69:3300/0 conn(0x7fb4900cf820 0x7fb4900d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:51.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48dd9b700 1 -- 172.21.15.69:0/4035295020 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114860178 0 0) 0x7fb4900d1bf0 con 0x7fb49015d750 2023-11-17T06:33:51.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48dd9b700 1 -- 172.21.15.69:0/4035295020 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4780035d0 con 0x7fb49015d750 2023-11-17T06:33:51.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48ed9d700 1 -- 172.21.15.69:0/4035295020 >> v1:172.21.15.93:6789/0 conn(0x7fb4900ce530 legacy=0x7fb4900b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:51.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48ed9d700 1 -- 172.21.15.69:0/4035295020 >> v1:172.21.15.69:6789/0 conn(0x7fb49015d750 legacy=0x7fb4900cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:51.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48ed9d700 1 -- 172.21.15.69:0/4035295020 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4900d2490 con 0x7fb4900cf820 2023-11-17T06:33:51.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48ed9d700 1 --2- 172.21.15.69:0/4035295020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900cf820 0x7fb4900d15c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb480009850 tx=0x7fb480009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe733b4804a8d1f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:51.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48dd9b700 1 -- 172.21.15.69:0/4035295020 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480011830 con 0x7fb4900cf820 2023-11-17T06:33:51.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48dd9b700 1 -- 172.21.15.69:0/4035295020 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb480011990 con 0x7fb4900cf820 2023-11-17T06:33:51.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.383+0000 7fb48dd9b700 1 -- 172.21.15.69:0/4035295020 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480011d00 con 0x7fb4900cf820 2023-11-17T06:33:51.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.387+0000 7fb494a4e700 1 -- 172.21.15.69:0/4035295020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900cf820 msgr2=0x7fb4900d15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:51.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.387+0000 7fb494a4e700 1 --2- 172.21.15.69:0/4035295020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900cf820 0x7fb4900d15c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb480009850 tx=0x7fb480009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:51.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.387+0000 7fb494a4e700 1 -- 172.21.15.69:0/4035295020 shutdown_connections 2023-11-17T06:33:51.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.387+0000 7fb494a4e700 1 --2- 172.21.15.69:0/4035295020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900cf820 0x7fb4900d15c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:51.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.387+0000 7fb494a4e700 1 -- 172.21.15.69:0/4035295020 >> 172.21.15.69:0/4035295020 conn(0x7fb4900b4c20 msgr2=0x7fb4900b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:51.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.387+0000 7fb494a4e700 1 -- 172.21.15.69:0/4035295020 shutdown_connections 2023-11-17T06:33:51.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.387+0000 7fb494a4e700 1 -- 172.21.15.69:0/4035295020 wait complete. 2023-11-17T06:33:51.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb494a4e700 1 Processor -- start 2023-11-17T06:33:51.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb494a4e700 1 -- start start 2023-11-17T06:33:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb494a4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900ce530 0x7fb4901e56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb494a4e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4900cf820 0x7fb4901f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb494a4e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb49015d750 0x7fb490152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb494a4e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901e5c00 con 0x7fb4900ce530 2023-11-17T06:33:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb494a4e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901e6c60 con 0x7fb49015d750 2023-11-17T06:33:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb494a4e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4901e6050 con 0x7fb4900cf820 2023-11-17T06:33:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900ce530 0x7fb4901e56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900ce530 0x7fb4901e56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55812/0 (socket says 172.21.15.69:55812) 2023-11-17T06:33:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48ed9d700 1 -- 172.21.15.69:0/752011050 learned_addr learned my addr 172.21.15.69:0/752011050 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:51.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48f59e700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb49015d750 0x7fb490152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48e59c700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4900cf820 0x7fb4901f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48ed9d700 1 -- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4900cf820 msgr2=0x7fb4901f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48ed9d700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4900cf820 0x7fb4901f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48ed9d700 1 -- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb49015d750 msgr2=0x7fb490152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48ed9d700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb49015d750 0x7fb490152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48ed9d700 1 -- 172.21.15.69:0/752011050 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800094b0 con 0x7fb4900ce530 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.391+0000 7fb48f59e700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb49015d750 0x7fb490152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.395+0000 7fb48ed9d700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900ce530 0x7fb4901e56c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb480000c00 tx=0x7fb480004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.395+0000 7fb4777fe700 1 -- 172.21.15.69:0/752011050 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800036c0 con 0x7fb4900ce530 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.395+0000 7fb4777fe700 1 -- 172.21.15.69:0/752011050 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48001f070 con 0x7fb4900ce530 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.395+0000 7fb494a4e700 1 -- 172.21.15.69:0/752011050 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4901e6330 con 0x7fb4900ce530 2023-11-17T06:33:51.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.395+0000 7fb4777fe700 1 -- 172.21.15.69:0/752011050 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480003a40 con 0x7fb4900ce530 2023-11-17T06:33:51.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.395+0000 7fb494a4e700 1 -- 172.21.15.69:0/752011050 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4901e68f0 con 0x7fb4900ce530 2023-11-17T06:33:51.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.395+0000 7fb494a4e700 1 -- 172.21.15.69:0/752011050 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49004eea0 con 0x7fb4900ce530 2023-11-17T06:33:51.402 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.399+0000 7fb4777fe700 1 -- 172.21.15.69:0/752011050 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb480003ba0 con 0x7fb4900ce530 2023-11-17T06:33:51.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.399+0000 7fb4777fe700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb47c066510 0x7fb47c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:51.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.399+0000 7fb4777fe700 1 -- 172.21.15.69:0/752011050 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6083+0+0 (secure 0 0 0) 0x7fb480021070 con 0x7fb4900ce530 2023-11-17T06:33:51.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.399+0000 7fb48e59c700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb47c066510 0x7fb47c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:51.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.399+0000 7fb48e59c700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb47c066510 0x7fb47c0689d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb490159100 tx=0x7fb484009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:51.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.403+0000 7fb4777fe700 1 -- 172.21.15.69:0/752011050 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fb480052920 con 0x7fb4900ce530 2023-11-17T06:33:51.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:51.579+0000 7fb494a4e700 1 -- 172.21.15.69:0/752011050 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb4901e5e30 con 0x7fb4900ce530 2023-11-17T06:33:52.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb4777fe700 1 -- 172.21.15.69:0/752011050 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb48002a0d0 con 0x7fb4900ce530 2023-11-17T06:33:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb494a4e700 1 -- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb47c066510 msgr2=0x7fb47c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb494a4e700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb47c066510 0x7fb47c0689d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb490159100 tx=0x7fb484009040 comp rx=0 tx=0).stop 2023-11-17T06:33:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb494a4e700 1 -- 172.21.15.69:0/752011050 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900ce530 msgr2=0x7fb4901e56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb494a4e700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900ce530 0x7fb4901e56c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb480000c00 tx=0x7fb480004770 comp rx=0 tx=0).stop 2023-11-17T06:33:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb494a4e700 1 -- 172.21.15.69:0/752011050 shutdown_connections 2023-11-17T06:33:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb494a4e700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb47c066510 0x7fb47c0689d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb494a4e700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb49015d750 0x7fb490152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb494a4e700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb4900cf820 0x7fb4901f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb494a4e700 1 --2- 172.21.15.69:0/752011050 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb4900ce530 0x7fb4901e56c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.311+0000 7fb494a4e700 1 -- 172.21.15.69:0/752011050 >> 172.21.15.69:0/752011050 conn(0x7fb4900b4c20 msgr2=0x7fb4900c95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:52.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.315+0000 7fb494a4e700 1 -- 172.21.15.69:0/752011050 shutdown_connections 2023-11-17T06:33:52.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.315+0000 7fb494a4e700 1 -- 172.21.15.69:0/752011050 wait complete. 2023-11-17T06:33:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' removed 2023-11-17T06:33:52.344 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-17T06:33:52.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.523+0000 7fe88f59e700 1 Processor -- start 2023-11-17T06:33:52.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.523+0000 7fe88f59e700 1 -- start start 2023-11-17T06:33:52.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88f59e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe8900cf820 0x7fe8900d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:52.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88f59e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fe89015d750 0x7fe8900cfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:52.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88f59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 0x7fe89006a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:52.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88f59e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8900d1bf0 con 0x7fe8900cf820 2023-11-17T06:33:52.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88f59e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8900d1ed0 con 0x7fe89015d750 2023-11-17T06:33:52.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88f59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900d21b0 con 0x7fe8900ce530 2023-11-17T06:33:52.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88e59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe8900cf820 0x7fe8900d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:52.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88e59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe8900cf820 0x7fe8900d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55818/0 (socket says 172.21.15.69:55818) 2023-11-17T06:33:52.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88e59c700 1 -- 172.21.15.69:0/1588952767 learned_addr learned my addr 172.21.15.69:0/1588952767 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:52.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88dd9b700 1 --2- 172.21.15.69:0/1588952767 >> v2:172.21.15.93:3300/0 conn(0x7fe89015d750 0x7fe8900cfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:52.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.527+0000 7fe88ed9d700 1 --2- 172.21.15.69:0/1588952767 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 0x7fe89006a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:52.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88e59c700 1 -- 172.21.15.69:0/1588952767 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 msgr2=0x7fe89006a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:52.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88e59c700 1 --2- 172.21.15.69:0/1588952767 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 0x7fe89006a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88e59c700 1 -- 172.21.15.69:0/1588952767 >> v2:172.21.15.93:3300/0 conn(0x7fe89015d750 msgr2=0x7fe8900cfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:52.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88e59c700 1 --2- 172.21.15.69:0/1588952767 >> v2:172.21.15.93:3300/0 conn(0x7fe89015d750 0x7fe8900cfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88e59c700 1 -- 172.21.15.69:0/1588952767 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8900d2490 con 0x7fe8900cf820 2023-11-17T06:33:52.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88ed9d700 1 --2- 172.21.15.69:0/1588952767 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 0x7fe89006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:52.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88e59c700 1 --2- 172.21.15.69:0/1588952767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8900cf820 0x7fe8900d15c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe8900d41a0 tx=0x7fe880009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3573e375c347ad server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:52.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88d59a700 1 -- 172.21.15.69:0/1588952767 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880011830 con 0x7fe8900cf820 2023-11-17T06:33:52.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88d59a700 1 -- 172.21.15.69:0/1588952767 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe880011990 con 0x7fe8900cf820 2023-11-17T06:33:52.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88d59a700 1 -- 172.21.15.69:0/1588952767 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe880011d20 con 0x7fe8900cf820 2023-11-17T06:33:52.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88f59e700 1 -- 172.21.15.69:0/1588952767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8900cf820 msgr2=0x7fe8900d15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:52.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88f59e700 1 --2- 172.21.15.69:0/1588952767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8900cf820 0x7fe8900d15c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe8900d41a0 tx=0x7fe880009bf0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88f59e700 1 -- 172.21.15.69:0/1588952767 shutdown_connections 2023-11-17T06:33:52.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88f59e700 1 --2- 172.21.15.69:0/1588952767 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 0x7fe89006a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88f59e700 1 --2- 172.21.15.69:0/1588952767 >> v2:172.21.15.93:3300/0 conn(0x7fe89015d750 0x7fe8900cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88f59e700 1 --2- 172.21.15.69:0/1588952767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8900cf820 0x7fe8900d15c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88f59e700 1 -- 172.21.15.69:0/1588952767 >> 172.21.15.69:0/1588952767 conn(0x7fe8900b4c20 msgr2=0x7fe8900b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:52.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88f59e700 1 -- 172.21.15.69:0/1588952767 shutdown_connections 2023-11-17T06:33:52.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.531+0000 7fe88f59e700 1 -- 172.21.15.69:0/1588952767 wait complete. 2023-11-17T06:33:52.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88f59e700 1 Processor -- start 2023-11-17T06:33:52.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88f59e700 1 -- start start 2023-11-17T06:33:52.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88f59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 0x7fe890155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:52.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88f59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8900cf820 0x7fe8901599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:52.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88f59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe89015d750 0x7fe8900b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:52.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88f59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8901582b0 con 0x7fe89015d750 2023-11-17T06:33:52.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88f59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8900c9bd0 con 0x7fe8900cf820 2023-11-17T06:33:52.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88f59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8901567f0 con 0x7fe8900ce530 2023-11-17T06:33:52.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe89015d750 0x7fe8900b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:52.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe89015d750 0x7fe8900b8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55830/0 (socket says 172.21.15.69:55830) 2023-11-17T06:33:52.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88ed9d700 1 -- 172.21.15.69:0/1944914390 learned_addr learned my addr 172.21.15.69:0/1944914390 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:52.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88e59c700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 0x7fe890155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:52.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88dd9b700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8900cf820 0x7fe8901599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:52.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88ed9d700 1 -- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 msgr2=0x7fe890155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:52.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88ed9d700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 0x7fe890155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88ed9d700 1 -- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8900cf820 msgr2=0x7fe8901599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:52.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88ed9d700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8900cf820 0x7fe8901599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:52.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88ed9d700 1 -- 172.21.15.69:0/1944914390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe880009570 con 0x7fe89015d750 2023-11-17T06:33:52.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.535+0000 7fe88dd9b700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8900cf820 0x7fe8901599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:52.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.539+0000 7fe88ed9d700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe89015d750 0x7fe8900b8270 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe888007ef0 tx=0x7fe88800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:52.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.539+0000 7fe87effd700 1 -- 172.21.15.69:0/1944914390 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88800de30 con 0x7fe89015d750 2023-11-17T06:33:52.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.539+0000 7fe87effd700 1 -- 172.21.15.69:0/1944914390 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88800f040 con 0x7fe89015d750 2023-11-17T06:33:52.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.539+0000 7fe88f59e700 1 -- 172.21.15.69:0/1944914390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8900c9610 con 0x7fe89015d750 2023-11-17T06:33:52.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.539+0000 7fe87effd700 1 -- 172.21.15.69:0/1944914390 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888003c80 con 0x7fe89015d750 2023-11-17T06:33:52.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.539+0000 7fe88f59e700 1 -- 172.21.15.69:0/1944914390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe890157ed0 con 0x7fe89015d750 2023-11-17T06:33:52.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.539+0000 7fe88f59e700 1 -- 172.21.15.69:0/1944914390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8901583f0 con 0x7fe89015d750 2023-11-17T06:33:52.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.543+0000 7fe87effd700 1 -- 172.21.15.69:0/1944914390 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fe888004030 con 0x7fe89015d750 2023-11-17T06:33:52.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.543+0000 7fe87effd700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe870066510 0x7fe8700689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:52.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.543+0000 7fe87effd700 1 -- 172.21.15.69:0/1944914390 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5645+0+0 (secure 0 0 0) 0x7fe888083ef0 con 0x7fe89015d750 2023-11-17T06:33:52.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.547+0000 7fe88e59c700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe870066510 0x7fe8700689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:52.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.547+0000 7fe88e59c700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe870066510 0x7fe8700689d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe880009860 tx=0x7fe880008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:52.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.551+0000 7fe87effd700 1 -- 172.21.15.69:0/1944914390 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fe8901583f0 con 0x7fe89015d750 2023-11-17T06:33:52.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:52.723+0000 7fe88f59e700 1 -- 172.21.15.69:0/1944914390 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe8901583f0 con 0x7fe89015d750 2023-11-17T06:33:53.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.323+0000 7fe87effd700 1 -- 172.21.15.69:0/1944914390 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe8901583f0 con 0x7fe89015d750 2023-11-17T06:33:53.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 -- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe870066510 msgr2=0x7fe8700689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe870066510 0x7fe8700689d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe880009860 tx=0x7fe880008030 comp rx=0 tx=0).stop 2023-11-17T06:33:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 -- 172.21.15.69:0/1944914390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe89015d750 msgr2=0x7fe8900b8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe89015d750 0x7fe8900b8270 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe888007ef0 tx=0x7fe88800d3b0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 -- 172.21.15.69:0/1944914390 shutdown_connections 2023-11-17T06:33:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fe870066510 0x7fe8700689d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe89015d750 0x7fe8900b8270 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe8900cf820 0x7fe8901599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 --2- 172.21.15.69:0/1944914390 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fe8900ce530 0x7fe890155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 -- 172.21.15.69:0/1944914390 >> 172.21.15.69:0/1944914390 conn(0x7fe8900b4c20 msgr2=0x7fe8900cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:53.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 -- 172.21.15.69:0/1944914390 shutdown_connections 2023-11-17T06:33:53.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.327+0000 7fe88f59e700 1 -- 172.21.15.69:0/1944914390 wait complete. 2023-11-17T06:33:53.338 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' removed 2023-11-17T06:33:53.358 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-17T06:33:53.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.555+0000 7fbc5df38700 1 Processor -- start 2023-11-17T06:33:53.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.555+0000 7fbc5df38700 1 -- start start 2023-11-17T06:33:53.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.559+0000 7fbc5df38700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbc5806bd80 0x7fbc58071db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.559+0000 7fbc5df38700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc58144e80 con 0x7fbc5806c160 2023-11-17T06:33:53.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.559+0000 7fbc5df38700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc580c95d0 con 0x7fbc580caac0 2023-11-17T06:33:53.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.559+0000 7fbc5df38700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc5806d400 con 0x7fbc5806bd80 2023-11-17T06:33:53.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.559+0000 7fbc577fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbc5806bd80 0x7fbc58071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.559+0000 7fbc56ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fbc5806c160 0x7fbc5806c5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:39850/0 (socket says 172.21.15.69:39850) 2023-11-17T06:33:53.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.559+0000 7fbc56ffd700 1 -- 172.21.15.69:0/4075804479 learned_addr learned my addr 172.21.15.69:0/4075804479 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:53.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.559+0000 7fbc577fe700 1 -- 172.21.15.69:0/4075804479 >> v1:172.21.15.93:6789/0 conn(0x7fbc580caac0 legacy=0x7fbc58164e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.559+0000 7fbc577fe700 1 -- 172.21.15.69:0/4075804479 >> v1:172.21.15.69:6789/0 conn(0x7fbc5806c160 legacy=0x7fbc5806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.559+0000 7fbc577fe700 1 -- 172.21.15.69:0/4075804479 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc5806d6e0 con 0x7fbc5806bd80 2023-11-17T06:33:53.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc577fe700 1 --2- 172.21.15.69:0/4075804479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 0x7fbc58071db0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009850 tx=0x7fbc48009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c781a4b90456ab server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:53.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc567fc700 1 -- 172.21.15.69:0/4075804479 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc48011830 con 0x7fbc5806bd80 2023-11-17T06:33:53.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc567fc700 1 -- 172.21.15.69:0/4075804479 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc48011990 con 0x7fbc5806bd80 2023-11-17T06:33:53.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc567fc700 1 -- 172.21.15.69:0/4075804479 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc48011d20 con 0x7fbc5806bd80 2023-11-17T06:33:53.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc5df38700 1 -- 172.21.15.69:0/4075804479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 msgr2=0x7fbc58071db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc5df38700 1 --2- 172.21.15.69:0/4075804479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 0x7fbc58071db0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009850 tx=0x7fbc48009b60 comp rx=0 tx=0).stop 2023-11-17T06:33:53.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc5df38700 1 -- 172.21.15.69:0/4075804479 shutdown_connections 2023-11-17T06:33:53.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc5df38700 1 --2- 172.21.15.69:0/4075804479 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 0x7fbc58071db0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc5df38700 1 -- 172.21.15.69:0/4075804479 >> 172.21.15.69:0/4075804479 conn(0x7fbc580ceee0 msgr2=0x7fbc580cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:53.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc5df38700 1 -- 172.21.15.69:0/4075804479 shutdown_connections 2023-11-17T06:33:53.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.563+0000 7fbc5df38700 1 -- 172.21.15.69:0/4075804479 wait complete. 2023-11-17T06:33:53.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc5df38700 1 Processor -- start 2023-11-17T06:33:53.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc5df38700 1 -- start start 2023-11-17T06:33:53.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc5df38700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 0x7fbc580c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc5df38700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc5806c160 0x7fbc580c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc5df38700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc580caac0 0x7fbc580af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc5df38700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc581f2990 con 0x7fbc5806bd80 2023-11-17T06:33:53.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc5df38700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc581f6de0 con 0x7fbc580caac0 2023-11-17T06:33:53.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc5df38700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc581f6020 con 0x7fbc5806c160 2023-11-17T06:33:53.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc577fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 0x7fbc580c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc577fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 0x7fbc580c7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55854/0 (socket says 172.21.15.69:55854) 2023-11-17T06:33:53.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc577fe700 1 -- 172.21.15.69:0/626933320 learned_addr learned my addr 172.21.15.69:0/626933320 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:53.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc56ffd700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc5806c160 0x7fbc580c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc57fff700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc580caac0 0x7fbc580af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc577fe700 1 -- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc5806c160 msgr2=0x7fbc580c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc577fe700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc5806c160 0x7fbc580c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc577fe700 1 -- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc580caac0 msgr2=0x7fbc580af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc577fe700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc580caac0 0x7fbc580af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc577fe700 1 -- 172.21.15.69:0/626933320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc480094b0 con 0x7fbc5806bd80 2023-11-17T06:33:53.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc577fe700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 0x7fbc580c7640 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009fd0 tx=0x7fbc48004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:53.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc3ffff700 1 -- 172.21.15.69:0/626933320 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc480038c0 con 0x7fbc5806bd80 2023-11-17T06:33:53.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc3ffff700 1 -- 172.21.15.69:0/626933320 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc4801e070 con 0x7fbc5806bd80 2023-11-17T06:33:53.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc5df38700 1 -- 172.21.15.69:0/626933320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc581f6300 con 0x7fbc5806bd80 2023-11-17T06:33:53.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.567+0000 7fbc3ffff700 1 -- 172.21.15.69:0/626933320 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc48003c80 con 0x7fbc5806bd80 2023-11-17T06:33:53.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.571+0000 7fbc5df38700 1 -- 172.21.15.69:0/626933320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc581f68c0 con 0x7fbc5806bd80 2023-11-17T06:33:53.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.571+0000 7fbc5df38700 1 -- 172.21.15.69:0/626933320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc581f6ab0 con 0x7fbc5806bd80 2023-11-17T06:33:53.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.571+0000 7fbc3ffff700 1 -- 172.21.15.69:0/626933320 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbc4801a420 con 0x7fbc5806bd80 2023-11-17T06:33:53.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.575+0000 7fbc3ffff700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc44066510 0x7fbc440689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.575+0000 7fbc3ffff700 1 -- 172.21.15.69:0/626933320 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fbc48020070 con 0x7fbc5806bd80 2023-11-17T06:33:53.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.575+0000 7fbc56ffd700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc44066510 0x7fbc440689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.575+0000 7fbc56ffd700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc44066510 0x7fbc440689d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbc5806c810 tx=0x7fbc4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:53.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.579+0000 7fbc3ffff700 1 -- 172.21.15.69:0/626933320 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbc48052a80 con 0x7fbc5806bd80 2023-11-17T06:33:53.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.755+0000 7fbc5df38700 1 -- 172.21.15.69:0/626933320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbc580ad410 con 0x7fbc5806bd80 2023-11-17T06:33:53.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.759+0000 7fbc3ffff700 1 -- 172.21.15.69:0/626933320 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc480560a0 con 0x7fbc5806bd80 2023-11-17T06:33:53.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.763+0000 7fbc5df38700 1 -- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc44066510 msgr2=0x7fbc440689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.763+0000 7fbc5df38700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc44066510 0x7fbc440689d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbc5806c810 tx=0x7fbc4c009040 comp rx=0 tx=0).stop 2023-11-17T06:33:53.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.763+0000 7fbc5df38700 1 -- 172.21.15.69:0/626933320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 msgr2=0x7fbc580c7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.763+0000 7fbc5df38700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 0x7fbc580c7640 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fbc48009fd0 tx=0x7fbc48004770 comp rx=0 tx=0).stop 2023-11-17T06:33:53.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.767+0000 7fbc5df38700 1 -- 172.21.15.69:0/626933320 shutdown_connections 2023-11-17T06:33:53.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.767+0000 7fbc5df38700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbc44066510 0x7fbc440689d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.767+0000 7fbc5df38700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbc580caac0 0x7fbc580af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.767+0000 7fbc5df38700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbc5806c160 0x7fbc580c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.767+0000 7fbc5df38700 1 --2- 172.21.15.69:0/626933320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc5806bd80 0x7fbc580c7640 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.767+0000 7fbc5df38700 1 -- 172.21.15.69:0/626933320 >> 172.21.15.69:0/626933320 conn(0x7fbc580ceee0 msgr2=0x7fbc580adc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:53.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.767+0000 7fbc5df38700 1 -- 172.21.15.69:0/626933320 shutdown_connections 2023-11-17T06:33:53.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.767+0000 7fbc5df38700 1 -- 172.21.15.69:0/626933320 wait complete. 2023-11-17T06:33:53.793 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection' 2023-11-17T06:33:53.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.967+0000 7f9361923700 1 Processor -- start 2023-11-17T06:33:53.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.967+0000 7f9361923700 1 -- start start 2023-11-17T06:33:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f9361923700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 0x7f935c0d2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f9361923700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f935c161be0 0x7f935c0ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f9361923700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935c0ceba0 con 0x7f935c0ce1e0 2023-11-17T06:33:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f9361923700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935c0d21a0 con 0x7f935c161be0 2023-11-17T06:33:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f9361923700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c15dc50 con 0x7f935c15d870 2023-11-17T06:33:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f935affd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 0x7f935c0d2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f935affd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 0x7f935c0d2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:51890/0 (socket says 172.21.15.69:51890) 2023-11-17T06:33:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f935b7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f935c161be0 0x7f935c0ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f935affd700 1 -- 172.21.15.69:0/529070613 learned_addr learned my addr 172.21.15.69:0/529070613 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f935affd700 1 -- 172.21.15.69:0/529070613 >> v2:172.21.15.93:3300/0 conn(0x7f935c161be0 msgr2=0x7f935c0ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f935affd700 1 --2- 172.21.15.69:0/529070613 >> v2:172.21.15.93:3300/0 conn(0x7f935c161be0 0x7f935c0ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f935affd700 1 -- 172.21.15.69:0/529070613 >> v1:172.21.15.93:6789/0 conn(0x7f935c0ce1e0 legacy=0x7f935c1614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f935affd700 1 -- 172.21.15.69:0/529070613 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c0d1870 con 0x7f935c15d870 2023-11-17T06:33:53.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f935affd700 1 --2- 172.21.15.69:0/529070613 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 0x7f935c0d2630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f934c009910 tx=0x7f934c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb04b7b0195f899c server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:53.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f9359ffb700 1 -- 172.21.15.69:0/529070613 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c011830 con 0x7f935c15d870 2023-11-17T06:33:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f9359ffb700 1 -- 172.21.15.69:0/529070613 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c011990 con 0x7f935c15d870 2023-11-17T06:33:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.971+0000 7f9359ffb700 1 -- 172.21.15.69:0/529070613 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c011d40 con 0x7f935c15d870 2023-11-17T06:33:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.975+0000 7f9361923700 1 -- 172.21.15.69:0/529070613 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 msgr2=0x7f935c0d2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.975+0000 7f9361923700 1 --2- 172.21.15.69:0/529070613 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 0x7f935c0d2630 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f934c009910 tx=0x7f934c009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.975+0000 7f9361923700 1 -- 172.21.15.69:0/529070613 shutdown_connections 2023-11-17T06:33:53.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.975+0000 7f9361923700 1 --2- 172.21.15.69:0/529070613 >> v2:172.21.15.93:3300/0 conn(0x7f935c161be0 0x7f935c0ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.975+0000 7f9361923700 1 --2- 172.21.15.69:0/529070613 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 0x7f935c0d2630 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.975+0000 7f9361923700 1 -- 172.21.15.69:0/529070613 >> 172.21.15.69:0/529070613 conn(0x7f935c0d3250 msgr2=0x7f935c0d3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:53.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.975+0000 7f9361923700 1 -- 172.21.15.69:0/529070613 shutdown_connections 2023-11-17T06:33:53.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.975+0000 7f9361923700 1 -- 172.21.15.69:0/529070613 wait complete. 2023-11-17T06:33:53.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.975+0000 7f9361923700 1 Processor -- start 2023-11-17T06:33:53.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.975+0000 7f9361923700 1 -- start start 2023-11-17T06:33:53.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9361923700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f935c0ce1e0 0x7f935c159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9361923700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 0x7f935c0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9361923700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f935c161be0 0x7f935c0c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9361923700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c15a490 con 0x7f935c161be0 2023-11-17T06:33:53.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9361923700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c0c94c0 con 0x7f935c0ce1e0 2023-11-17T06:33:53.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9361923700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c0c91e0 con 0x7f935c15d870 2023-11-17T06:33:53.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f935c161be0 0x7f935c0c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935a7fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 0x7f935c0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f935c161be0 0x7f935c0c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56812/0 (socket says 172.21.15.69:56812) 2023-11-17T06:33:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935b7fe700 1 -- 172.21.15.69:0/904765421 learned_addr learned my addr 172.21.15.69:0/904765421 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935affd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f935c0ce1e0 0x7f935c159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935b7fe700 1 -- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 msgr2=0x7f935c0b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935b7fe700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 0x7f935c0b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935b7fe700 1 -- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f935c0ce1e0 msgr2=0x7f935c159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935b7fe700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f935c0ce1e0 0x7f935c159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935b7fe700 1 -- 172.21.15.69:0/904765421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c009570 con 0x7f935c161be0 2023-11-17T06:33:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f935b7fe700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f935c161be0 0x7f935c0c8790 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f935400efc0 tx=0x7f935400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9343fff700 1 -- 172.21.15.69:0/904765421 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935400cad0 con 0x7f935c161be0 2023-11-17T06:33:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9343fff700 1 -- 172.21.15.69:0/904765421 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935400f040 con 0x7f935c161be0 2023-11-17T06:33:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9361923700 1 -- 172.21.15.69:0/904765421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935c0b2e50 con 0x7f935c161be0 2023-11-17T06:33:53.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9343fff700 1 -- 172.21.15.69:0/904765421 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935400ce70 con 0x7f935c161be0 2023-11-17T06:33:53.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.979+0000 7f9361923700 1 -- 172.21.15.69:0/904765421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935c0b3410 con 0x7f935c161be0 2023-11-17T06:33:53.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.983+0000 7f9361923700 1 -- 172.21.15.69:0/904765421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935c0b3630 con 0x7f935c161be0 2023-11-17T06:33:53.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.983+0000 7f9343fff700 1 -- 172.21.15.69:0/904765421 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f9354014480 con 0x7f935c161be0 2023-11-17T06:33:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.987+0000 7f9343fff700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9348066510 0x7f93480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.987+0000 7f9343fff700 1 -- 172.21.15.69:0/904765421 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f9354084330 con 0x7f935c161be0 2023-11-17T06:33:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.987+0000 7f935affd700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9348066510 0x7f93480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:53.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.987+0000 7f935affd700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9348066510 0x7f93480689d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f934c000c00 tx=0x7f934c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:53.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:53.991+0000 7f9343fff700 1 -- 172.21.15.69:0/904765421 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f93540519f0 con 0x7f935c161be0 2023-11-17T06:33:54.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.231+0000 7f9361923700 1 -- 172.21.15.69:0/904765421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]} v 0) v1 -- 0x7f935c0b2cb0 con 0x7f935c161be0 2023-11-17T06:33:54.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.327+0000 7f9343fff700 1 -- 172.21.15.69:0/904765421 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]}]=0 v218) v1 ==== 145+0+0 (secure 0 0 0) 0x7f935c0b2cb0 con 0x7f935c161be0 2023-11-17T06:33:54.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 -- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9348066510 msgr2=0x7f93480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:54.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9348066510 0x7f93480689d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f934c000c00 tx=0x7f934c008030 comp rx=0 tx=0).stop 2023-11-17T06:33:54.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 -- 172.21.15.69:0/904765421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f935c161be0 msgr2=0x7f935c0c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:54.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f935c161be0 0x7f935c0c8790 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f935400efc0 tx=0x7f935400c0c0 comp rx=0 tx=0).stop 2023-11-17T06:33:54.336 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 -- 172.21.15.69:0/904765421 shutdown_connections 2023-11-17T06:33:54.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9348066510 0x7f93480689d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:54.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f935c161be0 0x7f935c0c8790 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:54.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f935c15d870 0x7f935c0b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:54.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 --2- 172.21.15.69:0/904765421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f935c0ce1e0 0x7f935c159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:54.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 -- 172.21.15.69:0/904765421 >> 172.21.15.69:0/904765421 conn(0x7f935c0d3250 msgr2=0x7f935c0cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:54.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 -- 172.21.15.69:0/904765421 shutdown_connections 2023-11-17T06:33:54.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:54.331+0000 7f9361923700 1 -- 172.21.15.69:0/904765421 wait complete. 2023-11-17T06:33:54.359 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. ... ERROR 2023-11-17T06:33:54.360 INFO:tasks.cephfs_test_runner: 2023-11-17T06:33:54.360 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-17T06:33:54.360 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-17T06:33:54.360 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-17T06:33:54.360 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-17T06:33:54.360 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-17T06:33:54.360 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/test_data_scan.py", line 594, in test_fragmented_injection 2023-11-17T06:33:54.360 INFO:tasks.cephfs_test_runner: out = self.mount_a.run_shell_payload(f"sudo cat subdir/{victim_dentry}", omit_sudo=False).stdout.getvalue().strip() 2023-11-17T06:33:54.361 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/mount.py", line 793, in run_shell_payload 2023-11-17T06:33:54.361 INFO:tasks.cephfs_test_runner: return self.run_shell(**kwargs) 2023-11-17T06:33:54.361 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-17T06:33:54.361 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-17T06:33:54.361 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-17T06:33:54.361 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-17T06:33:54.361 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-17T06:33:54.361 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-17T06:33:54.362 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-17T06:33:54.362 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-17T06:33:54.362 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-17T06:33:54.362 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-17T06:33:54.362 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 1: "(cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo cat subdir/21')" 2023-11-17T06:33:54.362 INFO:tasks.cephfs_test_runner: 2023-11-17T06:33:54.362 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-17T06:33:54.363 INFO:tasks.cephfs_test_runner:Ran 1 test in 192.188s 2023-11-17T06:33:54.363 INFO:tasks.cephfs_test_runner: 2023-11-17T06:33:54.363 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-17T06:33:54.363 INFO:tasks.cephfs_test_runner: 2023-11-17T06:33:54.363 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-17T06:33:54.363 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-17T06:33:54.363 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-11-17T06:33:54.363 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-17T06:33:54.364 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-17T06:33:54.364 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/test_data_scan.py", line 594, in test_fragmented_injection 2023-11-17T06:33:54.364 INFO:tasks.cephfs_test_runner: out = self.mount_a.run_shell_payload(f"sudo cat subdir/{victim_dentry}", omit_sudo=False).stdout.getvalue().strip() 2023-11-17T06:33:54.364 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/mount.py", line 793, in run_shell_payload 2023-11-17T06:33:54.364 INFO:tasks.cephfs_test_runner: return self.run_shell(**kwargs) 2023-11-17T06:33:54.364 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-11-17T06:33:54.364 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-11-17T06:33:54.364 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/remote.py", line 522, in run 2023-11-17T06:33:54.364 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-11-17T06:33:54.365 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 455, in run 2023-11-17T06:33:54.365 INFO:tasks.cephfs_test_runner: r.wait() 2023-11-17T06:33:54.365 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 161, in wait 2023-11-17T06:33:54.365 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-11-17T06:33:54.365 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-11-17T06:33:54.365 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-11-17T06:33:54.365 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi069 with status 1: "(cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo cat subdir/21')" 2023-11-17T06:33:54.365 INFO:tasks.cephfs_test_runner: 2023-11-17T06:33:54.366 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-17T06:33:54.437 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=533bb14c1b45495bab1458bded46358a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_895e5adad9a763a0f13587c485b17f1ad3f04528/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-11-17T06:33:54.442 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-17T06:33:54.466 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-11-17T06:33:54.541 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-11-17T06:33:54.541 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:33:54.542 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:54.565 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352148k,nr_inodes=4088037,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4305 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-17T06:33:54.565 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-11-17T06:33:54.566 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:54.628 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352148k,nr_inodes=4088037,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4305 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-17T06:33:54.628 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:33:54.629 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:54.650 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352148k,nr_inodes=4088037,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6763 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-17T06:33:54.651 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-11-17T06:33:54.651 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-17T06:33:54.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352148k,nr_inodes=4088037,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=6763 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275348k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275352k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-17T06:33:54.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:54.713 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-11-17T06:33:54.730 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-17T06:33:54.731 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-17T06:33:54.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:54.732 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-17T06:33:54.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:54.816 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-17T06:33:54.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:54.900 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2023-11-17T06:33:55.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:55.092 DEBUG:teuthology.orchestra.run.smithi093:> ip netns list 2023-11-17T06:33:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-17T06:33:55.111 INFO:teuthology.orchestra.run.smithi093.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-17T06:33:55.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:55.112 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-17T06:33:55.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:55.195 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-17T06:33:55.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-17T06:33:55.299 DEBUG:teuthology.orchestra.run.smithi093:> sudo ip link delete ceph-brx 2023-11-17T06:33:55.463 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-17T06:33:55.481 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-17T06:33:55.482 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:33:55.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.663+0000 7fdb6b59e700 1 Processor -- start 2023-11-17T06:33:55.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.663+0000 7fdb6b59e700 1 -- start start 2023-11-17T06:33:55.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb6b59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 0x7fdb6c0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:55.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb6b59e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c0ca6b0 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb6b59e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c0ca8e0 con 0x7fdb6c15d480 2023-11-17T06:33:55.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb6b59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c15d860 con 0x7fdb6c0cd340 2023-11-17T06:33:55.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb61d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fdb6c0cb0f0 0x7fdb6c0ccc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40280/0 (socket says 172.21.15.69:40280) 2023-11-17T06:33:55.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb61d9b700 1 -- 172.21.15.69:0/1608898991 learned_addr learned my addr 172.21.15.69:0/1608898991 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:55.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb6ad9d700 1 --2- 172.21.15.69:0/1608898991 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 0x7fdb6c0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:55.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb69d9b700 1 -- 172.21.15.69:0/1608898991 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960802462 0 0) 0x7fdb6c0ca6b0 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb69d9b700 1 -- 172.21.15.69:0/1608898991 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb580035d0 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb69d9b700 1 -- 172.21.15.69:0/1608898991 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614902395 0 0) 0x7fdb6c0ca8e0 con 0x7fdb6c15d480 2023-11-17T06:33:55.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb69d9b700 1 -- 172.21.15.69:0/1608898991 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb6c0ca6b0 con 0x7fdb6c15d480 2023-11-17T06:33:55.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb6ad9d700 1 -- 172.21.15.69:0/1608898991 >> v1:172.21.15.93:6789/0 conn(0x7fdb6c15d480 legacy=0x7fdb6c06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:55.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb6ad9d700 1 -- 172.21.15.69:0/1608898991 >> v1:172.21.15.69:6789/0 conn(0x7fdb6c0cb0f0 legacy=0x7fdb6c0ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:55.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb69d9b700 1 -- 172.21.15.69:0/1608898991 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 159970433 0 0) 0x7fdb580035d0 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.667+0000 7fdb6ad9d700 1 -- 172.21.15.69:0/1608898991 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c0aca00 con 0x7fdb6c0cd340 2023-11-17T06:33:55.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb6ad9d700 1 --2- 172.21.15.69:0/1608898991 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 0x7fdb6c0ca170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009df0 tx=0x7fdb6400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f879b7ab1c2f6970 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:55.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb69d9b700 1 -- 172.21.15.69:0/1608898991 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6400e070 con 0x7fdb6c0cd340 2023-11-17T06:33:55.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb69d9b700 1 -- 172.21.15.69:0/1608898991 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64003a40 con 0x7fdb6c0cd340 2023-11-17T06:33:55.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb69d9b700 1 -- 172.21.15.69:0/1608898991 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54001670 con 0x7fdb6c0cd340 2023-11-17T06:33:55.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb6b59e700 1 -- 172.21.15.69:0/1608898991 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 msgr2=0x7fdb6c0ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:55.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb6b59e700 1 --2- 172.21.15.69:0/1608898991 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 0x7fdb6c0ca170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009df0 tx=0x7fdb6400b330 comp rx=0 tx=0).stop 2023-11-17T06:33:55.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb6b59e700 1 -- 172.21.15.69:0/1608898991 shutdown_connections 2023-11-17T06:33:55.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb6b59e700 1 --2- 172.21.15.69:0/1608898991 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 0x7fdb6c0ca170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:55.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb6b59e700 1 -- 172.21.15.69:0/1608898991 >> 172.21.15.69:0/1608898991 conn(0x7fdb6c0cece0 msgr2=0x7fdb6c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:55.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb6b59e700 1 -- 172.21.15.69:0/1608898991 shutdown_connections 2023-11-17T06:33:55.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.671+0000 7fdb6b59e700 1 -- 172.21.15.69:0/1608898991 wait complete. 2023-11-17T06:33:55.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.675+0000 7fdb6b59e700 1 Processor -- start 2023-11-17T06:33:55.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.675+0000 7fdb6b59e700 1 -- start start 2023-11-17T06:33:55.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.675+0000 7fdb6b59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb6c0cb0f0 0x7fdb6c0c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:55.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.675+0000 7fdb6b59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 0x7fdb6c0c26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:55.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.675+0000 7fdb6b59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb6c15d480 0x7fdb6c1f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:55.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.675+0000 7fdb6b59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0c2bf0 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.675+0000 7fdb6b59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0c3730 con 0x7fdb6c15d480 2023-11-17T06:33:55.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.675+0000 7fdb6b59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c0c2e90 con 0x7fdb6c0cd340 2023-11-17T06:33:55.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb6c0cb0f0 0x7fdb6c0c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:55.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb6c0cb0f0 0x7fdb6c0c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56824/0 (socket says 172.21.15.69:56824) 2023-11-17T06:33:55.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6a59c700 1 -- 172.21.15.69:0/3689835498 learned_addr learned my addr 172.21.15.69:0/3689835498 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:55.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6ad9d700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb6c15d480 0x7fdb6c1f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:55.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb61d9b700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 0x7fdb6c0c26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:55.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6a59c700 1 -- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 msgr2=0x7fdb6c0c26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:55.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6a59c700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 0x7fdb6c0c26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:55.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6a59c700 1 -- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb6c15d480 msgr2=0x7fdb6c1f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:55.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6a59c700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb6c15d480 0x7fdb6c1f22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:55.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6a59c700 1 -- 172.21.15.69:0/3689835498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb64009a70 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb61d9b700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 0x7fdb6c0c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:55.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6a59c700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb6c0cb0f0 0x7fdb6c0c4950 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c4e0 tx=0x7fdb5c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:55.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb637fe700 1 -- 172.21.15.69:0/3689835498 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0052d0 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb637fe700 1 -- 172.21.15.69:0/3689835498 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c005450 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6b59e700 1 -- 172.21.15.69:0/3689835498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c0c3170 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb637fe700 1 -- 172.21.15.69:0/3689835498 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0038e0 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6b59e700 1 -- 172.21.15.69:0/3689835498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c1f2bb0 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.679+0000 7fdb6b59e700 1 -- 172.21.15.69:0/3689835498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c0ce150 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.683+0000 7fdb637fe700 1 -- 172.21.15.69:0/3689835498 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fdb5c003a40 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.683+0000 7fdb637fe700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdb4c066510 0x7fdb4c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:55.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.683+0000 7fdb637fe700 1 -- 172.21.15.69:0/3689835498 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fdb5c0830a0 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.683+0000 7fdb61d9b700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdb4c066510 0x7fdb4c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:55.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.683+0000 7fdb61d9b700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdb4c066510 0x7fdb4c0689d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdb540017e0 tx=0x7fdb540015d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:55.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.687+0000 7fdb637fe700 1 -- 172.21.15.69:0/3689835498 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fdb5c050770 con 0x7fdb6c0cb0f0 2023-11-17T06:33:55.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.859+0000 7fdb6b59e700 1 -- 172.21.15.69:0/3689835498 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb6c0acfc0 con 0x7fdb4c066510 2023-11-17T06:33:55.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.867+0000 7fdb637fe700 1 -- 172.21.15.69:0/3689835498 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48488 (secure 0 0 0) 0x7fdb54005e20 con 0x7fdb4c066510 2023-11-17T06:33:55.874 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:55.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 -- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdb4c066510 msgr2=0x7fdb4c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:55.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdb4c066510 0x7fdb4c0689d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdb540017e0 tx=0x7fdb540015d0 comp rx=0 tx=0).stop 2023-11-17T06:33:55.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 -- 172.21.15.69:0/3689835498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb6c0cb0f0 msgr2=0x7fdb6c0c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:55.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb6c0cb0f0 0x7fdb6c0c4950 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c00c4e0 tx=0x7fdb5c00c7f0 comp rx=0 tx=0).stop 2023-11-17T06:33:55.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 -- 172.21.15.69:0/3689835498 shutdown_connections 2023-11-17T06:33:55.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdb4c066510 0x7fdb4c0689d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:55.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb6c15d480 0x7fdb6c1f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:55.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdb6c0cd340 0x7fdb6c0c26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:55.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 --2- 172.21.15.69:0/3689835498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb6c0cb0f0 0x7fdb6c0c4950 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:55.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 -- 172.21.15.69:0/3689835498 >> 172.21.15.69:0/3689835498 conn(0x7fdb6c0cece0 msgr2=0x7fdb6c0ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:55.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 -- 172.21.15.69:0/3689835498 shutdown_connections 2023-11-17T06:33:55.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:55.871+0000 7fdb6b59e700 1 -- 172.21.15.69:0/3689835498 wait complete. 2023-11-17T06:33:55.882 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:33:55.902 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2023-11-17T06:33:54.450679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235000,"kb_used_data":6376,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739720,"statfs":{"total":773094113280,"available":772853473280,"internally_reserved":0,"allocated":6529024,"data_stored":3499460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":234016313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-404281,"num_objects":-123,"num_object_clones":0,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":0,"num_read":-1808,"num_read_kb":-1513,"num_write":-908,"num_write_kb":-889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001872"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":181,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-17T06:33:30.647441+0000","last_change":"2023-11-17T06:29:48.031659+0000","last_active":"2023-11-17T06:33:30.647441+0000","last_peered":"2023-11-17T06:33:30.647441+0000","last_clean":"2023-11-17T06:33:30.647441+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:33:30.647441+0000","last_undegraded":"2023-11-17T06:33:30.647441+0000","last_fullsized":"2023-11-17T06:33:30.647441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_clean_scrub_stamp":"2023-11-17T06:29:47.005420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:11:29.801860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":186575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.137,"15min":1.149},"min":{"1min":0.71499999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.498,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.052},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.115,"15min":1.137},"min":{"1min":0.74399999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.627,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.29}]},{"osd":1,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.196,"15min":1.216},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.542,"5min":1.708,"15min":1.708},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1879999999999999,"15min":1.216},"min":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.4970000000000001,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1459999999999999,"15min":1.1439999999999999},"min":{"1min":0.88300000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4850000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.3129999999999999,"15min":1.3600000000000001},"min":{"1min":0.93500000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.482,"5min":2.173,"15min":2.173},"last":1.5700000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.288,"15min":1.3129999999999999},"min":{"1min":0.88700000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.585,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.363},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.403,"15min":1.4510000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.6659999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.4219999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.2509999999999999,"15min":1.3240000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5069999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.456},{"interface":"front","average":{"1min":1.177,"5min":1.2989999999999999,"15min":1.345},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5940000000000001,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.2470000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.411,"15min":1.4710000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.617,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.645},{"interface":"front","average":{"1min":1.26,"5min":1.411,"15min":1.4730000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.569,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.601}]},{"osd":6,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.5629999999999999,"15min":1.6459999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.571,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4590000000000001,"15min":1.502},"min":{"1min":0.81299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5780000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.526}]}]},{"osd":6,"up_from":15,"seq":64424509492,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":589858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1539999999999999,"15min":1.1879999999999999},"min":{"1min":0.59599999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6379999999999999,"5min":2.726,"15min":2.726},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.268,"15min":1.393},"min":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.556,"5min":6.3339999999999996,"15min":6.3339999999999996},"last":1.3}]},{"osd":1,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.119,"15min":1.1240000000000001},"min":{"1min":0.72399999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.4450000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.23,"15min":1.1990000000000001},"min":{"1min":0.80400000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.468,"5min":1.708,"15min":1.708},"last":1.2050000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.254,"15min":1.347},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4410000000000001,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.272,"15min":1.3380000000000001},"min":{"1min":0.93700000000000006,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6619999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.3320000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3009999999999999,"15min":1.3440000000000001},"min":{"1min":0.86499999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6100000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.401,"15min":1.516},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5820000000000001,"5min":6.2210000000000001,"15min":6.2210000000000001},"last":1.367}]},{"osd":4,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2709999999999999,"15min":1.286},"min":{"1min":0.91900000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6240000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.079},{"interface":"front","average":{"1min":1.206,"5min":1.266,"15min":1.333},"min":{"1min":0.873,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5740000000000001,"5min":1.99,"15min":1.99},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.337,"15min":1.407},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.595,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.391,"5min":1.4259999999999999,"15min":1.4430000000000001},"min":{"1min":0.93000000000000005,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6990000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.274}]},{"osd":7,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3759999999999999,"15min":1.464},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.554,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.393,"5min":1.4370000000000001,"15min":1.4970000000000001},"min":{"1min":0.90900000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.7490000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.4019999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1003520,"data_stored":589883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.081,"15min":1.103},"min":{"1min":0.81000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4370000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.878},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.145,"15min":1.1459999999999999},"min":{"1min":0.89800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.532,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.1619999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1539999999999999,"15min":1.1399999999999999},"min":{"1min":0.83799999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6930000000000001,"5min":1.744,"15min":1.744},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.236,"15min":1.27},"min":{"1min":0.88300000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5669999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.98699999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.25,"15min":1.272},"min":{"1min":0.83799999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.603,"5min":1.794,"15min":1.794},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.3,"15min":1.3160000000000001},"min":{"1min":0.78100000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.571,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.121}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2989999999999999,"15min":1.345},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.6100000000000001,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.05},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2649999999999999,"15min":1.2669999999999999},"min":{"1min":0.99099999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.8420000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3560000000000001,"15min":1.4059999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7490000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3380000000000001,"15min":1.3700000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6870000000000001,"5min":2.411,"15min":2.411},"last":1.399}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3320000000000001,"15min":1.369},"min":{"1min":0.85499999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7110000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.472,"15min":1.534},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6559999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4410000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.276,"15min":1.29},"min":{"1min":0.84299999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5860000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.256},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.401,"15min":1.4219999999999999},"min":{"1min":0.89200000000000002,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.7769999999999999,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.351}]}]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":569344,"data_stored":187329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.86199999999999999,"15min":0.88700000000000001},"min":{"1min":0.64500000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1830000000000001,"5min":1.615,"15min":1.615},"last":0.628},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95299999999999996,"15min":0.96899999999999997},"min":{"1min":0.64700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3620000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.88800000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.90700000000000003,"15min":0.92300000000000004},"min":{"1min":0.55500000000000005,"5min":0.441,"15min":0.441},"max":{"1min":1.2290000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0549999999999999,"15min":1.0569999999999999},"min":{"1min":0.73499999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.585,"5min":1.671,"15min":1.671},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.2490000000000001,"15min":1.3400000000000001},"min":{"1min":0.81999999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4410000000000001,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.165,"5min":1.135,"15min":1.1559999999999999},"min":{"1min":0.85599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5449999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.84799999999999998}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3360000000000001,"15min":1.3640000000000001},"min":{"1min":1.0209999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5329999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.278,"15min":1.3120000000000001},"min":{"1min":0.83699999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.462,"5min":2.085,"15min":2.085},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.431,"15min":1.4850000000000001},"min":{"1min":1.143,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.6200000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.347,"15min":1.375},"min":{"1min":0.92700000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.4490000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.351,"15min":1.365},"min":{"1min":1.0469999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.7889999999999999,"5min":2.177,"15min":2.177},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4710000000000001,"15min":1.4990000000000001},"min":{"1min":1.2849999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.615,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.357,"15min":1.373},"min":{"1min":1.113,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.5269999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.181},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4139999999999999,"15min":1.4239999999999999},"min":{"1min":1.1899999999999999,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.95,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.97399999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":569344,"data_stored":186595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.99199999999999999,"15min":1.071},"min":{"1min":0.54500000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2769999999999999,"5min":4.2469999999999999,"15min":4.2469999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.198,"15min":1.3240000000000001},"min":{"1min":0.64000000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.25,"5min":8.0510000000000002,"15min":8.0510000000000002},"last":0.90600000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94099999999999995,"15min":0.94499999999999995},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.208,"5min":1.2569999999999999,"15min":1.3},"min":{"1min":0.88800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.2589999999999999,"5min":4.5279999999999996,"15min":4.5279999999999996},"last":1.002}]},{"osd":3,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.105,"15min":1.1719999999999999},"min":{"1min":0.71599999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3899999999999999,"5min":4.2960000000000003,"15min":4.2960000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.276,"15min":1.359},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.956,"5min":4.2720000000000002,"15min":4.2720000000000002},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.359,"15min":1.421},"min":{"1min":0.95699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.4610000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.51,"15min":1.5800000000000001},"min":{"1min":1.1439999999999999,"5min":1.052,"15min":1.052},"max":{"1min":1.6990000000000001,"5min":4.6459999999999999,"15min":4.6459999999999999},"last":1.276}]},{"osd":5,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3420000000000001,"15min":1.375},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6910000000000001,"5min":1.875,"15min":1.875},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.502,"15min":1.573},"min":{"1min":1.1339999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.798,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":1.1579999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.595,"15min":1.6850000000000001},"min":{"1min":1.2310000000000001,"5min":1.056,"15min":1.056},"max":{"1min":1.6659999999999999,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.198},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.448,"15min":1.494},"min":{"1min":1.0049999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.72,"5min":2.218,"15min":2.218},"last":1.0229999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.49,"15min":1.55},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":1.8160000000000001,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.5249999999999999,"15min":1.589},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":1.6419999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.0600000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1155072,"data_stored":776992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93700000000000006,"15min":0.97399999999999998},"min":{"1min":0.66600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.677,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.1299999999999999,"15min":1.21},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5469999999999999,"5min":4.7199999999999998,"15min":4.7199999999999998},"last":0.88}]},{"osd":2,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.319,"15min":1.4370000000000001},"min":{"1min":0.78700000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.008,"5min":7.6180000000000003,"15min":7.6180000000000003},"last":1.22},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.544,"15min":1.7},"min":{"1min":0.89400000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.784,"5min":8.4649999999999999,"15min":8.4649999999999999},"last":1.2549999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.337,"15min":1.4450000000000001},"min":{"1min":0.78200000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8260000000000001,"5min":4.782,"15min":4.782},"last":1.044},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.1259999999999999,"15min":1.2170000000000001},"min":{"1min":0.65100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.359,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.624}]},{"osd":4,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.3560000000000001,"15min":1.4279999999999999},"min":{"1min":0.92500000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.46,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.407,"15min":1.4850000000000001},"min":{"1min":0.96399999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.881,"5min":4.3639999999999999,"15min":4.3639999999999999},"last":0.99099999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4890000000000001,"15min":1.587},"min":{"1min":1.032,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.1150000000000002,"5min":4.4180000000000001,"15min":4.4180000000000001},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.488,"15min":1.5720000000000001},"min":{"1min":1.145,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5900000000000001,"5min":4.6479999999999997,"15min":4.6479999999999997},"last":1.194}]},{"osd":6,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.486,"15min":1.5780000000000001},"min":{"1min":0.84799999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5269999999999999,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5860000000000001,"15min":1.657},"min":{"1min":1.232,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.069,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":1.3380000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.6060000000000001,"15min":1.702},"min":{"1min":1.133,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.7110000000000001,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.5529999999999999,"15min":1.649},"min":{"1min":1.0800000000000001,"5min":1.034,"15min":1.034},"max":{"1min":1.6359999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":1.2829999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":577536,"data_stored":186652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.86799999999999999,"15min":0.89200000000000002},"min":{"1min":0.59899999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.278,"5min":1.849,"15min":1.849},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93400000000000005,"15min":0.95299999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.429,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.083,"15min":1.125},"min":{"1min":0.82199999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3640000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.286},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.131,"15min":1.1579999999999999},"min":{"1min":0.76600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5760000000000001,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.3180000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.98999999999999999,"15min":1.03},"min":{"1min":0.65600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.554,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.1879999999999999,"15min":1.2450000000000001},"min":{"1min":0.77500000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3779999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.0329999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2969999999999999,"15min":1.347},"min":{"1min":0.91200000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.486,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":1.123},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.306,"15min":1.359},"min":{"1min":0.96699999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4279999999999999,"5min":3.2130000000000001,"15min":3.2130000000000001},"last":1.165}]},{"osd":5,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.339,"15min":1.4159999999999999},"min":{"1min":0.89700000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.411,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.22},{"interface":"front","average":{"1min":1.266,"5min":1.3959999999999999,"15min":1.4470000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":1.4770000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.1899999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.5029999999999999,"15min":1.5629999999999999},"min":{"1min":1.1879999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.5820000000000001,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":1.363},{"interface":"front","average":{"1min":1.357,"5min":1.4490000000000001,"15min":1.51},"min":{"1min":1.075,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.879,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.2410000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.486,"15min":1.536},"min":{"1min":1.1759999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.992,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":1.397},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.504,"15min":1.573},"min":{"1min":1.179,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.784,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.2649999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1101824,"data_stored":795576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0409999999999999,"15min":0.98899999999999999},"min":{"1min":0.81899999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.403,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.143,"5min":1.095,"15min":1.093},"min":{"1min":0.83899999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5029999999999999,"5min":1.647,"15min":1.647},"last":1.048}]},{"osd":1,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1439999999999999,"15min":1.147},"min":{"1min":0.75800000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5149999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.208},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.149,"15min":1.143},"min":{"1min":0.82099999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4610000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.395}]},{"osd":2,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.29,"15min":1.296},"min":{"1min":1.077,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.593,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.262,"15min":1.2789999999999999},"min":{"1min":0.88900000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.236,"15min":1.268},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5389999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.139},{"interface":"front","average":{"1min":1.236,"5min":1.2589999999999999,"15min":1.28},"min":{"1min":0.88500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5349999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.361}]},{"osd":4,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2170000000000001,"15min":1.2370000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.248},{"interface":"front","average":{"1min":1.28,"5min":1.321,"15min":1.3340000000000001},"min":{"1min":0.91400000000000003,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6040000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.2949999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3440000000000001,"15min":1.369},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.3600000000000001,"15min":1.3759999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.579,"5min":1.833,"15min":1.833},"last":1.488}]},{"osd":7,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4199999999999999,"15min":1.446},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.4710000000000001,"15min":1.508},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.8640000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.425}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:33:55.905 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:33:56.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.067+0000 7f4038184700 1 Processor -- start 2023-11-17T06:33:56.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f4038184700 1 -- start start 2023-11-17T06:33:56.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f4038184700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f40300cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:56.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f4038184700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4030161d80 con 0x7f40300cded0 2023-11-17T06:33:56.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f4038184700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40301661c0 con 0x7f40301619a0 2023-11-17T06:33:56.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f4038184700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4030165fe0 con 0x7f4030165b90 2023-11-17T06:33:56.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f403571f700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f40300cded0 0x7f403006bf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40292/0 (socket says 172.21.15.69:40292) 2023-11-17T06:33:56.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f403571f700 1 -- 172.21.15.69:0/2158451327 learned_addr learned my addr 172.21.15.69:0/2158451327 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:33:56.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f4036721700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f40300cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:56.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462623681 0 0) 0x7f4030161d80 con 0x7f40300cded0 2023-11-17T06:33:56.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f401c0035d0 con 0x7f40300cded0 2023-11-17T06:33:56.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139509508 0 0) 0x7f40301661c0 con 0x7f40301619a0 2023-11-17T06:33:56.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.071+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4030161d80 con 0x7f40301619a0 2023-11-17T06:33:56.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1686107248 0 0) 0x7f401c0035d0 con 0x7f40300cded0 2023-11-17T06:33:56.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 msgr2=0x7f40300cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:56.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f40300cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 >> v1:172.21.15.93:6789/0 conn(0x7f40301619a0 legacy=0x7f4030165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:56.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300c96a0 con 0x7f40300cded0 2023-11-17T06:33:56.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2770903827 0 0) 0x7f4020001670 con 0x7f40300cded0 2023-11-17T06:33:56.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 >> v1:172.21.15.69:6789/0 conn(0x7f40300cded0 legacy=0x7f403006bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:56.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f401c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:56.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f401c004190 0x7f401c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:56.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f401c004db0 0x7f401c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:56.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4030165fe0 con 0x7f401c004db0 2023-11-17T06:33:56.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c00bbf0 con 0x7f401c004190 2023-11-17T06:33:56.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c00bdb0 con 0x7f4030165b90 2023-11-17T06:33:56.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f403571f700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f401c004190 0x7f401c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:56.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4035f20700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f401c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:56.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4036721700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f401c004db0 0x7f401c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:56.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4035f20700 1 -- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f401c004190 msgr2=0x7f401c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:56.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4035f20700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f401c004190 0x7f401c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4035f20700 1 -- 172.21.15.69:0/2158451327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f401c004db0 msgr2=0x7f401c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:56.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4035f20700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f401c004db0 0x7f401c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4035f20700 1 -- 172.21.15.69:0/2158451327 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c0035d0 con 0x7f4030165b90 2023-11-17T06:33:56.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4035f20700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f401c003be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f402c00c320 tx=0x7f401c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ffa27ca00adeb8e server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:56.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c001f20 con 0x7f4030165b90 2023-11-17T06:33:56.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c003a70 con 0x7f4030165b90 2023-11-17T06:33:56.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4034f1e700 1 -- 172.21.15.69:0/2158451327 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00cea0 con 0x7f4030165b90 2023-11-17T06:33:56.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4038184700 1 -- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 msgr2=0x7f401c003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:56.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4038184700 1 --2- 172.21.15.69:0/2158451327 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f401c003be0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f402c00c320 tx=0x7f401c0058a0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4036721700 1 -- 172.21.15.69:0/2158451327 reap_dead start 2023-11-17T06:33:56.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4038184700 1 -- 172.21.15.69:0/2158451327 shutdown_connections 2023-11-17T06:33:56.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.075+0000 7f4038184700 1 -- 172.21.15.69:0/2158451327 >> 172.21.15.69:0/2158451327 conn(0x7f40300cee40 msgr2=0x7f40300cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:56.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4038184700 1 -- 172.21.15.69:0/2158451327 shutdown_connections 2023-11-17T06:33:56.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4038184700 1 -- 172.21.15.69:0/2158451327 wait complete. 2023-11-17T06:33:56.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4038184700 1 Processor -- start 2023-11-17T06:33:56.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4038184700 1 -- start start 2023-11-17T06:33:56.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4038184700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f403015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:56.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4038184700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4030162220 0x7f403006fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:56.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4038184700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40301626a0 0x7f4030070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:56.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4038184700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403015bb60 con 0x7f4030162220 2023-11-17T06:33:56.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4038184700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4030162c70 con 0x7f40301626a0 2023-11-17T06:33:56.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4038184700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4030162f50 con 0x7f4030165b90 2023-11-17T06:33:56.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4035f20700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f403015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:56.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4035f20700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f403015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:51964/0 (socket says 172.21.15.69:51964) 2023-11-17T06:33:56.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4035f20700 1 -- 172.21.15.69:0/2390828037 learned_addr learned my addr 172.21.15.69:0/2390828037 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:56.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f403571f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4030162220 0x7f403006fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:56.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.079+0000 7f4036721700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40301626a0 0x7f4030070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:56.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f4035f20700 1 -- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40301626a0 msgr2=0x7f4030070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:56.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f4035f20700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40301626a0 0x7f4030070410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f4035f20700 1 -- 172.21.15.69:0/2390828037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4030162220 msgr2=0x7f403006fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:56.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f4035f20700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4030162220 0x7f403006fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f4035f20700 1 -- 172.21.15.69:0/2390828037 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4030163230 con 0x7f4030165b90 2023-11-17T06:33:56.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f403571f700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4030162220 0x7f403006fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:56.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f4035f20700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f403015b620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f402c004000 tx=0x7f402c0016a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:56.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f40267fc700 1 -- 172.21.15.69:0/2390828037 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00ce80 con 0x7f4030165b90 2023-11-17T06:33:56.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f4038184700 1 -- 172.21.15.69:0/2390828037 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4030163510 con 0x7f4030165b90 2023-11-17T06:33:56.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f40267fc700 1 -- 172.21.15.69:0/2390828037 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c00cc60 con 0x7f4030165b90 2023-11-17T06:33:56.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f40267fc700 1 -- 172.21.15.69:0/2390828037 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c005500 con 0x7f4030165b90 2023-11-17T06:33:56.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f4038184700 1 -- 172.21.15.69:0/2390828037 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40300b1980 con 0x7f4030165b90 2023-11-17T06:33:56.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.083+0000 7f4038184700 1 -- 172.21.15.69:0/2390828037 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f403004e650 con 0x7f4030165b90 2023-11-17T06:33:56.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.087+0000 7f40267fc700 1 -- 172.21.15.69:0/2390828037 <== mon.2 v2:172.21.15.93:3301/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f402c005660 con 0x7f4030165b90 2023-11-17T06:33:56.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.087+0000 7f40267fc700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4014066540 0x7f4014068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:56.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.087+0000 7f40267fc700 1 -- 172.21.15.69:0/2390828037 <== mon.2 v2:172.21.15.93:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f402c084b60 con 0x7f4030165b90 2023-11-17T06:33:56.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.087+0000 7f403571f700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4014066540 0x7f4014068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:56.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.087+0000 7f403571f700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4014066540 0x7f4014068a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4020000c00 tx=0x7f4020001000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:56.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.095+0000 7f40267fc700 1 -- 172.21.15.69:0/2390828037 <== mon.2 v2:172.21.15.93:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f402c0521a0 con 0x7f4030165b90 2023-11-17T06:33:56.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.271+0000 7f4038184700 1 -- 172.21.15.69:0/2390828037 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40300c9c60 con 0x7f4014066540 2023-11-17T06:33:56.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.275+0000 7f40267fc700 1 -- 172.21.15.69:0/2390828037 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48488 (secure 0 0 0) 0x7f4020004df0 con 0x7f4014066540 2023-11-17T06:33:56.283 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:56.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 -- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4014066540 msgr2=0x7f4014068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:56.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4014066540 0x7f4014068a00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4020000c00 tx=0x7f4020001000 comp rx=0 tx=0).stop 2023-11-17T06:33:56.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 -- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 msgr2=0x7f403015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:56.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f403015b620 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f402c004000 tx=0x7f402c0016a0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 -- 172.21.15.69:0/2390828037 shutdown_connections 2023-11-17T06:33:56.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4014066540 0x7f4014068a00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40301626a0 0x7f4030070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4030162220 0x7f403006fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 --2- 172.21.15.69:0/2390828037 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4030165b90 0x7f403015b620 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:56.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 -- 172.21.15.69:0/2390828037 >> 172.21.15.69:0/2390828037 conn(0x7f40300cee40 msgr2=0x7f403006cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:56.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 -- 172.21.15.69:0/2390828037 shutdown_connections 2023-11-17T06:33:56.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.279+0000 7f4038184700 1 -- 172.21.15.69:0/2390828037 wait complete. 2023-11-17T06:33:56.288 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:33:56.309 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2023-11-17T06:33:54.450679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235000,"kb_used_data":6376,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754739720,"statfs":{"total":773094113280,"available":772853473280,"internally_reserved":0,"allocated":6529024,"data_stored":3499460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":234016313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-404281,"num_objects":-123,"num_object_clones":0,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":0,"num_read":-1808,"num_read_kb":-1513,"num_write":-908,"num_write_kb":-889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001872"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":181,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-11-17T06:33:30.647441+0000","last_change":"2023-11-17T06:29:48.031659+0000","last_active":"2023-11-17T06:33:30.647441+0000","last_peered":"2023-11-17T06:33:30.647441+0000","last_clean":"2023-11-17T06:33:30.647441+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:33:30.647441+0000","last_undegraded":"2023-11-17T06:33:30.647441+0000","last_fullsized":"2023-11-17T06:33:30.647441+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_clean_scrub_stamp":"2023-11-17T06:29:47.005420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:11:29.801860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509491,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27564,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344276,"statfs":{"total":96636764160,"available":96608538624,"internally_reserved":0,"allocated":557056,"data_stored":186575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.137,"15min":1.149},"min":{"1min":0.71499999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.498,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.052},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.115,"15min":1.137},"min":{"1min":0.74399999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.627,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.29}]},{"osd":1,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1299999999999999,"5min":1.196,"15min":1.216},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":1.542,"5min":1.708,"15min":1.708},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.1879999999999999,"15min":1.216},"min":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.4970000000000001,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1459999999999999,"15min":1.1439999999999999},"min":{"1min":0.88300000000000001,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4850000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.3129999999999999,"15min":1.3600000000000001},"min":{"1min":0.93500000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.482,"5min":2.173,"15min":2.173},"last":1.5700000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.288,"15min":1.3129999999999999},"min":{"1min":0.88700000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.585,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.363},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.403,"15min":1.4510000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.6659999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.4219999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.2509999999999999,"15min":1.3240000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.5069999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.456},{"interface":"front","average":{"1min":1.177,"5min":1.2989999999999999,"15min":1.345},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.5940000000000001,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.2470000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.411,"15min":1.4710000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.617,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.645},{"interface":"front","average":{"1min":1.26,"5min":1.411,"15min":1.4730000000000001},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.569,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.601}]},{"osd":6,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.351,"5min":1.5629999999999999,"15min":1.6459999999999999},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.571,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.4590000000000001,"15min":1.502},"min":{"1min":0.81299999999999994,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.5780000000000001,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.526}]}]},{"osd":6,"up_from":15,"seq":64424509492,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":995328,"data_stored":589858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1539999999999999,"15min":1.1879999999999999},"min":{"1min":0.59599999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6379999999999999,"5min":2.726,"15min":2.726},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.135,"5min":1.268,"15min":1.393},"min":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.556,"5min":6.3339999999999996,"15min":6.3339999999999996},"last":1.3}]},{"osd":1,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.119,"15min":1.1240000000000001},"min":{"1min":0.72399999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.4450000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.23,"15min":1.1990000000000001},"min":{"1min":0.80400000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.468,"5min":1.708,"15min":1.708},"last":1.2050000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.254,"15min":1.347},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4410000000000001,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.1850000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.272,"15min":1.3380000000000001},"min":{"1min":0.93700000000000006,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6619999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.3320000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3009999999999999,"15min":1.3440000000000001},"min":{"1min":0.86499999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6100000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.401,"15min":1.516},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5820000000000001,"5min":6.2210000000000001,"15min":6.2210000000000001},"last":1.367}]},{"osd":4,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2709999999999999,"15min":1.286},"min":{"1min":0.91900000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6240000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.079},{"interface":"front","average":{"1min":1.206,"5min":1.266,"15min":1.333},"min":{"1min":0.873,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5740000000000001,"5min":1.99,"15min":1.99},"last":1.1220000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.337,"15min":1.407},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.595,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.391,"5min":1.4259999999999999,"15min":1.4430000000000001},"min":{"1min":0.93000000000000005,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6990000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.274}]},{"osd":7,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3759999999999999,"15min":1.464},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.554,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.393,"5min":1.4370000000000001,"15min":1.4970000000000001},"min":{"1min":0.90900000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.7490000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.4019999999999999}]}]},{"osd":4,"up_from":15,"seq":64424509492,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":1003520,"data_stored":589883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.081,"15min":1.103},"min":{"1min":0.81000000000000005,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4370000000000001,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.878},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.145,"15min":1.1459999999999999},"min":{"1min":0.89800000000000002,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.532,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.1619999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1539999999999999,"15min":1.1399999999999999},"min":{"1min":0.83799999999999997,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.6930000000000001,"5min":1.744,"15min":1.744},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.236,"15min":1.27},"min":{"1min":0.88300000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5669999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.98699999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.25,"15min":1.272},"min":{"1min":0.83799999999999997,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.603,"5min":1.794,"15min":1.794},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.3,"15min":1.3160000000000001},"min":{"1min":0.78100000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.571,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.121}]},{"osd":3,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2989999999999999,"15min":1.345},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.6100000000000001,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.05},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2649999999999999,"15min":1.2669999999999999},"min":{"1min":0.99099999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.8420000000000001,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":0.82899999999999996}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.3560000000000001,"15min":1.4059999999999999},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.7490000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3380000000000001,"15min":1.3700000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6870000000000001,"5min":2.411,"15min":2.411},"last":1.399}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.3320000000000001,"15min":1.369},"min":{"1min":0.85499999999999998,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.7110000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.29,"5min":1.472,"15min":1.534},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.6559999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4410000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.216,"5min":1.276,"15min":1.29},"min":{"1min":0.84299999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5860000000000001,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.256},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.401,"15min":1.4219999999999999},"min":{"1min":0.89200000000000002,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.7769999999999999,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.351}]}]},{"osd":3,"up_from":15,"seq":64424509493,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31732,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340108,"statfs":{"total":96636764160,"available":96604270592,"internally_reserved":0,"allocated":569344,"data_stored":187329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.86199999999999999,"15min":0.88700000000000001},"min":{"1min":0.64500000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1830000000000001,"5min":1.615,"15min":1.615},"last":0.628},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.95299999999999996,"15min":0.96899999999999997},"min":{"1min":0.64700000000000002,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3620000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.88800000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.90700000000000003,"15min":0.92300000000000004},"min":{"1min":0.55500000000000005,"5min":0.441,"15min":0.441},"max":{"1min":1.2290000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0549999999999999,"15min":1.0569999999999999},"min":{"1min":0.73499999999999999,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.585,"5min":1.671,"15min":1.671},"last":0.70899999999999996}]},{"osd":2,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.2490000000000001,"15min":1.3400000000000001},"min":{"1min":0.81999999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.4410000000000001,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.165,"5min":1.135,"15min":1.1559999999999999},"min":{"1min":0.85599999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.5449999999999999,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.84799999999999998}]},{"osd":4,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.3360000000000001,"15min":1.3640000000000001},"min":{"1min":1.0209999999999999,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5329999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.165,"5min":1.278,"15min":1.3120000000000001},"min":{"1min":0.83699999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.462,"5min":2.085,"15min":2.085},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.431,"15min":1.4850000000000001},"min":{"1min":1.143,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.6200000000000001,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.347,"15min":1.375},"min":{"1min":0.92700000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.4490000000000001,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.351,"15min":1.365},"min":{"1min":1.0469999999999999,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.7889999999999999,"5min":2.177,"15min":2.177},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4710000000000001,"15min":1.4990000000000001},"min":{"1min":1.2849999999999999,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.615,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.82399999999999995}]},{"osd":7,"last update":"Fri Nov 17 06:32:51 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.357,"15min":1.373},"min":{"1min":1.113,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.5269999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.181},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4139999999999999,"15min":1.4239999999999999},"min":{"1min":1.1899999999999999,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.95,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":0.97399999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509493,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27572,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344268,"statfs":{"total":96636764160,"available":96608530432,"internally_reserved":0,"allocated":569344,"data_stored":186595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.99199999999999999,"15min":1.071},"min":{"1min":0.54500000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2769999999999999,"5min":4.2469999999999999,"15min":4.2469999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.198,"15min":1.3240000000000001},"min":{"1min":0.64000000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.25,"5min":8.0510000000000002,"15min":8.0510000000000002},"last":0.90600000000000003}]},{"osd":1,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94099999999999995,"15min":0.94499999999999995},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.208,"5min":1.2569999999999999,"15min":1.3},"min":{"1min":0.88800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.2589999999999999,"5min":4.5279999999999996,"15min":4.5279999999999996},"last":1.002}]},{"osd":3,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.105,"15min":1.1719999999999999},"min":{"1min":0.71599999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3899999999999999,"5min":4.2960000000000003,"15min":4.2960000000000003},"last":0.51400000000000001},{"interface":"front","average":{"1min":1.107,"5min":1.276,"15min":1.359},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.956,"5min":4.2720000000000002,"15min":4.2720000000000002},"last":0.78300000000000003}]},{"osd":4,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.359,"15min":1.421},"min":{"1min":0.95699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.4610000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.365,"5min":1.51,"15min":1.5800000000000001},"min":{"1min":1.1439999999999999,"5min":1.052,"15min":1.052},"max":{"1min":1.6990000000000001,"5min":4.6459999999999999,"15min":4.6459999999999999},"last":1.276}]},{"osd":5,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3420000000000001,"15min":1.375},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6910000000000001,"5min":1.875,"15min":1.875},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.502,"15min":1.573},"min":{"1min":1.1339999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.798,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":1.1579999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.595,"15min":1.6850000000000001},"min":{"1min":1.2310000000000001,"5min":1.056,"15min":1.056},"max":{"1min":1.6659999999999999,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.198},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.448,"15min":1.494},"min":{"1min":1.0049999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.72,"5min":2.218,"15min":2.218},"last":1.0229999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.49,"15min":1.55},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":1.8160000000000001,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":0.94499999999999995},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.5249999999999999,"15min":1.589},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":1.6419999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.0600000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509491,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1155072,"data_stored":776992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.93700000000000006,"15min":0.97399999999999998},"min":{"1min":0.66600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.677,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.1299999999999999,"15min":1.21},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5469999999999999,"5min":4.7199999999999998,"15min":4.7199999999999998},"last":0.88}]},{"osd":2,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.319,"15min":1.4370000000000001},"min":{"1min":0.78700000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.008,"5min":7.6180000000000003,"15min":7.6180000000000003},"last":1.22},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.544,"15min":1.7},"min":{"1min":0.89400000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.784,"5min":8.4649999999999999,"15min":8.4649999999999999},"last":1.2549999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.337,"15min":1.4450000000000001},"min":{"1min":0.78200000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8260000000000001,"5min":4.782,"15min":4.782},"last":1.044},{"interface":"front","average":{"1min":0.92000000000000004,"5min":1.1259999999999999,"15min":1.2170000000000001},"min":{"1min":0.65100000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.359,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.624}]},{"osd":4,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.3560000000000001,"15min":1.4279999999999999},"min":{"1min":0.92500000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.46,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.407,"15min":1.4850000000000001},"min":{"1min":0.96399999999999997,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.881,"5min":4.3639999999999999,"15min":4.3639999999999999},"last":0.99099999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.4890000000000001,"15min":1.587},"min":{"1min":1.032,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.1150000000000002,"5min":4.4180000000000001,"15min":4.4180000000000001},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.488,"15min":1.5720000000000001},"min":{"1min":1.145,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.5900000000000001,"5min":4.6479999999999997,"15min":4.6479999999999997},"last":1.194}]},{"osd":6,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.486,"15min":1.5780000000000001},"min":{"1min":0.84799999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5269999999999999,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.5860000000000001,"15min":1.657},"min":{"1min":1.232,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.069,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":1.3380000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.6060000000000001,"15min":1.702},"min":{"1min":1.133,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.7110000000000001,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.319,"5min":1.5529999999999999,"15min":1.649},"min":{"1min":1.0800000000000001,"5min":1.034,"15min":1.034},"max":{"1min":1.6359999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":1.2829999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509493,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27584,"kb_used_data":564,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344256,"statfs":{"total":96636764160,"available":96608518144,"internally_reserved":0,"allocated":577536,"data_stored":186652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.86799999999999999,"15min":0.89200000000000002},"min":{"1min":0.59899999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.278,"5min":1.849,"15min":1.849},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.93400000000000005,"15min":0.95299999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.429,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.76200000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.083,"15min":1.125},"min":{"1min":0.82199999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3640000000000001,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.286},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.131,"15min":1.1579999999999999},"min":{"1min":0.76600000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.5760000000000001,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.3180000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.98999999999999999,"15min":1.03},"min":{"1min":0.65600000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.554,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.113,"5min":1.1879999999999999,"15min":1.2450000000000001},"min":{"1min":0.77500000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3779999999999999,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.0329999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.2969999999999999,"15min":1.347},"min":{"1min":0.91200000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.486,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":1.123},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.306,"15min":1.359},"min":{"1min":0.96699999999999997,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.4279999999999999,"5min":3.2130000000000001,"15min":3.2130000000000001},"last":1.165}]},{"osd":5,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.339,"15min":1.4159999999999999},"min":{"1min":0.89700000000000002,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.411,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.22},{"interface":"front","average":{"1min":1.266,"5min":1.3959999999999999,"15min":1.4470000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":1.4770000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.1899999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.5029999999999999,"15min":1.5629999999999999},"min":{"1min":1.1879999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.5820000000000001,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":1.363},{"interface":"front","average":{"1min":1.357,"5min":1.4490000000000001,"15min":1.51},"min":{"1min":1.075,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.879,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.2410000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:32:49 2023","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.486,"15min":1.536},"min":{"1min":1.1759999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.992,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":1.397},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.504,"15min":1.573},"min":{"1min":1.179,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.784,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.2649999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1101824,"data_stored":795576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0409999999999999,"15min":0.98899999999999999},"min":{"1min":0.81899999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.403,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.143,"5min":1.095,"15min":1.093},"min":{"1min":0.83899999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5029999999999999,"5min":1.647,"15min":1.647},"last":1.048}]},{"osd":1,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1439999999999999,"15min":1.147},"min":{"1min":0.75800000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5149999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.208},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.149,"15min":1.143},"min":{"1min":0.82099999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4610000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.395}]},{"osd":2,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.29,"15min":1.296},"min":{"1min":1.077,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.593,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.262,"15min":1.2789999999999999},"min":{"1min":0.88900000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.236,"15min":1.268},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5389999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.139},{"interface":"front","average":{"1min":1.236,"5min":1.2589999999999999,"15min":1.28},"min":{"1min":0.88500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5349999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.361}]},{"osd":4,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2170000000000001,"15min":1.2370000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.248},{"interface":"front","average":{"1min":1.28,"5min":1.321,"15min":1.3340000000000001},"min":{"1min":0.91400000000000003,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6040000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.2949999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3440000000000001,"15min":1.369},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.3600000000000001,"15min":1.3759999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.579,"5min":1.833,"15min":1.833},"last":1.488}]},{"osd":7,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4199999999999999,"15min":1.446},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.4710000000000001,"15min":1.508},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.8640000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.425}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:33:56.312 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-17T06:33:56.312 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:33:56.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.483+0000 7f744f839700 1 Processor -- start 2023-11-17T06:33:59.253 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:33:59.268 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.483+0000 7f744f839700 1 -- start start 2023-11-17T06:33:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744f839700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f74480cded0 0x7f7448165b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744f839700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74480cb170 0x7f744806bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.269 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744f839700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7448161d80 con 0x7f74481619a0 2023-11-17T06:33:59.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744f839700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480c9490 con 0x7f74480cded0 2023-11-17T06:33:59.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744f839700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74481661c0 con 0x7f74480cb170 2023-11-17T06:33:59.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744ddd6700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74480cb170 0x7f744806bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744cdd4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f74480cded0 0x7f7448165b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744ddd6700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74480cb170 0x7f744806bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:51974/0 (socket says 172.21.15.69:51974) 2023-11-17T06:33:59.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744ddd6700 1 -- 172.21.15.69:0/540238149 learned_addr learned my addr 172.21.15.69:0/540238149 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:59.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744ddd6700 1 -- 172.21.15.69:0/540238149 >> v2:172.21.15.93:3300/0 conn(0x7f74480cded0 msgr2=0x7f7448165b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:59.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744ddd6700 1 --2- 172.21.15.69:0/540238149 >> v2:172.21.15.93:3300/0 conn(0x7f74480cded0 0x7f7448165b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744ddd6700 1 -- 172.21.15.69:0/540238149 >> v1:172.21.15.93:6789/0 conn(0x7f74481619a0 legacy=0x7f7448165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744ddd6700 1 -- 172.21.15.69:0/540238149 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480c96a0 con 0x7f74480cb170 2023-11-17T06:33:59.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.487+0000 7f744cdd4700 1 --2- 172.21.15.69:0/540238149 >> v2:172.21.15.93:3300/0 conn(0x7f74480cded0 0x7f7448165b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:59.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f744ddd6700 1 --2- 172.21.15.69:0/540238149 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74480cb170 0x7f744806bf10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7440009e50 tx=0x7f744000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27ba8bf8718d4b62 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f743ffff700 1 -- 172.21.15.69:0/540238149 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000e070 con 0x7f74480cb170 2023-11-17T06:33:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f743ffff700 1 -- 172.21.15.69:0/540238149 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744000b910 con 0x7f74480cb170 2023-11-17T06:33:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f743ffff700 1 -- 172.21.15.69:0/540238149 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000bcc0 con 0x7f74480cb170 2023-11-17T06:33:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f744f839700 1 -- 172.21.15.69:0/540238149 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74480cb170 msgr2=0x7f744806bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f744f839700 1 --2- 172.21.15.69:0/540238149 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74480cb170 0x7f744806bf10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7440009e50 tx=0x7f744000b330 comp rx=0 tx=0).stop 2023-11-17T06:33:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f744f839700 1 -- 172.21.15.69:0/540238149 shutdown_connections 2023-11-17T06:33:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f744f839700 1 --2- 172.21.15.69:0/540238149 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74480cb170 0x7f744806bf10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f744f839700 1 --2- 172.21.15.69:0/540238149 >> v2:172.21.15.93:3300/0 conn(0x7f74480cded0 0x7f7448165b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f744f839700 1 -- 172.21.15.69:0/540238149 >> 172.21.15.69:0/540238149 conn(0x7f74480cee40 msgr2=0x7f74480cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:59.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f744f839700 1 -- 172.21.15.69:0/540238149 shutdown_connections 2023-11-17T06:33:59.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.491+0000 7f744f839700 1 -- 172.21.15.69:0/540238149 wait complete. 2023-11-17T06:33:59.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.495+0000 7f744f839700 1 Processor -- start 2023-11-17T06:33:59.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.495+0000 7f744f839700 1 -- start start 2023-11-17T06:33:59.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.495+0000 7f744f839700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480cb170 0x7f74481f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744f839700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480cded0 0x7f74480c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744f839700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74481619a0 0x7f74480c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744f839700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7448162630 con 0x7f74480cded0 2023-11-17T06:33:59.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744f839700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744815e7a0 con 0x7f74480cb170 2023-11-17T06:33:59.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744f839700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74481f6d10 con 0x7f74481619a0 2023-11-17T06:33:59.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744cdd4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480cded0 0x7f74480c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744cdd4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480cded0 0x7f74480c4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56850/0 (socket says 172.21.15.69:56850) 2023-11-17T06:33:59.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744cdd4700 1 -- 172.21.15.69:0/2321730797 learned_addr learned my addr 172.21.15.69:0/2321730797 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:59.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744ddd6700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74481619a0 0x7f74480c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744d5d5700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480cb170 0x7f74481f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744cdd4700 1 -- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74481619a0 msgr2=0x7f74480c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744cdd4700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74481619a0 0x7f74480c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744cdd4700 1 -- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480cb170 msgr2=0x7f74481f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744cdd4700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480cb170 0x7f74481f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744cdd4700 1 -- 172.21.15.69:0/2321730797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380094b0 con 0x7f74480cded0 2023-11-17T06:33:59.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744d5d5700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480cb170 0x7f74481f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:33:59.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744cdd4700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480cded0 0x7f74480c4880 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f743800ebe0 tx=0x7f743800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:59.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f743dffb700 1 -- 172.21.15.69:0/2321730797 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800c850 con 0x7f74480cded0 2023-11-17T06:33:59.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f743dffb700 1 -- 172.21.15.69:0/2321730797 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743800c9b0 con 0x7f74480cded0 2023-11-17T06:33:59.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744f839700 1 -- 172.21.15.69:0/2321730797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7440009b30 con 0x7f74480cded0 2023-11-17T06:33:59.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f743dffb700 1 -- 172.21.15.69:0/2321730797 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743800cd40 con 0x7f74480cded0 2023-11-17T06:33:59.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.499+0000 7f744f839700 1 -- 172.21.15.69:0/2321730797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74480c3bd0 con 0x7f74480cded0 2023-11-17T06:33:59.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.503+0000 7f744f839700 1 -- 172.21.15.69:0/2321730797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74481627a0 con 0x7f74480cded0 2023-11-17T06:33:59.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.503+0000 7f743dffb700 1 -- 172.21.15.69:0/2321730797 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7438013470 con 0x7f74480cded0 2023-11-17T06:33:59.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.507+0000 7f743dffb700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f742c066510 0x7f742c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.507+0000 7f743dffb700 1 -- 172.21.15.69:0/2321730797 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f7438083d60 con 0x7f74480cded0 2023-11-17T06:33:59.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.507+0000 7f744d5d5700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f742c066510 0x7f742c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.507+0000 7f744d5d5700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f742c066510 0x7f742c0689d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7444000fb0 tx=0x7f7444009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:59.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.511+0000 7f743dffb700 1 -- 172.21.15.69:0/2321730797 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7438051390 con 0x7f74480cded0 2023-11-17T06:33:59.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.683+0000 7f744f839700 1 -- 172.21.15.69:0/2321730797 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74480cb5c0 con 0x7f742c066510 2023-11-17T06:33:59.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.691+0000 7f743dffb700 1 -- 172.21.15.69:0/2321730797 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48452 (secure 0 0 0) 0x7f74440050d0 con 0x7f742c066510 2023-11-17T06:33:59.306 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:59.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.691+0000 7f744f839700 1 -- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f742c066510 msgr2=0x7f742c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.691+0000 7f744f839700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f742c066510 0x7f742c0689d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7444000fb0 tx=0x7f7444009040 comp rx=0 tx=0).stop 2023-11-17T06:33:59.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.695+0000 7f744f839700 1 -- 172.21.15.69:0/2321730797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480cded0 msgr2=0x7f74480c4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.695+0000 7f744f839700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480cded0 0x7f74480c4880 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f743800ebe0 tx=0x7f743800eef0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.695+0000 7f744f839700 1 -- 172.21.15.69:0/2321730797 shutdown_connections 2023-11-17T06:33:59.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.695+0000 7f744f839700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f742c066510 0x7f742c0689d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.695+0000 7f744f839700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f74481619a0 0x7f74480c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.695+0000 7f744f839700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74480cded0 0x7f74480c4880 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.695+0000 7f744f839700 1 --2- 172.21.15.69:0/2321730797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f74480cb170 0x7f74481f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.695+0000 7f744f839700 1 -- 172.21.15.69:0/2321730797 >> 172.21.15.69:0/2321730797 conn(0x7f74480cee40 msgr2=0x7f744815c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:59.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.695+0000 7f744f839700 1 -- 172.21.15.69:0/2321730797 shutdown_connections 2023-11-17T06:33:59.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:56.695+0000 7f744f839700 1 -- 172.21.15.69:0/2321730797 wait complete. 2023-11-17T06:33:59.309 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:33:59.310 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2023-11-17T06:33:56.451255+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":234012,"kb_used_data":5360,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740708,"statfs":{"total":773094113280,"available":772854484992,"internally_reserved":0,"allocated":5488640,"data_stored":2805120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":234016313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-404281,"num_objects":-123,"num_object_clones":0,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":0,"num_read":-1808,"num_read_kb":-1513,"num_write":-908,"num_write_kb":-889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.287365"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-17T06:33:52.319860+0000","last_change":"2023-11-17T06:29:48.031659+0000","last_active":"2023-11-17T06:33:52.319860+0000","last_peered":"2023-11-17T06:33:52.319860+0000","last_clean":"2023-11-17T06:33:52.319860+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:33:52.319860+0000","last_undegraded":"2023-11-17T06:33:52.319860+0000","last_fullsized":"2023-11-17T06:33:52.319860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_clean_scrub_stamp":"2023-11-17T06:29:47.005420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:11:29.801860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509492,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.1100000000000001,"15min":1.1399999999999999},"min":{"1min":0.67900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3839999999999999,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.874},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.111,"15min":1.135},"min":{"1min":0.746,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8169999999999999,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.2989999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1619999999999999,"15min":1.204},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.3320000000000001,"5min":1.708,"15min":1.708},"last":0.995},{"interface":"front","average":{"1min":1.147,"5min":1.171,"15min":1.2110000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.514,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.514}]},{"osd":2,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.1299999999999999,"15min":1.139},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3360000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.3500000000000001},"min":{"1min":0.84299999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5700000000000001,"5min":2.173,"15min":2.173},"last":1.349}]},{"osd":3,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2569999999999999,"15min":1.3029999999999999},"min":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.893,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.081},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.365,"15min":1.4390000000000001},"min":{"1min":0.98299999999999998,"5min":0.878,"15min":0.878},"max":{"1min":1.5249999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.1930000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2050000000000001,"15min":1.3089999999999999},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.6919999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.2589999999999999,"15min":1.3320000000000001},"min":{"1min":0.70599999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.865,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.4690000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3700000000000001,"15min":1.458},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.645,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.4319999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.365,"15min":1.458},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7390000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.3979999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.5089999999999999,"15min":1.6279999999999999},"min":{"1min":0.875,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7809999999999999,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.415,"15min":1.4870000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.637,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.5609999999999999}]}]},{"osd":6,"up_from":15,"seq":64424509493,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1539999999999999,"15min":1.1879999999999999},"min":{"1min":0.59599999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6379999999999999,"5min":2.726,"15min":2.726},"last":1.621},{"interface":"front","average":{"1min":1.135,"5min":1.268,"15min":1.393},"min":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.556,"5min":6.3339999999999996,"15min":6.3339999999999996},"last":1.5620000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.119,"15min":1.1240000000000001},"min":{"1min":0.72399999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.4450000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.23,"15min":1.1990000000000001},"min":{"1min":0.80400000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.468,"5min":1.708,"15min":1.708},"last":1.1060000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.254,"15min":1.347},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4410000000000001,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.272,"15min":1.3380000000000001},"min":{"1min":0.93700000000000006,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6619999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.3}]},{"osd":3,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3009999999999999,"15min":1.3440000000000001},"min":{"1min":0.86499999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6100000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.401,"15min":1.516},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5820000000000001,"5min":6.2210000000000001,"15min":6.2210000000000001},"last":1.488}]},{"osd":4,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2709999999999999,"15min":1.286},"min":{"1min":0.91900000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6240000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.7030000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.266,"15min":1.333},"min":{"1min":0.873,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5740000000000001,"5min":1.99,"15min":1.99},"last":1.653}]},{"osd":5,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.337,"15min":1.407},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.595,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.46},{"interface":"front","average":{"1min":1.391,"5min":1.4259999999999999,"15min":1.4430000000000001},"min":{"1min":0.93000000000000005,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6990000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.7529999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3759999999999999,"15min":1.464},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.554,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.4370000000000001,"15min":1.4970000000000001},"min":{"1min":0.90900000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.7490000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.391}]}]},{"osd":4,"up_from":15,"seq":64424509493,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.085,"15min":1.105},"min":{"1min":0.58999999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.595,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.121,"15min":1.1379999999999999},"min":{"1min":0.81699999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.381,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.92900000000000005}]},{"osd":1,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1459999999999999,"15min":1.1379999999999999},"min":{"1min":0.80200000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5409999999999999,"5min":1.744,"15min":1.744},"last":1.341},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2150000000000001,"15min":1.2629999999999999},"min":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5409999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.216,"15min":1.2609999999999999},"min":{"1min":0.77500000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6499999999999999,"5min":1.794,"15min":1.794},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.276,"15min":1.3080000000000001},"min":{"1min":0.89300000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.492,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.294}]},{"osd":3,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.254,"15min":1.3300000000000001},"min":{"1min":0.75700000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.456,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.171},{"interface":"front","average":{"1min":1.256,"5min":1.2629999999999999,"15min":1.2669999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.536,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.452}]},{"osd":5,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3169999999999999,"15min":1.393},"min":{"1min":0.70399999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6870000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.403},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3129999999999999,"15min":1.361},"min":{"1min":0.80600000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6240000000000001,"5min":2.411,"15min":2.411},"last":1.367}]},{"osd":6,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.3260000000000001,"15min":1.367},"min":{"1min":1.0649999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5980000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.538},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.4319999999999999,"15min":1.52},"min":{"1min":0.91500000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7629999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.5089999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.2689999999999999,"15min":1.288},"min":{"1min":0.91100000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5469999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.26},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.379,"15min":1.415},"min":{"1min":1.0069999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.696,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.2170000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509494,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31752,"kb_used_data":568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":581632,"data_stored":199445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84199999999999997,"15min":0.88},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2529999999999999,"5min":1.615,"15min":1.615},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.93300000000000005,"15min":0.96299999999999997},"min":{"1min":0.499,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3420000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.25}]},{"osd":1,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89800000000000002,"15min":0.92000000000000004},"min":{"1min":0.627,"5min":0.441,"15min":0.441},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.038,"15min":1.052},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4059999999999999,"5min":1.671,"15min":1.671},"last":1.329}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1799999999999999,"15min":1.3169999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.732,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.732},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1459999999999999},"min":{"1min":0.69099999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.377,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.377}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3129999999999999,"15min":1.3560000000000001},"min":{"1min":1.0800000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4850000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.2490000000000001,"15min":1.3029999999999999},"min":{"1min":0.89300000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.504,"5min":2.085,"15min":2.085},"last":1.427}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3939999999999999,"15min":1.472},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8899999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.8899999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.321,"15min":1.3660000000000001},"min":{"1min":0.90100000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.6319999999999999,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.6319999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.331,"15min":1.359},"min":{"1min":0.94699999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":1.778},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4550000000000001,"15min":1.494},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.819,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.819}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.359,"15min":1.3740000000000001},"min":{"1min":1.123,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.8560000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.8560000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.3959999999999999,"15min":1.4179999999999999},"min":{"1min":0.97399999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7989999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.54}]}]},{"osd":2,"up_from":15,"seq":64424509494,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27604,"kb_used_data":580,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344236,"statfs":{"total":96636764160,"available":96608497664,"internally_reserved":0,"allocated":593920,"data_stored":199453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.99199999999999999,"15min":1.071},"min":{"1min":0.54500000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2769999999999999,"5min":4.2469999999999999,"15min":4.2469999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":1.198,"15min":1.3240000000000001},"min":{"1min":0.64000000000000001,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.25,"5min":8.0510000000000002,"15min":8.0510000000000002},"last":0.89200000000000002}]},{"osd":1,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.94099999999999995,"15min":0.94499999999999995},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.61399999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.2569999999999999,"15min":1.3},"min":{"1min":0.88800000000000001,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":2.2589999999999999,"5min":4.5279999999999996,"15min":4.5279999999999996},"last":0.73399999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.105,"15min":1.1719999999999999},"min":{"1min":0.71599999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3899999999999999,"5min":4.2960000000000003,"15min":4.2960000000000003},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.107,"5min":1.276,"15min":1.359},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.956,"5min":4.2720000000000002,"15min":4.2720000000000002},"last":1.387}]},{"osd":4,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.359,"15min":1.421},"min":{"1min":0.95699999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.4610000000000001,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.51,"15min":1.5800000000000001},"min":{"1min":1.1439999999999999,"5min":1.052,"15min":1.052},"max":{"1min":1.6990000000000001,"5min":4.6459999999999999,"15min":4.6459999999999999},"last":1.6220000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.3420000000000001,"15min":1.375},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.6910000000000001,"5min":1.875,"15min":1.875},"last":1.8799999999999999},{"interface":"front","average":{"1min":1.355,"5min":1.502,"15min":1.573},"min":{"1min":1.1339999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"max":{"1min":1.798,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":1.579}]},{"osd":6,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.595,"15min":1.6850000000000001},"min":{"1min":1.2310000000000001,"5min":1.056,"15min":1.056},"max":{"1min":1.6659999999999999,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.448,"15min":1.494},"min":{"1min":1.0049999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":1.72,"5min":2.218,"15min":2.218},"last":1.341}]},{"osd":7,"last update":"Fri Nov 17 06:32:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.49,"15min":1.55},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":1.8160000000000001,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":2.0219999999999998},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.5249999999999999,"15min":1.589},"min":{"1min":1.008,"5min":1.008,"15min":1.008},"max":{"1min":1.6419999999999999,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":2.0990000000000002}]}]},{"osd":1,"up_from":15,"seq":64424509492,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1179648,"data_stored":789814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91100000000000003,"15min":0.96499999999999997},"min":{"1min":0.56999999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.891,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":1.2609999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0609999999999999,"15min":1.1870000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.429,"5min":4.7199999999999998,"15min":4.7199999999999998},"last":0.85299999999999998}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.222,"15min":1.4039999999999999},"min":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.95,"5min":7.6180000000000003,"15min":7.6180000000000003},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.131,"5min":1.4139999999999999,"15min":1.6559999999999999},"min":{"1min":0.70599999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9450000000000001,"5min":8.4649999999999999,"15min":8.4649999999999999},"last":0.97999999999999998}]},{"osd":3,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.2490000000000001,"15min":1.415},"min":{"1min":0.67000000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0529999999999999,"5min":4.782,"15min":4.782},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.0669999999999999,"15min":1.1970000000000001},"min":{"1min":0.624,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2609999999999999,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":1.1819999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.3029999999999999,"15min":1.4099999999999999},"min":{"1min":0.93300000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.8140000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.6419999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.359,"15min":1.4690000000000001},"min":{"1min":0.80800000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.0059999999999998,"5min":4.3639999999999999,"15min":4.3639999999999999},"last":1.589}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.417,"15min":1.5629999999999999},"min":{"1min":0.88100000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0489999999999999,"5min":4.4180000000000001,"15min":4.4180000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.4139999999999999,"15min":1.548},"min":{"1min":0.91300000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.488,"5min":4.6479999999999997,"15min":4.6479999999999997},"last":1.306}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.4139999999999999,"15min":1.554},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7549999999999999,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.548},{"interface":"front","average":{"1min":1.397,"5min":1.5269999999999999,"15min":1.637},"min":{"1min":1.006,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":1.7150000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.5189999999999999,"15min":1.673},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5600000000000001,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.343,"5min":1.482,"15min":1.625},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":1.7529999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":1.4359999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509494,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85599999999999998,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4350000000000001,"5min":1.849,"15min":1.849},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.228,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0529999999999999,"15min":1.115},"min":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3149999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1519999999999999},"min":{"1min":0.70099999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.411,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":1.016},"min":{"1min":0.50800000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.343,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.131,"15min":1.226},"min":{"1min":0.59199999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.296,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":0.84499999999999997}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2549999999999999,"15min":1.333},"min":{"1min":0.88900000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.51,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.252,"15min":1.341},"min":{"1min":0.77200000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.373,"5min":3.2130000000000001,"15min":3.2130000000000001},"last":0.94299999999999995}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.284,"15min":1.3979999999999999},"min":{"1min":0.879,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4359999999999999,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.173},{"interface":"front","average":{"1min":1.218,"5min":1.345,"15min":1.4299999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.532,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.151}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.45,"15min":1.546},"min":{"1min":1.0369999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.6120000000000001,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":1.24},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3939999999999999,"15min":1.492},"min":{"1min":0.88800000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.754,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.0509999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4419999999999999,"15min":1.522},"min":{"1min":1.0820000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.599,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":1.097},{"interface":"front","average":{"1min":1.264,"5min":1.4359999999999999,"15min":1.55},"min":{"1min":1.0669999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.5169999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.228}]}]},{"osd":5,"up_from":14,"seq":60129542197,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1101824,"data_stored":795576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.0409999999999999,"15min":0.98899999999999999},"min":{"1min":0.81899999999999995,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.403,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.143,"5min":1.095,"15min":1.093},"min":{"1min":0.83899999999999997,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.5029999999999999,"5min":1.647,"15min":1.647},"last":1.048}]},{"osd":1,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.1439999999999999,"15min":1.147},"min":{"1min":0.75800000000000001,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.5149999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.208},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.149,"15min":1.143},"min":{"1min":0.82099999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4610000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.395}]},{"osd":2,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.29,"15min":1.296},"min":{"1min":1.077,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.593,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.262,"15min":1.2789999999999999},"min":{"1min":0.88900000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.82599999999999996}]},{"osd":3,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.236,"15min":1.268},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":1.5389999999999999,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.139},{"interface":"front","average":{"1min":1.236,"5min":1.2589999999999999,"15min":1.28},"min":{"1min":0.88500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5349999999999999,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.361}]},{"osd":4,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.2170000000000001,"15min":1.2370000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":1.248},{"interface":"front","average":{"1min":1.28,"5min":1.321,"15min":1.3340000000000001},"min":{"1min":0.91400000000000003,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":1.6040000000000001,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.2949999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.3440000000000001,"15min":1.369},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.3600000000000001,"15min":1.3759999999999999},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.579,"5min":1.833,"15min":1.833},"last":1.488}]},{"osd":7,"last update":"Fri Nov 17 06:32:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4199999999999999,"15min":1.446},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.369,"5min":1.4710000000000001,"15min":1.508},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.8640000000000001,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.425}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:33:59.312 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-17T06:33:59.357 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:33:59.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.539+0000 7f625658b700 1 Processor -- start 2023-11-17T06:33:59.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.539+0000 7f625658b700 1 -- start start 2023-11-17T06:33:59.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f625658b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f62501619a0 0x7f62500cb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f625658b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6250165b90 0x7f625006bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f625658b700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6250161d80 con 0x7f62500cded0 2023-11-17T06:33:59.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f625658b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6250165fe0 con 0x7f62501619a0 2023-11-17T06:33:59.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f625658b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62500c9490 con 0x7f6250165b90 2023-11-17T06:33:59.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624ffff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f62501619a0 0x7f62500cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f6254b28700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6250165b90 0x7f625006bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624ffff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f62501619a0 0x7f62500cb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:50476/0 (socket says 172.21.15.69:50476) 2023-11-17T06:33:59.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624ffff700 1 -- 172.21.15.69:0/4247096652 learned_addr learned my addr 172.21.15.69:0/4247096652 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:59.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624ffff700 1 -- 172.21.15.69:0/4247096652 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6250165b90 msgr2=0x7f625006bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:33:59.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624ffff700 1 --2- 172.21.15.69:0/4247096652 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6250165b90 0x7f625006bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624ffff700 1 -- 172.21.15.69:0/4247096652 >> v1:172.21.15.93:6789/0 conn(0x7f62500cded0 legacy=0x7f6250165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624ffff700 1 -- 172.21.15.69:0/4247096652 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62501661c0 con 0x7f62501619a0 2023-11-17T06:33:59.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624ffff700 1 --2- 172.21.15.69:0/4247096652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62501619a0 0x7f62500cb170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6240009910 tx=0x7f6240009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c2f3ff89366b09b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:59.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624f7fe700 1 -- 172.21.15.69:0/4247096652 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240005e50 con 0x7f62501619a0 2023-11-17T06:33:59.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624f7fe700 1 -- 172.21.15.69:0/4247096652 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6240006030 con 0x7f62501619a0 2023-11-17T06:33:59.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f624f7fe700 1 -- 172.21.15.69:0/4247096652 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400063e0 con 0x7f62501619a0 2023-11-17T06:33:59.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f625658b700 1 -- 172.21.15.69:0/4247096652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62501619a0 msgr2=0x7f62500cb170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.543+0000 7f625658b700 1 --2- 172.21.15.69:0/4247096652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62501619a0 0x7f62500cb170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6240009910 tx=0x7f6240009c20 comp rx=0 tx=0).stop 2023-11-17T06:33:59.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.547+0000 7f625658b700 1 -- 172.21.15.69:0/4247096652 shutdown_connections 2023-11-17T06:33:59.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.547+0000 7f625658b700 1 --2- 172.21.15.69:0/4247096652 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f6250165b90 0x7f625006bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.547+0000 7f625658b700 1 --2- 172.21.15.69:0/4247096652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f62501619a0 0x7f62500cb170 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.547+0000 7f625658b700 1 -- 172.21.15.69:0/4247096652 >> 172.21.15.69:0/4247096652 conn(0x7f62500cee40 msgr2=0x7f62500cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:59.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.547+0000 7f625658b700 1 -- 172.21.15.69:0/4247096652 shutdown_connections 2023-11-17T06:33:59.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.547+0000 7f625658b700 1 -- 172.21.15.69:0/4247096652 wait complete. 2023-11-17T06:33:59.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.547+0000 7f625658b700 1 Processor -- start 2023-11-17T06:33:59.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.547+0000 7f625658b700 1 -- start start 2023-11-17T06:33:59.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f625658b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62500cded0 0x7f62501f7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f625658b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f62501619a0 0x7f6250161f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f625658b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250165b90 0x7f6250162480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f625658b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62501643f0 con 0x7f62500cded0 2023-11-17T06:33:59.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f625658b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62501f7f60 con 0x7f6250165b90 2023-11-17T06:33:59.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f625658b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62501637e0 con 0x7f62501619a0 2023-11-17T06:33:59.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f624ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62500cded0 0x7f62501f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f624ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62500cded0 0x7f62501f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56862/0 (socket says 172.21.15.69:56862) 2023-11-17T06:33:59.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f624ffff700 1 -- 172.21.15.69:0/2374012301 learned_addr learned my addr 172.21.15.69:0/2374012301 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:33:59.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f6254b28700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250165b90 0x7f6250162480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f62477fe700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f62501619a0 0x7f6250161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f624ffff700 1 -- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f62501619a0 msgr2=0x7f6250161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f624ffff700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f62501619a0 0x7f6250161f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f624ffff700 1 -- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250165b90 msgr2=0x7f6250162480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f624ffff700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250165b90 0x7f6250162480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f624ffff700 1 -- 172.21.15.69:0/2374012301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6240009520 con 0x7f62500cded0 2023-11-17T06:33:59.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f6254b28700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250165b90 0x7f6250162480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:33:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f624ffff700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62500cded0 0x7f62501f7a20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6240000c00 tx=0x7f6240004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.551+0000 7f624d7fa700 1 -- 172.21.15.69:0/2374012301 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240006810 con 0x7f62500cded0 2023-11-17T06:33:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.555+0000 7f624d7fa700 1 -- 172.21.15.69:0/2374012301 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6240020070 con 0x7f62500cded0 2023-11-17T06:33:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.555+0000 7f625658b700 1 -- 172.21.15.69:0/2374012301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6250163ac0 con 0x7f62500cded0 2023-11-17T06:33:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.555+0000 7f624d7fa700 1 -- 172.21.15.69:0/2374012301 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240025670 con 0x7f62500cded0 2023-11-17T06:33:59.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.555+0000 7f625658b700 1 -- 172.21.15.69:0/2374012301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6250164080 con 0x7f62500cded0 2023-11-17T06:33:59.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.555+0000 7f625658b700 1 -- 172.21.15.69:0/2374012301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625004e650 con 0x7f62500cded0 2023-11-17T06:33:59.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.555+0000 7f624d7fa700 1 -- 172.21.15.69:0/2374012301 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f6240022030 con 0x7f62500cded0 2023-11-17T06:33:59.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.559+0000 7f624d7fa700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6230066510 0x7f62300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:33:59.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.559+0000 7f624d7fa700 1 -- 172.21.15.69:0/2374012301 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f6240084f80 con 0x7f62500cded0 2023-11-17T06:33:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.559+0000 7f62477fe700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6230066510 0x7f62300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:33:59.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.559+0000 7f62477fe700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6230066510 0x7f62300689d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6250071fc0 tx=0x7f6238009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:33:59.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.567+0000 7f624d7fa700 1 -- 172.21.15.69:0/2374012301 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f62400b6090 con 0x7f62500cded0 2023-11-17T06:33:59.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.743+0000 7f625658b700 1 -- 172.21.15.69:0/2374012301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62500ae640 con 0x7f62500cded0 2023-11-17T06:33:59.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.747+0000 7f624d7fa700 1 -- 172.21.15.69:0/2374012301 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13160 (secure 0 0 0) 0x7f62400526e0 con 0x7f62500cded0 2023-11-17T06:33:59.752 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:33:59.753 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":44,"fsid":"473113af-218f-4c66-9eb3-2c30c3150d71","created":"2023-11-17T06:28:32.200512+0000","modified":"2023-11-17T06:33:53.315353+0000","last_up_change":"2023-11-17T06:29:44.994588+0000","last_in_change":"2023-11-17T06:29:35.317698+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-17T06:29:46.467332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"21887f14-24ae-49fd-8af6-6e396eddb0da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6801","nonce":3449021474}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6803","nonce":3449021474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6807","nonce":3449021474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3449021474},{"type":"v1","addr":"172.21.15.69:6805","nonce":3449021474}]},"public_addr":"172.21.15.69:6801/3449021474","cluster_addr":"172.21.15.69:6803/3449021474","heartbeat_back_addr":"172.21.15.69:6807/3449021474","heartbeat_front_addr":"172.21.15.69:6805/3449021474","state":["exists","up"]},{"osd":1,"uuid":"d735b46c-a147-4975-94d8-fae9caeaf5ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6809","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6811","nonce":346628569}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6813","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6814","nonce":346628569}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6822","nonce":346628569}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":346628569},{"type":"v1","addr":"172.21.15.69:6818","nonce":346628569}]},"public_addr":"172.21.15.69:6811/346628569","cluster_addr":"172.21.15.69:6814/346628569","heartbeat_back_addr":"172.21.15.69:6822/346628569","heartbeat_front_addr":"172.21.15.69:6818/346628569","state":["exists","up"]},{"osd":2,"uuid":"3b03818f-034a-46e6-b430-264cecba8b92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6810","nonce":576340262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6815","nonce":576340262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6821","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6823","nonce":576340262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6817","nonce":576340262},{"type":"v1","addr":"172.21.15.69:6819","nonce":576340262}]},"public_addr":"172.21.15.69:6810/576340262","cluster_addr":"172.21.15.69:6815/576340262","heartbeat_back_addr":"172.21.15.69:6823/576340262","heartbeat_front_addr":"172.21.15.69:6819/576340262","state":["exists","up"]},{"osd":3,"uuid":"8f837026-cb9e-4964-b340-d8f4e8fb615c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6825","nonce":183679214}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6827","nonce":183679214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6831","nonce":183679214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":183679214},{"type":"v1","addr":"172.21.15.69:6829","nonce":183679214}]},"public_addr":"172.21.15.69:6825/183679214","cluster_addr":"172.21.15.69:6827/183679214","heartbeat_back_addr":"172.21.15.69:6831/183679214","heartbeat_front_addr":"172.21.15.69:6829/183679214","state":["exists","up"]},{"osd":4,"uuid":"56aceb78-f273-4527-9395-6f208db7185a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6814","nonce":1712617818}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6818","nonce":1712617818}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6825","nonce":1712617818}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":1712617818},{"type":"v1","addr":"172.21.15.93:6822","nonce":1712617818}]},"public_addr":"172.21.15.93:6814/1712617818","cluster_addr":"172.21.15.93:6818/1712617818","heartbeat_back_addr":"172.21.15.93:6825/1712617818","heartbeat_front_addr":"172.21.15.93:6822/1712617818","state":["exists","up"]},{"osd":5,"uuid":"473dae71-5906-4db7-b80f-3cf3fa280301","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6803","nonce":753754499}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6805","nonce":753754499}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6809","nonce":753754499}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":753754499},{"type":"v1","addr":"172.21.15.93:6807","nonce":753754499}]},"public_addr":"172.21.15.93:6803/753754499","cluster_addr":"172.21.15.93:6805/753754499","heartbeat_back_addr":"172.21.15.93:6809/753754499","heartbeat_front_addr":"172.21.15.93:6807/753754499","state":["exists","up"]},{"osd":6,"uuid":"ceda42ec-0314-43a7-83ed-6bb66a09e638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6827","nonce":2665225471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6829","nonce":2665225471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6833","nonce":2665225471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":2665225471},{"type":"v1","addr":"172.21.15.93:6831","nonce":2665225471}]},"public_addr":"172.21.15.93:6827/2665225471","cluster_addr":"172.21.15.93:6829/2665225471","heartbeat_back_addr":"172.21.15.93:6833/2665225471","heartbeat_front_addr":"172.21.15.93:6831/2665225471","state":["exists","up"]},{"osd":7,"uuid":"9102eb3c-e110-4cc2-b5b5-e1c53433d972","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6811","nonce":4059179485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6813","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6815","nonce":4059179485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6821","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6823","nonce":4059179485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6817","nonce":4059179485},{"type":"v1","addr":"172.21.15.93:6819","nonce":4059179485}]},"public_addr":"172.21.15.93:6811/4059179485","cluster_addr":"172.21.15.93:6815/4059179485","heartbeat_back_addr":"172.21.15.93:6823/4059179485","heartbeat_front_addr":"172.21.15.93:6819/4059179485","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.111214+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.064977+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.000443+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.123857+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.091228+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:40.960011+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.177014+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-17T06:29:41.054705+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6834/377943606":"2023-11-18T06:33:50.154047+0000","172.21.15.69:6835/377943606":"2023-11-18T06:33:50.154047+0000","172.21.15.69:6835/1050522275":"2023-11-18T06:33:30.515033+0000","172.21.15.69:6834/1050522275":"2023-11-18T06:33:30.515033+0000","172.21.15.93:6837/4181304583":"2023-11-18T06:33:11.857552+0000","172.21.15.93:6836/4181304583":"2023-11-18T06:33:11.857552+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-17T06:33:59.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 -- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6230066510 msgr2=0x7f62300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6230066510 0x7f62300689d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6250071fc0 tx=0x7f6238009040 comp rx=0 tx=0).stop 2023-11-17T06:33:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 -- 172.21.15.69:0/2374012301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62500cded0 msgr2=0x7f62501f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:33:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62500cded0 0x7f62501f7a20 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6240000c00 tx=0x7f6240004770 comp rx=0 tx=0).stop 2023-11-17T06:33:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 -- 172.21.15.69:0/2374012301 shutdown_connections 2023-11-17T06:33:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f6230066510 0x7f62300689d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250165b90 0x7f6250162480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f62501619a0 0x7f6250161f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 --2- 172.21.15.69:0/2374012301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62500cded0 0x7f62501f7a20 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:33:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 -- 172.21.15.69:0/2374012301 >> 172.21.15.69:0/2374012301 conn(0x7f62500cee40 msgr2=0x7f625006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:33:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 -- 172.21.15.69:0/2374012301 shutdown_connections 2023-11-17T06:33:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:33:59.751+0000 7f625658b700 1 -- 172.21.15.69:0/2374012301 wait complete. 2023-11-17T06:34:00.782 INFO:tasks.ceph:Scrubbing osd.0 2023-11-17T06:34:00.782 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:34:00.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.975+0000 7f19391bd700 1 Processor -- start 2023-11-17T06:34:00.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.975+0000 7f19391bd700 1 -- start start 2023-11-17T06:34:00.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f19391bd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934143a40 0x7f1934070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:00.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f19391bd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f19340c5d00 0x7f19340c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:00.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f19391bd700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19340c66a0 con 0x7f193415de90 2023-11-17T06:34:00.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f19391bd700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19340ca8a0 con 0x7f1934143a40 2023-11-17T06:34:00.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1932d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934143a40 0x7f1934070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:00.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f19391bd700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1934072230 con 0x7f19340c5d00 2023-11-17T06:34:00.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1932d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1934143a40 0x7f1934070ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56876/0 (socket says 172.21.15.69:56876) 2023-11-17T06:34:00.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1932d9d700 1 -- 172.21.15.69:0/1647432670 learned_addr learned my addr 172.21.15.69:0/1647432670 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:00.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f193259c700 1 --2- 172.21.15.69:0/1647432670 >> v2:172.21.15.93:3300/0 conn(0x7f19340c5d00 0x7f19340c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:00.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1932d9d700 1 -- 172.21.15.69:0/1647432670 >> v2:172.21.15.93:3300/0 conn(0x7f19340c5d00 msgr2=0x7f19340c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:00.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1932d9d700 1 --2- 172.21.15.69:0/1647432670 >> v2:172.21.15.93:3300/0 conn(0x7f19340c5d00 0x7f19340c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:00.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1932d9d700 1 -- 172.21.15.69:0/1647432670 >> v1:172.21.15.93:6789/0 conn(0x7f193415de90 legacy=0x7f193415e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:00.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1932d9d700 1 -- 172.21.15.69:0/1647432670 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934071990 con 0x7f1934143a40 2023-11-17T06:34:00.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f193259c700 1 --2- 172.21.15.69:0/1647432670 >> v2:172.21.15.93:3300/0 conn(0x7f19340c5d00 0x7f19340c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:34:00.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1932d9d700 1 --2- 172.21.15.69:0/1647432670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1934143a40 0x7f1934070ff0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f19340cdb50 tx=0x7f1924009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a571b74d03c427f server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:00.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1931d9b700 1 -- 172.21.15.69:0/1647432670 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400b8a0 con 0x7f1934143a40 2023-11-17T06:34:00.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1931d9b700 1 -- 172.21.15.69:0/1647432670 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192400ba00 con 0x7f1934143a40 2023-11-17T06:34:00.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.979+0000 7f1931d9b700 1 -- 172.21.15.69:0/1647432670 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192400bd90 con 0x7f1934143a40 2023-11-17T06:34:00.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.983+0000 7f19391bd700 1 -- 172.21.15.69:0/1647432670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1934143a40 msgr2=0x7f1934070ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:00.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.983+0000 7f19391bd700 1 --2- 172.21.15.69:0/1647432670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1934143a40 0x7f1934070ff0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f19340cdb50 tx=0x7f1924009bf0 comp rx=0 tx=0).stop 2023-11-17T06:34:00.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.983+0000 7f19391bd700 1 -- 172.21.15.69:0/1647432670 shutdown_connections 2023-11-17T06:34:00.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.983+0000 7f19391bd700 1 --2- 172.21.15.69:0/1647432670 >> v2:172.21.15.93:3300/0 conn(0x7f19340c5d00 0x7f19340c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:00.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.983+0000 7f19391bd700 1 --2- 172.21.15.69:0/1647432670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1934143a40 0x7f1934070ff0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:00.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.983+0000 7f19391bd700 1 -- 172.21.15.69:0/1647432670 >> 172.21.15.69:0/1647432670 conn(0x7f193406b3b0 msgr2=0x7f193406b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:00.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.983+0000 7f19391bd700 1 -- 172.21.15.69:0/1647432670 shutdown_connections 2023-11-17T06:34:00.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.983+0000 7f19391bd700 1 -- 172.21.15.69:0/1647432670 wait complete. 2023-11-17T06:34:00.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.983+0000 7f19391bd700 1 Processor -- start 2023-11-17T06:34:00.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.983+0000 7f19391bd700 1 -- start start 2023-11-17T06:34:00.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f19391bd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19340c5d00 0x7f1934159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:00.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f19391bd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1934143a40 0x7f193413ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:00.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f19391bd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f193415de90 0x7f1934141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:00.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f19391bd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19341416b0 con 0x7f1934143a40 2023-11-17T06:34:00.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f19391bd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19341596b0 con 0x7f193415de90 2023-11-17T06:34:00.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f19391bd700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1934140aa0 con 0x7f19340c5d00 2023-11-17T06:34:00.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f193259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1934143a40 0x7f193413ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:00.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f193259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1934143a40 0x7f193413ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56882/0 (socket says 172.21.15.69:56882) 2023-11-17T06:34:00.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f193259c700 1 -- 172.21.15.69:0/2060966926 learned_addr learned my addr 172.21.15.69:0/2060966926 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:00.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f193359e700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f193415de90 0x7f1934141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:00.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f1932d9d700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19340c5d00 0x7f1934159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:00.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f193259c700 1 -- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19340c5d00 msgr2=0x7f1934159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:00.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f193259c700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f19340c5d00 0x7f1934159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f193259c700 1 -- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f193415de90 msgr2=0x7f1934141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f193259c700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f193415de90 0x7f1934141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f193259c700 1 -- 172.21.15.69:0/2060966926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009570 con 0x7f1934143a40 2023-11-17T06:34:01.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f193259c700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1934143a40 0x7f193413ffa0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f192800e810 tx=0x7f192800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f191b7fe700 1 -- 172.21.15.69:0/2060966926 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1928004230 con 0x7f1934143a40 2023-11-17T06:34:01.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f191b7fe700 1 -- 172.21.15.69:0/2060966926 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1928004390 con 0x7f1934143a40 2023-11-17T06:34:01.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f191b7fe700 1 -- 172.21.15.69:0/2060966926 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19280036c0 con 0x7f1934143a40 2023-11-17T06:34:01.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934140d80 con 0x7f1934143a40 2023-11-17T06:34:01.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.987+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1934141340 con 0x7f1934143a40 2023-11-17T06:34:01.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.991+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1934071f50 con 0x7f1934143a40 2023-11-17T06:34:01.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.991+0000 7f191b7fe700 1 -- 172.21.15.69:0/2060966926 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f1928003840 con 0x7f1934143a40 2023-11-17T06:34:01.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.991+0000 7f191b7fe700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1920066510 0x7f19200689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.991+0000 7f191b7fe700 1 -- 172.21.15.69:0/2060966926 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f1928083680 con 0x7f1934143a40 2023-11-17T06:34:01.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.991+0000 7f191b7fe700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x7f192006c4b0 0x7f192006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.991+0000 7f191b7fe700 1 -- 172.21.15.69:0/2060966926 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f192006ef80 con 0x7f192006c4b0 2023-11-17T06:34:01.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.991+0000 7f191b7fe700 1 -- 172.21.15.69:0/2060966926 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1928085c60 con 0x7f1934143a40 2023-11-17T06:34:01.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.991+0000 7f1932d9d700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1920066510 0x7f19200689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.991+0000 7f193359e700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x7f192006c4b0 0x7f192006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.995+0000 7f193359e700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x7f192006c4b0 0x7f192006e8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.995+0000 7f1932d9d700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1920066510 0x7f19200689d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1924000c00 tx=0x7f1924008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:00.995+0000 7f191b7fe700 1 -- 172.21.15.69:0/2060966926 <== osd.0 v2:172.21.15.69:6800/3449021474 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f192006ef80 con 0x7f192006c4b0 2023-11-17T06:34:01.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.011+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 --> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1934071c70 con 0x7f192006c4b0 2023-11-17T06:34:01.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.011+0000 7f191b7fe700 1 -- 172.21.15.69:0/2060966926 <== osd.0 v2:172.21.15.69:6800/3449021474 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f192c001f40 con 0x7f192006c4b0 2023-11-17T06:34:01.018 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:34:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:34:01.019 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:34:01.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.011+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x7f192006c4b0 msgr2=0x7f192006e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.011+0000 7f19391bd700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.69:6800/3449021474,v1:172.21.15.69:6801/3449021474] conn(0x7f192006c4b0 0x7f192006e8d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.011+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1920066510 msgr2=0x7f19200689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.011+0000 7f19391bd700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f1920066510 0x7f19200689d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1924000c00 tx=0x7f1924008030 comp rx=0 tx=0).stop 2023-11-17T06:34:01.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.011+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1934143a40 msgr2=0x7f193413ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.011+0000 7f19391bd700 1 --2- 172.21.15.69:0/2060966926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1934143a40 0x7f193413ffa0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f192800e810 tx=0x7f192800eb20 comp rx=0 tx=0).stop 2023-11-17T06:34:01.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.015+0000 7f193359e700 1 -- 172.21.15.69:0/2060966926 reap_dead start 2023-11-17T06:34:01.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.015+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 shutdown_connections 2023-11-17T06:34:01.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.015+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 >> 172.21.15.69:0/2060966926 conn(0x7f193406b3b0 msgr2=0x7f193415a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:01.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.015+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 shutdown_connections 2023-11-17T06:34:01.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.015+0000 7f19391bd700 1 -- 172.21.15.69:0/2060966926 wait complete. 2023-11-17T06:34:01.042 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-17T06:34:01.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.211+0000 7f83a931d700 1 Processor -- start 2023-11-17T06:34:01.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.211+0000 7f83a931d700 1 -- start start 2023-11-17T06:34:01.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.211+0000 7f83a931d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f83a4159830 0x7f83a406d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a931d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40cec30 con 0x7f83a40ce2b0 2023-11-17T06:34:01.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a931d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a406d8c0 con 0x7f83a4070800 2023-11-17T06:34:01.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a931d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a406c2e0 con 0x7f83a4159830 2023-11-17T06:34:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a3fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f83a4159830 0x7f83a406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a3fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f83a4159830 0x7f83a406d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56886/0 (socket says 172.21.15.69:56886) 2023-11-17T06:34:01.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a3fff700 1 -- 172.21.15.69:0/2919053452 learned_addr learned my addr 172.21.15.69:0/2919053452 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a3fff700 1 -- 172.21.15.69:0/2919053452 >> v1:172.21.15.93:6789/0 conn(0x7f83a4070800 legacy=0x7f83a4070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a3fff700 1 -- 172.21.15.69:0/2919053452 >> v1:172.21.15.69:6789/0 conn(0x7f83a40ce2b0 legacy=0x7f83a406bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a3fff700 1 -- 172.21.15.69:0/2919053452 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a406c5c0 con 0x7f83a4159830 2023-11-17T06:34:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a3fff700 1 --2- 172.21.15.69:0/2919053452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4159830 0x7f83a406d380 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8394009910 tx=0x7f8394009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e98e15453812a07 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a2ffd700 1 -- 172.21.15.69:0/2919053452 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394004230 con 0x7f83a4159830 2023-11-17T06:34:01.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a2ffd700 1 -- 172.21.15.69:0/2919053452 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8394004390 con 0x7f83a4159830 2023-11-17T06:34:01.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a2ffd700 1 -- 172.21.15.69:0/2919053452 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394009e60 con 0x7f83a4159830 2023-11-17T06:34:01.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a931d700 1 -- 172.21.15.69:0/2919053452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4159830 msgr2=0x7f83a406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a931d700 1 --2- 172.21.15.69:0/2919053452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4159830 0x7f83a406d380 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8394009910 tx=0x7f8394009c20 comp rx=0 tx=0).stop 2023-11-17T06:34:01.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a931d700 1 -- 172.21.15.69:0/2919053452 shutdown_connections 2023-11-17T06:34:01.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a931d700 1 --2- 172.21.15.69:0/2919053452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4159830 0x7f83a406d380 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a931d700 1 -- 172.21.15.69:0/2919053452 >> 172.21.15.69:0/2919053452 conn(0x7f83a40cedc0 msgr2=0x7f83a40cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:01.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a931d700 1 -- 172.21.15.69:0/2919053452 shutdown_connections 2023-11-17T06:34:01.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.215+0000 7f83a931d700 1 -- 172.21.15.69:0/2919053452 wait complete. 2023-11-17T06:34:01.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.219+0000 7f83a931d700 1 Processor -- start 2023-11-17T06:34:01.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.219+0000 7f83a931d700 1 -- start start 2023-11-17T06:34:01.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.219+0000 7f83a931d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4070800 0x7f83a40c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.219+0000 7f83a931d700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f83a40ce2b0 0x7f83a40c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.219+0000 7f83a931d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83a4159830 0x7f83a40c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.219+0000 7f83a931d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40c8e60 con 0x7f83a4070800 2023-11-17T06:34:01.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.219+0000 7f83a931d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a414f770 con 0x7f83a4159830 2023-11-17T06:34:01.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.219+0000 7f83a931d700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a4151180 con 0x7f83a40ce2b0 2023-11-17T06:34:01.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.219+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4070800 0x7f83a40c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.219+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4070800 0x7f83a40c5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56888/0 (socket says 172.21.15.69:56888) 2023-11-17T06:34:01.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a3fff700 1 -- 172.21.15.69:0/1795657097 learned_addr learned my addr 172.21.15.69:0/1795657097 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:01.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a8b1c700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83a4159830 0x7f83a40c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a37fe700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f83a40ce2b0 0x7f83a40c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a3fff700 1 -- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f83a40ce2b0 msgr2=0x7f83a40c28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a3fff700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f83a40ce2b0 0x7f83a40c28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a3fff700 1 -- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83a4159830 msgr2=0x7f83a40c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a3fff700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83a4159830 0x7f83a40c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a3fff700 1 -- 172.21.15.69:0/1795657097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394009570 con 0x7f83a4070800 2023-11-17T06:34:01.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a3fff700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4070800 0x7f83a40c5180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8394004000 tx=0x7f8394004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a0ff9700 1 -- 172.21.15.69:0/1795657097 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839400be00 con 0x7f83a4070800 2023-11-17T06:34:01.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a0ff9700 1 -- 172.21.15.69:0/1795657097 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839401f070 con 0x7f83a4070800 2023-11-17T06:34:01.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a931d700 1 -- 172.21.15.69:0/1795657097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a4151460 con 0x7f83a4070800 2023-11-17T06:34:01.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a0ff9700 1 -- 172.21.15.69:0/1795657097 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394003900 con 0x7f83a4070800 2023-11-17T06:34:01.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a931d700 1 -- 172.21.15.69:0/1795657097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a4151a20 con 0x7f83a4070800 2023-11-17T06:34:01.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.223+0000 7f83a931d700 1 -- 172.21.15.69:0/1795657097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a4151c10 con 0x7f83a4070800 2023-11-17T06:34:01.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.227+0000 7f83a0ff9700 1 -- 172.21.15.69:0/1795657097 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8394021030 con 0x7f83a4070800 2023-11-17T06:34:01.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.227+0000 7f83a0ff9700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8390066510 0x7f83900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.227+0000 7f83a0ff9700 1 -- 172.21.15.69:0/1795657097 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f8394085370 con 0x7f83a4070800 2023-11-17T06:34:01.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.227+0000 7f83a37fe700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8390066510 0x7f83900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.231+0000 7f83a37fe700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8390066510 0x7f83900689d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83a40ae6a0 tx=0x7f8398009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.231+0000 7f83a0ff9700 1 -- 172.21.15.69:0/1795657097 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8394052a30 con 0x7f83a4070800 2023-11-17T06:34:01.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.403+0000 7f83a931d700 1 -- 172.21.15.69:0/1795657097 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f83a406cb80 con 0x7f8390066510 2023-11-17T06:34:01.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.407+0000 7f83a0ff9700 1 -- 172.21.15.69:0/1795657097 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83980050d0 con 0x7f8390066510 2023-11-17T06:34:01.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 -- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8390066510 msgr2=0x7f83900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8390066510 0x7f83900689d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83a40ae6a0 tx=0x7f8398009040 comp rx=0 tx=0).stop 2023-11-17T06:34:01.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 -- 172.21.15.69:0/1795657097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4070800 msgr2=0x7f83a40c5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4070800 0x7f83a40c5180 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8394004000 tx=0x7f8394004770 comp rx=0 tx=0).stop 2023-11-17T06:34:01.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 -- 172.21.15.69:0/1795657097 shutdown_connections 2023-11-17T06:34:01.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f8390066510 0x7f83900689d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f83a4159830 0x7f83a40c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f83a40ce2b0 0x7f83a40c28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 --2- 172.21.15.69:0/1795657097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a4070800 0x7f83a40c5180 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 -- 172.21.15.69:0/1795657097 >> 172.21.15.69:0/1795657097 conn(0x7f83a40cedc0 msgr2=0x7f83a40af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:01.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 -- 172.21.15.69:0/1795657097 shutdown_connections 2023-11-17T06:34:01.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.411+0000 7f83a931d700 1 -- 172.21.15.69:0/1795657097 wait complete. 2023-11-17T06:34:01.420 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 0 to deep-scrub 2023-11-17T06:34:01.438 INFO:tasks.ceph:Scrubbing osd.1 2023-11-17T06:34:01.439 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:34:01.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.619+0000 7f4d5b1a6700 1 Processor -- start 2023-11-17T06:34:01.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.619+0000 7f4d5b1a6700 1 -- start start 2023-11-17T06:34:01.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.623+0000 7f4d5b1a6700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4d54161840 0x7f4d5406b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.623+0000 7f4d5b1a6700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d540ca520 0x7f4d5406be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.623+0000 7f4d5b1a6700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d54165310 con 0x7f4d540c1d50 2023-11-17T06:34:01.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.623+0000 7f4d5b1a6700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d541655f0 con 0x7f4d54161840 2023-11-17T06:34:01.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.623+0000 7f4d5b1a6700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541658d0 con 0x7f4d540ca520 2023-11-17T06:34:01.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.623+0000 7f4d5a1a4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f4d54161840 0x7f4d5406b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.623+0000 7f4d5a9a5700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d540ca520 0x7f4d5406be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.623+0000 7f4d599a3700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f4d540c1d50 0x7f4d540ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40300/0 (socket says 172.21.15.69:40300) 2023-11-17T06:34:01.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.623+0000 7f4d599a3700 1 -- 172.21.15.69:0/4113427653 learned_addr learned my addr 172.21.15.69:0/4113427653 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:34:01.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5a9a5700 1 -- 172.21.15.69:0/4113427653 >> v2:172.21.15.93:3300/0 conn(0x7f4d54161840 msgr2=0x7f4d5406b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:01.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5a9a5700 1 --2- 172.21.15.69:0/4113427653 >> v2:172.21.15.93:3300/0 conn(0x7f4d54161840 0x7f4d5406b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5a9a5700 1 -- 172.21.15.69:0/4113427653 >> v1:172.21.15.69:6789/0 conn(0x7f4d540c1d50 legacy=0x7f4d540ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5a9a5700 1 -- 172.21.15.69:0/4113427653 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d54165bb0 con 0x7f4d540ca520 2023-11-17T06:34:01.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5a9a5700 1 --2- 172.21.15.69:0/4113427653 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d540ca520 0x7f4d5406be50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009d90 tx=0x7f4d4c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ae133cec29dad20 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d591a2700 1 -- 172.21.15.69:0/4113427653 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c00e070 con 0x7f4d540ca520 2023-11-17T06:34:01.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d591a2700 1 -- 172.21.15.69:0/4113427653 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c00bb20 con 0x7f4d540ca520 2023-11-17T06:34:01.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d591a2700 1 -- 172.21.15.69:0/4113427653 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c012430 con 0x7f4d540ca520 2023-11-17T06:34:01.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/4113427653 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d540ca520 msgr2=0x7f4d5406be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.633 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5b1a6700 1 --2- 172.21.15.69:0/4113427653 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d540ca520 0x7f4d5406be50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009d90 tx=0x7f4d4c00b330 comp rx=0 tx=0).stop 2023-11-17T06:34:01.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/4113427653 shutdown_connections 2023-11-17T06:34:01.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5b1a6700 1 --2- 172.21.15.69:0/4113427653 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d540ca520 0x7f4d5406be50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.634 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5b1a6700 1 --2- 172.21.15.69:0/4113427653 >> v2:172.21.15.93:3300/0 conn(0x7f4d54161840 0x7f4d5406b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/4113427653 >> 172.21.15.69:0/4113427653 conn(0x7f4d540cb900 msgr2=0x7f4d540cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:01.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/4113427653 shutdown_connections 2023-11-17T06:34:01.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.627+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/4113427653 wait complete. 2023-11-17T06:34:01.637 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5b1a6700 1 Processor -- start 2023-11-17T06:34:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5b1a6700 1 -- start start 2023-11-17T06:34:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5b1a6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d540c1d50 0x7f4d540c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5b1a6700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d540ca520 0x7f4d540ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5b1a6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d54161840 0x7f4d540cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5b1a6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d541648d0 con 0x7f4d540c1d50 2023-11-17T06:34:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5b1a6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540c8f00 con 0x7f4d54161840 2023-11-17T06:34:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5b1a6700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54163850 con 0x7f4d540ca520 2023-11-17T06:34:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5a1a4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d540c1d50 0x7f4d540c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5a1a4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d540c1d50 0x7f4d540c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56898/0 (socket says 172.21.15.69:56898) 2023-11-17T06:34:01.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5a1a4700 1 -- 172.21.15.69:0/1727024333 learned_addr learned my addr 172.21.15.69:0/1727024333 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:01.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d599a3700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d540ca520 0x7f4d540ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.631+0000 7f4d5a9a5700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d54161840 0x7f4d540cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d5a1a4700 1 -- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d540ca520 msgr2=0x7f4d540ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d5a1a4700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d540ca520 0x7f4d540ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d5a1a4700 1 -- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d54161840 msgr2=0x7f4d540cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d5a1a4700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d54161840 0x7f4d540cd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d5a1a4700 1 -- 172.21.15.69:0/1727024333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c009a70 con 0x7f4d540c1d50 2023-11-17T06:34:01.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d5a1a4700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d540c1d50 0x7f4d540c89c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000e840 tx=0x7f4d5000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d4affd700 1 -- 172.21.15.69:0/1727024333 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d500095a0 con 0x7f4d540c1d50 2023-11-17T06:34:01.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d4affd700 1 -- 172.21.15.69:0/1727024333 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5000c690 con 0x7f4d540c1d50 2023-11-17T06:34:01.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d4affd700 1 -- 172.21.15.69:0/1727024333 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5000ca00 con 0x7f4d540c1d50 2023-11-17T06:34:01.641 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5406dc60 con 0x7f4d540c1d50 2023-11-17T06:34:01.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d54163e10 con 0x7f4d540c1d50 2023-11-17T06:34:01.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.635+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d5406dae0 con 0x7f4d540c1d50 2023-11-17T06:34:01.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.639+0000 7f4d4affd700 1 -- 172.21.15.69:0/1727024333 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4d5000cb60 con 0x7f4d540c1d50 2023-11-17T06:34:01.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.639+0000 7f4d4affd700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d38066510 0x7f4d380689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.644 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.639+0000 7f4d4affd700 1 -- 172.21.15.69:0/1727024333 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f4d50083c00 con 0x7f4d540c1d50 2023-11-17T06:34:01.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.639+0000 7f4d4affd700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x7f4d3806c4b0 0x7f4d3806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.639+0000 7f4d4affd700 1 -- 172.21.15.69:0/1727024333 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d3806ef80 con 0x7f4d3806c4b0 2023-11-17T06:34:01.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.639+0000 7f4d4affd700 1 -- 172.21.15.69:0/1727024333 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d500862c0 con 0x7f4d540c1d50 2023-11-17T06:34:01.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.639+0000 7f4d599a3700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d38066510 0x7f4d380689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.645 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.639+0000 7f4d5a9a5700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x7f4d3806c4b0 0x7f4d3806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.639+0000 7f4d5a9a5700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x7f4d3806c4b0 0x7f4d3806e8d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.639+0000 7f4d599a3700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d38066510 0x7f4d380689d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4d540b3000 tx=0x7f4d44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.643+0000 7f4d4affd700 1 -- 172.21.15.69:0/1727024333 <== osd.1 v2:172.21.15.69:6809/346628569 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4d3806ef80 con 0x7f4d3806c4b0 2023-11-17T06:34:01.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 --> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d540c22a0 con 0x7f4d3806c4b0 2023-11-17T06:34:01.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d4affd700 1 -- 172.21.15.69:0/1727024333 <== osd.1 v2:172.21.15.69:6809/346628569 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4d4c003b60 con 0x7f4d3806c4b0 2023-11-17T06:34:01.666 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:34:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:34:01.666 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:34:01.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x7f4d3806c4b0 msgr2=0x7f4d3806e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.69:6809/346628569,v1:172.21.15.69:6811/346628569] conn(0x7f4d3806c4b0 0x7f4d3806e8d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d38066510 msgr2=0x7f4d380689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d38066510 0x7f4d380689d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4d540b3000 tx=0x7f4d44009040 comp rx=0 tx=0).stop 2023-11-17T06:34:01.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d540c1d50 msgr2=0x7f4d540c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 --2- 172.21.15.69:0/1727024333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d540c1d50 0x7f4d540c89c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000e840 tx=0x7f4d5000ec00 comp rx=0 tx=0).stop 2023-11-17T06:34:01.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5a9a5700 1 -- 172.21.15.69:0/1727024333 reap_dead start 2023-11-17T06:34:01.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 shutdown_connections 2023-11-17T06:34:01.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 >> 172.21.15.69:0/1727024333 conn(0x7f4d540cb900 msgr2=0x7f4d540cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:01.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 shutdown_connections 2023-11-17T06:34:01.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.659+0000 7f4d5b1a6700 1 -- 172.21.15.69:0/1727024333 wait complete. 2023-11-17T06:34:01.687 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-17T06:34:01.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.855+0000 7f2f41ada700 1 Processor -- start 2023-11-17T06:34:01.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.855+0000 7f2f41ada700 1 -- start start 2023-11-17T06:34:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f41ada700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 0x7f2f3c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f41ada700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2f3c0b6580 0x7f2f3c0b6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f41ada700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3c06d630 con 0x7f2f3c15d550 2023-11-17T06:34:01.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f41ada700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3c0cf400 con 0x7f2f3c0b6580 2023-11-17T06:34:01.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f41ada700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0d2340 con 0x7f2f3c06cc90 2023-11-17T06:34:01.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f412d9700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2f3c0b6580 0x7f2f3c0b6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f412d9700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2f3c0b6580 0x7f2f3c0b6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56914/0 (socket says 172.21.15.69:56914) 2023-11-17T06:34:01.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f412d9700 1 -- 172.21.15.69:0/34331434 learned_addr learned my addr 172.21.15.69:0/34331434 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:01.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f3bfff700 1 --2- 172.21.15.69:0/34331434 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 0x7f2f3c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f412d9700 1 -- 172.21.15.69:0/34331434 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 msgr2=0x7f2f3c06d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:01.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f412d9700 1 --2- 172.21.15.69:0/34331434 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 0x7f2f3c06d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f412d9700 1 -- 172.21.15.69:0/34331434 >> v1:172.21.15.93:6789/0 conn(0x7f2f3c15d550 legacy=0x7f2f3c0d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f412d9700 1 -- 172.21.15.69:0/34331434 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c0d1730 con 0x7f2f3c0b6580 2023-11-17T06:34:01.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.859+0000 7f2f412d9700 1 --2- 172.21.15.69:0/34331434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c0b6580 0x7f2f3c0b6a10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009e50 tx=0x7f2f3400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9966a203dc954a0d server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f3b7fe700 1 -- 172.21.15.69:0/34331434 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3400e070 con 0x7f2f3c0b6580 2023-11-17T06:34:01.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f3b7fe700 1 -- 172.21.15.69:0/34331434 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3400b910 con 0x7f2f3c0b6580 2023-11-17T06:34:01.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f3b7fe700 1 -- 172.21.15.69:0/34331434 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3400bcc0 con 0x7f2f3c0b6580 2023-11-17T06:34:01.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f41ada700 1 -- 172.21.15.69:0/34331434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c0b6580 msgr2=0x7f2f3c0b6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f41ada700 1 --2- 172.21.15.69:0/34331434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c0b6580 0x7f2f3c0b6a10 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009e50 tx=0x7f2f3400b330 comp rx=0 tx=0).stop 2023-11-17T06:34:01.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f41ada700 1 -- 172.21.15.69:0/34331434 shutdown_connections 2023-11-17T06:34:01.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f41ada700 1 --2- 172.21.15.69:0/34331434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c0b6580 0x7f2f3c0b6a10 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f41ada700 1 --2- 172.21.15.69:0/34331434 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 0x7f2f3c06d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f41ada700 1 -- 172.21.15.69:0/34331434 >> 172.21.15.69:0/34331434 conn(0x7f2f3c0b4cb0 msgr2=0x7f2f3c0b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:01.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f41ada700 1 -- 172.21.15.69:0/34331434 shutdown_connections 2023-11-17T06:34:01.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f41ada700 1 -- 172.21.15.69:0/34331434 wait complete. 2023-11-17T06:34:01.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f41ada700 1 Processor -- start 2023-11-17T06:34:01.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.863+0000 7f2f41ada700 1 -- start start 2023-11-17T06:34:01.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f41ada700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 0x7f2f3c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f41ada700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f3c0b6580 0x7f2f3c154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f41ada700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c15d550 0x7f2f3c157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f41ada700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c154940 con 0x7f2f3c15d550 2023-11-17T06:34:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f41ada700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c158070 con 0x7f2f3c0b6580 2023-11-17T06:34:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f41ada700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c157d90 con 0x7f2f3c06cc90 2023-11-17T06:34:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f412d9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c15d550 0x7f2f3c157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f412d9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c15d550 0x7f2f3c157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56918/0 (socket says 172.21.15.69:56918) 2023-11-17T06:34:01.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f412d9700 1 -- 172.21.15.69:0/1439915726 learned_addr learned my addr 172.21.15.69:0/1439915726 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:01.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f40ad8700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 0x7f2f3c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f3bfff700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f3c0b6580 0x7f2f3c154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f412d9700 1 -- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 msgr2=0x7f2f3c153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f412d9700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 0x7f2f3c153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f412d9700 1 -- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f3c0b6580 msgr2=0x7f2f3c154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f412d9700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f3c0b6580 0x7f2f3c154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f412d9700 1 -- 172.21.15.69:0/1439915726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34009b30 con 0x7f2f3c15d550 2023-11-17T06:34:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f40ad8700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 0x7f2f3c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:34:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f3bfff700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f3c0b6580 0x7f2f3c154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:34:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f412d9700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c15d550 0x7f2f3c157480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c08b210 tx=0x7f2f34004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f397fa700 1 -- 172.21.15.69:0/1439915726 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34004920 con 0x7f2f3c15d550 2023-11-17T06:34:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f397fa700 1 -- 172.21.15.69:0/1439915726 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f340099b0 con 0x7f2f3c15d550 2023-11-17T06:34:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f41ada700 1 -- 172.21.15.69:0/1439915726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c154280 con 0x7f2f3c15d550 2023-11-17T06:34:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f397fa700 1 -- 172.21.15.69:0/1439915726 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3401c680 con 0x7f2f3c15d550 2023-11-17T06:34:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.867+0000 7f2f41ada700 1 -- 172.21.15.69:0/1439915726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3c1579c0 con 0x7f2f3c15d550 2023-11-17T06:34:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.871+0000 7f2f41ada700 1 -- 172.21.15.69:0/1439915726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3c157b50 con 0x7f2f3c15d550 2023-11-17T06:34:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.871+0000 7f2f397fa700 1 -- 172.21.15.69:0/1439915726 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f2f3401c7e0 con 0x7f2f3c15d550 2023-11-17T06:34:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.875+0000 7f2f397fa700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2f20066540 0x7f2f20068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.875+0000 7f2f397fa700 1 -- 172.21.15.69:0/1439915726 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f2f34085890 con 0x7f2f3c15d550 2023-11-17T06:34:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.875+0000 7f2f40ad8700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2f20066540 0x7f2f20068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.875+0000 7f2f40ad8700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2f20066540 0x7f2f20068a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2f30000f60 tx=0x7f2f30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:01.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:01.879+0000 7f2f397fa700 1 -- 172.21.15.69:0/1439915726 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f2f3c157b50 con 0x7f2f3c15d550 2023-11-17T06:34:02.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.055+0000 7f2f41ada700 1 -- 172.21.15.69:0/1439915726 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f3c1552a0 con 0x7f2f20066540 2023-11-17T06:34:02.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.055+0000 7f2f397fa700 1 -- 172.21.15.69:0/1439915726 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2f3c1552a0 con 0x7f2f20066540 2023-11-17T06:34:02.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 -- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2f20066540 msgr2=0x7f2f20068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2f20066540 0x7f2f20068a00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2f30000f60 tx=0x7f2f30009040 comp rx=0 tx=0).stop 2023-11-17T06:34:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 -- 172.21.15.69:0/1439915726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c15d550 msgr2=0x7f2f3c157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c15d550 0x7f2f3c157480 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c08b210 tx=0x7f2f34004af0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 -- 172.21.15.69:0/1439915726 shutdown_connections 2023-11-17T06:34:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2f20066540 0x7f2f20068a00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2f3c15d550 0x7f2f3c157480 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f3c0b6580 0x7f2f3c154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 --2- 172.21.15.69:0/1439915726 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f2f3c06cc90 0x7f2f3c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 -- 172.21.15.69:0/1439915726 >> 172.21.15.69:0/1439915726 conn(0x7f2f3c0b4cb0 msgr2=0x7f2f3c0b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 -- 172.21.15.69:0/1439915726 shutdown_connections 2023-11-17T06:34:02.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.059+0000 7f2f41ada700 1 -- 172.21.15.69:0/1439915726 wait complete. 2023-11-17T06:34:02.066 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 1 to deep-scrub 2023-11-17T06:34:02.084 INFO:tasks.ceph:Scrubbing osd.2 2023-11-17T06:34:02.084 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:34:02.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.251+0000 7fdee5584700 1 Processor -- start 2023-11-17T06:34:02.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.251+0000 7fdee5584700 1 -- start start 2023-11-17T06:34:02.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.251+0000 7fdee5584700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdee006d7f0 0x7fdee00b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.251+0000 7fdee5584700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdee00b0c60 0x7fdee006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.251+0000 7fdee5584700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee0071860 con 0x7fdee015b170 2023-11-17T06:34:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.251+0000 7fdee5584700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee00b10f0 con 0x7fdee00b0c60 2023-11-17T06:34:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.251+0000 7fdee5584700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee0070360 con 0x7fdee006d7f0 2023-11-17T06:34:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdedf7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdee00b0c60 0x7fdee006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdedeffd700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fdee015b170 0x7fdee015f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:44218/0 (socket says 172.21.15.69:44218) 2023-11-17T06:34:02.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdedeffd700 1 -- 172.21.15.69:0/308697030 learned_addr learned my addr 172.21.15.69:0/308697030 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:34:02.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdede7fc700 1 --2- 172.21.15.69:0/308697030 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdee006d7f0 0x7fdee00b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdede7fc700 1 -- 172.21.15.69:0/308697030 >> v2:172.21.15.69:3300/0 conn(0x7fdee00b0c60 msgr2=0x7fdee006b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:02.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdede7fc700 1 --2- 172.21.15.69:0/308697030 >> v2:172.21.15.69:3300/0 conn(0x7fdee00b0c60 0x7fdee006b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdede7fc700 1 -- 172.21.15.69:0/308697030 >> v1:172.21.15.93:6789/0 conn(0x7fdee015b170 legacy=0x7fdee015f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdede7fc700 1 -- 172.21.15.69:0/308697030 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee006fda0 con 0x7fdee006d7f0 2023-11-17T06:34:02.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdeddffb700 1 -- 172.21.15.69:0/308697030 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646170998 0 0) 0x7fdee0071860 con 0x7fdee015b170 2023-11-17T06:34:02.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdede7fc700 1 --2- 172.21.15.69:0/308697030 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdee006d7f0 0x7fdee00b0720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009850 tx=0x7fdec8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ced8eda6cc68094 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdeddffb700 1 -- 172.21.15.69:0/308697030 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8011830 con 0x7fdee006d7f0 2023-11-17T06:34:02.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdeddffb700 1 -- 172.21.15.69:0/308697030 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdec8011990 con 0x7fdee006d7f0 2023-11-17T06:34:02.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdeddffb700 1 -- 172.21.15.69:0/308697030 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdec8011d40 con 0x7fdee006d7f0 2023-11-17T06:34:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdee5584700 1 -- 172.21.15.69:0/308697030 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdee006d7f0 msgr2=0x7fdee00b0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdee5584700 1 --2- 172.21.15.69:0/308697030 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdee006d7f0 0x7fdee00b0720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009850 tx=0x7fdec8009b60 comp rx=0 tx=0).stop 2023-11-17T06:34:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdee5584700 1 -- 172.21.15.69:0/308697030 shutdown_connections 2023-11-17T06:34:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdee5584700 1 --2- 172.21.15.69:0/308697030 >> v2:172.21.15.69:3300/0 conn(0x7fdee00b0c60 0x7fdee006b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdee5584700 1 --2- 172.21.15.69:0/308697030 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdee006d7f0 0x7fdee00b0720 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.255+0000 7fdee5584700 1 -- 172.21.15.69:0/308697030 >> 172.21.15.69:0/308697030 conn(0x7fdee00cb900 msgr2=0x7fdee00cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:02.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.259+0000 7fdee5584700 1 -- 172.21.15.69:0/308697030 shutdown_connections 2023-11-17T06:34:02.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.259+0000 7fdee5584700 1 -- 172.21.15.69:0/308697030 wait complete. 2023-11-17T06:34:02.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.259+0000 7fdee5584700 1 Processor -- start 2023-11-17T06:34:02.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.259+0000 7fdee5584700 1 -- start start 2023-11-17T06:34:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdee5584700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee006d7f0 0x7fdee00c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdee5584700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdee00b0c60 0x7fdee015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.273 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdee5584700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdee015b170 0x7fdee015d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdee5584700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00b2e50 con 0x7fdee015b170 2023-11-17T06:34:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdee5584700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00c5320 con 0x7fdee006d7f0 2023-11-17T06:34:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdee5584700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00b2240 con 0x7fdee00b0c60 2023-11-17T06:34:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdedf7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdee015b170 0x7fdee015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.274 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdedf7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdee015b170 0x7fdee015d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56928/0 (socket says 172.21.15.69:56928) 2023-11-17T06:34:02.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdedf7fe700 1 -- 172.21.15.69:0/505357297 learned_addr learned my addr 172.21.15.69:0/505357297 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:02.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdede7fc700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdee00b0c60 0x7fdee015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdedeffd700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee006d7f0 0x7fdee00c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdedf7fe700 1 -- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdee00b0c60 msgr2=0x7fdee015cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdedf7fe700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fdee00b0c60 0x7fdee015cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdedf7fe700 1 -- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee006d7f0 msgr2=0x7fdee00c4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdedf7fe700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdee006d7f0 0x7fdee00c4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdedf7fe700 1 -- 172.21.15.69:0/505357297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec80094b0 con 0x7fdee015b170 2023-11-17T06:34:02.275 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdedf7fe700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdee015b170 0x7fdee015d510 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fded800efc0 tx=0x7fded800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fded77fe700 1 -- 172.21.15.69:0/505357297 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8009ea0 con 0x7fdee015b170 2023-11-17T06:34:02.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fded77fe700 1 -- 172.21.15.69:0/505357297 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded800f040 con 0x7fdee015b170 2023-11-17T06:34:02.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fded77fe700 1 -- 172.21.15.69:0/505357297 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded800ced0 con 0x7fdee015b170 2023-11-17T06:34:02.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee00b2520 con 0x7fdee015b170 2023-11-17T06:34:02.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.263+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee00b2ae0 con 0x7fdee015b170 2023-11-17T06:34:02.276 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.267+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdee0071a90 con 0x7fdee015b170 2023-11-17T06:34:02.277 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.267+0000 7fded77fe700 1 -- 172.21.15.69:0/505357297 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fded8014480 con 0x7fdee015b170 2023-11-17T06:34:02.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.267+0000 7fded77fe700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdec0066510 0x7fdec00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.267+0000 7fded77fe700 1 -- 172.21.15.69:0/505357297 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fded80844f0 con 0x7fdee015b170 2023-11-17T06:34:02.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.271+0000 7fded77fe700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x7fdec006c340 0x7fdec006e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.271+0000 7fded77fe700 1 -- 172.21.15.69:0/505357297 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdec006ee10 con 0x7fdec006c340 2023-11-17T06:34:02.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.271+0000 7fded77fe700 1 -- 172.21.15.69:0/505357297 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fded8086a50 con 0x7fdee015b170 2023-11-17T06:34:02.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.271+0000 7fdedeffd700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdec0066510 0x7fdec00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.271+0000 7fdede7fc700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x7fdec006c340 0x7fdec006e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.271+0000 7fdede7fc700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x7fdec006c340 0x7fdec006e760 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.271+0000 7fdedeffd700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdec0066510 0x7fdec00689d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fded0000f60 tx=0x7fded0007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.271+0000 7fded77fe700 1 -- 172.21.15.69:0/505357297 <== osd.2 v2:172.21.15.69:6808/576340262 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fdec006ee10 con 0x7fdec006c340 2023-11-17T06:34:02.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.291+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 --> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdee0070080 con 0x7fdec006c340 2023-11-17T06:34:02.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.291+0000 7fded77fe700 1 -- 172.21.15.69:0/505357297 <== osd.2 v2:172.21.15.69:6808/576340262 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdec8022040 con 0x7fdec006c340 2023-11-17T06:34:02.298 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:34:02.298 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:34:02.299 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:34:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.291+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x7fdec006c340 msgr2=0x7fdec006e760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.291+0000 7fdee5584700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.69:6808/576340262,v1:172.21.15.69:6810/576340262] conn(0x7fdec006c340 0x7fdec006e760 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.295+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdec0066510 msgr2=0x7fdec00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.295+0000 7fdee5584700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fdec0066510 0x7fdec00689d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fded0000f60 tx=0x7fded0007e90 comp rx=0 tx=0).stop 2023-11-17T06:34:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.295+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdee015b170 msgr2=0x7fdee015d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.295+0000 7fdee5584700 1 --2- 172.21.15.69:0/505357297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdee015b170 0x7fdee015d510 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fded800efc0 tx=0x7fded800c3a0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.295+0000 7fdedf7fe700 1 -- 172.21.15.69:0/505357297 reap_dead start 2023-11-17T06:34:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.295+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 shutdown_connections 2023-11-17T06:34:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.295+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 >> 172.21.15.69:0/505357297 conn(0x7fdee00cb900 msgr2=0x7fdee00ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.295+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 shutdown_connections 2023-11-17T06:34:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.295+0000 7fdee5584700 1 -- 172.21.15.69:0/505357297 wait complete. 2023-11-17T06:34:02.322 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-17T06:34:02.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.503+0000 7fa75f59e700 1 Processor -- start 2023-11-17T06:34:02.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.503+0000 7fa75f59e700 1 -- start start 2023-11-17T06:34:02.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.503+0000 7fa75f59e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa760155a10 0x7fa760142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.503+0000 7fa75f59e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7600cca30 con 0x7fa760142000 2023-11-17T06:34:02.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.503+0000 7fa75f59e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7600ccd10 con 0x7fa76006d5d0 2023-11-17T06:34:02.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.503+0000 7fa75f59e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7600ccff0 con 0x7fa760155a10 2023-11-17T06:34:02.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.503+0000 7fa75e59c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa760142000 0x7fa76006b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40306/0 (socket says 172.21.15.69:40306) 2023-11-17T06:34:02.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75e59c700 1 -- 172.21.15.69:0/987664458 learned_addr learned my addr 172.21.15.69:0/987664458 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:34:02.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75ed9d700 1 --2- 172.21.15.69:0/987664458 >> v2:172.21.15.93:3300/0 conn(0x7fa760155a10 0x7fa760142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75dd9b700 1 -- 172.21.15.69:0/987664458 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501145074 0 0) 0x7fa7600cca30 con 0x7fa760142000 2023-11-17T06:34:02.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75dd9b700 1 -- 172.21.15.69:0/987664458 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa74c0035d0 con 0x7fa760142000 2023-11-17T06:34:02.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75ed9d700 1 -- 172.21.15.69:0/987664458 >> v1:172.21.15.93:6789/0 conn(0x7fa76006d5d0 legacy=0x7fa760155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75ed9d700 1 -- 172.21.15.69:0/987664458 >> v1:172.21.15.69:6789/0 conn(0x7fa760142000 legacy=0x7fa76006b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75ed9d700 1 -- 172.21.15.69:0/987664458 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7600cd2d0 con 0x7fa760155a10 2023-11-17T06:34:02.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75ed9d700 1 --2- 172.21.15.69:0/987664458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760155a10 0x7fa760142e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa758009d90 tx=0x7fa75800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5431a98fc056678 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75dd9b700 1 -- 172.21.15.69:0/987664458 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75800e070 con 0x7fa760155a10 2023-11-17T06:34:02.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75dd9b700 1 -- 172.21.15.69:0/987664458 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75800bb20 con 0x7fa760155a10 2023-11-17T06:34:02.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75dd9b700 1 -- 172.21.15.69:0/987664458 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75800be90 con 0x7fa760155a10 2023-11-17T06:34:02.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75f59e700 1 -- 172.21.15.69:0/987664458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760155a10 msgr2=0x7fa760142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75f59e700 1 --2- 172.21.15.69:0/987664458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760155a10 0x7fa760142e10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa758009d90 tx=0x7fa75800b330 comp rx=0 tx=0).stop 2023-11-17T06:34:02.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75f59e700 1 -- 172.21.15.69:0/987664458 shutdown_connections 2023-11-17T06:34:02.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75f59e700 1 --2- 172.21.15.69:0/987664458 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760155a10 0x7fa760142e10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75f59e700 1 -- 172.21.15.69:0/987664458 >> 172.21.15.69:0/987664458 conn(0x7fa7600cedc0 msgr2=0x7fa7600cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:02.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75f59e700 1 -- 172.21.15.69:0/987664458 shutdown_connections 2023-11-17T06:34:02.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.507+0000 7fa75f59e700 1 -- 172.21.15.69:0/987664458 wait complete. 2023-11-17T06:34:02.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.511+0000 7fa75f59e700 1 Processor -- start 2023-11-17T06:34:02.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.511+0000 7fa75f59e700 1 -- start start 2023-11-17T06:34:02.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.511+0000 7fa75f59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa76006d5d0 0x7fa7600ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.511+0000 7fa75f59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa760142000 0x7fa760152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.511+0000 7fa75f59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760155a10 0x7fa7600b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.511+0000 7fa75f59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7600c4220 con 0x7fa760142000 2023-11-17T06:34:02.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.511+0000 7fa75f59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76015caa0 con 0x7fa760155a10 2023-11-17T06:34:02.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.511+0000 7fa75f59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76015c4e0 con 0x7fa76006d5d0 2023-11-17T06:34:02.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa75e59c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa76006d5d0 0x7fa7600ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa75e59c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa76006d5d0 0x7fa7600ae730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3301/0 says I am v2:172.21.15.69:52092/0 (socket says 172.21.15.69:52092) 2023-11-17T06:34:02.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa75e59c700 1 -- 172.21.15.69:0/1542828727 learned_addr learned my addr 172.21.15.69:0/1542828727 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:02.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa75ed9d700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760155a10 0x7fa7600b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa755d9b700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa760142000 0x7fa760152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa755d9b700 1 -- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa76006d5d0 msgr2=0x7fa7600ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa755d9b700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa76006d5d0 0x7fa7600ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa755d9b700 1 -- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760155a10 msgr2=0x7fa7600b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa755d9b700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760155a10 0x7fa7600b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa755d9b700 1 -- 172.21.15.69:0/1542828727 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa758009a70 con 0x7fa760142000 2023-11-17T06:34:02.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa75ed9d700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760155a10 0x7fa7600b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:34:02.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa755d9b700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa760142000 0x7fa760152c40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa748001eb0 tx=0x7fa74800c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa7577fe700 1 -- 172.21.15.69:0/1542828727 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7480052d0 con 0x7fa760142000 2023-11-17T06:34:02.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa7577fe700 1 -- 172.21.15.69:0/1542828727 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748005450 con 0x7fa760142000 2023-11-17T06:34:02.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa75f59e700 1 -- 172.21.15.69:0/1542828727 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76015c7c0 con 0x7fa760142000 2023-11-17T06:34:02.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa7577fe700 1 -- 172.21.15.69:0/1542828727 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748006ac0 con 0x7fa760142000 2023-11-17T06:34:02.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa75f59e700 1 -- 172.21.15.69:0/1542828727 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7601f0b00 con 0x7fa760142000 2023-11-17T06:34:02.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.515+0000 7fa75f59e700 1 -- 172.21.15.69:0/1542828727 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7600c4360 con 0x7fa760142000 2023-11-17T06:34:02.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.519+0000 7fa7577fe700 1 -- 172.21.15.69:0/1542828727 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fa7480036a0 con 0x7fa760142000 2023-11-17T06:34:02.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.519+0000 7fa7577fe700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa740066510 0x7fa7400689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.519+0000 7fa7577fe700 1 -- 172.21.15.69:0/1542828727 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fa748082c90 con 0x7fa760142000 2023-11-17T06:34:02.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.519+0000 7fa75e59c700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa740066510 0x7fa7400689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.523+0000 7fa75e59c700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa740066510 0x7fa7400689d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa7500011e0 tx=0x7fa750009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.523+0000 7fa7577fe700 1 -- 172.21.15.69:0/1542828727 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fa7600c4360 con 0x7fa760142000 2023-11-17T06:34:02.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.695+0000 7fa75f59e700 1 -- 172.21.15.69:0/1542828727 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa76006bf40 con 0x7fa740066510 2023-11-17T06:34:02.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.695+0000 7fa7577fe700 1 -- 172.21.15.69:0/1542828727 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa75000f690 con 0x7fa740066510 2023-11-17T06:34:02.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 -- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa740066510 msgr2=0x7fa7400689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa740066510 0x7fa7400689d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa7500011e0 tx=0x7fa750009040 comp rx=0 tx=0).stop 2023-11-17T06:34:02.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 -- 172.21.15.69:0/1542828727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa760142000 msgr2=0x7fa760152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa760142000 0x7fa760152c40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa748001eb0 tx=0x7fa74800c6e0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 -- 172.21.15.69:0/1542828727 shutdown_connections 2023-11-17T06:34:02.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fa740066510 0x7fa7400689d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa760155a10 0x7fa7600b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa760142000 0x7fa760152c40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 --2- 172.21.15.69:0/1542828727 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fa76006d5d0 0x7fa7600ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 -- 172.21.15.69:0/1542828727 >> 172.21.15.69:0/1542828727 conn(0x7fa7600cedc0 msgr2=0x7fa760154070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:02.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 -- 172.21.15.69:0/1542828727 shutdown_connections 2023-11-17T06:34:02.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.699+0000 7fa75f59e700 1 -- 172.21.15.69:0/1542828727 wait complete. 2023-11-17T06:34:02.707 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 2 to deep-scrub 2023-11-17T06:34:02.724 INFO:tasks.ceph:Scrubbing osd.3 2023-11-17T06:34:02.724 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:34:02.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.899+0000 7f0618e14700 1 Processor -- start 2023-11-17T06:34:02.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.899+0000 7f0618e14700 1 -- start start 2023-11-17T06:34:02.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f0618e14700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f061415b170 0x7f061415f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f0618e14700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f061406d7f0 0x7f06140b0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f0618e14700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06140b0c60 0x7f06140ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f0618e14700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06140b10f0 con 0x7f061415b170 2023-11-17T06:34:02.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f0618e14700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0614071860 con 0x7f061406d7f0 2023-11-17T06:34:02.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f0618e14700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0614070360 con 0x7f06140b0c60 2023-11-17T06:34:02.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f06137fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f061415b170 0x7f061415f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f06137fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f061415b170 0x7f061415f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56944/0 (socket says 172.21.15.69:56944) 2023-11-17T06:34:02.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f06137fe700 1 -- 172.21.15.69:0/2020733637 learned_addr learned my addr 172.21.15.69:0/2020733637 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:02.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f0612ffd700 1 --2- 172.21.15.69:0/2020733637 >> v2:172.21.15.93:3300/0 conn(0x7f061406d7f0 0x7f06140b0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f0613fff700 1 --2- 172.21.15.69:0/2020733637 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06140b0c60 0x7f06140ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f06137fe700 1 -- 172.21.15.69:0/2020733637 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06140b0c60 msgr2=0x7f06140ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:02.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f06137fe700 1 --2- 172.21.15.69:0/2020733637 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06140b0c60 0x7f06140ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f06137fe700 1 -- 172.21.15.69:0/2020733637 >> v2:172.21.15.93:3300/0 conn(0x7f061406d7f0 msgr2=0x7f06140b0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:02.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f06137fe700 1 --2- 172.21.15.69:0/2020733637 >> v2:172.21.15.93:3300/0 conn(0x7f061406d7f0 0x7f06140b0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f06137fe700 1 -- 172.21.15.69:0/2020733637 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061415fd00 con 0x7f061415b170 2023-11-17T06:34:02.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.903+0000 7f0612ffd700 1 --2- 172.21.15.69:0/2020733637 >> v2:172.21.15.93:3300/0 conn(0x7f061406d7f0 0x7f06140b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:34:02.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f06137fe700 1 --2- 172.21.15.69:0/2020733637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061415b170 0x7f061415f7c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f061406e110 tx=0x7f0604009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a176f8d58dbbe107 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f06127fc700 1 -- 172.21.15.69:0/2020733637 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604011830 con 0x7f061415b170 2023-11-17T06:34:02.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f06127fc700 1 -- 172.21.15.69:0/2020733637 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0604011990 con 0x7f061415b170 2023-11-17T06:34:02.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f06127fc700 1 -- 172.21.15.69:0/2020733637 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604011d20 con 0x7f061415b170 2023-11-17T06:34:02.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f0618e14700 1 -- 172.21.15.69:0/2020733637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061415b170 msgr2=0x7f061415f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f0618e14700 1 --2- 172.21.15.69:0/2020733637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061415b170 0x7f061415f7c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f061406e110 tx=0x7f0604009bf0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f0618e14700 1 -- 172.21.15.69:0/2020733637 shutdown_connections 2023-11-17T06:34:02.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f0618e14700 1 --2- 172.21.15.69:0/2020733637 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06140b0c60 0x7f06140ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f0618e14700 1 --2- 172.21.15.69:0/2020733637 >> v2:172.21.15.93:3300/0 conn(0x7f061406d7f0 0x7f06140b0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f0618e14700 1 --2- 172.21.15.69:0/2020733637 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061415b170 0x7f061415f7c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f0618e14700 1 -- 172.21.15.69:0/2020733637 >> 172.21.15.69:0/2020733637 conn(0x7f06140cb900 msgr2=0x7f06140cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:02.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f0618e14700 1 -- 172.21.15.69:0/2020733637 shutdown_connections 2023-11-17T06:34:02.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.907+0000 7f0618e14700 1 -- 172.21.15.69:0/2020733637 wait complete. 2023-11-17T06:34:02.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.911+0000 7f0618e14700 1 Processor -- start 2023-11-17T06:34:02.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.911+0000 7f0618e14700 1 -- start start 2023-11-17T06:34:02.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0618e14700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061406d7f0 0x7f06140c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0618e14700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06140b0c60 0x7f0614153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0618e14700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f061415b170 0x7f0614154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0618e14700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0614155f90 con 0x7f061406d7f0 2023-11-17T06:34:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0618e14700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06140c7300 con 0x7f061415b170 2023-11-17T06:34:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0618e14700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06140c75e0 con 0x7f06140b0c60 2023-11-17T06:34:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f06137fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061406d7f0 0x7f06140c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f06137fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061406d7f0 0x7f06140c83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56954/0 (socket says 172.21.15.69:56954) 2023-11-17T06:34:02.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f06137fe700 1 -- 172.21.15.69:0/3364009650 learned_addr learned my addr 172.21.15.69:0/3364009650 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:02.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0612ffd700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06140b0c60 0x7f0614153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0613fff700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f061415b170 0x7f0614154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f06137fe700 1 -- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06140b0c60 msgr2=0x7f0614153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f06137fe700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f06140b0c60 0x7f0614153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f06137fe700 1 -- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f061415b170 msgr2=0x7f0614154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f06137fe700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f061415b170 0x7f0614154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f06137fe700 1 -- 172.21.15.69:0/3364009650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06080094b0 con 0x7f061406d7f0 2023-11-17T06:34:02.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0613fff700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f061415b170 0x7f0614154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:34:02.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f06137fe700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061406d7f0 0x7f06140c83a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0604000c00 tx=0x7f0604004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f05fbfff700 1 -- 172.21.15.69:0/3364009650 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604004450 con 0x7f061406d7f0 2023-11-17T06:34:02.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f05fbfff700 1 -- 172.21.15.69:0/3364009650 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060401e070 con 0x7f061406d7f0 2023-11-17T06:34:02.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0604009570 con 0x7f061406d7f0 2023-11-17T06:34:02.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f05fbfff700 1 -- 172.21.15.69:0/3364009650 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040038e0 con 0x7f061406d7f0 2023-11-17T06:34:02.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.915+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06140c7ba0 con 0x7f061406d7f0 2023-11-17T06:34:02.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.919+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0614070080 con 0x7f061406d7f0 2023-11-17T06:34:02.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.919+0000 7f05fbfff700 1 -- 172.21.15.69:0/3364009650 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f0604003a40 con 0x7f061406d7f0 2023-11-17T06:34:02.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.919+0000 7f05fbfff700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0600066510 0x7f06000689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.923+0000 7f05fbfff700 1 -- 172.21.15.69:0/3364009650 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f0604084b30 con 0x7f061406d7f0 2023-11-17T06:34:02.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.923+0000 7f05fbfff700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x7f060006c4b0 0x7f060006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:02.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.923+0000 7f05fbfff700 1 -- 172.21.15.69:0/3364009650 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f060006ef80 con 0x7f060006c4b0 2023-11-17T06:34:02.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.923+0000 7f05fbfff700 1 -- 172.21.15.69:0/3364009650 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06040892a0 con 0x7f061406d7f0 2023-11-17T06:34:02.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.923+0000 7f0612ffd700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0600066510 0x7f06000689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.923+0000 7f0613fff700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x7f060006c4b0 0x7f060006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:02.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.923+0000 7f0612ffd700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0600066510 0x7f06000689d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f06140b21b0 tx=0x7f0608009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.923+0000 7f0613fff700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x7f060006c4b0 0x7f060006e8d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:02.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.923+0000 7f05fbfff700 1 -- 172.21.15.69:0/3364009650 <== osd.3 v2:172.21.15.69:6824/183679214 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f060006ef80 con 0x7f060006c4b0 2023-11-17T06:34:02.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.939+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 --> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f061406fda0 con 0x7f060006c4b0 2023-11-17T06:34:02.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f05fbfff700 1 -- 172.21.15.69:0/3364009650 <== osd.3 v2:172.21.15.69:6824/183679214 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f060c00f040 con 0x7f060006c4b0 2023-11-17T06:34:02.948 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:34:02.949 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:34:02.949 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:34:02.950 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x7f060006c4b0 msgr2=0x7f060006e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0618e14700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.69:6824/183679214,v1:172.21.15.69:6825/183679214] conn(0x7f060006c4b0 0x7f060006e8d0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:02.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0600066510 msgr2=0x7f06000689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0618e14700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0600066510 0x7f06000689d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f06140b21b0 tx=0x7f0608009240 comp rx=0 tx=0).stop 2023-11-17T06:34:02.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061406d7f0 msgr2=0x7f06140c83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:02.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0618e14700 1 --2- 172.21.15.69:0/3364009650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f061406d7f0 0x7f06140c83a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0604000c00 tx=0x7f0604004770 comp rx=0 tx=0).stop 2023-11-17T06:34:02.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0613fff700 1 -- 172.21.15.69:0/3364009650 reap_dead start 2023-11-17T06:34:02.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 shutdown_connections 2023-11-17T06:34:02.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 >> 172.21.15.69:0/3364009650 conn(0x7f06140cb900 msgr2=0x7f0614159810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:02.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 shutdown_connections 2023-11-17T06:34:02.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:02.943+0000 7f0618e14700 1 -- 172.21.15.69:0/3364009650 wait complete. 2023-11-17T06:34:02.974 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-17T06:34:03.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84163da700 1 Processor -- start 2023-11-17T06:34:03.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84163da700 1 -- start start 2023-11-17T06:34:03.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84163da700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f84101617a0 0x7f84100cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84163da700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f84100cdc30 0x7f841006fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84163da700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 0x7f8410165460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84163da700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100707a0 con 0x7f84101617a0 2023-11-17T06:34:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84163da700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84100ce070 con 0x7f84100cdc30 2023-11-17T06:34:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84163da700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c95b0 con 0x7f8410070330 2023-11-17T06:34:03.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84153d8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f84101617a0 0x7f84100cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84153d8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f84101617a0 0x7f84100cd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56964/0 (socket says 172.21.15.69:56964) 2023-11-17T06:34:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f84153d8700 1 -- 172.21.15.69:0/1949485380 learned_addr learned my addr 172.21.15.69:0/1949485380 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f8415bd9700 1 --2- 172.21.15.69:0/1949485380 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 0x7f8410165460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.139+0000 7f8414bd7700 1 --2- 172.21.15.69:0/1949485380 >> v2:172.21.15.93:3300/0 conn(0x7f84100cdc30 0x7f841006fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84153d8700 1 -- 172.21.15.69:0/1949485380 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 msgr2=0x7f8410165460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84153d8700 1 --2- 172.21.15.69:0/1949485380 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 0x7f8410165460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84153d8700 1 -- 172.21.15.69:0/1949485380 >> v2:172.21.15.93:3300/0 conn(0x7f84100cdc30 msgr2=0x7f841006fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84153d8700 1 --2- 172.21.15.69:0/1949485380 >> v2:172.21.15.93:3300/0 conn(0x7f84100cdc30 0x7f841006fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84153d8700 1 -- 172.21.15.69:0/1949485380 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100c9890 con 0x7f84101617a0 2023-11-17T06:34:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84153d8700 1 --2- 172.21.15.69:0/1949485380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 0x7f84100cd6f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f84100676c0 tx=0x7f840c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5ae91c7791b8f2 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f8407fff700 1 -- 172.21.15.69:0/1949485380 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c011830 con 0x7f84101617a0 2023-11-17T06:34:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f8407fff700 1 -- 172.21.15.69:0/1949485380 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c011990 con 0x7f84101617a0 2023-11-17T06:34:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f8407fff700 1 -- 172.21.15.69:0/1949485380 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c011d40 con 0x7f84101617a0 2023-11-17T06:34:03.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84163da700 1 -- 172.21.15.69:0/1949485380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 msgr2=0x7f84100cd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84163da700 1 --2- 172.21.15.69:0/1949485380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 0x7f84100cd6f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f84100676c0 tx=0x7f840c009c20 comp rx=0 tx=0).stop 2023-11-17T06:34:03.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84163da700 1 -- 172.21.15.69:0/1949485380 shutdown_connections 2023-11-17T06:34:03.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84163da700 1 --2- 172.21.15.69:0/1949485380 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 0x7f8410165460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84163da700 1 --2- 172.21.15.69:0/1949485380 >> v2:172.21.15.93:3300/0 conn(0x7f84100cdc30 0x7f841006fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84163da700 1 --2- 172.21.15.69:0/1949485380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 0x7f84100cd6f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84163da700 1 -- 172.21.15.69:0/1949485380 >> 172.21.15.69:0/1949485380 conn(0x7f84100cedc0 msgr2=0x7f84100cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:03.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84163da700 1 -- 172.21.15.69:0/1949485380 shutdown_connections 2023-11-17T06:34:03.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.143+0000 7f84163da700 1 -- 172.21.15.69:0/1949485380 wait complete. 2023-11-17T06:34:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f84163da700 1 Processor -- start 2023-11-17T06:34:03.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f84163da700 1 -- start start 2023-11-17T06:34:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f84163da700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 0x7f841015c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f84163da700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84100cdc30 0x7f841006ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f84163da700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 0x7f841006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f84163da700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c6b80 con 0x7f84101617a0 2023-11-17T06:34:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f84163da700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c6e60 con 0x7f84100cdc30 2023-11-17T06:34:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f84163da700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84100c7140 con 0x7f8410070330 2023-11-17T06:34:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f8415bd9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 0x7f841006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f8415bd9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 0x7f841006d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56968/0 (socket says 172.21.15.69:56968) 2023-11-17T06:34:03.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f8415bd9700 1 -- 172.21.15.69:0/2342759226 learned_addr learned my addr 172.21.15.69:0/2342759226 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:03.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f84153d8700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 0x7f841015c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.147+0000 7f8414bd7700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84100cdc30 0x7f841006ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f8415bd9700 1 -- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 msgr2=0x7f841015c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f8415bd9700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 0x7f841015c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f8415bd9700 1 -- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84100cdc30 msgr2=0x7f841006ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f8415bd9700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84100cdc30 0x7f841006ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f8415bd9700 1 -- 172.21.15.69:0/2342759226 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c009570 con 0x7f84101617a0 2023-11-17T06:34:03.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f84153d8700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 0x7f841015c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-17T06:34:03.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f8415bd9700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 0x7f841006d390 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f840800eed0 tx=0x7f840800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:03.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f8405ffb700 1 -- 172.21.15.69:0/2342759226 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408010040 con 0x7f84101617a0 2023-11-17T06:34:03.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f8405ffb700 1 -- 172.21.15.69:0/2342759226 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840800bc80 con 0x7f84101617a0 2023-11-17T06:34:03.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f8405ffb700 1 -- 172.21.15.69:0/2342759226 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8408009e40 con 0x7f84101617a0 2023-11-17T06:34:03.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f84163da700 1 -- 172.21.15.69:0/2342759226 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84100c7420 con 0x7f84101617a0 2023-11-17T06:34:03.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f84163da700 1 -- 172.21.15.69:0/2342759226 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841015f1b0 con 0x7f84101617a0 2023-11-17T06:34:03.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.151+0000 7f84163da700 1 -- 172.21.15.69:0/2342759226 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84100c2200 con 0x7f84101617a0 2023-11-17T06:34:03.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.155+0000 7f8405ffb700 1 -- 172.21.15.69:0/2342759226 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f8408014400 con 0x7f84101617a0 2023-11-17T06:34:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.155+0000 7f8405ffb700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f83f4066510 0x7f83f40689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.155+0000 7f8405ffb700 1 -- 172.21.15.69:0/2342759226 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f8408084000 con 0x7f84101617a0 2023-11-17T06:34:03.161 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.155+0000 7f84153d8700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f83f4066510 0x7f83f40689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.155+0000 7f84153d8700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f83f4066510 0x7f83f40689d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f840c014040 tx=0x7f840c008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:03.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.159+0000 7f8405ffb700 1 -- 172.21.15.69:0/2342759226 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f8408051630 con 0x7f84101617a0 2023-11-17T06:34:03.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.335+0000 7f84163da700 1 -- 172.21.15.69:0/2342759226 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f84100c9e50 con 0x7f83f4066510 2023-11-17T06:34:03.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.339+0000 7f8405ffb700 1 -- 172.21.15.69:0/2342759226 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f840c006d20 con 0x7f83f4066510 2023-11-17T06:34:03.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 -- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f83f4066510 msgr2=0x7f83f40689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f83f4066510 0x7f83f40689d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f840c014040 tx=0x7f840c008030 comp rx=0 tx=0).stop 2023-11-17T06:34:03.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 -- 172.21.15.69:0/2342759226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 msgr2=0x7f841006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 0x7f841006d390 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f840800eed0 tx=0x7f840800b390 comp rx=0 tx=0).stop 2023-11-17T06:34:03.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 -- 172.21.15.69:0/2342759226 shutdown_connections 2023-11-17T06:34:03.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f83f4066510 0x7f83f40689d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84101617a0 0x7f841006d390 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f84100cdc30 0x7f841006ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 --2- 172.21.15.69:0/2342759226 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f8410070330 0x7f841015c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 -- 172.21.15.69:0/2342759226 >> 172.21.15.69:0/2342759226 conn(0x7f84100cedc0 msgr2=0x7f84100b3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:03.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 -- 172.21.15.69:0/2342759226 shutdown_connections 2023-11-17T06:34:03.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.343+0000 7f84163da700 1 -- 172.21.15.69:0/2342759226 wait complete. 2023-11-17T06:34:03.350 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 3 to deep-scrub 2023-11-17T06:34:03.371 INFO:tasks.ceph:Scrubbing osd.4 2023-11-17T06:34:03.371 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:34:03.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.543+0000 7f00c2b90700 1 Processor -- start 2023-11-17T06:34:03.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.543+0000 7f00c2b90700 1 -- start start 2023-11-17T06:34:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c2b90700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00bc15b180 0x7f00bc070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c2b90700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f00bc06d540 0x7f00bc0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c2b90700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00bc0c5920 con 0x7f00bc0716b0 2023-11-17T06:34:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c2b90700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc0c64a0 con 0x7f00bc06d540 2023-11-17T06:34:03.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c2b90700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc0cd620 con 0x7f00bc15b180 2023-11-17T06:34:03.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c092c700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00bc15b180 0x7f00bc070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00bbfff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f00bc0716b0 0x7f00bc06ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:44232/0 (socket says 172.21.15.69:44232) 2023-11-17T06:34:03.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00bbfff700 1 -- 172.21.15.69:0/2288837702 learned_addr learned my addr 172.21.15.69:0/2288837702 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:34:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c112d700 1 --2- 172.21.15.69:0/2288837702 >> v2:172.21.15.93:3300/0 conn(0x7f00bc06d540 0x7f00bc0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c092c700 1 -- 172.21.15.69:0/2288837702 >> v2:172.21.15.93:3300/0 conn(0x7f00bc06d540 msgr2=0x7f00bc0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c092c700 1 --2- 172.21.15.69:0/2288837702 >> v2:172.21.15.93:3300/0 conn(0x7f00bc06d540 0x7f00bc0c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c092c700 1 -- 172.21.15.69:0/2288837702 >> v1:172.21.15.93:6789/0 conn(0x7f00bc0716b0 legacy=0x7f00bc06ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00bb7fe700 1 -- 172.21.15.69:0/2288837702 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268768003 0 0) 0x7f00bc0c5920 con 0x7f00bc0716b0 2023-11-17T06:34:03.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.547+0000 7f00c092c700 1 -- 172.21.15.69:0/2288837702 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc0c5b70 con 0x7f00bc15b180 2023-11-17T06:34:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00c092c700 1 --2- 172.21.15.69:0/2288837702 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00bc15b180 0x7f00bc070eb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009d90 tx=0x7f00b000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c285c1faacf099ee server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00bb7fe700 1 -- 172.21.15.69:0/2288837702 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b000e070 con 0x7f00bc15b180 2023-11-17T06:34:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00bb7fe700 1 -- 172.21.15.69:0/2288837702 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b000bb20 con 0x7f00bc15b180 2023-11-17T06:34:03.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00bb7fe700 1 -- 172.21.15.69:0/2288837702 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0012430 con 0x7f00bc15b180 2023-11-17T06:34:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00c2b90700 1 -- 172.21.15.69:0/2288837702 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00bc15b180 msgr2=0x7f00bc070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00c2b90700 1 --2- 172.21.15.69:0/2288837702 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00bc15b180 0x7f00bc070eb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f00b0009d90 tx=0x7f00b000b330 comp rx=0 tx=0).stop 2023-11-17T06:34:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00c2b90700 1 -- 172.21.15.69:0/2288837702 shutdown_connections 2023-11-17T06:34:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00c2b90700 1 --2- 172.21.15.69:0/2288837702 >> v2:172.21.15.93:3300/0 conn(0x7f00bc06d540 0x7f00bc0c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00c2b90700 1 --2- 172.21.15.69:0/2288837702 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00bc15b180 0x7f00bc070eb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00c2b90700 1 -- 172.21.15.69:0/2288837702 >> 172.21.15.69:0/2288837702 conn(0x7f00bc06b590 msgr2=0x7f00bc06b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00c2b90700 1 -- 172.21.15.69:0/2288837702 shutdown_connections 2023-11-17T06:34:03.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.551+0000 7f00c2b90700 1 -- 172.21.15.69:0/2288837702 wait complete. 2023-11-17T06:34:03.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.555+0000 7f00c2b90700 1 Processor -- start 2023-11-17T06:34:03.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.555+0000 7f00c2b90700 1 -- start start 2023-11-17T06:34:03.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.555+0000 7f00c2b90700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00bc06d540 0x7f00bc1f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00c2b90700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00bc0716b0 0x7f00bc0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00c2b90700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00bc15b180 0x7f00bc158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00c2b90700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc1f6cc0 con 0x7f00bc0716b0 2023-11-17T06:34:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00c2b90700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc15ca70 con 0x7f00bc06d540 2023-11-17T06:34:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00c2b90700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc151490 con 0x7f00bc15b180 2023-11-17T06:34:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00bbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00bc0716b0 0x7f00bc0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00bbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00bc0716b0 0x7f00bc0c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56978/0 (socket says 172.21.15.69:56978) 2023-11-17T06:34:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00bbfff700 1 -- 172.21.15.69:0/4161328571 learned_addr learned my addr 172.21.15.69:0/4161328571 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:03.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00c092c700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00bc06d540 0x7f00bc1f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00c112d700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00bc15b180 0x7f00bc158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00bbfff700 1 -- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00bc15b180 msgr2=0x7f00bc158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00bbfff700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f00bc15b180 0x7f00bc158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00bbfff700 1 -- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00bc06d540 msgr2=0x7f00bc1f5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00bbfff700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00bc06d540 0x7f00bc1f5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00bbfff700 1 -- 172.21.15.69:0/4161328571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0009a70 con 0x7f00bc0716b0 2023-11-17T06:34:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00bbfff700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00bc0716b0 0x7f00bc0c9f30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c580 tx=0x7f00a800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:03.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00b97fa700 1 -- 172.21.15.69:0/4161328571 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004ca0 con 0x7f00bc0716b0 2023-11-17T06:34:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00b97fa700 1 -- 172.21.15.69:0/4161328571 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a8004e20 con 0x7f00bc0716b0 2023-11-17T06:34:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc0ca470 con 0x7f00bc0716b0 2023-11-17T06:34:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00b97fa700 1 -- 172.21.15.69:0/4161328571 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8007310 con 0x7f00bc0716b0 2023-11-17T06:34:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00bc1f6700 con 0x7f00bc0716b0 2023-11-17T06:34:03.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.559+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00bc0c6130 con 0x7f00bc0716b0 2023-11-17T06:34:03.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.563+0000 7f00b97fa700 1 -- 172.21.15.69:0/4161328571 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f00a8007470 con 0x7f00bc0716b0 2023-11-17T06:34:03.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.563+0000 7f00b97fa700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00a0066510 0x7f00a00689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.563+0000 7f00b97fa700 1 -- 172.21.15.69:0/4161328571 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f00a8083980 con 0x7f00bc0716b0 2023-11-17T06:34:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.567+0000 7f00b97fa700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x7f00a006c4b0 0x7f00a006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.567+0000 7f00b97fa700 1 -- 172.21.15.69:0/4161328571 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00a006ef80 con 0x7f00a006c4b0 2023-11-17T06:34:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.567+0000 7f00b97fa700 1 -- 172.21.15.69:0/4161328571 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00a8088280 con 0x7f00bc0716b0 2023-11-17T06:34:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.567+0000 7f00c092c700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00a0066510 0x7f00a00689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.567+0000 7f00c112d700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x7f00a006c4b0 0x7f00a006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.567+0000 7f00c092c700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00a0066510 0x7f00a00689d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f00b0014040 tx=0x7f00b0011000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:03.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.567+0000 7f00c112d700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x7f00a006c4b0 0x7f00a006e8d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:03.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.567+0000 7f00b97fa700 1 -- 172.21.15.69:0/4161328571 <== osd.4 v2:172.21.15.93:6812/1712617818 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f00a006ef80 con 0x7f00a006c4b0 2023-11-17T06:34:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.587+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 --> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00bc0c5e50 con 0x7f00a006c4b0 2023-11-17T06:34:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.587+0000 7f00b97fa700 1 -- 172.21.15.69:0/4161328571 <== osd.4 v2:172.21.15.93:6812/1712617818 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f00b4009ce0 con 0x7f00a006c4b0 2023-11-17T06:34:03.594 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:34:03.594 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:34:03.594 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:34:03.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.587+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x7f00a006c4b0 msgr2=0x7f00a006e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.587+0000 7f00c2b90700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:6812/1712617818,v1:172.21.15.93:6814/1712617818] conn(0x7f00a006c4b0 0x7f00a006e8d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.591+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00a0066510 msgr2=0x7f00a00689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.591+0000 7f00c2b90700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f00a0066510 0x7f00a00689d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f00b0014040 tx=0x7f00b0011000 comp rx=0 tx=0).stop 2023-11-17T06:34:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.591+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00bc0716b0 msgr2=0x7f00bc0c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.591+0000 7f00c2b90700 1 --2- 172.21.15.69:0/4161328571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00bc0716b0 0x7f00bc0c9f30 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c580 tx=0x7f00a800c890 comp rx=0 tx=0).stop 2023-11-17T06:34:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.591+0000 7f00c112d700 1 -- 172.21.15.69:0/4161328571 reap_dead start 2023-11-17T06:34:03.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.591+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 shutdown_connections 2023-11-17T06:34:03.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.591+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 >> 172.21.15.69:0/4161328571 conn(0x7f00bc06b590 msgr2=0x7f00bc06b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:03.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.591+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 shutdown_connections 2023-11-17T06:34:03.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.591+0000 7f00c2b90700 1 -- 172.21.15.69:0/4161328571 wait complete. 2023-11-17T06:34:03.617 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-17T06:34:03.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.787+0000 7f7ea9014700 1 Processor -- start 2023-11-17T06:34:03.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea9014700 1 -- start start 2023-11-17T06:34:03.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea9014700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7ea4142000 0x7f7ea4142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea9014700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea40cca30 con 0x7f7ea41423e0 2023-11-17T06:34:03.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea9014700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea40ccd10 con 0x7f7ea406d5d0 2023-11-17T06:34:03.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea9014700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea40ccff0 con 0x7f7ea4142000 2023-11-17T06:34:03.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea3fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7ea4142000 0x7f7ea4142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea3fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7ea4142000 0x7f7ea4142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.69:50656/0 (socket says 172.21.15.69:50656) 2023-11-17T06:34:03.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea3fff700 1 -- 172.21.15.69:0/2692708051 learned_addr learned my addr 172.21.15.69:0/2692708051 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:03.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea8813700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7ea41423e0 0x7f7ea4155300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:40312/0 (socket says 172.21.15.69:40312) 2023-11-17T06:34:03.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea3fff700 1 -- 172.21.15.69:0/2692708051 >> v1:172.21.15.93:6789/0 conn(0x7f7ea406d5d0 legacy=0x7f7ea406b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:03.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea3fff700 1 -- 172.21.15.69:0/2692708051 >> v1:172.21.15.69:6789/0 conn(0x7f7ea41423e0 legacy=0x7f7ea4155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.791+0000 7f7ea3fff700 1 -- 172.21.15.69:0/2692708051 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea40cd2d0 con 0x7f7ea4142000 2023-11-17T06:34:03.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea3fff700 1 --2- 172.21.15.69:0/2692708051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ea4142000 0x7f7ea4142e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009910 tx=0x7f7e94009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45f4bd08757b4c50 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:03.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea2ffd700 1 -- 172.21.15.69:0/2692708051 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94004230 con 0x7f7ea4142000 2023-11-17T06:34:03.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea2ffd700 1 -- 172.21.15.69:0/2692708051 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e94004390 con 0x7f7ea4142000 2023-11-17T06:34:03.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea2ffd700 1 -- 172.21.15.69:0/2692708051 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e94009e60 con 0x7f7ea4142000 2023-11-17T06:34:03.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea9014700 1 -- 172.21.15.69:0/2692708051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ea4142000 msgr2=0x7f7ea4142e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea9014700 1 --2- 172.21.15.69:0/2692708051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ea4142000 0x7f7ea4142e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009910 tx=0x7f7e94009c20 comp rx=0 tx=0).stop 2023-11-17T06:34:03.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea9014700 1 -- 172.21.15.69:0/2692708051 shutdown_connections 2023-11-17T06:34:03.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea9014700 1 --2- 172.21.15.69:0/2692708051 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ea4142000 0x7f7ea4142e10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea9014700 1 -- 172.21.15.69:0/2692708051 >> 172.21.15.69:0/2692708051 conn(0x7f7ea40cedc0 msgr2=0x7f7ea40cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:03.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea9014700 1 -- 172.21.15.69:0/2692708051 shutdown_connections 2023-11-17T06:34:03.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.795+0000 7f7ea9014700 1 -- 172.21.15.69:0/2692708051 wait complete. 2023-11-17T06:34:03.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.799+0000 7f7ea9014700 1 Processor -- start 2023-11-17T06:34:03.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.799+0000 7f7ea9014700 1 -- start start 2023-11-17T06:34:03.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.799+0000 7f7ea9014700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7ea406d5d0 0x7f7ea40c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea9014700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ea4142000 0x7f7ea4154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea9014700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ea41423e0 0x7f7ea41f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea9014700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea415e730 con 0x7f7ea41423e0 2023-11-17T06:34:03.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea9014700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea40ca300 con 0x7f7ea4142000 2023-11-17T06:34:03.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea9014700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea40c9db0 con 0x7f7ea406d5d0 2023-11-17T06:34:03.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea8813700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ea41423e0 0x7f7ea41f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea8813700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ea41423e0 0x7f7ea41f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56986/0 (socket says 172.21.15.69:56986) 2023-11-17T06:34:03.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea8813700 1 -- 172.21.15.69:0/2211983625 learned_addr learned my addr 172.21.15.69:0/2211983625 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:03.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea3fff700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7ea406d5d0 0x7f7ea40c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea37fe700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ea4142000 0x7f7ea4154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea8813700 1 -- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7ea406d5d0 msgr2=0x7f7ea40c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea8813700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7ea406d5d0 0x7f7ea40c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea8813700 1 -- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ea4142000 msgr2=0x7f7ea4154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea8813700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ea4142000 0x7f7ea4154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea8813700 1 -- 172.21.15.69:0/2211983625 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e94009570 con 0x7f7ea41423e0 2023-11-17T06:34:03.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea3fff700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7ea406d5d0 0x7f7ea40c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:34:03.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea8813700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ea41423e0 0x7f7ea41f5700 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00cb10 tx=0x7f7e9c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:03.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea0ff9700 1 -- 172.21.15.69:0/2211983625 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c00aaa0 con 0x7f7ea41423e0 2023-11-17T06:34:03.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea0ff9700 1 -- 172.21.15.69:0/2211983625 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c00ac00 con 0x7f7ea41423e0 2023-11-17T06:34:03.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea9014700 1 -- 172.21.15.69:0/2211983625 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea415de90 con 0x7f7ea41423e0 2023-11-17T06:34:03.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea0ff9700 1 -- 172.21.15.69:0/2211983625 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c007070 con 0x7f7ea41423e0 2023-11-17T06:34:03.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.803+0000 7f7ea9014700 1 -- 172.21.15.69:0/2211983625 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea415e450 con 0x7f7ea41423e0 2023-11-17T06:34:03.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.807+0000 7f7ea9014700 1 -- 172.21.15.69:0/2211983625 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea40ca0d0 con 0x7f7ea41423e0 2023-11-17T06:34:03.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.807+0000 7f7ea0ff9700 1 -- 172.21.15.69:0/2211983625 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f7e9c0071d0 con 0x7f7ea41423e0 2023-11-17T06:34:03.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.811+0000 7f7ea0ff9700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7e90066510 0x7f7e900689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:03.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.811+0000 7f7ea0ff9700 1 -- 172.21.15.69:0/2211983625 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f7e9c083af0 con 0x7f7ea41423e0 2023-11-17T06:34:03.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.811+0000 7f7ea3fff700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7e90066510 0x7f7e900689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:03.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.811+0000 7f7ea3fff700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7e90066510 0x7f7e900689d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009910 tx=0x7f7e94008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:03.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.815+0000 7f7ea0ff9700 1 -- 172.21.15.69:0/2211983625 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f7ea40ca0d0 con 0x7f7ea41423e0 2023-11-17T06:34:03.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.983+0000 7f7ea9014700 1 -- 172.21.15.69:0/2211983625 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ea406bf40 con 0x7f7e90066510 2023-11-17T06:34:03.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea0ff9700 1 -- 172.21.15.69:0/2211983625 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7e9400b820 con 0x7f7e90066510 2023-11-17T06:34:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea9014700 1 -- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7e90066510 msgr2=0x7f7e900689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea9014700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7e90066510 0x7f7e900689d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7e94009910 tx=0x7f7e94008030 comp rx=0 tx=0).stop 2023-11-17T06:34:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea9014700 1 -- 172.21.15.69:0/2211983625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ea41423e0 msgr2=0x7f7ea41f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:03.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea9014700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ea41423e0 0x7f7ea41f5700 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c00cb10 tx=0x7f7e9c00ced0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea9014700 1 -- 172.21.15.69:0/2211983625 shutdown_connections 2023-11-17T06:34:03.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea9014700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f7e90066510 0x7f7e900689d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea9014700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ea41423e0 0x7f7ea41f5700 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea9014700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7ea4142000 0x7f7ea4154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea9014700 1 --2- 172.21.15.69:0/2211983625 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f7ea406d5d0 0x7f7ea40c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.987+0000 7f7ea9014700 1 -- 172.21.15.69:0/2211983625 >> 172.21.15.69:0/2211983625 conn(0x7f7ea40cedc0 msgr2=0x7f7ea40af5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.991+0000 7f7ea9014700 1 -- 172.21.15.69:0/2211983625 shutdown_connections 2023-11-17T06:34:03.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:03.991+0000 7f7ea9014700 1 -- 172.21.15.69:0/2211983625 wait complete. 2023-11-17T06:34:03.998 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 4 to deep-scrub 2023-11-17T06:34:04.017 INFO:tasks.ceph:Scrubbing osd.5 2023-11-17T06:34:04.017 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:34:04.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.203+0000 7f4d3b876700 1 Processor -- start 2023-11-17T06:34:04.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.203+0000 7f4d3b876700 1 -- start start 2023-11-17T06:34:04.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d3b876700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d3415d450 0x7f4d340d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d3b876700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d340cdf30 0x7f4d340ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d3b876700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d340ce8c0 con 0x7f4d340b8ed0 2023-11-17T06:34:04.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d3b876700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3415d830 con 0x7f4d340cdf30 2023-11-17T06:34:04.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d3b876700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340d1b30 con 0x7f4d3415d450 2023-11-17T06:34:04.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d39e13700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d340cdf30 0x7f4d340ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d39e13700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4d340cdf30 0x7f4d340ce380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41204/0 (socket says 172.21.15.69:41204) 2023-11-17T06:34:04.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d39e13700 1 -- 172.21.15.69:0/3749082429 learned_addr learned my addr 172.21.15.69:0/3749082429 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:04.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d39612700 1 --2- 172.21.15.69:0/3749082429 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d3415d450 0x7f4d340d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d39e13700 1 -- 172.21.15.69:0/3749082429 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d3415d450 msgr2=0x7f4d340d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:04.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d39e13700 1 --2- 172.21.15.69:0/3749082429 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d3415d450 0x7f4d340d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d39e13700 1 -- 172.21.15.69:0/3749082429 >> v1:172.21.15.69:6789/0 conn(0x7f4d340b8ed0 legacy=0x7f4d340d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d39e13700 1 -- 172.21.15.69:0/3749082429 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340d1e10 con 0x7f4d340cdf30 2023-11-17T06:34:04.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d39e13700 1 --2- 172.21.15.69:0/3749082429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d340cdf30 0x7f4d340ce380 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009e50 tx=0x7f4d2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b972a3b644ec81ab server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d2bfff700 1 -- 172.21.15.69:0/3749082429 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00e070 con 0x7f4d340cdf30 2023-11-17T06:34:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d2bfff700 1 -- 172.21.15.69:0/3749082429 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c00b9c0 con 0x7f4d340cdf30 2023-11-17T06:34:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d2bfff700 1 -- 172.21.15.69:0/3749082429 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00bd70 con 0x7f4d340cdf30 2023-11-17T06:34:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d3b876700 1 -- 172.21.15.69:0/3749082429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d340cdf30 msgr2=0x7f4d340ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d3b876700 1 --2- 172.21.15.69:0/3749082429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d340cdf30 0x7f4d340ce380 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009e50 tx=0x7f4d2c00b330 comp rx=0 tx=0).stop 2023-11-17T06:34:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d3b876700 1 -- 172.21.15.69:0/3749082429 shutdown_connections 2023-11-17T06:34:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d3b876700 1 --2- 172.21.15.69:0/3749082429 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d340cdf30 0x7f4d340ce380 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.207+0000 7f4d3b876700 1 --2- 172.21.15.69:0/3749082429 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d3415d450 0x7f4d340d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.211+0000 7f4d3b876700 1 -- 172.21.15.69:0/3749082429 >> 172.21.15.69:0/3749082429 conn(0x7f4d3406a6c0 msgr2=0x7f4d3406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:04.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.211+0000 7f4d3b876700 1 -- 172.21.15.69:0/3749082429 shutdown_connections 2023-11-17T06:34:04.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.211+0000 7f4d3b876700 1 -- 172.21.15.69:0/3749082429 wait complete. 2023-11-17T06:34:04.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.211+0000 7f4d3b876700 1 Processor -- start 2023-11-17T06:34:04.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.211+0000 7f4d3b876700 1 -- start start 2023-11-17T06:34:04.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d3b876700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d340b8ed0 0x7f4d3415f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d3b876700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d340cdf30 0x7f4d34156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d3b876700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d3415d450 0x7f4d341599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d3b876700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3415eaf0 con 0x7f4d340cdf30 2023-11-17T06:34:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d3b876700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3415a3b0 con 0x7f4d3415d450 2023-11-17T06:34:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d3b876700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3415ed90 con 0x7f4d340b8ed0 2023-11-17T06:34:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d38e11700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d340cdf30 0x7f4d34156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d38e11700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d340cdf30 0x7f4d34156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41218/0 (socket says 172.21.15.69:41218) 2023-11-17T06:34:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d38e11700 1 -- 172.21.15.69:0/1407547129 learned_addr learned my addr 172.21.15.69:0/1407547129 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d39612700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d340b8ed0 0x7f4d3415f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d39e13700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d3415d450 0x7f4d341599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d38e11700 1 -- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d340b8ed0 msgr2=0x7f4d3415f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d38e11700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f4d340b8ed0 0x7f4d3415f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d38e11700 1 -- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d3415d450 msgr2=0x7f4d341599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d38e11700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d3415d450 0x7f4d341599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d38e11700 1 -- 172.21.15.69:0/1407547129 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c009b30 con 0x7f4d340cdf30 2023-11-17T06:34:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d39e13700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d3415d450 0x7f4d341599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-17T06:34:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d38e11700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d340cdf30 0x7f4d34156a30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c500 tx=0x7f4d2400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d29ffb700 1 -- 172.21.15.69:0/1407547129 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240052d0 con 0x7f4d340cdf30 2023-11-17T06:34:04.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d29ffb700 1 -- 172.21.15.69:0/1407547129 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d24005430 con 0x7f4d340cdf30 2023-11-17T06:34:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3415f070 con 0x7f4d340cdf30 2023-11-17T06:34:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d29ffb700 1 -- 172.21.15.69:0/1407547129 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240055a0 con 0x7f4d340cdf30 2023-11-17T06:34:04.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d34156f70 con 0x7f4d340cdf30 2023-11-17T06:34:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.215+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4d340d23d0 con 0x7f4d340cdf30 2023-11-17T06:34:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.219+0000 7f4d29ffb700 1 -- 172.21.15.69:0/1407547129 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f4d240038e0 con 0x7f4d340cdf30 2023-11-17T06:34:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.219+0000 7f4d29ffb700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d18066540 0x7f4d18068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.219+0000 7f4d29ffb700 1 -- 172.21.15.69:0/1407547129 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f4d24082e50 con 0x7f4d340cdf30 2023-11-17T06:34:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.219+0000 7f4d29ffb700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x7f4d1806c4e0 0x7f4d1806e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.219+0000 7f4d29ffb700 1 -- 172.21.15.69:0/1407547129 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d1806efb0 con 0x7f4d1806c4e0 2023-11-17T06:34:04.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.219+0000 7f4d29ffb700 1 -- 172.21.15.69:0/1407547129 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d24085430 con 0x7f4d340cdf30 2023-11-17T06:34:04.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.219+0000 7f4d39612700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d18066540 0x7f4d18068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.219+0000 7f4d39e13700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x7f4d1806c4e0 0x7f4d1806e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.223+0000 7f4d39612700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d18066540 0x7f4d18068a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4d340d3920 tx=0x7f4d30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.223+0000 7f4d39e13700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x7f4d1806c4e0 0x7f4d1806e900 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.223+0000 7f4d29ffb700 1 -- 172.21.15.69:0/1407547129 <== osd.5 v2:172.21.15.93:6802/753754499 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4d1806efb0 con 0x7f4d1806c4e0 2023-11-17T06:34:04.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.243+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 --> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4d340d20f0 con 0x7f4d1806c4e0 2023-11-17T06:34:04.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d29ffb700 1 -- 172.21.15.69:0/1407547129 <== osd.5 v2:172.21.15.93:6802/753754499 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4d2c00bb30 con 0x7f4d1806c4e0 2023-11-17T06:34:04.251 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:34:04.251 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:34:04.252 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:34:04.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x7f4d1806c4e0 msgr2=0x7f4d1806e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d3b876700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:6802/753754499,v1:172.21.15.93:6803/753754499] conn(0x7f4d1806c4e0 0x7f4d1806e900 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d18066540 msgr2=0x7f4d18068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d3b876700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f4d18066540 0x7f4d18068a00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4d340d3920 tx=0x7f4d30008040 comp rx=0 tx=0).stop 2023-11-17T06:34:04.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d340cdf30 msgr2=0x7f4d34156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d3b876700 1 --2- 172.21.15.69:0/1407547129 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4d340cdf30 0x7f4d34156a30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400c500 tx=0x7f4d2400c810 comp rx=0 tx=0).stop 2023-11-17T06:34:04.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d39e13700 1 -- 172.21.15.69:0/1407547129 reap_dead start 2023-11-17T06:34:04.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 shutdown_connections 2023-11-17T06:34:04.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 >> 172.21.15.69:0/1407547129 conn(0x7f4d3406a6c0 msgr2=0x7f4d340b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:04.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 shutdown_connections 2023-11-17T06:34:04.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.247+0000 7f4d3b876700 1 -- 172.21.15.69:0/1407547129 wait complete. 2023-11-17T06:34:04.275 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-17T06:34:04.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f394992b700 1 Processor -- start 2023-11-17T06:34:04.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f394992b700 1 -- start start 2023-11-17T06:34:04.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f394992b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394415d550 0x7f39440d2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f394992b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f39440d2c60 0x7f394406cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f394992b700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39440d2340 con 0x7f394406d1d0 2023-11-17T06:34:04.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f394992b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39440cf400 con 0x7f39440d2c60 2023-11-17T06:34:04.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f394992b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394406d660 con 0x7f394415d550 2023-11-17T06:34:04.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f39427fc700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f39440d2c60 0x7f394406cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f3942ffd700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394415d550 0x7f39440d2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f39437fe700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f394406d1d0 0x7f394406b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.69:47162/0 (socket says 172.21.15.69:47162) 2023-11-17T06:34:04.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.455+0000 7f39437fe700 1 -- 172.21.15.69:0/4001882363 learned_addr learned my addr 172.21.15.69:0/4001882363 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:34:04.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f39427fc700 1 -- 172.21.15.69:0/4001882363 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394415d550 msgr2=0x7f39440d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:04.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f39427fc700 1 --2- 172.21.15.69:0/4001882363 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394415d550 0x7f39440d2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f39427fc700 1 -- 172.21.15.69:0/4001882363 >> v1:172.21.15.93:6789/0 conn(0x7f394406d1d0 legacy=0x7f394406b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f39427fc700 1 -- 172.21.15.69:0/4001882363 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39440d1730 con 0x7f39440d2c60 2023-11-17T06:34:04.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f3941ffb700 1 -- 172.21.15.69:0/4001882363 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287430016 0 0) 0x7f39440d2340 con 0x7f394406d1d0 2023-11-17T06:34:04.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f39427fc700 1 --2- 172.21.15.69:0/4001882363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39440d2c60 0x7f394406cc90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3938009850 tx=0x7f3938009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e942fd4e34ffe3f3 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f3941ffb700 1 -- 172.21.15.69:0/4001882363 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938011830 con 0x7f39440d2c60 2023-11-17T06:34:04.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f3941ffb700 1 -- 172.21.15.69:0/4001882363 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3938011990 con 0x7f39440d2c60 2023-11-17T06:34:04.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f3941ffb700 1 -- 172.21.15.69:0/4001882363 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938011d40 con 0x7f39440d2c60 2023-11-17T06:34:04.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f394992b700 1 -- 172.21.15.69:0/4001882363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39440d2c60 msgr2=0x7f394406cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f394992b700 1 --2- 172.21.15.69:0/4001882363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39440d2c60 0x7f394406cc90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3938009850 tx=0x7f3938009b60 comp rx=0 tx=0).stop 2023-11-17T06:34:04.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f394992b700 1 -- 172.21.15.69:0/4001882363 shutdown_connections 2023-11-17T06:34:04.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f394992b700 1 --2- 172.21.15.69:0/4001882363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f39440d2c60 0x7f394406cc90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f394992b700 1 --2- 172.21.15.69:0/4001882363 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f394415d550 0x7f39440d2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f394992b700 1 -- 172.21.15.69:0/4001882363 >> 172.21.15.69:0/4001882363 conn(0x7f39440b4cb0 msgr2=0x7f39440b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:04.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f394992b700 1 -- 172.21.15.69:0/4001882363 shutdown_connections 2023-11-17T06:34:04.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.459+0000 7f394992b700 1 -- 172.21.15.69:0/4001882363 wait complete. 2023-11-17T06:34:04.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f394992b700 1 Processor -- start 2023-11-17T06:34:04.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f394992b700 1 -- start start 2023-11-17T06:34:04.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f394992b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f394406d1d0 0x7f39441e6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f394992b700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39440d2c60 0x7f39441513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f394992b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f394415d550 0x7f39441518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f394992b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39440cba20 con 0x7f394415d550 2023-11-17T06:34:04.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f394992b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39440caea0 con 0x7f394406d1d0 2023-11-17T06:34:04.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f394992b700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39440cb180 con 0x7f39440d2c60 2023-11-17T06:34:04.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f39437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f394415d550 0x7f39441518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f39437fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f394415d550 0x7f39441518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41224/0 (socket says 172.21.15.69:41224) 2023-11-17T06:34:04.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f39437fe700 1 -- 172.21.15.69:0/30966623 learned_addr learned my addr 172.21.15.69:0/30966623 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:04.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f39427fc700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39440d2c60 0x7f39441513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f3942ffd700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f394406d1d0 0x7f39441e6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f39437fe700 1 -- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39440d2c60 msgr2=0x7f39441513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f39437fe700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39440d2c60 0x7f39441513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f39437fe700 1 -- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f394406d1d0 msgr2=0x7f39441e6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f39437fe700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f394406d1d0 0x7f39441e6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f39437fe700 1 -- 172.21.15.69:0/30966623 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39380094b0 con 0x7f394415d550 2023-11-17T06:34:04.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f39437fe700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f394415d550 0x7f39441518f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f393c002230 tx=0x7f393c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.463+0000 7f392bfff700 1 -- 172.21.15.69:0/30966623 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c00aac0 con 0x7f394415d550 2023-11-17T06:34:04.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.467+0000 7f392bfff700 1 -- 172.21.15.69:0/30966623 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f393c00ac40 con 0x7f394415d550 2023-11-17T06:34:04.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.467+0000 7f394992b700 1 -- 172.21.15.69:0/30966623 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39440cb460 con 0x7f394415d550 2023-11-17T06:34:04.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.467+0000 7f392bfff700 1 -- 172.21.15.69:0/30966623 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393c0070d0 con 0x7f394415d550 2023-11-17T06:34:04.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.467+0000 7f394992b700 1 -- 172.21.15.69:0/30966623 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39440cab00 con 0x7f394415d550 2023-11-17T06:34:04.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.467+0000 7f394992b700 1 -- 172.21.15.69:0/30966623 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394414f970 con 0x7f394415d550 2023-11-17T06:34:04.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.467+0000 7f392bfff700 1 -- 172.21.15.69:0/30966623 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f393c007250 con 0x7f394415d550 2023-11-17T06:34:04.475 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.471+0000 7f392bfff700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3930066510 0x7f39300689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.471+0000 7f392bfff700 1 -- 172.21.15.69:0/30966623 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f393c083650 con 0x7f394415d550 2023-11-17T06:34:04.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.471+0000 7f3942ffd700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3930066510 0x7f39300689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.471+0000 7f3942ffd700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3930066510 0x7f39300689d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3934009b50 tx=0x7f3934009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.475+0000 7f392bfff700 1 -- 172.21.15.69:0/30966623 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f394414f970 con 0x7f394415d550 2023-11-17T06:34:04.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.647+0000 7f394992b700 1 -- 172.21.15.69:0/30966623 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f39440d1cf0 con 0x7f3930066510 2023-11-17T06:34:04.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.647+0000 7f392bfff700 1 -- 172.21.15.69:0/30966623 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3934004020 con 0x7f3930066510 2023-11-17T06:34:04.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 -- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3930066510 msgr2=0x7f39300689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3930066510 0x7f39300689d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3934009b50 tx=0x7f3934009240 comp rx=0 tx=0).stop 2023-11-17T06:34:04.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 -- 172.21.15.69:0/30966623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f394415d550 msgr2=0x7f39441518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f394415d550 0x7f39441518f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f393c002230 tx=0x7f393c00cf50 comp rx=0 tx=0).stop 2023-11-17T06:34:04.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 -- 172.21.15.69:0/30966623 shutdown_connections 2023-11-17T06:34:04.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f3930066510 0x7f39300689d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f394415d550 0x7f39441518f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f39440d2c60 0x7f39441513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 --2- 172.21.15.69:0/30966623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f394406d1d0 0x7f39441e6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 -- 172.21.15.69:0/30966623 >> 172.21.15.69:0/30966623 conn(0x7f39440b4cb0 msgr2=0x7f39440b7730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:04.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 -- 172.21.15.69:0/30966623 shutdown_connections 2023-11-17T06:34:04.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.651+0000 7f394992b700 1 -- 172.21.15.69:0/30966623 wait complete. 2023-11-17T06:34:04.659 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 5 to deep-scrub 2023-11-17T06:34:04.679 INFO:tasks.ceph:Scrubbing osd.6 2023-11-17T06:34:04.679 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:34:04.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.855+0000 7f64f3582700 1 Processor -- start 2023-11-17T06:34:04.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.855+0000 7f64f3582700 1 -- start start 2023-11-17T06:34:04.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64ec161840 0x7f64ec06b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f64ec0c1d50 0x7f64ec06be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f64ec0c22a0 0x7f64ec0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec165310 con 0x7f64ec0c22a0 2023-11-17T06:34:04.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64ec1655f0 con 0x7f64ec0c1d50 2023-11-17T06:34:04.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec1658d0 con 0x7f64ec161840 2023-11-17T06:34:04.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f2d81700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f64ec0c22a0 0x7f64ec0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f2d81700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f64ec0c22a0 0x7f64ec0ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41236/0 (socket says 172.21.15.69:41236) 2023-11-17T06:34:04.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f2d81700 1 -- 172.21.15.69:0/1789903605 learned_addr learned my addr 172.21.15.69:0/1789903605 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:04.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f2580700 1 --2- 172.21.15.69:0/1789903605 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64ec161840 0x7f64ec06b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f1d7f700 1 --2- 172.21.15.69:0/1789903605 >> v2:172.21.15.93:3300/0 conn(0x7f64ec0c1d50 0x7f64ec06be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f2d81700 1 -- 172.21.15.69:0/1789903605 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64ec161840 msgr2=0x7f64ec06b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:04.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f2d81700 1 --2- 172.21.15.69:0/1789903605 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64ec161840 0x7f64ec06b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f2d81700 1 -- 172.21.15.69:0/1789903605 >> v2:172.21.15.93:3300/0 conn(0x7f64ec0c1d50 msgr2=0x7f64ec06be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:04.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f2d81700 1 --2- 172.21.15.69:0/1789903605 >> v2:172.21.15.93:3300/0 conn(0x7f64ec0c1d50 0x7f64ec06be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f2d81700 1 -- 172.21.15.69:0/1789903605 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec165bb0 con 0x7f64ec0c22a0 2023-11-17T06:34:04.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f2d81700 1 --2- 172.21.15.69:0/1789903605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64ec0c22a0 0x7f64ec0ccba0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f64ec06e1b0 tx=0x7f64e4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5ecaf5cb44a5f7 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f157e700 1 -- 172.21.15.69:0/1789903605 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e400b8a0 con 0x7f64ec0c22a0 2023-11-17T06:34:04.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f157e700 1 -- 172.21.15.69:0/1789903605 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e400ba00 con 0x7f64ec0c22a0 2023-11-17T06:34:04.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f157e700 1 -- 172.21.15.69:0/1789903605 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e400bd90 con 0x7f64ec0c22a0 2023-11-17T06:34:04.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 -- 172.21.15.69:0/1789903605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64ec0c22a0 msgr2=0x7f64ec0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 --2- 172.21.15.69:0/1789903605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64ec0c22a0 0x7f64ec0ccba0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f64ec06e1b0 tx=0x7f64e4009bf0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 -- 172.21.15.69:0/1789903605 shutdown_connections 2023-11-17T06:34:04.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 --2- 172.21.15.69:0/1789903605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64ec0c22a0 0x7f64ec0ccba0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 --2- 172.21.15.69:0/1789903605 >> v2:172.21.15.93:3300/0 conn(0x7f64ec0c1d50 0x7f64ec06be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 --2- 172.21.15.69:0/1789903605 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64ec161840 0x7f64ec06b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.859+0000 7f64f3582700 1 -- 172.21.15.69:0/1789903605 >> 172.21.15.69:0/1789903605 conn(0x7f64ec0cb900 msgr2=0x7f64ec0cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:04.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.863+0000 7f64f3582700 1 -- 172.21.15.69:0/1789903605 shutdown_connections 2023-11-17T06:34:04.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.863+0000 7f64f3582700 1 -- 172.21.15.69:0/1789903605 wait complete. 2023-11-17T06:34:04.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.863+0000 7f64f3582700 1 Processor -- start 2023-11-17T06:34:04.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.863+0000 7f64f3582700 1 -- start start 2023-11-17T06:34:04.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f3582700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64ec0c1d50 0x7f64ec1f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f3582700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64ec0c22a0 0x7f64ec1fa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f3582700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64ec161840 0x7f64ec0b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f3582700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0c75d0 con 0x7f64ec0c1d50 2023-11-17T06:34:04.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f3582700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0b43f0 con 0x7f64ec161840 2023-11-17T06:34:04.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f3582700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64ec0c6f80 con 0x7f64ec0c22a0 2023-11-17T06:34:04.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f2580700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64ec0c1d50 0x7f64ec1f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f2580700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64ec0c1d50 0x7f64ec1f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41244/0 (socket says 172.21.15.69:41244) 2023-11-17T06:34:04.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f2580700 1 -- 172.21.15.69:0/1857228111 learned_addr learned my addr 172.21.15.69:0/1857228111 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:04.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f1d7f700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64ec0c22a0 0x7f64ec1fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f2d81700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64ec161840 0x7f64ec0b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f2580700 1 -- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64ec0c22a0 msgr2=0x7f64ec1fa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f2580700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f64ec0c22a0 0x7f64ec1fa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f2580700 1 -- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64ec161840 msgr2=0x7f64ec0b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f2580700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f64ec161840 0x7f64ec0b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f2580700 1 -- 172.21.15.69:0/1857228111 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e4009570 con 0x7f64ec0c1d50 2023-11-17T06:34:04.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f2580700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64ec0c1d50 0x7f64ec1f84b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f64e8007e40 tx=0x7f64e800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64e2ffd700 1 -- 172.21.15.69:0/1857228111 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e800ede0 con 0x7f64ec0c1d50 2023-11-17T06:34:04.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64e2ffd700 1 -- 172.21.15.69:0/1857228111 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e8014420 con 0x7f64ec0c1d50 2023-11-17T06:34:04.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64ec06dc60 con 0x7f64ec0c1d50 2023-11-17T06:34:04.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64e2ffd700 1 -- 172.21.15.69:0/1857228111 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e80147d0 con 0x7f64ec0c1d50 2023-11-17T06:34:04.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.867+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64ec1fa5d0 con 0x7f64ec0c1d50 2023-11-17T06:34:04.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.871+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64ec06dae0 con 0x7f64ec0c1d50 2023-11-17T06:34:04.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.871+0000 7f64e2ffd700 1 -- 172.21.15.69:0/1857228111 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f64e8014930 con 0x7f64ec0c1d50 2023-11-17T06:34:04.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.871+0000 7f64e2ffd700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d0066540 0x7f64d0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.871+0000 7f64e2ffd700 1 -- 172.21.15.69:0/1857228111 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f64e8084350 con 0x7f64ec0c1d50 2023-11-17T06:34:04.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.871+0000 7f64e2ffd700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x7f64d006c4e0 0x7f64d006e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:04.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.871+0000 7f64e2ffd700 1 -- 172.21.15.69:0/1857228111 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64d006efb0 con 0x7f64d006c4e0 2023-11-17T06:34:04.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.871+0000 7f64e2ffd700 1 -- 172.21.15.69:0/1857228111 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64e8086930 con 0x7f64ec0c1d50 2023-11-17T06:34:04.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.875+0000 7f64f1d7f700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d0066540 0x7f64d0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.875+0000 7f64f2d81700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x7f64d006c4e0 0x7f64d006e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:04.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.875+0000 7f64f1d7f700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d0066540 0x7f64d0068a00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f64ec070e90 tx=0x7f64dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.875+0000 7f64f2d81700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x7f64d006c4e0 0x7f64d006e900 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:04.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.875+0000 7f64e2ffd700 1 -- 172.21.15.69:0/1857228111 <== osd.6 v2:172.21.15.93:6826/2665225471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f64d006efb0 con 0x7f64d006c4e0 2023-11-17T06:34:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 --> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f64ec0cd0e0 con 0x7f64d006c4e0 2023-11-17T06:34:04.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64e2ffd700 1 -- 172.21.15.69:0/1857228111 <== osd.6 v2:172.21.15.93:6826/2665225471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f64e400b6a0 con 0x7f64d006c4e0 2023-11-17T06:34:04.901 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:34:04.901 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:34:04.901 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:34:04.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x7f64d006c4e0 msgr2=0x7f64d006e900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:6826/2665225471,v1:172.21.15.93:6827/2665225471] conn(0x7f64d006c4e0 0x7f64d006e900 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d0066540 msgr2=0x7f64d0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f64d0066540 0x7f64d0068a00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f64ec070e90 tx=0x7f64dc008040 comp rx=0 tx=0).stop 2023-11-17T06:34:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64ec0c1d50 msgr2=0x7f64ec1f84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 --2- 172.21.15.69:0/1857228111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64ec0c1d50 0x7f64ec1f84b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f64e8007e40 tx=0x7f64e800e3c0 comp rx=0 tx=0).stop 2023-11-17T06:34:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f2d81700 1 -- 172.21.15.69:0/1857228111 reap_dead start 2023-11-17T06:34:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 shutdown_connections 2023-11-17T06:34:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 >> 172.21.15.69:0/1857228111 conn(0x7f64ec0cb900 msgr2=0x7f64ec071400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:04.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 shutdown_connections 2023-11-17T06:34:04.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:04.895+0000 7f64f3582700 1 -- 172.21.15.69:0/1857228111 wait complete. 2023-11-17T06:34:04.923 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-17T06:34:05.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f5341524700 1 Processor -- start 2023-11-17T06:34:05.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f5341524700 1 -- start start 2023-11-17T06:34:05.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f5341524700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f533c15d550 0x7f533c0d2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f5341524700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f533c0d2c60 0x7f533c06cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f5341524700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f533c06d1d0 0x7f533c06b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f5341524700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533c0cf400 con 0x7f533c06d1d0 2023-11-17T06:34:05.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f5341524700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533c06d660 con 0x7f533c0d2c60 2023-11-17T06:34:05.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f5341524700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c0d2340 con 0x7f533c15d550 2023-11-17T06:34:05.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f533b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f533c06d1d0 0x7f533c06b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f533b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f533c06d1d0 0x7f533c06b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41252/0 (socket says 172.21.15.69:41252) 2023-11-17T06:34:05.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f533b7fe700 1 -- 172.21.15.69:0/3812534537 learned_addr learned my addr 172.21.15.69:0/3812534537 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:05.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.091+0000 7f533affd700 1 --2- 172.21.15.69:0/3812534537 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f533c15d550 0x7f533c0d2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f533a7fc700 1 --2- 172.21.15.69:0/3812534537 >> v2:172.21.15.93:3300/0 conn(0x7f533c0d2c60 0x7f533c06cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f533b7fe700 1 -- 172.21.15.69:0/3812534537 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f533c15d550 msgr2=0x7f533c0d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:05.101 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f533b7fe700 1 --2- 172.21.15.69:0/3812534537 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f533c15d550 0x7f533c0d2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f533b7fe700 1 -- 172.21.15.69:0/3812534537 >> v2:172.21.15.93:3300/0 conn(0x7f533c0d2c60 msgr2=0x7f533c06cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:05.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f533b7fe700 1 --2- 172.21.15.69:0/3812534537 >> v2:172.21.15.93:3300/0 conn(0x7f533c0d2c60 0x7f533c06cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f533b7fe700 1 -- 172.21.15.69:0/3812534537 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c0d1730 con 0x7f533c06d1d0 2023-11-17T06:34:05.102 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f533b7fe700 1 --2- 172.21.15.69:0/3812534537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c06d1d0 0x7f533c06b790 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f533c08c210 tx=0x7f533400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e1cc7146e5f92b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:05.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5339ffb700 1 -- 172.21.15.69:0/3812534537 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533400e070 con 0x7f533c06d1d0 2023-11-17T06:34:05.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5339ffb700 1 -- 172.21.15.69:0/3812534537 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533400b910 con 0x7f533c06d1d0 2023-11-17T06:34:05.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5339ffb700 1 -- 172.21.15.69:0/3812534537 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533400bcc0 con 0x7f533c06d1d0 2023-11-17T06:34:05.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5341524700 1 -- 172.21.15.69:0/3812534537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c06d1d0 msgr2=0x7f533c06b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5341524700 1 --2- 172.21.15.69:0/3812534537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c06d1d0 0x7f533c06b790 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f533c08c210 tx=0x7f533400b330 comp rx=0 tx=0).stop 2023-11-17T06:34:05.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5341524700 1 -- 172.21.15.69:0/3812534537 shutdown_connections 2023-11-17T06:34:05.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5341524700 1 --2- 172.21.15.69:0/3812534537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c06d1d0 0x7f533c06b790 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5341524700 1 --2- 172.21.15.69:0/3812534537 >> v2:172.21.15.93:3300/0 conn(0x7f533c0d2c60 0x7f533c06cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5341524700 1 --2- 172.21.15.69:0/3812534537 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f533c15d550 0x7f533c0d2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5341524700 1 -- 172.21.15.69:0/3812534537 >> 172.21.15.69:0/3812534537 conn(0x7f533c0b4cb0 msgr2=0x7f533c0b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:05.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5341524700 1 -- 172.21.15.69:0/3812534537 shutdown_connections 2023-11-17T06:34:05.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.095+0000 7f5341524700 1 -- 172.21.15.69:0/3812534537 wait complete. 2023-11-17T06:34:05.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.099+0000 7f5341524700 1 Processor -- start 2023-11-17T06:34:05.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.099+0000 7f5341524700 1 -- start start 2023-11-17T06:34:05.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f5341524700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f533c06d1d0 0x7f533c0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f5341524700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c0d2c60 0x7f533c1f29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f5341524700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f533c15d550 0x7f533c15b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f5341524700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1f3a00 con 0x7f533c0d2c60 2023-11-17T06:34:05.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f5341524700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1f3440 con 0x7f533c15d550 2023-11-17T06:34:05.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f5341524700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1f3720 con 0x7f533c06d1d0 2023-11-17T06:34:05.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c0d2c60 0x7f533c1f29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533a7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c0d2c60 0x7f533c1f29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41254/0 (socket says 172.21.15.69:41254) 2023-11-17T06:34:05.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533a7fc700 1 -- 172.21.15.69:0/4075748483 learned_addr learned my addr 172.21.15.69:0/4075748483 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:05.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533affd700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f533c06d1d0 0x7f533c0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533b7fe700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f533c15d550 0x7f533c15b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533a7fc700 1 -- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f533c06d1d0 msgr2=0x7f533c0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533a7fc700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f533c06d1d0 0x7f533c0cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533a7fc700 1 -- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f533c15d550 msgr2=0x7f533c15b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533a7fc700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f533c15d550 0x7f533c15b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533a7fc700 1 -- 172.21.15.69:0/4075748483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5334009b30 con 0x7f533c0d2c60 2023-11-17T06:34:05.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f533a7fc700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c0d2c60 0x7f533c1f29c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f533000e910 tx=0x7f533000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:05.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f53237fe700 1 -- 172.21.15.69:0/4075748483 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330013680 con 0x7f533c0d2c60 2023-11-17T06:34:05.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f53237fe700 1 -- 172.21.15.69:0/4075748483 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53300137e0 con 0x7f533c0d2c60 2023-11-17T06:34:05.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f53237fe700 1 -- 172.21.15.69:0/4075748483 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330013b90 con 0x7f533c0d2c60 2023-11-17T06:34:05.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f5341524700 1 -- 172.21.15.69:0/4075748483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533c15afc0 con 0x7f533c0d2c60 2023-11-17T06:34:05.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.103+0000 7f5341524700 1 -- 172.21.15.69:0/4075748483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c1e66f0 con 0x7f533c0d2c60 2023-11-17T06:34:05.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.107+0000 7f5341524700 1 -- 172.21.15.69:0/4075748483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533c04e650 con 0x7f533c0d2c60 2023-11-17T06:34:05.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.107+0000 7f53237fe700 1 -- 172.21.15.69:0/4075748483 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f5330013cf0 con 0x7f533c0d2c60 2023-11-17T06:34:05.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.107+0000 7f53237fe700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5328066510 0x7f53280689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.107+0000 7f53237fe700 1 -- 172.21.15.69:0/4075748483 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f5330083b00 con 0x7f533c0d2c60 2023-11-17T06:34:05.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.111+0000 7f533affd700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5328066510 0x7f53280689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.117 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.111+0000 7f533affd700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5328066510 0x7f53280689d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f533c0b71e0 tx=0x7f532c009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:05.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.115+0000 7f53237fe700 1 -- 172.21.15.69:0/4075748483 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f5330085e60 con 0x7f533c0d2c60 2023-11-17T06:34:05.294 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.287+0000 7f5341524700 1 -- 172.21.15.69:0/4075748483 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f533c15ae40 con 0x7f5328066510 2023-11-17T06:34:05.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.291+0000 7f53237fe700 1 -- 172.21.15.69:0/4075748483 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f532c011860 con 0x7f5328066510 2023-11-17T06:34:05.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.291+0000 7f5341524700 1 -- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5328066510 msgr2=0x7f53280689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.291+0000 7f5341524700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5328066510 0x7f53280689d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f533c0b71e0 tx=0x7f532c009240 comp rx=0 tx=0).stop 2023-11-17T06:34:05.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.291+0000 7f5341524700 1 -- 172.21.15.69:0/4075748483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c0d2c60 msgr2=0x7f533c1f29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.291+0000 7f5341524700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c0d2c60 0x7f533c1f29c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f533000e910 tx=0x7f533000ec20 comp rx=0 tx=0).stop 2023-11-17T06:34:05.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.295+0000 7f5341524700 1 -- 172.21.15.69:0/4075748483 shutdown_connections 2023-11-17T06:34:05.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.295+0000 7f5341524700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f5328066510 0x7f53280689d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.295+0000 7f5341524700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f533c15d550 0x7f533c15b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.295+0000 7f5341524700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f533c0d2c60 0x7f533c1f29c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.295+0000 7f5341524700 1 --2- 172.21.15.69:0/4075748483 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f533c06d1d0 0x7f533c0cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.295+0000 7f5341524700 1 -- 172.21.15.69:0/4075748483 >> 172.21.15.69:0/4075748483 conn(0x7f533c0b4cb0 msgr2=0x7f533c0c64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:05.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.295+0000 7f5341524700 1 -- 172.21.15.69:0/4075748483 shutdown_connections 2023-11-17T06:34:05.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.295+0000 7f5341524700 1 -- 172.21.15.69:0/4075748483 wait complete. 2023-11-17T06:34:05.301 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 6 to deep-scrub 2023-11-17T06:34:05.320 INFO:tasks.ceph:Scrubbing osd.7 2023-11-17T06:34:05.320 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-17T06:34:05.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.499+0000 7fb7bb59e700 1 Processor -- start 2023-11-17T06:34:05.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.499+0000 7fb7bb59e700 1 -- start start 2023-11-17T06:34:05.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bb59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7bc161840 0x7fb7bc06b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bb59e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb7bc0ca520 0x7fb7bc06be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bb59e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7bc165310 con 0x7fb7bc0c1d50 2023-11-17T06:34:05.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bb59e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc1655f0 con 0x7fb7bc0ca520 2023-11-17T06:34:05.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bb59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc1658d0 con 0x7fb7bc161840 2023-11-17T06:34:05.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7b9d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb7bc0c1d50 0x7fb7bc0ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60498/0 (socket says 172.21.15.69:60498) 2023-11-17T06:34:05.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7b9d9b700 1 -- 172.21.15.69:0/1253633544 learned_addr learned my addr 172.21.15.69:0/1253633544 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:34:05.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bad9d700 1 --2- 172.21.15.69:0/1253633544 >> v2:172.21.15.93:3300/0 conn(0x7fb7bc0ca520 0x7fb7bc06be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7ba59c700 1 --2- 172.21.15.69:0/1253633544 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7bc161840 0x7fb7bc06b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7b959a700 1 -- 172.21.15.69:0/1253633544 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861613890 0 0) 0x7fb7bc165310 con 0x7fb7bc0c1d50 2023-11-17T06:34:05.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7b959a700 1 -- 172.21.15.69:0/1253633544 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7a40035d0 con 0x7fb7bc0c1d50 2023-11-17T06:34:05.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bad9d700 1 -- 172.21.15.69:0/1253633544 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7bc161840 msgr2=0x7fb7bc06b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:05.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bad9d700 1 --2- 172.21.15.69:0/1253633544 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7bc161840 0x7fb7bc06b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bad9d700 1 -- 172.21.15.69:0/1253633544 >> v1:172.21.15.69:6789/0 conn(0x7fb7bc0c1d50 legacy=0x7fb7bc0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bad9d700 1 -- 172.21.15.69:0/1253633544 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc165bb0 con 0x7fb7bc0ca520 2023-11-17T06:34:05.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.503+0000 7fb7bad9d700 1 --2- 172.21.15.69:0/1253633544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7bc0ca520 0x7fb7bc06be50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009d90 tx=0x7fb7b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6817ce20455da844 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:05.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7b959a700 1 -- 172.21.15.69:0/1253633544 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b400e070 con 0x7fb7bc0ca520 2023-11-17T06:34:05.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7b959a700 1 -- 172.21.15.69:0/1253633544 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b400bb20 con 0x7fb7bc0ca520 2023-11-17T06:34:05.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7b959a700 1 -- 172.21.15.69:0/1253633544 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b4012430 con 0x7fb7bc0ca520 2023-11-17T06:34:05.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7bb59e700 1 -- 172.21.15.69:0/1253633544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7bc0ca520 msgr2=0x7fb7bc06be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7bb59e700 1 --2- 172.21.15.69:0/1253633544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7bc0ca520 0x7fb7bc06be50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009d90 tx=0x7fb7b400b330 comp rx=0 tx=0).stop 2023-11-17T06:34:05.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7bb59e700 1 -- 172.21.15.69:0/1253633544 shutdown_connections 2023-11-17T06:34:05.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7bb59e700 1 --2- 172.21.15.69:0/1253633544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7bc0ca520 0x7fb7bc06be50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7bb59e700 1 --2- 172.21.15.69:0/1253633544 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7bc161840 0x7fb7bc06b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7bb59e700 1 -- 172.21.15.69:0/1253633544 >> 172.21.15.69:0/1253633544 conn(0x7fb7bc0cb900 msgr2=0x7fb7bc0cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:05.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7bb59e700 1 -- 172.21.15.69:0/1253633544 shutdown_connections 2023-11-17T06:34:05.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.507+0000 7fb7bb59e700 1 -- 172.21.15.69:0/1253633544 wait complete. 2023-11-17T06:34:05.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7bb59e700 1 Processor -- start 2023-11-17T06:34:05.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7bb59e700 1 -- start start 2023-11-17T06:34:05.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7bb59e700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7bc0c1d50 0x7fb7bc1f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7bb59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7bc0ca520 0x7fb7bc0b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7bb59e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7bc161840 0x7fb7bc0c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.516 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7bb59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0c7190 con 0x7fb7bc0ca520 2023-11-17T06:34:05.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7bb59e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0b4540 con 0x7fb7bc161840 2023-11-17T06:34:05.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7bb59e700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0c62b0 con 0x7fb7bc0c1d50 2023-11-17T06:34:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7b9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7bc0ca520 0x7fb7bc0b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7b9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7bc0ca520 0x7fb7bc0b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41258/0 (socket says 172.21.15.69:41258) 2023-11-17T06:34:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7b9d9b700 1 -- 172.21.15.69:0/2995717004 learned_addr learned my addr 172.21.15.69:0/2995717004 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7bad9d700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7bc161840 0x7fb7bc0c5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7ba59c700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7bc0c1d50 0x7fb7bc1f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7b9d9b700 1 -- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7bc0c1d50 msgr2=0x7fb7bc1f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7b9d9b700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fb7bc0c1d50 0x7fb7bc1f77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7b9d9b700 1 -- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7bc161840 msgr2=0x7fb7bc0c5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7b9d9b700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb7bc161840 0x7fb7bc0c5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7b9d9b700 1 -- 172.21.15.69:0/2995717004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b4009a70 con 0x7fb7bc0ca520 2023-11-17T06:34:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7b9d9b700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7bc0ca520 0x7fb7bc0b4000 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c700 tx=0x7fb7b000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:05.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7aaffd700 1 -- 172.21.15.69:0/2995717004 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0005d90 con 0x7fb7bc0ca520 2023-11-17T06:34:05.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7aaffd700 1 -- 172.21.15.69:0/2995717004 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b00070d0 con 0x7fb7bc0ca520 2023-11-17T06:34:05.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7aaffd700 1 -- 172.21.15.69:0/2995717004 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0007480 con 0x7fb7bc0ca520 2023-11-17T06:34:05.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.511+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7bc06dc60 con 0x7fb7bc0ca520 2023-11-17T06:34:05.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.515+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc0c6860 con 0x7fb7bc0ca520 2023-11-17T06:34:05.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.515+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7bc06dae0 con 0x7fb7bc0ca520 2023-11-17T06:34:05.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.515+0000 7fb7aaffd700 1 -- 172.21.15.69:0/2995717004 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fb7b00075e0 con 0x7fb7bc0ca520 2023-11-17T06:34:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.519+0000 7fb7aaffd700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb79c066510 0x7fb79c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.519+0000 7fb7aaffd700 1 -- 172.21.15.69:0/2995717004 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fb7b0083060 con 0x7fb7bc0ca520 2023-11-17T06:34:05.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.519+0000 7fb7aaffd700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x7fb79c06c4b0 0x7fb79c06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.519+0000 7fb7aaffd700 1 -- 172.21.15.69:0/2995717004 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb79c06ef80 con 0x7fb79c06c4b0 2023-11-17T06:34:05.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.519+0000 7fb7aaffd700 1 -- 172.21.15.69:0/2995717004 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7b00855e0 con 0x7fb7bc0ca520 2023-11-17T06:34:05.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.519+0000 7fb7ba59c700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb79c066510 0x7fb79c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.519+0000 7fb7bad9d700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x7fb79c06c4b0 0x7fb79c06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.519+0000 7fb7ba59c700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb79c066510 0x7fb79c0689d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009b50 tx=0x7fb7ac009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:05.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.519+0000 7fb7bad9d700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x7fb79c06c4b0 0x7fb79c06e8d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:05.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.523+0000 7fb7aaffd700 1 -- 172.21.15.69:0/2995717004 <== osd.7 v2:172.21.15.93:6810/4059179485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb79c06ef80 con 0x7fb79c06c4b0 2023-11-17T06:34:05.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.539+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 --> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb7bc0c22a0 con 0x7fb79c06c4b0 2023-11-17T06:34:05.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7aaffd700 1 -- 172.21.15.69:0/2995717004 <== osd.7 v2:172.21.15.93:6810/4059179485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb7b40098f0 con 0x7fb79c06c4b0 2023-11-17T06:34:05.547 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-11-17T06:34:05.547 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-11-17T06:34:05.547 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-11-17T06:34:05.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x7fb79c06c4b0 msgr2=0x7fb79c06e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bb59e700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:6810/4059179485,v1:172.21.15.93:6811/4059179485] conn(0x7fb79c06c4b0 0x7fb79c06e8d0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb79c066510 msgr2=0x7fb79c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bb59e700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fb79c066510 0x7fb79c0689d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009b50 tx=0x7fb7ac009240 comp rx=0 tx=0).stop 2023-11-17T06:34:05.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7bc0ca520 msgr2=0x7fb7bc0b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bb59e700 1 --2- 172.21.15.69:0/2995717004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7bc0ca520 0x7fb7bc0b4000 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c700 tx=0x7fb7b000ca10 comp rx=0 tx=0).stop 2023-11-17T06:34:05.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bad9d700 1 -- 172.21.15.69:0/2995717004 reap_dead start 2023-11-17T06:34:05.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 shutdown_connections 2023-11-17T06:34:05.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 >> 172.21.15.69:0/2995717004 conn(0x7fb7bc0cb900 msgr2=0x7fb7bc0ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:05.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 shutdown_connections 2023-11-17T06:34:05.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.543+0000 7fb7bb59e700 1 -- 172.21.15.69:0/2995717004 wait complete. 2023-11-17T06:34:05.568 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-17T06:34:05.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.731+0000 7ff0913a5700 1 Processor -- start 2023-11-17T06:34:05.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0913a5700 1 -- start start 2023-11-17T06:34:05.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0913a5700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff08c142000 0x7ff08c142e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0913a5700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 0x7ff08c06b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0913a5700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08c0cca30 con 0x7ff08c06bd70 2023-11-17T06:34:05.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0913a5700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08c0ccd10 con 0x7ff08c142000 2023-11-17T06:34:05.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0913a5700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c0ccff0 con 0x7ff08c06d5d0 2023-11-17T06:34:05.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff08affd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff08c142000 0x7ff08c142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0827fc700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 0x7ff08c06b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff08affd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff08c142000 0x7ff08c142e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41270/0 (socket says 172.21.15.69:41270) 2023-11-17T06:34:05.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff08affd700 1 -- 172.21.15.69:0/1673872946 learned_addr learned my addr 172.21.15.69:0/1673872946 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:05.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0827fc700 1 -- 172.21.15.69:0/1673872946 >> v2:172.21.15.69:3300/0 conn(0x7ff08c142000 msgr2=0x7ff08c142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:05.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0827fc700 1 --2- 172.21.15.69:0/1673872946 >> v2:172.21.15.69:3300/0 conn(0x7ff08c142000 0x7ff08c142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0827fc700 1 -- 172.21.15.69:0/1673872946 >> v1:172.21.15.93:6789/0 conn(0x7ff08c06bd70 legacy=0x7ff08c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0827fc700 1 -- 172.21.15.69:0/1673872946 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c0cd2d0 con 0x7ff08c06d5d0 2023-11-17T06:34:05.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff0827fc700 1 --2- 172.21.15.69:0/1673872946 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 0x7ff08c06b830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff074009850 tx=0x7ff074009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11e422a0e9aab98b server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:05.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.735+0000 7ff08a7fc700 1 -- 172.21.15.69:0/1673872946 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074011830 con 0x7ff08c06d5d0 2023-11-17T06:34:05.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.739+0000 7ff08a7fc700 1 -- 172.21.15.69:0/1673872946 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff074011990 con 0x7ff08c06d5d0 2023-11-17T06:34:05.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.739+0000 7ff08a7fc700 1 -- 172.21.15.69:0/1673872946 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff074011d40 con 0x7ff08c06d5d0 2023-11-17T06:34:05.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.739+0000 7ff0913a5700 1 -- 172.21.15.69:0/1673872946 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 msgr2=0x7ff08c06b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.739+0000 7ff0913a5700 1 --2- 172.21.15.69:0/1673872946 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 0x7ff08c06b830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff074009850 tx=0x7ff074009b60 comp rx=0 tx=0).stop 2023-11-17T06:34:05.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.739+0000 7ff0913a5700 1 -- 172.21.15.69:0/1673872946 shutdown_connections 2023-11-17T06:34:05.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.739+0000 7ff0913a5700 1 --2- 172.21.15.69:0/1673872946 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 0x7ff08c06b830 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.739+0000 7ff0913a5700 1 --2- 172.21.15.69:0/1673872946 >> v2:172.21.15.69:3300/0 conn(0x7ff08c142000 0x7ff08c142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.745 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.739+0000 7ff0913a5700 1 -- 172.21.15.69:0/1673872946 >> 172.21.15.69:0/1673872946 conn(0x7ff08c0cedc0 msgr2=0x7ff08c0cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:05.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.739+0000 7ff0913a5700 1 -- 172.21.15.69:0/1673872946 shutdown_connections 2023-11-17T06:34:05.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.739+0000 7ff0913a5700 1 -- 172.21.15.69:0/1673872946 wait complete. 2023-11-17T06:34:05.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.743+0000 7ff0913a5700 1 Processor -- start 2023-11-17T06:34:05.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.743+0000 7ff0913a5700 1 -- start start 2023-11-17T06:34:05.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.743+0000 7ff0913a5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff08c06bd70 0x7ff08c1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.743+0000 7ff0913a5700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 0x7ff08c0b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.743+0000 7ff0913a5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff08c142000 0x7ff08c0b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.743+0000 7ff0913a5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c1f3040 con 0x7ff08c06bd70 2023-11-17T06:34:05.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.743+0000 7ff0913a5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c1f3230 con 0x7ff08c142000 2023-11-17T06:34:05.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.743+0000 7ff0913a5700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08c1f3510 con 0x7ff08c06d5d0 2023-11-17T06:34:05.752 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff08c06bd70 0x7ff08c1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff08c06bd70 0x7ff08c1539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41278/0 (socket says 172.21.15.69:41278) 2023-11-17T06:34:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08affd700 1 -- 172.21.15.69:0/2501107235 learned_addr learned my addr 172.21.15.69:0/2501107235 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08b7fe700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff08c142000 0x7ff08c0b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff0827fc700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 0x7ff08c0b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08affd700 1 -- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 msgr2=0x7ff08c0b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08affd700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 0x7ff08c0b0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08affd700 1 -- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff08c142000 msgr2=0x7ff08c0b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08affd700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff08c142000 0x7ff08c0b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08affd700 1 -- 172.21.15.69:0/2501107235 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0740094b0 con 0x7ff08c06bd70 2023-11-17T06:34:05.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08b7fe700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff08c142000 0x7ff08c0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:34:05.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff0827fc700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 0x7ff08c0b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:34:05.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff08affd700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff08c06bd70 0x7ff08c1539a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00e890 tx=0x7ff07c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:05.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff083fff700 1 -- 172.21.15.69:0/2501107235 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c009620 con 0x7ff08c06bd70 2023-11-17T06:34:05.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff083fff700 1 -- 172.21.15.69:0/2501107235 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c00ee90 con 0x7ff08c06bd70 2023-11-17T06:34:05.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff0913a5700 1 -- 172.21.15.69:0/2501107235 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff08c1f37f0 con 0x7ff08c06bd70 2023-11-17T06:34:05.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff083fff700 1 -- 172.21.15.69:0/2501107235 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c00ca90 con 0x7ff08c06bd70 2023-11-17T06:34:05.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff0913a5700 1 -- 172.21.15.69:0/2501107235 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08c0c5bf0 con 0x7ff08c06bd70 2023-11-17T06:34:05.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.747+0000 7ff0913a5700 1 -- 172.21.15.69:0/2501107235 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08c04e650 con 0x7ff08c06bd70 2023-11-17T06:34:05.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.751+0000 7ff083fff700 1 -- 172.21.15.69:0/2501107235 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7ff07c00cbf0 con 0x7ff08c06bd70 2023-11-17T06:34:05.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.751+0000 7ff083fff700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff06c066510 0x7ff06c0689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:05.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.751+0000 7ff083fff700 1 -- 172.21.15.69:0/2501107235 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7ff07c083c60 con 0x7ff08c06bd70 2023-11-17T06:34:05.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.751+0000 7ff0827fc700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff06c066510 0x7ff06c0689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:05.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.755+0000 7ff0827fc700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff06c066510 0x7ff06c0689d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff0740090b0 tx=0x7ff074008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:05.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.759+0000 7ff083fff700 1 -- 172.21.15.69:0/2501107235 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7ff07c0512a0 con 0x7ff08c06bd70 2023-11-17T06:34:05.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.931+0000 7ff0913a5700 1 -- 172.21.15.69:0/2501107235 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff08c0cd5b0 con 0x7ff06c066510 2023-11-17T06:34:05.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.931+0000 7ff083fff700 1 -- 172.21.15.69:0/2501107235 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff074011750 con 0x7ff06c066510 2023-11-17T06:34:05.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.931+0000 7ff0913a5700 1 -- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff06c066510 msgr2=0x7ff06c0689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.931+0000 7ff0913a5700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff06c066510 0x7ff06c0689d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff0740090b0 tx=0x7ff074008030 comp rx=0 tx=0).stop 2023-11-17T06:34:05.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.931+0000 7ff0913a5700 1 -- 172.21.15.69:0/2501107235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff08c06bd70 msgr2=0x7ff08c1539a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:05.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.931+0000 7ff0913a5700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff08c06bd70 0x7ff08c1539a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00e890 tx=0x7ff07c00ec50 comp rx=0 tx=0).stop 2023-11-17T06:34:05.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.935+0000 7ff0913a5700 1 -- 172.21.15.69:0/2501107235 shutdown_connections 2023-11-17T06:34:05.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.935+0000 7ff0913a5700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7ff06c066510 0x7ff06c0689d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.935+0000 7ff0913a5700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff08c142000 0x7ff08c0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.935+0000 7ff0913a5700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7ff08c06d5d0 0x7ff08c0b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.935+0000 7ff0913a5700 1 --2- 172.21.15.69:0/2501107235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff08c06bd70 0x7ff08c1539a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:05.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.935+0000 7ff0913a5700 1 -- 172.21.15.69:0/2501107235 >> 172.21.15.69:0/2501107235 conn(0x7ff08c0cedc0 msgr2=0x7ff08c15a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:05.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.935+0000 7ff0913a5700 1 -- 172.21.15.69:0/2501107235 shutdown_connections 2023-11-17T06:34:05.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:05.935+0000 7ff0913a5700 1 -- 172.21.15.69:0/2501107235 wait complete. 2023-11-17T06:34:05.943 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 7 to deep-scrub 2023-11-17T06:34:05.963 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:34:06.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.131+0000 7f0626c63700 1 Processor -- start 2023-11-17T06:34:06.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.131+0000 7f0626c63700 1 -- start start 2023-11-17T06:34:06.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f0626c63700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f06200cfa00 0x7f06200cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:06.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f0626c63700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f06200b20f0 0x7f06200b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:06.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f0626c63700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06200c3fd0 con 0x7f0620071620 2023-11-17T06:34:06.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f0626c63700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200b2ac0 con 0x7f06200b20f0 2023-11-17T06:34:06.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f0626c63700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200d0320 con 0x7f06200cfa00 2023-11-17T06:34:06.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f06200b20f0 0x7f06200b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:06.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061ffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f06200b20f0 0x7f06200b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41280/0 (socket says 172.21.15.69:41280) 2023-11-17T06:34:06.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061ffff700 1 -- 172.21.15.69:0/1785532879 learned_addr learned my addr 172.21.15.69:0/1785532879 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:06.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f06249ff700 1 --2- 172.21.15.69:0/1785532879 >> v2:172.21.15.93:3300/0 conn(0x7f06200cfa00 0x7f06200cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:06.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061ffff700 1 -- 172.21.15.69:0/1785532879 >> v2:172.21.15.93:3300/0 conn(0x7f06200cfa00 msgr2=0x7f06200cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:06.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061ffff700 1 --2- 172.21.15.69:0/1785532879 >> v2:172.21.15.93:3300/0 conn(0x7f06200cfa00 0x7f06200cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061ffff700 1 -- 172.21.15.69:0/1785532879 >> v1:172.21.15.93:6789/0 conn(0x7f0620071620 legacy=0x7f0620071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:06.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061ffff700 1 -- 172.21.15.69:0/1785532879 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0620165240 con 0x7f06200b20f0 2023-11-17T06:34:06.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061ffff700 1 --2- 172.21.15.69:0/1785532879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200b20f0 0x7f06200b2580 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f062006cf90 tx=0x7f060c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a45f27023486518 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:06.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061f7fe700 1 -- 172.21.15.69:0/1785532879 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c011830 con 0x7f06200b20f0 2023-11-17T06:34:06.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061f7fe700 1 -- 172.21.15.69:0/1785532879 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c011990 con 0x7f06200b20f0 2023-11-17T06:34:06.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f061f7fe700 1 -- 172.21.15.69:0/1785532879 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c011d20 con 0x7f06200b20f0 2023-11-17T06:34:06.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f0626c63700 1 -- 172.21.15.69:0/1785532879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200b20f0 msgr2=0x7f06200b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:06.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.135+0000 7f0626c63700 1 --2- 172.21.15.69:0/1785532879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200b20f0 0x7f06200b2580 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f062006cf90 tx=0x7f060c009bf0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.139+0000 7f0626c63700 1 -- 172.21.15.69:0/1785532879 shutdown_connections 2023-11-17T06:34:06.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.139+0000 7f0626c63700 1 --2- 172.21.15.69:0/1785532879 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200b20f0 0x7f06200b2580 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.139+0000 7f0626c63700 1 --2- 172.21.15.69:0/1785532879 >> v2:172.21.15.93:3300/0 conn(0x7f06200cfa00 0x7f06200cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.139+0000 7f0626c63700 1 -- 172.21.15.69:0/1785532879 >> 172.21.15.69:0/1785532879 conn(0x7f06200cd0f0 msgr2=0x7f06200cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:06.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.139+0000 7f0626c63700 1 -- 172.21.15.69:0/1785532879 shutdown_connections 2023-11-17T06:34:06.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.139+0000 7f0626c63700 1 -- 172.21.15.69:0/1785532879 wait complete. 2023-11-17T06:34:06.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.139+0000 7f0626c63700 1 Processor -- start 2023-11-17T06:34:06.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.139+0000 7f0626c63700 1 -- start start 2023-11-17T06:34:06.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0626c63700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0620071620 0x7f0620152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:06.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0626c63700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06200b20f0 0x7f06201638b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:06.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0626c63700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200cfa00 0x7f0620163df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:06.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0626c63700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0620163560 con 0x7f06200cfa00 2023-11-17T06:34:06.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0626c63700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06200c4950 con 0x7f06200b20f0 2023-11-17T06:34:06.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0626c63700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0620163280 con 0x7f0620071620 2023-11-17T06:34:06.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0625a01700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200cfa00 0x7f0620163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:06.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0625a01700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200cfa00 0x7f0620163df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41292/0 (socket says 172.21.15.69:41292) 2023-11-17T06:34:06.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0625a01700 1 -- 172.21.15.69:0/3850413164 learned_addr learned my addr 172.21.15.69:0/3850413164 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:06.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f061ffff700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06200b20f0 0x7f06201638b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:06.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f06249ff700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0620071620 0x7f0620152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:06.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0625a01700 1 -- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0620071620 msgr2=0x7f0620152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:06.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0625a01700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0620071620 0x7f0620152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0625a01700 1 -- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06200b20f0 msgr2=0x7f06201638b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:06.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0625a01700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06200b20f0 0x7f06201638b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0625a01700 1 -- 172.21.15.69:0/3850413164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f060c009570 con 0x7f06200cfa00 2023-11-17T06:34:06.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.143+0000 7f0625a01700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200cfa00 0x7f0620163df0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f061800cbd0 tx=0x7f061800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:06.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.147+0000 7f061d7fa700 1 -- 172.21.15.69:0/3850413164 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618003c20 con 0x7f06200cfa00 2023-11-17T06:34:06.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.147+0000 7f061d7fa700 1 -- 172.21.15.69:0/3850413164 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0618003d80 con 0x7f06200cfa00 2023-11-17T06:34:06.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.147+0000 7f0626c63700 1 -- 172.21.15.69:0/3850413164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06200c4300 con 0x7f06200cfa00 2023-11-17T06:34:06.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.147+0000 7f061d7fa700 1 -- 172.21.15.69:0/3850413164 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800aaa0 con 0x7f06200cfa00 2023-11-17T06:34:06.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.147+0000 7f0626c63700 1 -- 172.21.15.69:0/3850413164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06201532e0 con 0x7f06200cfa00 2023-11-17T06:34:06.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.151+0000 7f0626c63700 1 -- 172.21.15.69:0/3850413164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06200c4160 con 0x7f06200cfa00 2023-11-17T06:34:06.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.151+0000 7f061d7fa700 1 -- 172.21.15.69:0/3850413164 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f061800ac00 con 0x7f06200cfa00 2023-11-17T06:34:06.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.151+0000 7f061d7fa700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0604066510 0x7f06040689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:06.158 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.151+0000 7f061d7fa700 1 -- 172.21.15.69:0/3850413164 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f0618083ae0 con 0x7f06200cfa00 2023-11-17T06:34:06.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.155+0000 7f06249ff700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0604066510 0x7f06040689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:06.159 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.155+0000 7f06249ff700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0604066510 0x7f06040689d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0614009b50 tx=0x7f0614009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:06.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.159+0000 7f061d7fa700 1 -- 172.21.15.69:0/3850413164 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f06200c4160 con 0x7f06200cfa00 2023-11-17T06:34:06.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.331+0000 7f0626c63700 1 -- 172.21.15.69:0/3850413164 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0620165800 con 0x7f0604066510 2023-11-17T06:34:06.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.339+0000 7f061d7fa700 1 -- 172.21.15.69:0/3850413164 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48409 (secure 0 0 0) 0x7f0614011810 con 0x7f0604066510 2023-11-17T06:34:06.344 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:34:06.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.339+0000 7f0626c63700 1 -- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0604066510 msgr2=0x7f06040689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:06.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.339+0000 7f0626c63700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0604066510 0x7f06040689d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0614009b50 tx=0x7f0614009240 comp rx=0 tx=0).stop 2023-11-17T06:34:06.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.343+0000 7f0626c63700 1 -- 172.21.15.69:0/3850413164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200cfa00 msgr2=0x7f0620163df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:06.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.343+0000 7f0626c63700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200cfa00 0x7f0620163df0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f061800cbd0 tx=0x7f061800cee0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.343+0000 7f0626c63700 1 -- 172.21.15.69:0/3850413164 shutdown_connections 2023-11-17T06:34:06.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.343+0000 7f0626c63700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f0604066510 0x7f06040689d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.343+0000 7f0626c63700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f06200cfa00 0x7f0620163df0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.343+0000 7f0626c63700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f06200b20f0 0x7f06201638b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.343+0000 7f0626c63700 1 --2- 172.21.15.69:0/3850413164 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f0620071620 0x7f0620152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:06.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.343+0000 7f0626c63700 1 -- 172.21.15.69:0/3850413164 >> 172.21.15.69:0/3850413164 conn(0x7f06200cd0f0 msgr2=0x7f0620071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:06.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.343+0000 7f0626c63700 1 -- 172.21.15.69:0/3850413164 shutdown_connections 2023-11-17T06:34:06.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:06.343+0000 7f0626c63700 1 -- 172.21.15.69:0/3850413164 wait complete. 2023-11-17T06:34:06.350 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:34:06.370 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2023-11-17T06:34:04.453535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":233776,"kb_used_data":5128,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740944,"statfs":{"total":773094113280,"available":772854726656,"internally_reserved":0,"allocated":5251072,"data_stored":2822400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":234016313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.125531"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-11-17T06:33:52.319860+0000","last_change":"2023-11-17T06:29:48.031659+0000","last_active":"2023-11-17T06:33:52.319860+0000","last_peered":"2023-11-17T06:33:52.319860+0000","last_clean":"2023-11-17T06:33:52.319860+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:33:52.319860+0000","last_undegraded":"2023-11-17T06:33:52.319860+0000","last_fullsized":"2023-11-17T06:33:52.319860+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-17T06:29:47.005420+0000","last_clean_scrub_stamp":"2023-11-17T06:29:47.005420+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:11:29.801860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509493,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.1100000000000001,"15min":1.1399999999999999},"min":{"1min":0.67900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3839999999999999,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.111,"15min":1.135},"min":{"1min":0.746,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8169999999999999,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.3759999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1619999999999999,"15min":1.204},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.3320000000000001,"5min":1.708,"15min":1.708},"last":1.4099999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.171,"15min":1.2110000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.514,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.2170000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.1299999999999999,"15min":1.139},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3360000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.3500000000000001},"min":{"1min":0.84299999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5700000000000001,"5min":2.173,"15min":2.173},"last":1.095}]},{"osd":3,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2569999999999999,"15min":1.3029999999999999},"min":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.893,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.365,"15min":1.4390000000000001},"min":{"1min":0.98299999999999998,"5min":0.878,"15min":0.878},"max":{"1min":1.5249999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.282}]},{"osd":4,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2050000000000001,"15min":1.3089999999999999},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.6919999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.135},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.2589999999999999,"15min":1.3320000000000001},"min":{"1min":0.70599999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.865,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.0489999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3700000000000001,"15min":1.458},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.645,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.365,"15min":1.458},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7390000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.5089999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.5089999999999999,"15min":1.6279999999999999},"min":{"1min":0.875,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7809999999999999,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.327},{"interface":"front","average":{"1min":1.304,"5min":1.415,"15min":1.4870000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.637,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.466}]}]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1539999999999999,"15min":1.1879999999999999},"min":{"1min":0.59599999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6379999999999999,"5min":2.726,"15min":2.726},"last":1.643},{"interface":"front","average":{"1min":1.135,"5min":1.268,"15min":1.393},"min":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.556,"5min":6.3339999999999996,"15min":6.3339999999999996},"last":1.0900000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.119,"15min":1.1240000000000001},"min":{"1min":0.72399999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.4450000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.23,"15min":1.1990000000000001},"min":{"1min":0.80400000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.468,"5min":1.708,"15min":1.708},"last":1.5369999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.254,"15min":1.347},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4410000000000001,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.45},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.272,"15min":1.3380000000000001},"min":{"1min":0.93700000000000006,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6619999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.2490000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3009999999999999,"15min":1.3440000000000001},"min":{"1min":0.86499999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6100000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.401,"15min":1.516},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5820000000000001,"5min":6.2210000000000001,"15min":6.2210000000000001},"last":1.1910000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2709999999999999,"15min":1.286},"min":{"1min":0.91900000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6240000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.389},{"interface":"front","average":{"1min":1.206,"5min":1.266,"15min":1.333},"min":{"1min":0.873,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5740000000000001,"5min":1.99,"15min":1.99},"last":1.302}]},{"osd":5,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.337,"15min":1.407},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.595,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4259999999999999,"15min":1.4430000000000001},"min":{"1min":0.93000000000000005,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6990000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.716}]},{"osd":7,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3759999999999999,"15min":1.464},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.554,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.4370000000000001,"15min":1.4970000000000001},"min":{"1min":0.90900000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.7490000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.6080000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509494,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.085,"15min":1.105},"min":{"1min":0.58999999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.595,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.121,"15min":1.1379999999999999},"min":{"1min":0.81699999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.381,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.034}]},{"osd":1,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1459999999999999,"15min":1.1379999999999999},"min":{"1min":0.80200000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5409999999999999,"5min":1.744,"15min":1.744},"last":1.151},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2150000000000001,"15min":1.2629999999999999},"min":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5409999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.4370000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.216,"15min":1.2609999999999999},"min":{"1min":0.77500000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6499999999999999,"5min":1.794,"15min":1.794},"last":1.329},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.276,"15min":1.3080000000000001},"min":{"1min":0.89300000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.492,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.177}]},{"osd":3,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.254,"15min":1.3300000000000001},"min":{"1min":0.75700000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.456,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.2629999999999999,"15min":1.2669999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.536,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.375}]},{"osd":5,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3169999999999999,"15min":1.393},"min":{"1min":0.70399999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6870000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3129999999999999,"15min":1.361},"min":{"1min":0.80600000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6240000000000001,"5min":2.411,"15min":2.411},"last":1.216}]},{"osd":6,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.3260000000000001,"15min":1.367},"min":{"1min":1.0649999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5980000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.4319999999999999,"15min":1.52},"min":{"1min":0.91500000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7629999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.5149999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.2689999999999999,"15min":1.288},"min":{"1min":0.91100000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5469999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.379,"15min":1.415},"min":{"1min":1.0069999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.696,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.254}]}]},{"osd":3,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31676,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84199999999999997,"15min":0.88},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2529999999999999,"5min":1.615,"15min":1.615},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.93300000000000005,"15min":0.96299999999999997},"min":{"1min":0.499,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3420000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.2949999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89800000000000002,"15min":0.92000000000000004},"min":{"1min":0.627,"5min":0.441,"15min":0.441},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":1.113},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.038,"15min":1.052},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4059999999999999,"5min":1.671,"15min":1.671},"last":1.3320000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1799999999999999,"15min":1.3169999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.732,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1459999999999999},"min":{"1min":0.69099999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.377,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.94199999999999995}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3129999999999999,"15min":1.3560000000000001},"min":{"1min":1.0800000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4850000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.2490000000000001,"15min":1.3029999999999999},"min":{"1min":0.89300000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.504,"5min":2.085,"15min":2.085},"last":1.3759999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3939999999999999,"15min":1.472},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8899999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.321,"15min":1.3660000000000001},"min":{"1min":0.90100000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.6319999999999999,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.1719999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.331,"15min":1.359},"min":{"1min":0.94699999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4550000000000001,"15min":1.494},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.819,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.5069999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.359,"15min":1.3740000000000001},"min":{"1min":1.123,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.8560000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.341,"5min":1.3959999999999999,"15min":1.4179999999999999},"min":{"1min":0.97399999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7989999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.2789999999999999}]}]},{"osd":2,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93400000000000005,"15min":1.052},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1499999999999999,"5min":4.2469999999999999,"15min":4.2469999999999999},"last":1.073},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.085,"15min":1.286},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.482,"5min":8.0510000000000002,"15min":8.0510000000000002},"last":0.71199999999999997}]},{"osd":1,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.22,"15min":1.288},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.302,"5min":4.5279999999999996,"15min":4.5279999999999996},"last":1.1910000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0509999999999999,"15min":1.1539999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.448,"5min":4.2960000000000003,"15min":4.2960000000000003},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.214,"15min":1.3380000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.774,"5min":4.2720000000000002,"15min":4.2720000000000002},"last":1.103}]},{"osd":4,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.3120000000000001,"15min":1.4059999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6699999999999999,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.149},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.4530000000000001,"15min":1.5609999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.833,"5min":4.6459999999999999,"15min":4.6459999999999999},"last":1.3}]},{"osd":5,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3240000000000001,"15min":1.369},"min":{"1min":0.98399999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.276},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.4379999999999999,"15min":1.552},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.786,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":1.335}]},{"osd":6,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.52,"15min":1.6599999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.881,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.411},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4039999999999999,"15min":1.48},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.827,"5min":2.218,"15min":2.218},"last":1.3819999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4350000000000001,"15min":1.532},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.0219999999999998,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.036},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.486,"15min":1.5760000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.0990000000000002,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.218}]}]},{"osd":1,"up_from":15,"seq":64424509493,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1101824,"data_stored":795576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91100000000000003,"15min":0.96499999999999997},"min":{"1min":0.56999999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.891,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":1.359},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0609999999999999,"15min":1.1870000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.429,"5min":4.7199999999999998,"15min":4.7199999999999998},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.222,"15min":1.4039999999999999},"min":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.95,"5min":7.6180000000000003,"15min":7.6180000000000003},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.4139999999999999,"15min":1.6559999999999999},"min":{"1min":0.70599999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9450000000000001,"5min":8.4649999999999999,"15min":8.4649999999999999},"last":1.0409999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.2490000000000001,"15min":1.415},"min":{"1min":0.67000000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0529999999999999,"5min":4.782,"15min":4.782},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.0669999999999999,"15min":1.1970000000000001},"min":{"1min":0.624,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2609999999999999,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.99099999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.3029999999999999,"15min":1.4099999999999999},"min":{"1min":0.93300000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.8140000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.359,"15min":1.4690000000000001},"min":{"1min":0.80800000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.0059999999999998,"5min":4.3639999999999999,"15min":4.3639999999999999},"last":1.4350000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.417,"15min":1.5629999999999999},"min":{"1min":0.88100000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0489999999999999,"5min":4.4180000000000001,"15min":4.4180000000000001},"last":1.577},{"interface":"front","average":{"1min":1.244,"5min":1.4139999999999999,"15min":1.548},"min":{"1min":0.91300000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.488,"5min":4.6479999999999997,"15min":4.6479999999999997},"last":1.3160000000000001}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.4139999999999999,"15min":1.554},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7549999999999999,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.5269999999999999,"15min":1.637},"min":{"1min":1.006,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":1.5209999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.5189999999999999,"15min":1.673},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5600000000000001,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":1.466},{"interface":"front","average":{"1min":1.343,"5min":1.482,"15min":1.625},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":1.7529999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":1.274}]}]},{"osd":0,"up_from":15,"seq":64424509495,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85599999999999998,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4350000000000001,"5min":1.849,"15min":1.849},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.228,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1870000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0529999999999999,"15min":1.115},"min":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3149999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1519999999999999},"min":{"1min":0.70099999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.411,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.4910000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":1.016},"min":{"1min":0.50800000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.343,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.131,"15min":1.226},"min":{"1min":0.59199999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.296,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.0609999999999999}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2549999999999999,"15min":1.333},"min":{"1min":0.88900000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.51,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.252,"15min":1.341},"min":{"1min":0.77200000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.373,"5min":3.2130000000000001,"15min":3.2130000000000001},"last":1.248}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.284,"15min":1.3979999999999999},"min":{"1min":0.879,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4359999999999999,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.393},{"interface":"front","average":{"1min":1.218,"5min":1.345,"15min":1.4299999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.532,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.1719999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.45,"15min":1.546},"min":{"1min":1.0369999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.6120000000000001,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":1.359},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3939999999999999,"15min":1.492},"min":{"1min":0.88800000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.754,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.29}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4419999999999999,"15min":1.522},"min":{"1min":1.0820000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.599,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":1.546},{"interface":"front","average":{"1min":1.264,"5min":1.4359999999999999,"15min":1.55},"min":{"1min":1.0669999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.5169999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.3380000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542199,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32260,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339580,"statfs":{"total":96636764160,"available":96603729920,"internally_reserved":0,"allocated":1101824,"data_stored":795576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.056,"15min":0.99399999999999999},"min":{"1min":0.627,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.407,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.081,"15min":1.0880000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.995}]},{"osd":1,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.119,"15min":1.139},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3440000000000001,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.133},{"interface":"front","average":{"1min":1.111,"5min":1.143,"15min":1.141},"min":{"1min":0.71399999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4159999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.044}]},{"osd":2,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.266,"15min":1.288},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.90000000000000002},{"interface":"front","average":{"1min":1.165,"5min":1.2370000000000001,"15min":1.2709999999999999},"min":{"1min":0.76200000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5149999999999999,"5min":1.649,"15min":1.649},"last":1.302}]},{"osd":3,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.21,"15min":1.2589999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.234,"15min":1.272},"min":{"1min":0.91900000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.571,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.234}]},{"osd":4,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.177,"15min":1.2230000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4750000000000001,"5min":1.796,"15min":1.796},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.169,"5min":1.2869999999999999,"15min":1.323},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.639,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.2669999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.3029999999999999,"15min":1.355},"min":{"1min":0.82699999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5920000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.3160000000000001,"15min":1.361},"min":{"1min":0.90300000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.518,"5min":1.833,"15min":1.833},"last":1.1970000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.373,"15min":1.431},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7390000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.339},{"interface":"front","average":{"1min":1.302,"5min":1.4259999999999999,"15min":1.4930000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.698,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.4219999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:34:06.376 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-17T06:29:47.005420+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=17, tm_hour=6, tm_min=29, tm_sec=47, tm_wday=4, tm_yday=321, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=17, tm_hour=6, tm_min=33, tm_sec=59, tm_wday=4, tm_yday=321, tm_isdst=0) 2023-11-17T06:34:06.376 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-17T06:34:26.378 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-17T06:34:26.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9399879700 1 Processor -- start 2023-11-17T06:34:26.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9399879700 1 -- start start 2023-11-17T06:34:26.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9399879700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9394070080 0x7f9394070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:26.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9399879700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93940715c0 con 0x7f939415a090 2023-11-17T06:34:26.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9399879700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f939406cce0 con 0x7f9394071170 2023-11-17T06:34:26.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9399879700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939415a470 con 0x7f9394070080 2023-11-17T06:34:26.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9393fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9394070080 0x7f9394070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:26.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9398877700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f939415a090 0x7f93940ce460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:35604/0 (socket says 172.21.15.69:35604) 2023-11-17T06:34:26.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9398877700 1 -- 172.21.15.69:0/3735557794 learned_addr learned my addr 172.21.15.69:0/3735557794 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:34:26.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9393fff700 1 -- 172.21.15.69:0/3735557794 >> v1:172.21.15.93:6789/0 conn(0x7f9394071170 legacy=0x7f93940c93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9393fff700 1 -- 172.21.15.69:0/3735557794 >> v1:172.21.15.69:6789/0 conn(0x7f939415a090 legacy=0x7f93940ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9393fff700 1 -- 172.21.15.69:0/3735557794 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939406cf30 con 0x7f9394070080 2023-11-17T06:34:26.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.562+0000 7f9393fff700 1 --2- 172.21.15.69:0/3735557794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 0x7f9394070c30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9380009850 tx=0x7f9380009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da66944f1f8efdff server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:26.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f93937fe700 1 -- 172.21.15.69:0/3735557794 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380011830 con 0x7f9394070080 2023-11-17T06:34:26.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f93937fe700 1 -- 172.21.15.69:0/3735557794 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9380011990 con 0x7f9394070080 2023-11-17T06:34:26.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f93937fe700 1 -- 172.21.15.69:0/3735557794 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9380011d20 con 0x7f9394070080 2023-11-17T06:34:26.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f9399879700 1 -- 172.21.15.69:0/3735557794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 msgr2=0x7f9394070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f9399879700 1 --2- 172.21.15.69:0/3735557794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 0x7f9394070c30 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f9380009850 tx=0x7f9380009b60 comp rx=0 tx=0).stop 2023-11-17T06:34:26.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f9399879700 1 -- 172.21.15.69:0/3735557794 shutdown_connections 2023-11-17T06:34:26.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f9399879700 1 --2- 172.21.15.69:0/3735557794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 0x7f9394070c30 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:26.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f9399879700 1 -- 172.21.15.69:0/3735557794 >> 172.21.15.69:0/3735557794 conn(0x7f93940cece0 msgr2=0x7f93940cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:26.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f9399879700 1 -- 172.21.15.69:0/3735557794 shutdown_connections 2023-11-17T06:34:26.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f9399879700 1 -- 172.21.15.69:0/3735557794 wait complete. 2023-11-17T06:34:26.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f9399879700 1 Processor -- start 2023-11-17T06:34:26.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.566+0000 7f9399879700 1 -- start start 2023-11-17T06:34:26.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9399879700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 0x7f9394159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:26.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9399879700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9394071170 0x7f93940cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:26.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9399879700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f939415a090 0x7f939414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:26.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9399879700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939414f410 con 0x7f9394070080 2023-11-17T06:34:26.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9399879700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f939414dce0 con 0x7f939415a090 2023-11-17T06:34:26.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9399879700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93940c8380 con 0x7f9394071170 2023-11-17T06:34:26.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9398877700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 0x7f9394159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:26.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9398877700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 0x7f9394159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42232/0 (socket says 172.21.15.69:42232) 2023-11-17T06:34:26.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9398877700 1 -- 172.21.15.69:0/385382539 learned_addr learned my addr 172.21.15.69:0/385382539 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:26.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9393fff700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9394071170 0x7f93940cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:26.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9399078700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f939415a090 0x7f939414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:26.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9398877700 1 -- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9394071170 msgr2=0x7f93940cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9398877700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9394071170 0x7f93940cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:26.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9398877700 1 -- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f939415a090 msgr2=0x7f939414e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9398877700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f939415a090 0x7f939414e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:26.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9398877700 1 -- 172.21.15.69:0/385382539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93800094b0 con 0x7f9394070080 2023-11-17T06:34:26.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9399078700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f939415a090 0x7f939414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-17T06:34:26.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9398877700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 0x7f9394159000 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f938800c700 tx=0x7f938800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:26.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f93917fa700 1 -- 172.21.15.69:0/385382539 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388005d90 con 0x7f9394070080 2023-11-17T06:34:26.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f93917fa700 1 -- 172.21.15.69:0/385382539 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93880070d0 con 0x7f9394070080 2023-11-17T06:34:26.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f93917fa700 1 -- 172.21.15.69:0/385382539 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388007440 con 0x7f9394070080 2023-11-17T06:34:26.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9399879700 1 -- 172.21.15.69:0/385382539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93940c8660 con 0x7f9394070080 2023-11-17T06:34:26.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.570+0000 7f9399879700 1 -- 172.21.15.69:0/385382539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93940c8c20 con 0x7f9394070080 2023-11-17T06:34:26.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.574+0000 7f9399879700 1 -- 172.21.15.69:0/385382539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f939404e650 con 0x7f9394070080 2023-11-17T06:34:26.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.574+0000 7f93917fa700 1 -- 172.21.15.69:0/385382539 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f93880075a0 con 0x7f9394070080 2023-11-17T06:34:26.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.578+0000 7f93917fa700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9378066540 0x7f9378068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:26.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.578+0000 7f93917fa700 1 -- 172.21.15.69:0/385382539 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f9388082e00 con 0x7f9394070080 2023-11-17T06:34:26.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.578+0000 7f9393fff700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9378066540 0x7f9378068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:26.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.578+0000 7f9393fff700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9378066540 0x7f9378068a00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9380014040 tx=0x7f938001c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:26.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.582+0000 7f93917fa700 1 -- 172.21.15.69:0/385382539 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f9388050570 con 0x7f9394070080 2023-11-17T06:34:26.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.758+0000 7f9399879700 1 -- 172.21.15.69:0/385382539 --> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f939406d4f0 con 0x7f9378066540 2023-11-17T06:34:26.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.762+0000 7f93917fa700 1 -- 172.21.15.69:0/385382539 <== mgr.4105 v2:172.21.15.93:6800/1112302525 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48387 (secure 0 0 0) 0x7f9380011c00 con 0x7f9378066540 2023-11-17T06:34:26.770 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:34:26.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 -- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9378066540 msgr2=0x7f9378068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9378066540 0x7f9378068a00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9380014040 tx=0x7f938001c040 comp rx=0 tx=0).stop 2023-11-17T06:34:26.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 -- 172.21.15.69:0/385382539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 msgr2=0x7f9394159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 0x7f9394159000 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f938800c700 tx=0x7f938800ca10 comp rx=0 tx=0).stop 2023-11-17T06:34:26.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 -- 172.21.15.69:0/385382539 shutdown_connections 2023-11-17T06:34:26.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f9378066540 0x7f9378068a00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:26.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f939415a090 0x7f939414e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:26.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f9394071170 0x7f93940cdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:26.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 --2- 172.21.15.69:0/385382539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9394070080 0x7f9394159000 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:26.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 -- 172.21.15.69:0/385382539 >> 172.21.15.69:0/385382539 conn(0x7f93940cece0 msgr2=0x7f9394152f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:26.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 -- 172.21.15.69:0/385382539 shutdown_connections 2023-11-17T06:34:26.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.766+0000 7f9399879700 1 -- 172.21.15.69:0/385382539 wait complete. 2023-11-17T06:34:26.776 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-11-17T06:34:26.795 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2023-11-17T06:34:26.459742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":233760,"kb_used_data":5128,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740960,"statfs":{"total":773094113280,"available":772854743040,"internally_reserved":0,"allocated":5251072,"data_stored":2822400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":234016313},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003350"},"pg_stats":[{"pgid":"1.0","version":"44'119","reported_seq":195,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-11-17T06:34:04.586658+0000","last_change":"2023-11-17T06:34:04.586724+0000","last_active":"2023-11-17T06:34:04.586658+0000","last_peered":"2023-11-17T06:34:04.586658+0000","last_clean":"2023-11-17T06:34:04.586658+0000","last_became_active":"2023-11-17T06:29:48.031251+0000","last_became_peered":"2023-11-17T06:29:48.031251+0000","last_unstale":"2023-11-17T06:34:04.586658+0000","last_undegraded":"2023-11-17T06:34:04.586658+0000","last_fullsized":"2023-11-17T06:34:04.586658+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2023-11-17T06:34:04.586555+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2023-11-17T06:34:04.586555+0000","last_clean_scrub_stamp":"2023-11-17T06:34:04.586555+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-18T09:52:56.525562+0000","scrub_duration":0.011928434999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509498,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.1100000000000001,"15min":1.1399999999999999},"min":{"1min":0.67900000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.3839999999999999,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.516},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.111,"15min":1.135},"min":{"1min":0.746,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.8169999999999999,"5min":2.1150000000000002,"15min":2.1150000000000002},"last":1.008}]},{"osd":1,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0569999999999999,"5min":1.1619999999999999,"15min":1.204},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.3320000000000001,"5min":1.708,"15min":1.708},"last":1.423},{"interface":"front","average":{"1min":1.147,"5min":1.171,"15min":1.2110000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.514,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.212}]},{"osd":2,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.1299999999999999,"15min":1.139},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3360000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.238},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.284,"15min":1.3500000000000001},"min":{"1min":0.84299999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5700000000000001,"5min":2.173,"15min":2.173},"last":1.1719999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.2569999999999999,"15min":1.3029999999999999},"min":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.893,"5min":2.0910000000000002,"15min":2.0910000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.2829999999999999,"5min":1.365,"15min":1.4390000000000001},"min":{"1min":0.98299999999999998,"5min":0.878,"15min":0.878},"max":{"1min":1.5249999999999999,"5min":2.0289999999999999,"15min":2.0289999999999999},"last":1.569}]},{"osd":4,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.2050000000000001,"15min":1.3089999999999999},"min":{"1min":0.58899999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.6919999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.2589999999999999,"15min":1.3320000000000001},"min":{"1min":0.70599999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.865,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5449999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.3700000000000001,"15min":1.458},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.645,"5min":2.1040000000000001,"15min":2.1040000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.365,"15min":1.458},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7390000000000001,"5min":2.3490000000000002,"15min":2.3490000000000002},"last":1.2869999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.5089999999999999,"15min":1.6279999999999999},"min":{"1min":0.875,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.7809999999999999,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.304,"5min":1.415,"15min":1.4870000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.637,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.4790000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.1539999999999999,"15min":1.1879999999999999},"min":{"1min":0.59599999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6379999999999999,"5min":2.726,"15min":2.726},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.268,"15min":1.393},"min":{"1min":0.66700000000000004,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.556,"5min":6.3339999999999996,"15min":6.3339999999999996},"last":0.75700000000000001}]},{"osd":1,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.119,"15min":1.1240000000000001},"min":{"1min":0.72399999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.4450000000000001,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.23,"15min":1.1990000000000001},"min":{"1min":0.80400000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.468,"5min":1.708,"15min":1.708},"last":0.98999999999999999}]},{"osd":2,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.254,"15min":1.347},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.4410000000000001,"5min":2.7679999999999998,"15min":2.7679999999999998},"last":1.3140000000000001},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.272,"15min":1.3380000000000001},"min":{"1min":0.93700000000000006,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.6619999999999999,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.079}]},{"osd":3,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3009999999999999,"15min":1.3440000000000001},"min":{"1min":0.86499999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.6100000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":1.413},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.401,"15min":1.516},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5820000000000001,"5min":6.2210000000000001,"15min":6.2210000000000001},"last":1.2330000000000001}]},{"osd":4,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.2709999999999999,"15min":1.286},"min":{"1min":0.91900000000000004,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6240000000000001,"5min":1.9590000000000001,"15min":1.9590000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.266,"15min":1.333},"min":{"1min":0.873,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.5740000000000001,"5min":1.99,"15min":1.99},"last":1.1080000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.337,"15min":1.407},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.595,"5min":2.2389999999999999,"15min":2.2389999999999999},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.391,"5min":1.4259999999999999,"15min":1.4430000000000001},"min":{"1min":0.93000000000000005,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.6990000000000001,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.2949999999999999}]},{"osd":7,"last update":"Fri Nov 17 06:33:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.3759999999999999,"15min":1.464},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.554,"5min":2.1539999999999999,"15min":2.1539999999999999},"last":1.21},{"interface":"front","average":{"1min":1.393,"5min":1.4370000000000001,"15min":1.4970000000000001},"min":{"1min":0.90900000000000003,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.7490000000000001,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":1.262}]}]},{"osd":4,"up_from":15,"seq":64424509499,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.085,"15min":1.105},"min":{"1min":0.58999999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.595,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.872},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.121,"15min":1.1379999999999999},"min":{"1min":0.81699999999999995,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.381,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.98099999999999998}]},{"osd":1,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.1459999999999999,"15min":1.1379999999999999},"min":{"1min":0.80200000000000005,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.5409999999999999,"5min":1.744,"15min":1.744},"last":1.268},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2150000000000001,"15min":1.2629999999999999},"min":{"1min":0.76000000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5409999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.288}]},{"osd":2,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.216,"15min":1.2609999999999999},"min":{"1min":0.77500000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.6499999999999999,"5min":1.794,"15min":1.794},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.276,"15min":1.3080000000000001},"min":{"1min":0.89300000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.492,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.1639999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.254,"15min":1.3300000000000001},"min":{"1min":0.75700000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.456,"5min":2.7789999999999999,"15min":2.7789999999999999},"last":1.2290000000000001},{"interface":"front","average":{"1min":1.256,"5min":1.2629999999999999,"15min":1.2669999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.536,"5min":2.1920000000000002,"15min":2.1920000000000002},"last":1.0740000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.3169999999999999,"15min":1.393},"min":{"1min":0.70399999999999996,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.6870000000000001,"5min":2.3170000000000002,"15min":2.3170000000000002},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.3129999999999999,"15min":1.361},"min":{"1min":0.80600000000000005,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6240000000000001,"5min":2.411,"15min":2.411},"last":1.321}]},{"osd":6,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.3260000000000001,"15min":1.367},"min":{"1min":1.0649999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.5980000000000001,"5min":2.1160000000000001,"15min":2.1160000000000001},"last":1.347},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.4319999999999999,"15min":1.52},"min":{"1min":0.91500000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.7629999999999999,"5min":2.8679999999999999,"15min":2.8679999999999999},"last":1.4430000000000001}]},{"osd":7,"last update":"Fri Nov 17 06:33:51 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.2689999999999999,"15min":1.288},"min":{"1min":0.91100000000000003,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5469999999999999,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.379,"15min":1.415},"min":{"1min":1.0069999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"max":{"1min":1.696,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":1.411}]}]},{"osd":3,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31676,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.84199999999999997,"15min":0.88},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.2529999999999999,"5min":1.615,"15min":1.615},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.876,"5min":0.93300000000000005,"15min":0.96299999999999997},"min":{"1min":0.499,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3420000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":1.1379999999999999}]},{"osd":1,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89800000000000002,"15min":0.92000000000000004},"min":{"1min":0.627,"5min":0.441,"15min":0.441},"max":{"1min":1.474,"5min":1.474,"15min":1.474},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.038,"15min":1.052},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4059999999999999,"5min":1.671,"15min":1.671},"last":1.0700000000000001}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.1799999999999999,"15min":1.3169999999999999},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":1.732,"5min":4.2990000000000004,"15min":4.2990000000000004},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1040000000000001,"15min":1.1459999999999999},"min":{"1min":0.69099999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.377,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.016}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.3129999999999999,"15min":1.3560000000000001},"min":{"1min":1.0800000000000001,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.4850000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.2490000000000001,"15min":1.3029999999999999},"min":{"1min":0.89300000000000002,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.504,"5min":2.085,"15min":2.085},"last":1.3100000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3939999999999999,"15min":1.472},"min":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"max":{"1min":1.8899999999999999,"5min":2.2290000000000001,"15min":2.2290000000000001},"last":1.272},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.321,"15min":1.3660000000000001},"min":{"1min":0.90100000000000002,"5min":0.81699999999999995,"15min":0.81699999999999995},"max":{"1min":1.6319999999999999,"5min":2.1970000000000001,"15min":2.1970000000000001},"last":1.232}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.331,"15min":1.359},"min":{"1min":0.94699999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.8859999999999999,"5min":2.177,"15min":2.177},"last":1.109},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4550000000000001,"15min":1.494},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.819,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.369}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.359,"15min":1.3740000000000001},"min":{"1min":1.123,"5min":0.85199999999999998,"15min":0.85199999999999998},"max":{"1min":1.8560000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.3959999999999999,"15min":1.4179999999999999},"min":{"1min":0.97399999999999998,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7989999999999999,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.3440000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.93400000000000005,"15min":1.052},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1499999999999999,"5min":4.2469999999999999,"15min":4.2469999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":1.085,"15min":1.286},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.482,"5min":8.0510000000000002,"15min":8.0510000000000002},"last":0.89900000000000002}]},{"osd":1,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.92600000000000005,"15min":0.93999999999999995},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.2650000000000001,"5min":2.2650000000000001,"15min":2.2650000000000001},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.1379999999999999,"5min":1.22,"15min":1.288},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.302,"5min":4.5279999999999996,"15min":4.5279999999999996},"last":1.0820000000000001}]},{"osd":3,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":1.0509999999999999,"15min":1.1539999999999999},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.448,"5min":4.2960000000000003,"15min":4.2960000000000003},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.214,"15min":1.3380000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.774,"5min":4.2720000000000002,"15min":4.2720000000000002},"last":1.171}]},{"osd":4,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.3120000000000001,"15min":1.4059999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.6699999999999999,"5min":4.6280000000000001,"15min":4.6280000000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.4530000000000001,"15min":1.5609999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.833,"5min":4.6459999999999999,"15min":4.6459999999999999},"last":1.3180000000000001}]},{"osd":5,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.3240000000000001,"15min":1.369},"min":{"1min":0.98399999999999999,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.966,"5min":1.966,"15min":1.966},"last":1.423},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.4379999999999999,"15min":1.552},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.786,"5min":4.4420000000000002,"15min":4.4420000000000002},"last":1.129}]},{"osd":6,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.52,"15min":1.6599999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.881,"5min":4.5679999999999996,"15min":4.5679999999999996},"last":1.268},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.4039999999999999,"15min":1.48},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":1.827,"5min":2.218,"15min":2.218},"last":1.599}]},{"osd":7,"last update":"Fri Nov 17 06:33:55 2023","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4350000000000001,"15min":1.532},"min":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":2.0219999999999998,"5min":2.9969999999999999,"15min":2.9969999999999999},"last":1.345},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.486,"15min":1.5760000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":2.0990000000000002,"5min":2.6539999999999999,"15min":2.6539999999999999},"last":1.51}]}]},{"osd":1,"up_from":15,"seq":64424509498,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1101824,"data_stored":795576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.91100000000000003,"15min":0.96499999999999997},"min":{"1min":0.56999999999999995,"5min":0.505,"15min":0.505},"max":{"1min":1.891,"5min":4.0709999999999997,"15min":4.0709999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":1.0609999999999999,"15min":1.1870000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.429,"5min":4.7199999999999998,"15min":4.7199999999999998},"last":0.69999999999999996}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.222,"15min":1.4039999999999999},"min":{"1min":0.56100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.95,"5min":7.6180000000000003,"15min":7.6180000000000003},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.131,"5min":1.4139999999999999,"15min":1.6559999999999999},"min":{"1min":0.70599999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.9450000000000001,"5min":8.4649999999999999,"15min":8.4649999999999999},"last":1.1319999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.2490000000000001,"15min":1.415},"min":{"1min":0.67000000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0529999999999999,"5min":4.782,"15min":4.782},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.0669999999999999,"15min":1.1970000000000001},"min":{"1min":0.624,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2609999999999999,"5min":4.3079999999999998,"15min":4.3079999999999998},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.3029999999999999,"15min":1.4099999999999999},"min":{"1min":0.93300000000000005,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.8140000000000001,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":1.298},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.359,"15min":1.4690000000000001},"min":{"1min":0.80800000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":2.0059999999999998,"5min":4.3639999999999999,"15min":4.3639999999999999},"last":1.0629999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.417,"15min":1.5629999999999999},"min":{"1min":0.88100000000000001,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":2.0489999999999999,"5min":4.4180000000000001,"15min":4.4180000000000001},"last":1.198},{"interface":"front","average":{"1min":1.244,"5min":1.4139999999999999,"15min":1.548},"min":{"1min":0.91300000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.488,"5min":4.6479999999999997,"15min":4.6479999999999997},"last":1.0289999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.4139999999999999,"15min":1.554},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7549999999999999,"5min":4.5839999999999996,"15min":4.5839999999999996},"last":1.087},{"interface":"front","average":{"1min":1.397,"5min":1.5269999999999999,"15min":1.637},"min":{"1min":1.006,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":2.0899999999999999,"5min":4.2359999999999998,"15min":4.2359999999999998},"last":1.268}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.5189999999999999,"15min":1.673},"min":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.5600000000000001,"5min":4.6849999999999996,"15min":4.6849999999999996},"last":1.234},{"interface":"front","average":{"1min":1.343,"5min":1.482,"15min":1.625},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":1.7529999999999999,"5min":4.7469999999999999,"15min":4.7469999999999999},"last":1.1830000000000001}]}]},{"osd":0,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27516,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344324,"statfs":{"total":96636764160,"available":96608587776,"internally_reserved":0,"allocated":507904,"data_stored":205208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.85599999999999998,"15min":0.88800000000000001},"min":{"1min":0.58799999999999997,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4350000000000001,"5min":1.849,"15min":1.849},"last":1.105},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.91100000000000003,"15min":0.94499999999999995},"min":{"1min":0.499,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.228,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1.0529999999999999,"15min":1.115},"min":{"1min":0.60799999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.3149999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.177},{"interface":"front","average":{"1min":1.0860000000000001,"5min":1.1140000000000001,"15min":1.1519999999999999},"min":{"1min":0.70099999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.411,"5min":3.0339999999999998,"15min":3.0339999999999998},"last":1.0529999999999999}]},{"osd":3,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.94999999999999996,"15min":1.016},"min":{"1min":0.50800000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.343,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.131,"15min":1.226},"min":{"1min":0.59199999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.296,"5min":3.2549999999999999,"15min":3.2549999999999999},"last":1.238}]},{"osd":4,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.2549999999999999,"15min":1.333},"min":{"1min":0.88900000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.51,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":1.149},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.252,"15min":1.341},"min":{"1min":0.77200000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.373,"5min":3.2130000000000001,"15min":3.2130000000000001},"last":1.2849999999999999}]},{"osd":5,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.284,"15min":1.3979999999999999},"min":{"1min":0.879,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.4359999999999999,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":1.208},{"interface":"front","average":{"1min":1.218,"5min":1.345,"15min":1.4299999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":1.532,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":1.4239999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.45,"15min":1.546},"min":{"1min":1.0369999999999999,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":1.6120000000000001,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3939999999999999,"15min":1.492},"min":{"1min":0.88800000000000001,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.754,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":1.357}]},{"osd":7,"last update":"Fri Nov 17 06:33:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.4419999999999999,"15min":1.522},"min":{"1min":1.0820000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.599,"5min":3.5219999999999998,"15min":3.5219999999999998},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.264,"5min":1.4359999999999999,"15min":1.55},"min":{"1min":1.0669999999999999,"5min":0.95399999999999996,"15min":0.95399999999999996},"max":{"1min":1.5169999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.3400000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542203,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1101824,"data_stored":795576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.056,"15min":0.99399999999999999},"min":{"1min":0.627,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.407,"5min":1.5469999999999999,"15min":1.5469999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.081,"15min":1.0880000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.84299999999999997}]},{"osd":1,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.119,"15min":1.139},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.3440000000000001,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":1.294},{"interface":"front","average":{"1min":1.111,"5min":1.143,"15min":1.141},"min":{"1min":0.71399999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4159999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.109}]},{"osd":2,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.266,"15min":1.288},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":1.76},{"interface":"front","average":{"1min":1.165,"5min":1.2370000000000001,"15min":1.2709999999999999},"min":{"1min":0.76200000000000001,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.5149999999999999,"5min":1.649,"15min":1.649},"last":1.484}]},{"osd":3,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.21,"15min":1.2589999999999999},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.234,"15min":1.272},"min":{"1min":0.91900000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.571,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.571}]},{"osd":4,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.177,"15min":1.2230000000000001},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.4750000000000001,"5min":1.796,"15min":1.796},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.2869999999999999,"15min":1.323},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.639,"5min":1.8049999999999999,"15min":1.8049999999999999},"last":1.5249999999999999}]},{"osd":6,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.3029999999999999,"15min":1.355},"min":{"1min":0.82699999999999996,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":1.5920000000000001,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.7230000000000001},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.3160000000000001,"15min":1.361},"min":{"1min":0.90300000000000002,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.518,"5min":1.833,"15min":1.833},"last":1.331}]},{"osd":7,"last update":"Fri Nov 17 06:33:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.373,"15min":1.431},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.7390000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.653},{"interface":"front","average":{"1min":1.302,"5min":1.4259999999999999,"15min":1.4930000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.698,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.6319999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-17T06:34:26.797 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-17T06:34:26.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.950+0000 7f206d963700 1 Processor -- start 2023-11-17T06:34:26.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.950+0000 7f206d963700 1 -- start start 2023-11-17T06:34:26.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f206d963700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f206806cc90 0x7f206806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:26.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f206d963700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206806d630 con 0x7f20680b6580 2023-11-17T06:34:26.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f206d963700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20680d2340 con 0x7f206815d550 2023-11-17T06:34:26.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f206d963700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20680cf400 con 0x7f206806cc90 2023-11-17T06:34:26.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f20677fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f20680b6580 0x7f20680b6a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:35608/0 (socket says 172.21.15.69:35608) 2023-11-17T06:34:26.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f20677fe700 1 -- 172.21.15.69:0/2526722754 learned_addr learned my addr 172.21.15.69:0/2526722754 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-11-17T06:34:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f205e7fc700 1 --2- 172.21.15.69:0/2526722754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f206806cc90 0x7f206806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f20667fc700 1 -- 172.21.15.69:0/2526722754 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226261045 0 0) 0x7f206806d630 con 0x7f20680b6580 2023-11-17T06:34:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f20667fc700 1 -- 172.21.15.69:0/2526722754 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20540035d0 con 0x7f20680b6580 2023-11-17T06:34:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f20667fc700 1 -- 172.21.15.69:0/2526722754 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522664764 0 0) 0x7f20680d2340 con 0x7f206815d550 2023-11-17T06:34:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f20667fc700 1 -- 172.21.15.69:0/2526722754 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f206806d630 con 0x7f206815d550 2023-11-17T06:34:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f205e7fc700 1 -- 172.21.15.69:0/2526722754 >> v1:172.21.15.93:6789/0 conn(0x7f206815d550 legacy=0x7f20680d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f205e7fc700 1 -- 172.21.15.69:0/2526722754 >> v1:172.21.15.69:6789/0 conn(0x7f20680b6580 legacy=0x7f20680b6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.954+0000 7f205e7fc700 1 -- 172.21.15.69:0/2526722754 --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20680d1730 con 0x7f206806cc90 2023-11-17T06:34:26.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f205e7fc700 1 --2- 172.21.15.69:0/2526722754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f206806cc90 0x7f206806d0f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2050009880 tx=0x7f2050009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17c737df512ddf26 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:26.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f20667fc700 1 -- 172.21.15.69:0/2526722754 <== mon.2 v2:172.21.15.93:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050011830 con 0x7f206806cc90 2023-11-17T06:34:26.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f20667fc700 1 -- 172.21.15.69:0/2526722754 <== mon.2 v2:172.21.15.93:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2050011990 con 0x7f206806cc90 2023-11-17T06:34:26.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f20667fc700 1 -- 172.21.15.69:0/2526722754 <== mon.2 v2:172.21.15.93:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050011d00 con 0x7f206806cc90 2023-11-17T06:34:26.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f206d963700 1 -- 172.21.15.69:0/2526722754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f206806cc90 msgr2=0x7f206806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f206d963700 1 --2- 172.21.15.69:0/2526722754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f206806cc90 0x7f206806d0f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2050009880 tx=0x7f2050009b90 comp rx=0 tx=0).stop 2023-11-17T06:34:26.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f206d963700 1 -- 172.21.15.69:0/2526722754 shutdown_connections 2023-11-17T06:34:26.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f206d963700 1 --2- 172.21.15.69:0/2526722754 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f206806cc90 0x7f206806d0f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:26.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f206d963700 1 -- 172.21.15.69:0/2526722754 >> 172.21.15.69:0/2526722754 conn(0x7f20680b4cb0 msgr2=0x7f20680b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:26.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f206d963700 1 -- 172.21.15.69:0/2526722754 shutdown_connections 2023-11-17T06:34:26.966 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.958+0000 7f206d963700 1 -- 172.21.15.69:0/2526722754 wait complete. 2023-11-17T06:34:26.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f206d963700 1 Processor -- start 2023-11-17T06:34:26.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f206d963700 1 -- start start 2023-11-17T06:34:26.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f206d963700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f206806cc90 0x7f206806a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:26.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f206d963700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f20680b6580 0x7f206815e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:26.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f206d963700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f206815d550 0x7f2068155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:26.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f206d963700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20680cafc0 con 0x7f206815d550 2023-11-17T06:34:26.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f206d963700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206806ae00 con 0x7f206806cc90 2023-11-17T06:34:26.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f206d963700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20680cb260 con 0x7f20680b6580 2023-11-17T06:34:26.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f20677fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f206815d550 0x7f2068155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:26.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f20677fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f206815d550 0x7f2068155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42242/0 (socket says 172.21.15.69:42242) 2023-11-17T06:34:26.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f20677fe700 1 -- 172.21.15.69:0/691560908 learned_addr learned my addr 172.21.15.69:0/691560908 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:26.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f205e7fc700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f20680b6580 0x7f206815e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:26.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f2066ffd700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f206806cc90 0x7f206806a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:26.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f20677fe700 1 -- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f20680b6580 msgr2=0x7f206815e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f20677fe700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f20680b6580 0x7f206815e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f20677fe700 1 -- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f206806cc90 msgr2=0x7f206806a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.962+0000 7f20677fe700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f206806cc90 0x7f206806a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:26.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.966+0000 7f20677fe700 1 -- 172.21.15.69:0/691560908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20500094b0 con 0x7f206815d550 2023-11-17T06:34:26.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.966+0000 7f20677fe700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f206815d550 0x7f2068155190 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f206000cb40 tx=0x7f206000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:26.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.966+0000 7f2064ff9700 1 -- 172.21.15.69:0/691560908 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060007500 con 0x7f206815d550 2023-11-17T06:34:26.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.966+0000 7f2064ff9700 1 -- 172.21.15.69:0/691560908 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2060007680 con 0x7f206815d550 2023-11-17T06:34:26.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.966+0000 7f206d963700 1 -- 172.21.15.69:0/691560908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20680cb540 con 0x7f206815d550 2023-11-17T06:34:26.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.966+0000 7f2064ff9700 1 -- 172.21.15.69:0/691560908 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060007a30 con 0x7f206815d550 2023-11-17T06:34:26.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.966+0000 7f206d963700 1 -- 172.21.15.69:0/691560908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206806aa40 con 0x7f206815d550 2023-11-17T06:34:26.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.966+0000 7f206d963700 1 -- 172.21.15.69:0/691560908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20680cba60 con 0x7f206815d550 2023-11-17T06:34:26.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.970+0000 7f2064ff9700 1 -- 172.21.15.69:0/691560908 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7f206001b3b0 con 0x7f206815d550 2023-11-17T06:34:26.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.970+0000 7f2064ff9700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2048066510 0x7f20480689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:26.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.970+0000 7f2064ff9700 1 -- 172.21.15.69:0/691560908 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f2060083640 con 0x7f206815d550 2023-11-17T06:34:26.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.970+0000 7f2066ffd700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2048066510 0x7f20480689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:26.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.970+0000 7f2066ffd700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2048066510 0x7f20480689d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f20580017b0 tx=0x7f2058009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:26.983 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:26.978+0000 7f2064ff9700 1 -- 172.21.15.69:0/691560908 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7f20680cba60 con 0x7f206815d550 2023-11-17T06:34:27.162 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.154+0000 7f206d963700 1 -- 172.21.15.69:0/691560908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f20680cba60 con 0x7f206815d550 2023-11-17T06:34:27.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.162+0000 7f2064ff9700 1 -- 172.21.15.69:0/691560908 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f20680cba60 con 0x7f206815d550 2023-11-17T06:34:27.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.166+0000 7f2064ff9700 1 -- 172.21.15.69:0/691560908 <== mon.0 v2:172.21.15.69:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2060083030 con 0x7f206815d550 2023-11-17T06:34:27.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.166+0000 7f206d963700 1 -- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2048066510 msgr2=0x7f20480689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:27.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.166+0000 7f206d963700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2048066510 0x7f20480689d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f20580017b0 tx=0x7f2058009040 comp rx=0 tx=0).stop 2023-11-17T06:34:27.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.166+0000 7f206d963700 1 -- 172.21.15.69:0/691560908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f206815d550 msgr2=0x7f2068155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:27.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.166+0000 7f206d963700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f206815d550 0x7f2068155190 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f206000cb40 tx=0x7f206000cb70 comp rx=0 tx=0).stop 2023-11-17T06:34:27.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.170+0000 7f206d963700 1 -- 172.21.15.69:0/691560908 shutdown_connections 2023-11-17T06:34:27.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.170+0000 7f206d963700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7f2048066510 0x7f20480689d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.170+0000 7f206d963700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f206815d550 0x7f2068155190 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.170+0000 7f206d963700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7f20680b6580 0x7f206815e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.170+0000 7f206d963700 1 --2- 172.21.15.69:0/691560908 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f206806cc90 0x7f206806a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.170+0000 7f206d963700 1 -- 172.21.15.69:0/691560908 >> 172.21.15.69:0/691560908 conn(0x7f20680b4cb0 msgr2=0x7f20680b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:27.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.170+0000 7f206d963700 1 -- 172.21.15.69:0/691560908 shutdown_connections 2023-11-17T06:34:27.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.170+0000 7f206d963700 1 -- 172.21.15.69:0/691560908 wait complete. 2023-11-17T06:34:27.197 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-17T06:34:27.197 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-17T06:34:27.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe9dcb3700 1 Processor -- start 2023-11-17T06:34:27.367 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe9dcb3700 1 -- start start 2023-11-17T06:34:27.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe9dcb3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbe9806fe60 0x7fbe9815c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:27.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe9dcb3700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbe980cab00 0x7fbe980caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:27.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe9dcb3700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe980cb490 con 0x7fbe9815b2f0 2023-11-17T06:34:27.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe9dcb3700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9815f160 con 0x7fbe9806fe60 2023-11-17T06:34:27.370 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe9dcb3700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9815b6d0 con 0x7fbe980cab00 2023-11-17T06:34:27.371 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe96ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbe9806fe60 0x7fbe9815c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:27.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe96ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbe9806fe60 0x7fbe9815c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42248/0 (socket says 172.21.15.69:42248) 2023-11-17T06:34:27.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe96ffd700 1 -- 172.21.15.69:0/2023254961 learned_addr learned my addr 172.21.15.69:0/2023254961 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:27.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe977fe700 1 --1- 172.21.15.69:0/2023254961 >> v1:172.21.15.69:6789/0 conn(0x7fbe9815b2f0 0x7fbe9815f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:35610/0 (socket says 172.21.15.69:35610) 2023-11-17T06:34:27.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe97fff700 1 --2- 172.21.15.69:0/2023254961 >> v2:172.21.15.93:3300/0 conn(0x7fbe980cab00 0x7fbe980caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:27.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe96ffd700 1 -- 172.21.15.69:0/2023254961 >> v2:172.21.15.93:3300/0 conn(0x7fbe980cab00 msgr2=0x7fbe980caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-17T06:34:27.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe96ffd700 1 --2- 172.21.15.69:0/2023254961 >> v2:172.21.15.93:3300/0 conn(0x7fbe980cab00 0x7fbe980caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe96ffd700 1 -- 172.21.15.69:0/2023254961 >> v1:172.21.15.69:6789/0 conn(0x7fbe9815b2f0 legacy=0x7fbe9815f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:27.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe96ffd700 1 -- 172.21.15.69:0/2023254961 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9806db30 con 0x7fbe9806fe60 2023-11-17T06:34:27.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.362+0000 7fbe967fc700 1 -- 172.21.15.69:0/2023254961 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409627264 0 0) 0x7fbe880011d0 con 0x7fbe9815b2f0 2023-11-17T06:34:27.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe96ffd700 1 --2- 172.21.15.69:0/2023254961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 0x7fbe9815c2c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009910 tx=0x7fbe80009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f54a2bd5df6cfc server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:27.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe967fc700 1 -- 172.21.15.69:0/2023254961 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80011830 con 0x7fbe9806fe60 2023-11-17T06:34:27.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe967fc700 1 -- 172.21.15.69:0/2023254961 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbe80011990 con 0x7fbe9806fe60 2023-11-17T06:34:27.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe967fc700 1 -- 172.21.15.69:0/2023254961 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80011d60 con 0x7fbe9806fe60 2023-11-17T06:34:27.374 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/2023254961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 msgr2=0x7fbe9815c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:27.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe9dcb3700 1 --2- 172.21.15.69:0/2023254961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 0x7fbe9815c2c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbe80009910 tx=0x7fbe80009c20 comp rx=0 tx=0).stop 2023-11-17T06:34:27.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/2023254961 shutdown_connections 2023-11-17T06:34:27.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe9dcb3700 1 --2- 172.21.15.69:0/2023254961 >> v2:172.21.15.93:3300/0 conn(0x7fbe980cab00 0x7fbe980caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe9dcb3700 1 --2- 172.21.15.69:0/2023254961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 0x7fbe9815c2c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/2023254961 >> 172.21.15.69:0/2023254961 conn(0x7fbe980cee40 msgr2=0x7fbe980cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:27.375 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/2023254961 shutdown_connections 2023-11-17T06:34:27.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.366+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/2023254961 wait complete. 2023-11-17T06:34:27.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe9dcb3700 1 Processor -- start 2023-11-17T06:34:27.376 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe9dcb3700 1 -- start start 2023-11-17T06:34:27.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe9dcb3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 0x7fbe981594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:27.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe9dcb3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe980cab00 0x7fbe98159a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:27.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe9dcb3700 1 --2- >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbe9815b2f0 0x7fbe981e6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:27.377 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe9dcb3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe980c2b80 con 0x7fbe9806fe60 2023-11-17T06:34:27.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe9dcb3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe98159f40 con 0x7fbe980cab00 2023-11-17T06:34:27.378 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe9dcb3700 1 -- --> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9815a140 con 0x7fbe9815b2f0 2023-11-17T06:34:27.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 0x7fbe981594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:27.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe977fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 0x7fbe981594c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42260/0 (socket says 172.21.15.69:42260) 2023-11-17T06:34:27.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe977fe700 1 -- 172.21.15.69:0/333874556 learned_addr learned my addr 172.21.15.69:0/333874556 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-11-17T06:34:27.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe96ffd700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe980cab00 0x7fbe98159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:27.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe97fff700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbe9815b2f0 0x7fbe981e6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:27.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe977fe700 1 -- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbe9815b2f0 msgr2=0x7fbe981e6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:27.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe977fe700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbe9815b2f0 0x7fbe981e6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe977fe700 1 -- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe980cab00 msgr2=0x7fbe98159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:27.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe977fe700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe980cab00 0x7fbe98159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe977fe700 1 -- 172.21.15.69:0/333874556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe80009570 con 0x7fbe9806fe60 2023-11-17T06:34:27.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.370+0000 7fbe977fe700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 0x7fbe981594c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c700 tx=0x7fbe8800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:27.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.374+0000 7fbe8ffff700 1 -- 172.21.15.69:0/333874556 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe880074e0 con 0x7fbe9806fe60 2023-11-17T06:34:27.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.374+0000 7fbe8ffff700 1 -- 172.21.15.69:0/333874556 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fbe88007640 con 0x7fbe9806fe60 2023-11-17T06:34:27.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.374+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/333874556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe9815a420 con 0x7fbe9806fe60 2023-11-17T06:34:27.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.374+0000 7fbe8ffff700 1 -- 172.21.15.69:0/333874556 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88005ab0 con 0x7fbe9806fe60 2023-11-17T06:34:27.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.374+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/333874556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe980c3040 con 0x7fbe9806fe60 2023-11-17T06:34:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.374+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/333874556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe980c3230 con 0x7fbe9806fe60 2023-11-17T06:34:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.374+0000 7fbe8ffff700 1 -- 172.21.15.69:0/333874556 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 85850+0+0 (secure 0 0 0) 0x7fbe88005c10 con 0x7fbe9806fe60 2023-11-17T06:34:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.378+0000 7fbe8ffff700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbe78066510 0x7fbe780689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-17T06:34:27.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.378+0000 7fbe8ffff700 1 -- 172.21.15.69:0/333874556 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fbe88082ff0 con 0x7fbe9806fe60 2023-11-17T06:34:27.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.378+0000 7fbe96ffd700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbe78066510 0x7fbe780689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-17T06:34:27.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.378+0000 7fbe96ffd700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbe78066510 0x7fbe780689d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbe80014040 tx=0x7fbe80008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-17T06:34:27.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.382+0000 7fbe8ffff700 1 -- 172.21.15.69:0/333874556 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172159 (secure 0 0 0) 0x7fbe88050710 con 0x7fbe9806fe60 2023-11-17T06:34:27.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.590+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/333874556 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe980cb490 con 0x7fbe9806fe60 2023-11-17T06:34:27.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe8ffff700 1 -- 172.21.15.69:0/333874556 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3699 (secure 0 0 0) 0x7fbe980cb490 con 0x7fbe9806fe60 2023-11-17T06:34:27.599 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-11-17T06:34:27.599 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/4233438842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":4233438842},{"type":"v1","addr":"172.21.15.93:6835","nonce":4233438842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5075,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/1610247908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1610247908},{"type":"v1","addr":"172.21.15.93:6837","nonce":1610247908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":17},{"gid":5199,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6833/3385954124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":3385954124},{"type":"v1","addr":"172.21.15.69:6833","nonce":3385954124}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5877,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/1559729172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1559729172},{"type":"v1","addr":"172.21.15.69:6835","nonce":1559729172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[]} 2023-11-17T06:34:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbe78066510 msgr2=0x7fbe780689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbe78066510 0x7fbe780689d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbe80014040 tx=0x7fbe80008030 comp rx=0 tx=0).stop 2023-11-17T06:34:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/333874556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 msgr2=0x7fbe981594c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-17T06:34:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 0x7fbe981594c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c700 tx=0x7fbe8800cac0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/333874556 shutdown_connections 2023-11-17T06:34:27.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:6800/1112302525,v1:172.21.15.93:6801/1112302525] conn(0x7fbe78066510 0x7fbe780689d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:3301/0,v1:172.21.15.93:6790/0] conn(0x7fbe9815b2f0 0x7fbe981e6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe980cab00 0x7fbe98159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 --2- 172.21.15.69:0/333874556 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe9806fe60 0x7fbe981594c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-17T06:34:27.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/333874556 >> 172.21.15.69:0/333874556 conn(0x7fbe980cee40 msgr2=0x7fbe980cf970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-17T06:34:27.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/333874556 shutdown_connections 2023-11-17T06:34:27.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-11-17T06:34:27.594+0000 7fbe9dcb3700 1 -- 172.21.15.69:0/333874556 wait complete. 2023-11-17T06:34:27.604 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 30 2023-11-17T06:34:27.623 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-17T06:34:27.624 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-17T06:34:27.624 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-17T06:34:27.624 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:27.645 INFO:tasks.ceph.mds.a:Stopped 2023-11-17T06:34:27.645 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-17T06:34:27.645 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:27.712 INFO:tasks.ceph.mds.c:Stopped 2023-11-17T06:34:27.713 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-17T06:34:27.713 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:27.736 INFO:tasks.ceph.mds.b:Stopped 2023-11-17T06:34:27.736 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-17T06:34:27.736 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:27.806 INFO:tasks.ceph.mds.d:Stopped 2023-11-17T06:34:27.806 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-17T06:34:27.807 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-17T06:34:27.807 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:27.882 INFO:tasks.ceph.osd.0:Stopped 2023-11-17T06:34:27.883 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-17T06:34:27.883 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:29.430 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:29.437 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:33.924 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-17T06:34:33.985 INFO:tasks.ceph.osd.1:Stopped 2023-11-17T06:34:33.986 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-17T06:34:33.986 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:39.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-17T06:34:39.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-17T06:34:40.088 INFO:tasks.ceph.osd.2:Stopped 2023-11-17T06:34:40.089 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-17T06:34:40.089 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:45.840 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-17T06:34:45.841 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-17T06:34:46.191 INFO:tasks.ceph.osd.3:Stopped 2023-11-17T06:34:46.191 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-17T06:34:46.191 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:46.263 INFO:tasks.ceph.osd.4:Stopped 2023-11-17T06:34:46.263 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-17T06:34:46.264 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:46.353 INFO:tasks.ceph.osd.5:Stopped 2023-11-17T06:34:46.353 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-17T06:34:46.354 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:51.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-17T06:34:51.446 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-17T06:34:52.455 INFO:tasks.ceph.osd.6:Stopped 2023-11-17T06:34:52.456 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-17T06:34:52.456 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:52.539 INFO:tasks.ceph.osd.7:Stopped 2023-11-17T06:34:52.539 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-17T06:34:52.540 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-17T06:34:52.540 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:52.598 INFO:tasks.ceph.mgr.y:Stopped 2023-11-17T06:34:52.598 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-17T06:34:52.598 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:52.667 INFO:tasks.ceph.mgr.x:Stopped 2023-11-17T06:34:52.667 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-17T06:34:52.668 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-17T06:34:52.668 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:52.696 INFO:tasks.ceph.mon.a:Stopped 2023-11-17T06:34:52.697 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-17T06:34:52.697 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:52.727 INFO:tasks.ceph.mon.b:Stopped 2023-11-17T06:34:52.728 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-17T06:34:52.728 INFO:teuthology.orchestra.run:waiting for 300 2023-11-17T06:34:52.802 INFO:tasks.ceph.mon.c:Stopped 2023-11-17T06:34:52.803 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-17T06:34:52.803 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v 'inconsistent rstat on inode' | egrep -v 'Error recovering journal' | head -n 1 2023-11-17T06:34:52.856 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:34:52.856 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-17T06:34:53.117 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:34:53.117 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-17T06:34:53.286 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:34:53.287 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-17T06:34:53.517 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:34:53.518 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-17T06:34:53.672 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:34:53.672 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-17T06:34:53.910 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:34:53.910 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-17T06:34:54.110 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:34:54.111 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-17T06:34:54.334 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:34:54.334 DEBUG:teuthology.orchestra.run.smithi093:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-17T06:34:54.563 INFO:tasks.ceph:Archiving mon data... 2023-11-17T06:34:54.565 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341/data/mon.a.tgz 2023-11-17T06:34:54.566 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2023-11-17T06:34:54.586 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.guxSOM3tvz 2023-11-17T06:34:54.587 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.guxSOM3tvz 2023-11-17T06:34:54.761 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.guxSOM3tvz 2023-11-17T06:34:54.859 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.guxSOM3tvz is 355KB 2023-11-17T06:34:54.892 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.guxSOM3tvz 2023-11-17T06:34:54.907 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341/data/mon.b.tgz 2023-11-17T06:34:54.907 DEBUG:teuthology.orchestra.run.smithi093:> mktemp 2023-11-17T06:34:54.924 INFO:teuthology.orchestra.run.smithi093.stdout:/tmp/tmp.Mhfk2Cf9a8 2023-11-17T06:34:54.924 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Mhfk2Cf9a8 2023-11-17T06:34:55.114 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0666 /tmp/tmp.Mhfk2Cf9a8 2023-11-17T06:34:55.210 DEBUG:teuthology.orchestra.remote:smithi093:/tmp/tmp.Mhfk2Cf9a8 is 469KB 2023-11-17T06:34:55.290 DEBUG:teuthology.orchestra.run.smithi093:> rm -fr /tmp/tmp.Mhfk2Cf9a8 2023-11-17T06:34:55.310 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341/data/mon.c.tgz 2023-11-17T06:34:55.310 DEBUG:teuthology.orchestra.run.smithi093:> mktemp 2023-11-17T06:34:55.370 INFO:teuthology.orchestra.run.smithi093.stdout:/tmp/tmp.AEl3IMpmwm 2023-11-17T06:34:55.371 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.AEl3IMpmwm 2023-11-17T06:34:55.553 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 0666 /tmp/tmp.AEl3IMpmwm 2023-11-17T06:34:55.659 DEBUG:teuthology.orchestra.remote:smithi093:/tmp/tmp.AEl3IMpmwm is 469KB 2023-11-17T06:34:55.738 DEBUG:teuthology.orchestra.run.smithi093:> rm -fr /tmp/tmp.AEl3IMpmwm 2023-11-17T06:34:55.755 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-17T06:34:55.755 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-17T06:34:55.762 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-17T06:34:55.839 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-17T06:34:55.839 DEBUG:teuthology.orchestra.run.smithi069:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-17T06:34:55.846 DEBUG:teuthology.orchestra.run.smithi093:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-17T06:34:55.897 INFO:teuthology.orchestra.run.smithi069.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-17T06:34:55.935 INFO:teuthology.orchestra.run.smithi093.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-17T06:34:55.947 INFO:tasks.ceph:Archiving crash dumps... 2023-11-17T06:34:55.949 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341/remote/smithi069/crash 2023-11-17T06:34:55.950 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-17T06:34:55.988 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341/remote/smithi093/crash 2023-11-17T06:34:55.989 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-17T06:34:56.024 INFO:tasks.ceph:Shutting down logrotate 2023-11-17T06:34:56.025 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:56.041 DEBUG:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:56.176 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:56.211 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-17T06:34:56.245 INFO:tasks.ceph:Compressing logs... 2023-11-17T06:34:56.245 DEBUG:teuthology.orchestra.run.smithi069:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-17T06:34:56.261 DEBUG:teuthology.orchestra.run.smithi093:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-17T06:34:56.302 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43985.log 2023-11-17T06:34:56.303 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48584.log 2023-11-17T06:34:56.304 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48611.log 2023-11-17T06:34:56.305 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43985.log.gz 2023-11-17T06:34:56.307 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48584.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48584.log.gz 2023-11-17T06:34:56.307 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46667.log 2023-11-17T06:34:56.309 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43157.log 2023-11-17T06:34:56.310 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48611.log.gz 2023-11-17T06:34:56.311 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48484.log 2023-11-17T06:34:56.312 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46667.log: /var/log/ceph/ceph-client.admin.43157.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46667.log.gz 2023-11-17T06:34:56.312 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43157.log.gz 2023-11-17T06:34:56.315 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2023-11-17T06:34:56.315 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48152.log 2023-11-17T06:34:56.316 INFO:teuthology.orchestra.run.smithi069.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48484.log.gz 2023-11-17T06:34:56.316 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48098.log 2023-11-17T06:34:56.317 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47241.log: /var/log/ceph/ceph-client.admin.48152.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2023-11-17T06:34:56.318 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43628.log 2023-11-17T06:34:56.318 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48152.log.gz 2023-11-17T06:34:56.319 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48098.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48098.log.gz 2023-11-17T06:34:56.319 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45493.log 2023-11-17T06:34:56.320 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43628.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43628.log.gz 2023-11-17T06:34:56.321 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44893.log 2023-11-17T06:34:56.323 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-17T06:34:56.325 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45493.log: /var/log/ceph/ceph-client.admin.44893.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45493.log.gz 2023-11-17T06:34:56.325 INFO:teuthology.orchestra.run.smithi069.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44893.log.gz 2023-11-17T06:34:56.325 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45083.log 2023-11-17T06:34:56.326 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44012.log 2023-11-17T06:34:56.327 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45083.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45083.log.gz 2023-11-17T06:34:56.327 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42668.log 2023-11-17T06:34:56.328 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41616.log 2023-11-17T06:34:56.328 INFO:teuthology.orchestra.run.smithi069.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44012.log.gz 2023-11-17T06:34:56.329 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-17T06:34:56.330 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43715.log 2023-11-17T06:34:56.330 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42668.log.gz 2023-11-17T06:34:56.330 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-17T06:34:56.331 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41616.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41616.log.gz 2023-11-17T06:34:56.331 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44920.log 2023-11-17T06:34:56.332 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36746.log 2023-11-17T06:34:56.333 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43715.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43715.log.gz 2023-11-17T06:34:56.333 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48403.log 2023-11-17T06:34:56.334 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36538.log 2023-11-17T06:34:56.334 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44920.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44920.log.gz 2023-11-17T06:34:56.335 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47628.log 2023-11-17T06:34:56.336 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48403.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48403.log.gz 2023-11-17T06:34:56.336 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36511.log 2023-11-17T06:34:56.336 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.36746.log: /var/log/ceph/ceph-client.admin.36538.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36538.log.gz 2023-11-17T06:34:56.337 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44975.log 2023-11-17T06:34:56.337 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-17T06:34:56.337 INFO:teuthology.orchestra.run.smithi093.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36746.log.gz 2023-11-17T06:34:56.338 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48322.log 2023-11-17T06:34:56.339 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.36511.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-17T06:34:56.339 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36511.log.gz 2023-11-17T06:34:56.340 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47628.log: /var/log/ceph/ceph-client.admin.44975.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44975.log.gz 2023-11-17T06:34:56.340 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.47628.log.gz 2023-11-17T06:34:56.340 INFO:teuthology.orchestra.run.smithi069.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.46885.log 2023-11-17T06:34:56.341 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36721.log 2023-11-17T06:34:56.341 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46722.log 2023-11-17T06:34:56.341 INFO:teuthology.orchestra.run.smithi069.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48322.log.gz 2023-11-17T06:34:56.342 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46885.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46885.log.gz 2023-11-17T06:34:56.342 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44839.log 2023-11-17T06:34:56.343 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-17T06:34:56.343 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45439.log 2023-11-17T06:34:56.344 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46722.log.gz 2023-11-17T06:34:56.345 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.36721.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-17T06:34:56.345 INFO:teuthology.orchestra.run.smithi093.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36721.log.gz 2023-11-17T06:34:56.346 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44839.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44839.log.gz 2023-11-17T06:34:56.346 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-17T06:34:56.347 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49117.log 2023-11-17T06:34:56.347 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45439.log.gz 2023-11-17T06:34:56.347 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-17T06:34:56.348 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42449.log 2023-11-17T06:34:56.349 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41190.log 2023-11-17T06:34:56.350 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46483.log 2023-11-17T06:34:56.351 INFO:teuthology.orchestra.run.smithi069.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49117.log.gz 2023-11-17T06:34:56.352 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42449.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42449.log.gz 2023-11-17T06:34:56.352 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42444.log 2023-11-17T06:34:56.352 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-osd.6.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-17T06:34:56.353 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49063.log 2023-11-17T06:34:56.354 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.1.41190.log: 91.5% -- replaced with /var/log/ceph/ceph-client.1.41190.log.gz 2023-11-17T06:34:56.354 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.41301.log 2023-11-17T06:34:56.355 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46483.log: /var/log/ceph/ceph-client.admin.42444.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42444.log.gz 2023-11-17T06:34:56.355 INFO:teuthology.orchestra.run.smithi069.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.46483.log.gz 2023-11-17T06:34:56.355 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41847.log 2023-11-17T06:34:56.356 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-17T06:34:56.357 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49063.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49063.log.gz 2023-11-17T06:34:56.357 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42434.log 2023-11-17T06:34:56.358 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2023-11-17T06:34:56.359 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42434.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41847.log.gz 2023-11-17T06:34:56.360 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.3.41301.log: /var/log/ceph/ceph-mds.b.log: 92.1% -- replaced with /var/log/ceph/ceph-client.3.41301.log.gz 2023-11-17T06:34:56.360 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36457.log 2023-11-17T06:34:56.360 INFO:teuthology.orchestra.run.smithi069.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42434.log.gz 2023-11-17T06:34:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-11-17T06:34:56.362 INFO:teuthology.orchestra.run.smithi093.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-17T06:34:56.362 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36669.log 2023-11-17T06:34:56.363 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.36457.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36457.log.gz 2023-11-17T06:34:56.364 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42048.log 2023-11-17T06:34:56.364 INFO:teuthology.orchestra.run.smithi069.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2023-11-17T06:34:56.364 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47404.log 2023-11-17T06:34:56.365 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.36669.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36669.log.gz 2023-11-17T06:34:56.365 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-17T06:34:56.366 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42048.log: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-11-17T06:34:56.366 INFO:teuthology.orchestra.run.smithi069.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42048.log.gz 2023-11-17T06:34:56.366 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41911.log 2023-11-17T06:34:56.366 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42232.log 2023-11-17T06:34:56.367 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47404.log.gz 2023-11-17T06:34:56.367 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-17T06:34:56.368 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41911.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41911.log.gz 2023-11-17T06:34:56.368 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43655.log 2023-11-17T06:34:56.368 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41764.log 2023-11-17T06:34:56.369 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42232.log.gz 2023-11-17T06:34:56.369 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43655.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43655.log.gz 2023-11-17T06:34:56.370 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45601.log 2023-11-17T06:34:56.371 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41764.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41764.log.gz 2023-11-17T06:34:56.372 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46294.log 2023-11-17T06:34:56.372 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.4.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-17T06:34:56.372 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36483.log 2023-11-17T06:34:56.374 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45601.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45601.log.gz 2023-11-17T06:34:56.374 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42439.log 2023-11-17T06:34:56.374 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48007.log 2023-11-17T06:34:56.375 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36696.log 2023-11-17T06:34:56.375 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.36483.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36483.log.gz 2023-11-17T06:34:56.376 INFO:teuthology.orchestra.run.smithi069.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46294.log.gz 2023-11-17T06:34:56.376 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42439.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42439.log.gz 2023-11-17T06:34:56.376 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49171.log 2023-11-17T06:34:56.377 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-client.admin.36696.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36696.log.gz 2023-11-17T06:34:56.377 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.0.48007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44648.log 2023-11-17T06:34:56.377 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49171.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49171.log.gz 2023-11-17T06:34:56.378 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45939.log 2023-11-17T06:34:56.379 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43769.log 2023-11-17T06:34:56.379 INFO:teuthology.orchestra.run.smithi093.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-17T06:34:56.380 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz 2023-11-17T06:34:56.381 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45939.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45939.log.gz 2023-11-17T06:34:56.381 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48710.log 2023-11-17T06:34:56.382 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43769.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43769.log.gz 2023-11-17T06:34:56.382 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46858.log 2023-11-17T06:34:56.384 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.43586.log 2023-11-17T06:34:56.385 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48710.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48710.log.gz 2023-11-17T06:34:56.385 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46858.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46858.log.gz-5 2023-11-17T06:34:56.385 INFO:teuthology.orchestra.run.smithi069.stderr:--verbose -- /var/log/ceph/ceph-client.admin.42453.log 2023-11-17T06:34:56.387 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.2.43586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42670.log 2023-11-17T06:34:56.387 INFO:teuthology.orchestra.run.smithi069.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.2.43586.log.gz 2023-11-17T06:34:56.389 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43076.log 2023-11-17T06:34:56.389 INFO:teuthology.orchestra.run.smithi069.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42453.log.gz 2023-11-17T06:34:56.390 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42670.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42670.log.gz 2023-11-17T06:34:56.390 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48295.log 2023-11-17T06:34:56.392 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42968.log 2023-11-17T06:34:56.392 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43076.log.gz 2023-11-17T06:34:56.393 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48901.log 2023-11-17T06:34:56.393 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48295.log.gz 2023-11-17T06:34:56.395 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42968.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42968.log.gz 2023-11-17T06:34:56.395 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48638.log 2023-11-17T06:34:56.397 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45520.log 2023-11-17T06:34:56.397 INFO:teuthology.orchestra.run.smithi069.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48901.log.gz 2023-11-17T06:34:56.398 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48638.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48638.log.gz 2023-11-17T06:34:56.398 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48457.log 2023-11-17T06:34:56.399 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45520.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-17T06:34:56.400 INFO:teuthology.orchestra.run.smithi069.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.48007.log.gz 2023-11-17T06:34:56.400 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45520.log.gz 2023-11-17T06:34:56.400 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48457.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48457.log.gz 2023-11-17T06:34:56.401 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45547.log 2023-11-17T06:34:56.402 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42238.log 2023-11-17T06:34:56.404 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45547.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45547.log.gz 2023-11-17T06:34:56.404 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48241.log 2023-11-17T06:34:56.405 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42238.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42238.log.gz 2023-11-17T06:34:56.406 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41938.log 2023-11-17T06:34:56.406 INFO:teuthology.orchestra.run.smithi069.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-17T06:34:56.407 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48241.log: 91.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-17T06:34:56.407 INFO:teuthology.orchestra.run.smithi069.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48241.log.gz 2023-11-17T06:34:56.408 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42451.log 2023-11-17T06:34:56.409 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49305.log 2023-11-17T06:34:56.409 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41938.log.gz 2023-11-17T06:34:56.410 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42451.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42451.log.gz 2023-11-17T06:34:56.410 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42237.log 2023-11-17T06:34:56.412 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49305.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49305.log.gz 2023-11-17T06:34:56.412 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42183.log 2023-11-17T06:34:56.413 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42237.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42237.log.gz 2023-11-17T06:34:56.413 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47458.log 2023-11-17T06:34:56.414 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47948.log 2023-11-17T06:34:56.415 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42183.log.gz 2023-11-17T06:34:56.415 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48847.log 2023-11-17T06:34:56.416 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47458.log.gz 2023-11-17T06:34:56.417 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47948.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47948.log.gz 2023-11-17T06:34:56.417 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48071.log 2023-11-17T06:34:56.419 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48847.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48847.log.gz 2023-11-17T06:34:56.419 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41965.log 2023-11-17T06:34:56.420 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47725.log 2023-11-17T06:34:56.421 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48071.log.gz 2023-11-17T06:34:56.421 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43447.log 2023-11-17T06:34:56.422 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41965.log.gz 2023-11-17T06:34:56.422 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49225.log 2023-11-17T06:34:56.424 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.0.43447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44756.log 2023-11-17T06:34:56.424 INFO:teuthology.orchestra.run.smithi069.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.43447.log.gz 2023-11-17T06:34:56.426 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49225.log: gzip -5 88.2%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49225.log.gz/var/log/ceph/ceph-client.admin.36320.log 2023-11-17T06:34:56.426 INFO:teuthology.orchestra.run.smithi069.stderr: 2023-11-17T06:34:56.428 INFO:teuthology.orchestra.run.smithi069.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.47725.log.gz 2023-11-17T06:34:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44756.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44756.log.gz 2023-11-17T06:34:56.428 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44594.log 2023-11-17T06:34:56.429 INFO:teuthology.orchestra.run.smithi093.stderr:/var/log/ceph/ceph-osd.7.log: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-17T06:34:56.430 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.36320.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36320.log.gz 2023-11-17T06:34:56.430 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2023-11-17T06:34:56.431 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47044.log 2023-11-17T06:34:56.435 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44594.log.gz 2023-11-17T06:34:56.435 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45115.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2023-11-17T06:34:56.435 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43211.log 2023-11-17T06:34:56.435 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46186.log 2023-11-17T06:34:56.435 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47044.log: /var/log/ceph/ceph-client.admin.43211.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43211.log.gz 2023-11-17T06:34:56.436 INFO:teuthology.orchestra.run.smithi069.stderr:gzip 89.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.47044.log.gz--verbose 2023-11-17T06:34:56.436 INFO:teuthology.orchestra.run.smithi069.stderr:-- /var/log/ceph/ceph-client.admin.45331.log 2023-11-17T06:34:56.437 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46186.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46186.log.gz 2023-11-17T06:34:56.437 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43022.log 2023-11-17T06:34:56.438 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47513.log 2023-11-17T06:34:56.438 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45331.log.gz 2023-11-17T06:34:56.439 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43022.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43022.log.gz 2023-11-17T06:34:56.439 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42665.log 2023-11-17T06:34:56.440 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45684.log 2023-11-17T06:34:56.440 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47513.log.gz 2023-11-17T06:34:56.441 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42665.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42665.log.gz 2023-11-17T06:34:56.441 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47777.log 2023-11-17T06:34:56.443 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45993.log 2023-11-17T06:34:56.443 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45684.log.gz 2023-11-17T06:34:56.444 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47777.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47777.log.gz 2023-11-17T06:34:56.444 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43184.log 2023-11-17T06:34:56.445 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44481.log 2023-11-17T06:34:56.445 INFO:teuthology.orchestra.run.smithi069.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45993.log.gz 2023-11-17T06:34:56.446 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36588.log 2023-11-17T06:34:56.446 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43184.log.gz 2023-11-17T06:34:56.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-17T06:34:56.448 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44481.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44481.log.gz 2023-11-17T06:34:56.448 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42941.log 2023-11-17T06:34:56.449 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.36588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47752.log 2023-11-17T06:34:56.450 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36588.log.gz 2023-11-17T06:34:56.451 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46020.log 2023-11-17T06:34:56.452 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42941.log: /var/log/ceph/ceph-client.admin.47752.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42941.log.gz 2023-11-17T06:34:56.452 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45757.log 2023-11-17T06:34:56.453 INFO:teuthology.orchestra.run.smithi069.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47752.log.gz 2023-11-17T06:34:56.453 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46020.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-17T06:34:56.453 INFO:teuthology.orchestra.run.smithi069.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46020.log.gz 2023-11-17T06:34:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45757.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45757.log.gz 2023-11-17T06:34:56.455 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43491.log 2023-11-17T06:34:56.456 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44508.log 2023-11-17T06:34:56.458 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45250.log 2023-11-17T06:34:56.458 INFO:teuthology.orchestra.run.smithi069.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43491.log.gz 2023-11-17T06:34:56.458 INFO:teuthology.orchestra.run.smithi069.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-17T06:34:56.459 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2023-11-17T06:34:56.459 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44508.log.gz 2023-11-17T06:34:56.460 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45250.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45250.log.gz 2023-11-17T06:34:56.460 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42454.log 2023-11-17T06:34:56.461 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44066.log 2023-11-17T06:34:56.462 INFO:teuthology.orchestra.run.smithi069.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2023-11-17T06:34:56.462 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42454.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42454.log.gz 2023-11-17T06:34:56.463 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48683.log 2023-11-17T06:34:56.464 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45223.log 2023-11-17T06:34:56.464 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44066.log.gz 2023-11-17T06:34:56.465 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48683.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48683.log.gz 2023-11-17T06:34:56.465 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41682.log 2023-11-17T06:34:56.466 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46749.log 2023-11-17T06:34:56.466 INFO:teuthology.orchestra.run.smithi069.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45223.log.gz 2023-11-17T06:34:56.467 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41682.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41682.log.gz 2023-11-17T06:34:56.468 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2023-11-17T06:34:56.469 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46749.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31466.log 2023-11-17T06:34:56.469 INFO:teuthology.orchestra.run.smithi069.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46749.log.gz 2023-11-17T06:34:56.470 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44621.log 2023-11-17T06:34:56.470 INFO:teuthology.orchestra.run.smithi069.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz 2023-11-17T06:34:56.471 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph.tmp-client.admin.31466.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31466.log.gz 2023-11-17T06:34:56.471 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48737.log 2023-11-17T06:34:56.473 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44621.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44621.log.gz 2023-11-17T06:34:56.473 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48928.log 2023-11-17T06:34:56.474 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46429.log 2023-11-17T06:34:56.475 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48737.log.gz 2023-11-17T06:34:56.475 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45358.log 2023-11-17T06:34:56.475 INFO:teuthology.orchestra.run.smithi069.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48928.log.gz 2023-11-17T06:34:56.476 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46429.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46429.log.gz 2023-11-17T06:34:56.477 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49009.log 2023-11-17T06:34:56.478 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46939.log 2023-11-17T06:34:56.479 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45358.log.gz 2023-11-17T06:34:56.479 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49009.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49009.log.gz 2023-11-17T06:34:56.480 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41709.log 2023-11-17T06:34:56.481 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46456.log 2023-11-17T06:34:56.481 INFO:teuthology.orchestra.run.smithi069.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46939.log.gz 2023-11-17T06:34:56.482 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41709.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41709.log.gz 2023-11-17T06:34:56.482 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47106.log 2023-11-17T06:34:56.483 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46456.log: gzip -5 88.4%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.46456.log.gz 2023-11-17T06:34:56.483 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48874.log 2023-11-17T06:34:56.484 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47106.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47106.log.gz 2023-11-17T06:34:56.484 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47133.log 2023-11-17T06:34:56.485 INFO:teuthology.orchestra.run.smithi093.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-17T06:34:56.485 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47870.log 2023-11-17T06:34:56.486 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48874.log.gz 2023-11-17T06:34:56.487 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42221.log 2023-11-17T06:34:56.487 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47133.log.gz 2023-11-17T06:34:56.488 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43130.log 2023-11-17T06:34:56.489 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47870.log.gz 2023-11-17T06:34:56.489 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47069.log 2023-11-17T06:34:56.490 INFO:teuthology.orchestra.run.smithi069.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42221.log.gz 2023-11-17T06:34:56.491 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43130.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43130.log.gz 2023-11-17T06:34:56.491 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48430.log 2023-11-17T06:34:56.492 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47069.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47069.log.gz 2023-11-17T06:34:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42671.log 2023-11-17T06:34:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2023-11-17T06:34:56.494 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42671.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48430.log.gz 2023-11-17T06:34:56.495 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42671.log.gz 2023-11-17T06:34:56.495 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45574.log 2023-11-17T06:34:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44039.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2023-11-17T06:34:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44783.log 2023-11-17T06:34:56.498 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45574.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45574.log.gz 2023-11-17T06:34:56.498 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46348.log 2023-11-17T06:34:56.499 INFO:teuthology.orchestra.run.smithi069.stderr:gzip /var/log/ceph/ceph-client.admin.44783.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45858.log 2023-11-17T06:34:56.499 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44783.log.gz 2023-11-17T06:34:56.500 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46348.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46348.log.gz 2023-11-17T06:34:56.501 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47350.log 2023-11-17T06:34:56.501 INFO:teuthology.orchestra.run.smithi093.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-17T06:34:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45858.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45858.log.gz 2023-11-17T06:34:56.503 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48214.log 2023-11-17T06:34:56.504 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47350.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47350.log.gz 2023-11-17T06:34:56.504 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45466.log 2023-11-17T06:34:56.505 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48214.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48214.log.gz 2023-11-17T06:34:56.506 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48557.log 2023-11-17T06:34:56.507 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46912.log 2023-11-17T06:34:56.507 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45466.log.gz 2023-11-17T06:34:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48557.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48557.log.gz 2023-11-17T06:34:56.509 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42860.log 2023-11-17T06:34:56.510 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47897.log 2023-11-17T06:34:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46912.log: /var/log/ceph/ceph-client.admin.42860.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46912.log.gz 2023-11-17T06:34:56.512 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42860.log.gz 2023-11-17T06:34:56.512 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45169.log 2023-11-17T06:34:56.513 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44729.log 2023-11-17T06:34:56.513 INFO:teuthology.orchestra.run.smithi069.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47897.log.gz 2023-11-17T06:34:56.515 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45169.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45169.log.gz 2023-11-17T06:34:56.515 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47486.log 2023-11-17T06:34:56.516 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44729.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2023-11-17T06:34:56.517 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47300.log 2023-11-17T06:34:56.519 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41876.log 2023-11-17T06:34:56.519 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47486.log.gz 2023-11-17T06:34:56.520 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.0.47300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44291.log 2023-11-17T06:34:56.521 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46128.log 2023-11-17T06:34:56.521 INFO:teuthology.orchestra.run.smithi069.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41876.log.gz 2023-11-17T06:34:56.522 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44291.log: 88.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.44291.log.gz 2023-11-17T06:34:56.523 INFO:teuthology.orchestra.run.smithi069.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.46074.log 2023-11-17T06:34:56.524 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46128.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-17T06:34:56.524 INFO:teuthology.orchestra.run.smithi069.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46128.log.gz 2023-11-17T06:34:56.525 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46074.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46074.log.gz 2023-11-17T06:34:56.525 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2023-11-17T06:34:56.526 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45966.log 2023-11-17T06:34:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45385.log 2023-11-17T06:34:56.528 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2023-11-17T06:34:56.529 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45966.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45966.log.gz 2023-11-17T06:34:56.530 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45730.log 2023-11-17T06:34:56.531 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36469.log 2023-11-17T06:34:56.532 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45730.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45385.log.gz 2023-11-17T06:34:56.532 INFO:teuthology.orchestra.run.smithi069.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45730.log.gz 2023-11-17T06:34:56.533 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47697.log 2023-11-17T06:34:56.533 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.36469.log: 94.5% -- replaced with /var/log/ceph/ceph-client.0.47300.log.gz 2023-11-17T06:34:56.534 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36469.log.gz 2023-11-17T06:34:56.534 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47652.log 2023-11-17T06:34:56.535 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46402.log 2023-11-17T06:34:56.537 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44318.log 2023-11-17T06:34:56.538 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46402.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46402.log.gz 2023-11-17T06:34:56.539 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43904.log 2023-11-17T06:34:56.540 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42228.log 2023-11-17T06:34:56.540 INFO:teuthology.orchestra.run.smithi069.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.47652.log.gz 2023-11-17T06:34:56.541 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44318.log.gz 2023-11-17T06:34:56.541 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43904.log: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.47697.log.gz 2023-11-17T06:34:56.542 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44567.log 2023-11-17T06:34:56.542 INFO:teuthology.orchestra.run.smithi069.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43904.log.gz 2023-11-17T06:34:56.543 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42224.log 2023-11-17T06:34:56.543 INFO:teuthology.orchestra.run.smithi069.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42228.log.gz 2023-11-17T06:34:56.546 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44567.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44567.log.gz 2023-11-17T06:34:56.546 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47841.log 2023-11-17T06:34:56.546 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46101.log 2023-11-17T06:34:56.546 INFO:teuthology.orchestra.run.smithi069.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42224.log.gz 2023-11-17T06:34:56.547 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46267.log 88.7% 2023-11-17T06:34:56.547 INFO:teuthology.orchestra.run.smithi069.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47841.log.gz 2023-11-17T06:34:56.547 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45277.log 2023-11-17T06:34:56.548 INFO:teuthology.orchestra.run.smithi069.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46101.log.gz 2023-11-17T06:34:56.548 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46267.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46267.log.gz-5 2023-11-17T06:34:56.549 INFO:teuthology.orchestra.run.smithi069.stderr:--verbose -- /var/log/ceph/ceph-client.admin.46157.log 2023-11-17T06:34:56.550 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41525.log 2023-11-17T06:34:56.550 INFO:teuthology.orchestra.run.smithi069.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45277.log.gz 2023-11-17T06:34:56.551 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46157.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46157.log.gz 2023-11-17T06:34:56.551 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48820.log 2023-11-17T06:34:56.552 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48376.log 2023-11-17T06:34:56.552 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41525.log.gz 2023-11-17T06:34:56.553 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48820.log: gzip -5 --verbose 87.9%-- /var/log/ceph/ceph-client.admin.44675.log -- replaced with /var/log/ceph/ceph-client.admin.48820.log.gz 2023-11-17T06:34:56.553 INFO:teuthology.orchestra.run.smithi069.stderr: 2023-11-17T06:34:56.554 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45657.log 2023-11-17T06:34:56.555 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48376.log.gz 2023-11-17T06:34:56.556 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2023-11-17T06:34:56.556 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44675.log.gz 2023-11-17T06:34:56.557 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45657.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45657.log.gz 2023-11-17T06:34:56.557 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43796.log 2023-11-17T06:34:56.558 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47431.log 2023-11-17T06:34:56.558 INFO:teuthology.orchestra.run.smithi069.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2023-11-17T06:34:56.559 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43796.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43796.log.gz 2023-11-17T06:34:56.559 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42227.log 2023-11-17T06:34:56.560 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47431.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47431.log.gz 2023-11-17T06:34:56.560 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42075.log 2023-11-17T06:34:56.561 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42227.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42227.log.gz 2023-11-17T06:34:56.561 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44149.log 2023-11-17T06:34:56.562 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42075.log: gzip 88.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.42075.log.gz--verbose 2023-11-17T06:34:56.562 INFO:teuthology.orchestra.run.smithi069.stderr:-- /var/log/ceph/ceph-client.admin.44203.log 2023-11-17T06:34:56.563 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44230.log 2023-11-17T06:34:56.564 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44149.log.gz 2023-11-17T06:34:56.564 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44203.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44203.log.gz 2023-11-17T06:34:56.565 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49036.log 2023-11-17T06:34:56.566 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42672.log 2023-11-17T06:34:56.566 INFO:teuthology.orchestra.run.smithi069.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44230.log.gz 2023-11-17T06:34:56.567 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49036.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49036.log.gz 2023-11-17T06:34:56.567 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46998.log 2023-11-17T06:34:56.568 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42672.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42672.log.gz 2023-11-17T06:34:56.569 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45790.log 2023-11-17T06:34:56.570 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43823.log 2023-11-17T06:34:56.570 INFO:teuthology.orchestra.run.smithi069.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46998.log.gz 2023-11-17T06:34:56.571 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45790.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45790.log.gz 2023-11-17T06:34:56.571 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49253.log 2023-11-17T06:34:56.572 INFO:teuthology.orchestra.run.smithi093.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-17T06:34:56.572 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43850.log 2023-11-17T06:34:56.573 INFO:teuthology.orchestra.run.smithi069.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43823.log.gz 2023-11-17T06:34:56.573 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49253.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49253.log.gz 2023-11-17T06:34:56.574 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45304.log 2023-11-17T06:34:56.574 INFO:teuthology.orchestra.run.smithi093.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-17T06:34:56.575 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2023-11-17T06:34:56.575 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43850.log.gz 2023-11-17T06:34:56.576 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41737.log 2023-11-17T06:34:56.576 INFO:teuthology.orchestra.run.smithi069.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45304.log.gz 2023-11-17T06:34:56.577 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43049.log 2023-11-17T06:34:56.577 INFO:teuthology.orchestra.run.smithi069.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2023-11-17T06:34:56.579 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46047.log 2023-11-17T06:34:56.579 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41737.log.gz 2023-11-17T06:34:56.580 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47814.log 2023-11-17T06:34:56.580 INFO:teuthology.orchestra.run.smithi069.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43049.log.gz 2023-11-17T06:34:56.581 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46047.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46047.log.gz 2023-11-17T06:34:56.581 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46694.log 2023-11-17T06:34:56.583 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47814.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47814.log.gz 2023-11-17T06:34:56.583 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49144.log 2023-11-17T06:34:56.583 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46694.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46694.log.gz 2023-11-17T06:34:56.584 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44535.log 2023-11-17T06:34:56.585 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46240.log 2023-11-17T06:34:56.585 INFO:teuthology.orchestra.run.smithi069.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49144.log.gz 2023-11-17T06:34:56.586 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44535.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44535.log.gz 2023-11-17T06:34:56.586 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42234.log 2023-11-17T06:34:56.587 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42156.log 2023-11-17T06:34:56.588 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46240.log.gz 2023-11-17T06:34:56.589 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42234.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42234.log.gz 2023-11-17T06:34:56.589 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41818.log 2023-11-17T06:34:56.590 INFO:teuthology.orchestra.run.smithi093.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-17T06:34:56.591 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46598.log 2023-11-17T06:34:56.591 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42156.log.gz 2023-11-17T06:34:56.592 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41818.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41818.log.gz 2023-11-17T06:34:56.592 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48125.log 2023-11-17T06:34:56.593 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.0.46598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46321.log 2023-11-17T06:34:56.595 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45912.log 2023-11-17T06:34:56.595 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48125.log.gz 2023-11-17T06:34:56.596 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42995.log 2023-11-17T06:34:56.597 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46321.log.gz 2023-11-17T06:34:56.597 INFO:teuthology.orchestra.run.smithi093.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-17T06:34:56.598 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41582.log 2023-11-17T06:34:56.598 INFO:teuthology.orchestra.run.smithi069.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45912.log.gz 2023-11-17T06:34:56.600 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48955.log 2023-11-17T06:34:56.600 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42995.log.gz 2023-11-17T06:34:56.601 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42452.log 2023-11-17T06:34:56.601 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41582.log.gz 2023-11-17T06:34:56.602 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48955.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48955.log.gz 2023-11-17T06:34:56.603 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44947.log 2023-11-17T06:34:56.603 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42452.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42452.log.gz 2023-11-17T06:34:56.604 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46803.log 2023-11-17T06:34:56.605 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2023-11-17T06:34:56.605 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44947.log.gz 2023-11-17T06:34:56.607 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46803.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.46803.log.gz-5 2023-11-17T06:34:56.607 INFO:teuthology.orchestra.run.smithi069.stderr:--verbose -- /var/log/ceph/ceph-client.admin.47162.log 2023-11-17T06:34:56.608 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45056.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2023-11-17T06:34:56.608 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48766.log 2023-11-17T06:34:56.609 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45885.log 2023-11-17T06:34:56.610 INFO:teuthology.orchestra.run.smithi069.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47162.log.gz 2023-11-17T06:34:56.611 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42129.log 2023-11-17T06:34:56.611 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48766.log.gz 2023-11-17T06:34:56.612 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45885.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45885.log.gz 2023-11-17T06:34:56.612 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-17T06:34:56.614 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46375.log 2023-11-17T06:34:56.614 INFO:teuthology.orchestra.run.smithi069.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42129.log.gz 2023-11-17T06:34:56.615 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42644.log 2023-11-17T06:34:56.617 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46375.log: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-17T06:34:56.617 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42914.log 2023-11-17T06:34:56.617 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46375.log.gz 2023-11-17T06:34:56.618 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42657.log 2023-11-17T06:34:56.618 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42644.log.gz 2023-11-17T06:34:56.620 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42914.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42914.log.gz 2023-11-17T06:34:56.620 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47567.log 2023-11-17T06:34:56.622 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42657.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42657.log.gz 2023-11-17T06:34:56.622 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-17T06:34:56.622 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44810.log 2023-11-17T06:34:56.623 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47567.log.gz 2023-11-17T06:34:56.624 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45628.log 2023-11-17T06:34:56.626 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44122.log 2023-11-17T06:34:56.627 INFO:teuthology.orchestra.run.smithi069.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44810.log.gz 2023-11-17T06:34:56.627 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45002.log 2023-11-17T06:34:56.627 INFO:teuthology.orchestra.run.smithi069.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45628.log.gz 2023-11-17T06:34:56.629 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43877.log 2023-11-17T06:34:56.629 INFO:teuthology.orchestra.run.smithi069.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44122.log.gz 2023-11-17T06:34:56.630 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45002.log: gzip 88.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.45002.log.gz--verbose 2023-11-17T06:34:56.630 INFO:teuthology.orchestra.run.smithi069.stderr:-- /var/log/ceph/ceph-client.admin.44427.log 2023-11-17T06:34:56.632 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48179.log 2023-11-17T06:34:56.632 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43877.log.gz 2023-11-17T06:34:56.633 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43688.log 2023-11-17T06:34:56.634 INFO:teuthology.orchestra.run.smithi069.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44427.log.gz 2023-11-17T06:34:56.635 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48179.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48179.log.gzgzip 2023-11-17T06:34:56.635 INFO:teuthology.orchestra.run.smithi069.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.41791.log 2023-11-17T06:34:56.636 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49198.log 2023-11-17T06:34:56.637 INFO:teuthology.orchestra.run.smithi069.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43688.log.gz 2023-11-17T06:34:56.638 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41994.log 2023-11-17T06:34:56.638 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41791.log.gz 2023-11-17T06:34:56.638 INFO:teuthology.orchestra.run.smithi093.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-17T06:34:56.640 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48511.log 2023-11-17T06:34:56.640 INFO:teuthology.orchestra.run.smithi069.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49198.log.gz 2023-11-17T06:34:56.641 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.41994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43238.log 2023-11-17T06:34:56.641 INFO:teuthology.orchestra.run.smithi069.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41994.log.gz 2023-11-17T06:34:56.643 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45412.log 2023-11-17T06:34:56.643 INFO:teuthology.orchestra.run.smithi069.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48511.log.gz 2023-11-17T06:34:56.644 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47022.log 2023-11-17T06:34:56.644 INFO:teuthology.orchestra.run.smithi069.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43238.log.gz 2023-11-17T06:34:56.645 INFO:teuthology.orchestra.run.smithi093.stderr: 2023-11-17T06:34:56.645 INFO:teuthology.orchestra.run.smithi093.stderr:real 0m0.343s 2023-11-17T06:34:56.645 INFO:teuthology.orchestra.run.smithi093.stderr:user 0m1.458s 2023-11-17T06:34:56.645 INFO:teuthology.orchestra.run.smithi093.stderr:sys 0m0.262s 2023-11-17T06:34:56.646 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42663.log 2023-11-17T06:34:56.647 INFO:teuthology.orchestra.run.smithi069.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45412.log.gz 2023-11-17T06:34:56.647 INFO:teuthology.orchestra.run.smithi069.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.0.46598.log.gz 2023-11-17T06:34:56.647 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48982.log 2023-11-17T06:34:56.648 INFO:teuthology.orchestra.run.smithi069.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47022.log.gz 2023-11-17T06:34:56.648 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42663.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42663.log.gz 2023-11-17T06:34:56.649 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47377.log 2023-11-17T06:34:56.650 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43322.log 2023-11-17T06:34:56.650 INFO:teuthology.orchestra.run.smithi069.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48982.log.gz 2023-11-17T06:34:56.652 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44399.log 2023-11-17T06:34:56.652 INFO:teuthology.orchestra.run.smithi069.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47377.log.gz 2023-11-17T06:34:56.652 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43322.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43322.log.gz 2023-11-17T06:34:56.653 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48793.log 2023-11-17T06:34:56.654 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44372.log 2023-11-17T06:34:56.655 INFO:teuthology.orchestra.run.smithi069.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44399.log.gz 2023-11-17T06:34:56.655 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48793.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48793.log.gz 2023-11-17T06:34:56.656 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-17T06:34:56.657 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44372.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44372.log.gz 2023-11-17T06:34:56.657 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43103.log 2023-11-17T06:34:56.659 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44702.log 2023-11-17T06:34:56.659 INFO:teuthology.orchestra.run.smithi069.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-17T06:34:56.660 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45196.log 2023-11-17T06:34:56.661 INFO:teuthology.orchestra.run.smithi069.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43103.log.gz 2023-11-17T06:34:56.661 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44702.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44702.log.gz 2023-11-17T06:34:56.662 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42021.log 2023-11-17T06:34:56.663 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43931.log 2023-11-17T06:34:56.664 INFO:teuthology.orchestra.run.smithi069.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45196.log.gz 2023-11-17T06:34:56.664 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42021.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42021.log.gz 2023-11-17T06:34:56.665 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47540.log 2023-11-17T06:34:56.665 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43931.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43931.log.gz 2023-11-17T06:34:56.666 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42102.log 2023-11-17T06:34:56.667 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44257.log 2023-11-17T06:34:56.668 INFO:teuthology.orchestra.run.smithi069.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47540.log.gz 2023-11-17T06:34:56.669 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.42102.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42102.log.gz 2023-11-17T06:34:56.670 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45142.log 2023-11-17T06:34:56.670 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44345.log 2023-11-17T06:34:56.671 INFO:teuthology.orchestra.run.smithi069.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44257.log.gz 2023-11-17T06:34:56.671 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45142.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45142.log.gz 2023-11-17T06:34:56.672 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44454.log 2023-11-17T06:34:56.673 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46830.log 2023-11-17T06:34:56.673 INFO:teuthology.orchestra.run.smithi069.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44345.log.gz 2023-11-17T06:34:56.674 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44454.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44454.log.gz 2023-11-17T06:34:56.674 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45029.log 2023-11-17T06:34:56.675 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2023-11-17T06:34:56.676 INFO:teuthology.orchestra.run.smithi069.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46830.log.gz 2023-11-17T06:34:56.677 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.45029.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45029.log.gz 2023-11-17T06:34:56.677 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46534.log 2023-11-17T06:34:56.678 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46776.log 2023-11-17T06:34:56.679 INFO:teuthology.orchestra.run.smithi069.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2023-11-17T06:34:56.680 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46534.log: gzip -5 --verbose -- 88.2%/var/log/ceph/ceph-client.admin.49278.log 2023-11-17T06:34:56.680 INFO:teuthology.orchestra.run.smithi069.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46534.log.gz 2023-11-17T06:34:56.682 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46776.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46776.log.gz 2023-11-17T06:34:56.682 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49090.log 2023-11-17T06:34:56.683 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43742.log 2023-11-17T06:34:56.683 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49278.log.gz 2023-11-17T06:34:56.685 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.49090.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49090.log.gz 2023-11-17T06:34:56.685 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47189.log 2023-11-17T06:34:56.686 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.43742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2023-11-17T06:34:56.686 INFO:teuthology.orchestra.run.smithi069.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43742.log.gz 2023-11-17T06:34:56.688 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.47189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48349.log 2023-11-17T06:34:56.688 INFO:teuthology.orchestra.run.smithi069.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47189.log.gz 2023-11-17T06:34:56.689 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44176.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-17T06:34:56.689 INFO:teuthology.orchestra.run.smithi069.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2023-11-17T06:34:56.690 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.48349.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48349.log.gz 2023-11-17T06:34:56.690 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46966.log 2023-11-17T06:34:56.692 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44866.log 2023-11-17T06:34:56.693 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.46966.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46966.log.gz 2023-11-17T06:34:56.695 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.admin.44866.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44866.log.gz 2023-11-17T06:34:56.717 INFO:teuthology.orchestra.run.smithi069.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-17T06:34:56.797 INFO:teuthology.orchestra.run.smithi069.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-17T06:34:56.884 INFO:teuthology.orchestra.run.smithi069.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-17T06:34:56.889 INFO:teuthology.orchestra.run.smithi069.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-17T06:34:56.892 INFO:teuthology.orchestra.run.smithi069.stderr: 2023-11-17T06:34:56.892 INFO:teuthology.orchestra.run.smithi069.stderr:real 0m0.623s 2023-11-17T06:34:56.892 INFO:teuthology.orchestra.run.smithi069.stderr:user 0m1.510s 2023-11-17T06:34:56.892 INFO:teuthology.orchestra.run.smithi069.stderr:sys 0m0.707s 2023-11-17T06:34:56.894 INFO:tasks.ceph:Archiving logs... 2023-11-17T06:34:56.894 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341/remote/smithi069/log 2023-11-17T06:34:56.896 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-17T06:34:57.381 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341/remote/smithi093/log 2023-11-17T06:34:57.382 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-17T06:34:57.623 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-17T06:34:57.637 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-17T06:34:57.637 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-17T06:34:57.644 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-17T06:34:57.724 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-17T06:34:57.733 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-17T06:34:57.734 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-17T06:34:57.741 DEBUG:teuthology.orchestra.run.smithi093:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-17T06:34:57.779 INFO:teuthology.orchestra.run.smithi069.stdout: remote refid st t when poll reach delay offset jitter 2023-11-17T06:34:57.780 INFO:teuthology.orchestra.run.smithi069.stdout:============================================================================== 2023-11-17T06:34:57.780 INFO:teuthology.orchestra.run.smithi069.stdout:*hv01.front.sepi 44.4.53.2 2 u 28 64 377 0.071 -0.232 0.583 2023-11-17T06:34:57.780 INFO:teuthology.orchestra.run.smithi069.stdout:+hv02.front.sepi 63.231.80.2 3 u 19 64 377 0.113 1.598 0.594 2023-11-17T06:34:57.780 INFO:teuthology.orchestra.run.smithi069.stdout:+hv03.front.sepi 74.6.168.72 3 u 21 64 377 0.075 1.177 0.553 2023-11-17T06:34:57.780 INFO:teuthology.orchestra.run.smithi069.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-11-17T06:34:57.782 INFO:teuthology.orchestra.run.smithi093.stdout: remote refid st t when poll reach delay offset jitter 2023-11-17T06:34:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================== 2023-11-17T06:34:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:*hv01.front.sepi 44.4.53.2 2 u 21 64 377 0.114 -0.746 0.342 2023-11-17T06:34:57.782 INFO:teuthology.orchestra.run.smithi093.stdout:+hv02.front.sepi 63.231.80.2 3 u 25 64 377 0.108 0.924 0.448 2023-11-17T06:34:57.783 INFO:teuthology.orchestra.run.smithi093.stdout:+hv03.front.sepi 74.6.168.72 3 u 29 64 377 0.105 0.712 0.391 2023-11-17T06:34:57.783 INFO:teuthology.orchestra.run.smithi093.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2023-11-17T06:34:57.784 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-17T06:34:57.794 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-17T06:34:57.794 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-17T06:34:57.857 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-17T06:34:57.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-17T06:34:57.875 INFO:teuthology.task.internal:Duration was 1248.243179 seconds 2023-11-17T06:34:57.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-17T06:34:57.885 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-17T06:34:57.885 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-17T06:34:57.893 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-17T06:34:58.027 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-17T06:34:58.028 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2023-11-17T06:34:58.028 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-17T06:34:58.059 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi093.front.sepia.ceph.com 2023-11-17T06:34:58.059 DEBUG:teuthology.orchestra.run.smithi093:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-17T06:34:58.096 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-17T06:34:58.097 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-17T06:34:58.109 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-17T06:34:58.202 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-17T06:34:58.203 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-17T06:34:58.210 DEBUG:teuthology.orchestra.run.smithi093:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-17T06:34:58.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-17T06:34:58.319 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-17T06:34:58.319 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-17T06:34:58.358 DEBUG:teuthology.orchestra.run.smithi093:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-17T06:34:58.399 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-17T06:34:58.411 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-17T06:34:58.418 DEBUG:teuthology.orchestra.run.smithi093:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-17T06:34:58.447 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2023-11-17T06:34:58.482 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = core 2023-11-17T06:34:58.511 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-17T06:34:58.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:34:58.542 DEBUG:teuthology.orchestra.run.smithi093:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-17T06:34:58.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-17T06:34:58.569 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-17T06:34:58.580 INFO:teuthology.task.internal:Transferring archived files... 2023-11-17T06:34:58.580 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341/remote/smithi069 2023-11-17T06:34:58.581 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-17T06:34:58.629 DEBUG:teuthology.misc:Transferring archived files from smithi093:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341/remote/smithi093 2023-11-17T06:34:58.629 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-17T06:34:58.670 INFO:teuthology.task.internal:Removing archive directory... 2023-11-17T06:34:58.671 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-17T06:34:58.678 DEBUG:teuthology.orchestra.run.smithi093:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-17T06:34:58.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-17T06:34:58.745 INFO:teuthology.task.internal:Not uploading archives. 2023-11-17T06:34:58.745 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-17T06:34:58.756 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-17T06:34:58.756 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-17T06:34:58.764 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-17T06:34:58.780 INFO:teuthology.orchestra.run.smithi069.stdout: 1048619 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 17 06:34 /home/ubuntu/cephtest 2023-11-17T06:34:58.798 INFO:teuthology.orchestra.run.smithi093.stdout: 1048597 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 17 06:34 /home/ubuntu/cephtest 2023-11-17T06:34:58.805 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-17T06:34:58.815 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-17T06:34:58.910 INFO:teuthology.nuke:Checking targets against current locks 2023-11-17T06:34:58.932 DEBUG:teuthology.nuke:shortname: smithi069 2023-11-17T06:34:58.933 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-17T06:34:58.953 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 06:03:38.476958', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-17T06:34:58.957 DEBUG:teuthology.nuke:shortname: smithi093 2023-11-17T06:34:58.957 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-17T06:34:58.977 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-17_05:53:21-fs-wip-57087-3-testing-default-smithi/7461341', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-17 06:03:38.475383', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-11-17T06:34:59.012 INFO:teuthology.orchestra.console.smithi069:Power off 2023-11-17T06:34:59.012 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T06:34:59.035 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-11-17T06:34:59.035 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:34:59.053 INFO:teuthology.orchestra.console.smithi093:Power off 2023-11-17T06:34:59.053 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-17T06:34:59.063 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-11-17T06:34:59.075 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-11-17T06:34:59.076 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:34:59.100 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-11-17T06:35:03.064 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:35:03.101 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:35:03.178 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-11-17T06:35:03.212 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-11-17T06:35:07.180 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:35:32.834 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-17T06:35:32.936 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-11-17T06:35:32.945 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-11-17T06:35:33.037 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-11-17T06:35:33.046 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-11-17T06:35:33.305 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} duration: 1248.243178844452 failure_reason: 'Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)' flavor: default mon.a-kernel-sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 mon.b-kernel-sha1: 5b73517e0e2fa132ea79290e5fc06ea5349b2288 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=533bb14c1b45495bab1458bded46358a status: fail success: false 2023-11-17T06:35:33.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-17T06:35:33.393 INFO:teuthology.run:FAIL